-- Logs begin at Fri 2022-07-01 09:32:21 UTC, end at Fri 2022-07-01 12:15:44 UTC. -- Jul 01 10:15:15.956675 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 10:15:15.965914 n-d-master-1 devstack@n-api.service[104430]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 10:15:15 2022] *** Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: nodename: n-d-master-1 Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: machine: x86_64 Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: clock source: unix Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: pcre jit disabled Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: detected number of CPU cores: 4 Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: current working directory: / Jul 01 10:15:15.967863 n-d-master-1 devstack@n-api.service[104430]: detected binary path: /usr/bin/uwsgi-core Jul 01 10:15:15.968568 n-d-master-1 devstack@n-api.service[104430]: your processes number limit is 47680 Jul 01 10:15:15.968568 n-d-master-1 devstack@n-api.service[104430]: your memory page size is 4096 bytes Jul 01 10:15:15.968568 n-d-master-1 devstack@n-api.service[104430]: detected max file descriptor number: 2048 Jul 01 10:15:15.968568 n-d-master-1 devstack@n-api.service[104430]: lock engine: pthread robust mutexes Jul 01 10:15:15.968568 n-d-master-1 devstack@n-api.service[104430]: thunder lock: enabled Jul 01 10:15:15.968568 n-d-master-1 devstack@n-api.service[104430]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 10:15:15.968568 n-d-master-1 devstack@n-api.service[104430]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 10:15:16.011693 n-d-master-1 devstack@n-api.service[104430]: Python main interpreter initialized at 0x55bd882259c0 Jul 01 10:15:16.011693 n-d-master-1 devstack@n-api.service[104430]: python threads support enabled Jul 01 10:15:16.011693 n-d-master-1 devstack@n-api.service[104430]: your server socket listen backlog is limited to 100 connections Jul 01 10:15:16.011693 n-d-master-1 devstack@n-api.service[104430]: your mercy for graceful operations on workers is 90 seconds Jul 01 10:15:16.012014 n-d-master-1 devstack@n-api.service[104430]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 10:15:16.012092 n-d-master-1 devstack@n-api.service[104430]: *** Operational MODE: preforking *** Jul 01 10:15:16.012344 n-d-master-1 devstack@n-api.service[104430]: *** uWSGI is running in multiple interpreter mode *** Jul 01 10:15:16.012344 n-d-master-1 devstack@n-api.service[104430]: spawned uWSGI master process (pid: 104430) Jul 01 10:15:16.012524 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 01 10:15:16.013056 n-d-master-1 devstack@n-api.service[104430]: spawned uWSGI worker 1 (pid: 104431, cores: 1) Jul 01 10:15:16.013478 n-d-master-1 devstack@n-api.service[104430]: spawned uWSGI worker 2 (pid: 104432, cores: 1) Jul 01 10:15:16.013637 n-d-master-1 devstack@n-api.service[104430]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 10:15:16.670544 n-d-master-1 devstack@n-api.service[104432]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 10:15:16.673585 n-d-master-1 devstack@n-api.service[104431]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 10:15:17.806078 n-d-master-1 devstack@n-api.service[104431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:15:17.806078 n-d-master-1 devstack@n-api.service[104431]: from cryptography.utils import int_from_bytes Jul 01 10:15:17.806739 n-d-master-1 devstack@n-api.service[104431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:15:17.806739 n-d-master-1 devstack@n-api.service[104431]: from cryptography.utils import int_from_bytes Jul 01 10:15:17.809445 n-d-master-1 devstack@n-api.service[104432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:15:17.809445 n-d-master-1 devstack@n-api.service[104432]: from cryptography.utils import int_from_bytes Jul 01 10:15:17.809893 n-d-master-1 devstack@n-api.service[104432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:15:17.809893 n-d-master-1 devstack@n-api.service[104432]: from cryptography.utils import int_from_bytes Jul 01 10:15:20.260467 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 10:15:20.261126 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 10:15:20.261312 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 10:15:20.261775 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 10:15:20.262196 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 10:15:20.262830 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.263397 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.263970 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.264538 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.265175 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.265754 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.266335 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.266927 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.267537 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.268013 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.268593 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.269226 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.269824 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.270394 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.270496 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 10:15:20.271540 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 10:15:20.271625 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.271750 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 10:15:20.272110 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 10:15:20.272213 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.272363 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 10:15:20.272679 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.272773 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.273051 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.273303 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.273393 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.273694 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.273876 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.274017 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.274323 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.274636 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.274807 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.274950 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276022 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276022 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276183 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276259 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276326 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276389 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276452 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276745 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276856 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.276946 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.277016 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.277391 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.277575 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.277878 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.278097 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.278202 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.278533 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.278670 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.278870 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.279227 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.279329 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.279631 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.279959 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.280155 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.280272 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.280583 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.280716 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.281001 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.281290 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.281384 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.281645 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.281867 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.281963 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.282294 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.282477 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.282610 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.282943 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.283030 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.283267 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.283589 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.283685 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.283912 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.284181 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.284287 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.284515 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.284746 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.284835 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.285133 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.285371 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.285460 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.285753 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.285962 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.286110 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.286302 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.286648 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.286746 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.286972 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.287229 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.287319 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.287535 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.287786 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.287875 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.288104 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.288364 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.288462 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.288719 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.289030 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.289128 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.289365 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.289676 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.289765 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.289987 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.290286 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.290382 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.290684 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.291112 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.291201 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.291428 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.291584 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.291750 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.291946 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.292084 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.292261 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.292385 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.292586 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.292699 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.292913 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.293023 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.293248 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.293446 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.293564 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.293702 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.293875 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.294013 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.294199 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.294358 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.294505 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.294677 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.294811 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.294989 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.295091 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.295309 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.295397 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.295630 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.295718 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.295940 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.296037 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.296251 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.296339 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.296508 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.296604 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.296757 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.296873 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.297076 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.297234 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.297429 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.297532 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.297738 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.297828 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.298046 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.298136 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.298353 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.298442 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.298666 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.298761 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.298971 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.299059 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.299273 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.299368 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.299577 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.299671 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.299879 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.299966 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.300185 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.300282 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.300494 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.300628 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.300798 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.300892 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.301105 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.301238 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.301438 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.301526 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.301742 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.301893 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.302581 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.302753 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.302892 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.303230 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.303453 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.303541 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.303771 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.303868 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.304092 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.304180 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.304401 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.304512 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.304705 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.304795 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.305010 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.305116 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.305344 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.305443 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.305648 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.305745 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.305958 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.306046 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.306265 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.306355 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.306582 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.306677 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.306833 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.306928 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.307134 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.307276 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.307438 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.307528 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.307754 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.307849 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.308060 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.308147 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.308363 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.308458 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.308660 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.308746 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.308956 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.309050 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.309285 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.309376 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.309591 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.309678 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.309893 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.309997 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.310195 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.310292 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.310495 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.310582 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.310797 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.310897 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.311098 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.311185 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.311400 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.311488 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.311702 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.311798 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.312000 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.312086 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.312319 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.312418 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.312618 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.312757 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.312921 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.313017 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.313249 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.313355 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.313556 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.313656 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.313870 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.313958 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.314174 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.314268 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.314481 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.314590 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.314797 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.314893 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.315102 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.315198 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.315407 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.315496 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.315723 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.315812 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.316027 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.316122 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.316329 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.316418 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.316642 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.316738 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.316941 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.317029 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.317272 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.317410 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.317709 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.318290 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.318526 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.318615 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.318832 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.318921 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.319136 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.319224 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.319440 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.319536 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.319742 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.319831 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.320046 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.320134 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.320349 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.320451 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.320651 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.320739 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.320947 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.321034 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.321285 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.321391 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.321604 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.321692 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.321910 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.321997 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.322212 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.322314 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.322516 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.322606 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.322829 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:15:20.322918 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.323161 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.323251 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.323486 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.323583 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.323801 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.323889 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.324115 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.324280 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.324428 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.324532 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.324752 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.324858 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.325062 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.325182 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.325397 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.325486 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.325710 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.325798 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.326020 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.326117 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.326330 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.326424 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.326638 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.326732 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.326947 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.327034 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.327254 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.327350 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.327566 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.327657 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.327893 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.327982 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.328205 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.328291 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.328518 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.328620 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.328830 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.328924 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.329138 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.329251 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.329475 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.329577 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.329787 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.329876 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.330093 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.330181 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.330396 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.330498 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.330697 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.330791 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.331008 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.331099 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.331313 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.331415 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.331635 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.331723 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.331961 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.332055 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.332268 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.332355 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.332577 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.332667 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.332885 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.332984 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.333245 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.333338 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.333562 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.333651 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.333872 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.333969 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.334176 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.334264 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.334481 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.334568 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.334793 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.334899 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.335100 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.335199 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.335408 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.335498 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.335717 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.335814 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.336023 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.336112 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.336340 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.336426 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.336642 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.336739 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.336945 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.337040 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.337281 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.337383 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.337595 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.337692 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.337901 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.337988 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.338203 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.338290 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.338509 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.338613 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.338809 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.338903 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.339111 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.339199 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.339422 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.339531 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.339729 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.339819 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.340045 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.340136 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.340354 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.340443 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.340655 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.340743 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.340983 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.341081 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.341313 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.341404 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.341612 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.341717 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.341916 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.342005 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.342214 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.342304 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.342512 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.342607 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.342811 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.342928 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.343117 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.343208 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.343414 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.343504 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.343717 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.343820 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.344018 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.344115 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.344316 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.344403 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.344615 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.344712 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.344924 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.345029 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.345245 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.345339 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.345548 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.345649 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.345850 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.345938 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.346154 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.346244 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.346457 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.346546 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.346765 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.346860 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.347084 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.347173 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.347396 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.347487 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.347705 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.347793 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.348033 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.348128 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.348345 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.348441 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.348654 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.348750 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.349041 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.349170 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.349388 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.349486 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.349701 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.349790 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.350001 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.350098 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.350309 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.350399 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.350611 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.350699 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.350911 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.351009 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.351211 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.351303 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.351518 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.351607 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.351818 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.351915 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.352118 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.352208 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.352415 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.352504 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.352716 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.352884 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.353014 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.353103 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.353356 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.353449 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.353663 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.353769 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.353965 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.354054 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.354263 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.354351 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.354563 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.354652 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.354902 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.355007 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.355208 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.355307 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.355525 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.355615 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.355837 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.355928 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.356155 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.356243 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.356464 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.356563 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.356768 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.356856 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.357080 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.357187 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.357412 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.357502 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.357722 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.357812 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.358030 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.358127 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.358333 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.358427 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.358648 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.358744 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.358952 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.359049 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.359266 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.359361 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.359576 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.359679 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.359893 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.359993 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.360195 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.360289 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.360510 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.360607 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.360812 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.360911 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.361121 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.361290 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.361451 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.361539 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.361758 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.361848 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.362071 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.362159 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.362385 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.362472 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.362693 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.362782 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.363003 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.363090 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.363304 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.363392 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.363612 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.363702 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.363916 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.364011 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.364217 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.364312 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.365037 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.365169 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.365377 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.365480 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.365703 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.365792 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.366018 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.366108 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.366331 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.366426 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.366637 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.366740 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.366943 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.367031 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.367240 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.367327 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.367547 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.367653 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.367862 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.367949 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.368169 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.368257 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.368476 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.368576 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.368780 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.368867 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.369104 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.369226 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.369439 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.369538 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.369740 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.369827 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.370046 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.370132 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.370351 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.370448 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.370654 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.370749 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.370962 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.371051 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.371270 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.371404 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.371576 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.371670 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.371885 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.371973 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.372189 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.372279 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.372494 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.372581 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.372795 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.372882 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.373095 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.373240 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.373423 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.373523 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.373729 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.373826 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.374042 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.374135 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.374350 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.374441 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.374661 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.374759 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.374970 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.375076 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.375269 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.375391 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.375571 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.375669 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.375886 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.375973 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.376189 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.376449 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.376536 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.376774 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.376862 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.377074 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.377182 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.377422 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.377519 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.377732 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.377819 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.378033 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.378129 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.378343 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.378440 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.378660 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.378749 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.378971 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.379060 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.379281 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.379379 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.379587 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.379678 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.379889 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.379977 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.380766 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.380858 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.381078 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.381188 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.381414 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.381505 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.381717 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.381804 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.382020 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.382108 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.382329 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.382417 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.382630 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.382718 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.382935 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.383025 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.383238 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.383324 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.383539 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.383634 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.383842 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.383930 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.384142 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.384230 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.384448 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.384544 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.384749 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.384836 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.385072 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.385326 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.385424 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.385658 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.385747 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.385970 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.386065 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.386276 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.386372 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.386587 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.386676 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.386903 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.386998 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.387230 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.387327 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.387555 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.387643 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.387886 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.387982 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.388190 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.388282 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.388491 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.388580 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.388789 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.388964 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.389124 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.389453 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.389599 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.389765 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.390072 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.390161 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.390384 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.390610 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.390707 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.390985 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.391170 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.391297 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.391609 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.391738 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.391923 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.392234 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.392323 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.392537 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.392802 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.392899 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.393139 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.393407 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.393505 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.393770 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.393979 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.394077 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.394363 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.394544 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.394674 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.394985 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.395073 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.395289 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.395526 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.395623 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.395894 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.395979 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.396237 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.396341 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.396566 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.396661 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.396866 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.396953 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.397191 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.397294 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.397507 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.397595 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.397814 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.397903 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.398124 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.398213 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.398445 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.398534 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.398875 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.398974 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.399200 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.399290 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.399507 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.399597 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.399819 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.399915 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.400125 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.400215 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.400429 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.400517 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.400732 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.400828 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.401040 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.401128 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.401378 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.401467 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.401680 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.401781 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.401981 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.402069 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.402286 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.402373 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.402593 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.402690 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.402897 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.402985 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.403204 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.403291 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.403505 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.403602 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.403810 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.403898 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.404108 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.404201 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.404409 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.404504 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.404713 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.404808 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.405012 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.405099 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.405353 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.405451 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.405655 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.405744 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.405959 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.406047 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.406258 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.406355 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.406566 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.406661 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.406869 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.406999 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.407184 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.407277 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.407489 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.407577 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.407791 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.407953 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.408093 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.408182 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.408401 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.408497 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.408711 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.408808 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.409018 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.409108 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.409345 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.409434 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.409663 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.409769 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.409973 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.410059 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.410276 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.410365 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.410578 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.410681 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.410877 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.410964 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.411179 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.411267 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.411519 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.411617 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.411831 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.411919 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.412143 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.412230 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.412446 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.412536 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.412756 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.412854 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.413060 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.413167 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.413387 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.413476 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.413692 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.413781 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414000 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414088 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414299 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414387 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414600 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414701 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414901 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.414999 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.415202 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.415303 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.415504 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.415593 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.415811 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.415907 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.416115 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.416202 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.416418 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.416508 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.416721 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.416819 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.417020 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.417108 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.417358 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.417448 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.417674 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.417771 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.417985 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.418072 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.418298 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.418434 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.418613 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.418703 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.418920 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.419009 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.419229 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.419316 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.419533 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.419629 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.419843 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.419961 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.420145 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.420274 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.420460 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.420589 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.420769 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.420898 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.421081 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.421233 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.421410 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.421547 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.421711 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.421863 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.422030 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.422178 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.422340 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.422483 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.422647 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.422897 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.422986 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.423210 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.423299 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.423523 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.423612 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.423837 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.423971 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.424145 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.424233 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.424447 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.424535 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.424750 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.424838 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.425057 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.425165 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.425388 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.425476 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.425692 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.425790 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.425999 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.426097 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.426310 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.426399 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.426610 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.426712 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.426917 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.427540 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.427754 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.427851 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.428328 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.428600 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.428689 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.429001 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.429093 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.429351 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.429484 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.429669 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.429803 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.429972 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.430121 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.430281 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.430448 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.430583 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.430771 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.430891 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.431101 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.431191 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.431409 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.431597 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.431726 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.431905 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.432041 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.432214 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.432369 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.432516 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.432696 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.432822 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.433009 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.433129 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.433353 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.433464 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.433663 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.433775 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.433989 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.434086 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.434313 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.434471 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.434629 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.434779 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.434952 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.435086 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.435366 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.435462 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.435682 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.435769 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.435983 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.436081 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.436292 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.436382 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.436611 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.436721 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.436913 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.437003 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.437241 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.437344 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.437543 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.437638 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.437849 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.437938 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.438145 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.438241 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.438463 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.438598 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.438767 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.438856 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.439085 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.439182 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.439398 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.439522 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.439711 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.439844 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.440020 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.440152 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.440326 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.440461 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.440650 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.440780 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.440957 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.441096 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.441316 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.441440 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.441635 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.441732 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.441958 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.442086 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.442283 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.442372 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.442635 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.443213 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.443456 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.443553 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.443771 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.443871 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.444081 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.444222 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.444379 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.444466 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.444682 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.444777 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.445000 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.445101 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.445348 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.445439 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.445667 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.445755 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.445995 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.446135 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.446325 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.446414 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.446638 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.446726 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.446974 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.447082 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.447296 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.447386 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.447599 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.447688 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.447902 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.447999 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.448212 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.448303 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.448513 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.448609 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.448812 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.448902 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.449124 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.449242 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.449452 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.449550 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.449754 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.449842 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.450058 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.450145 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.450364 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.450451 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.450664 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.450753 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.450960 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.451057 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.451262 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.451361 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.451562 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.451650 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.451869 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.451964 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.452176 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.452276 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.452483 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.452570 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.452787 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.452882 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.453088 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.453211 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.453413 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.453501 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.453728 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.453827 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.454034 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.454132 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.454338 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.454440 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.454640 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.454728 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.454966 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.455063 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.455275 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.455371 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.455589 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.455676 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.455912 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.456011 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.456229 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.456318 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.456534 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.456630 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.456846 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.456941 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.457195 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.457289 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.457499 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.457588 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.457811 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.457905 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.458123 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.458211 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.458448 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.458551 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.458750 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.458839 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.459056 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.459144 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.459359 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.459456 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.459667 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.459873 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.459963 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.460202 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.460299 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.460520 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.460611 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.460823 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.460911 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.461121 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.461273 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.461455 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.461595 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.461754 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.461841 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.462066 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.462162 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.462369 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.462459 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.462671 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.462759 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.462972 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.463142 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.463270 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.463367 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.463602 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.463691 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.463900 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.463997 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.464231 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.464327 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.464543 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.464632 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.464854 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.464943 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.465192 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.465318 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.465503 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.465597 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.465825 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.465916 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.466140 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.466229 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.466446 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.466543 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.466757 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.466845 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.467069 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.467158 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.467379 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.467479 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.467687 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.467774 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.467994 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.468087 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.468300 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.468395 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.468612 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.468702 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.468922 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.469021 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.469257 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.469360 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.469569 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.469779 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.469869 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.470104 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.470202 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.470418 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.470506 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.470731 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.470820 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.471042 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.471143 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.471352 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.471440 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.471663 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.471751 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.471974 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.472216 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.472313 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.472533 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.472621 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.472865 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.472967 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.473204 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.473295 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.473527 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.473617 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.473862 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.473963 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.474185 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.474274 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.474493 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.474582 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.474800 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.474900 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.475107 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.475195 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.475416 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.475504 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.475726 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.475824 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.476030 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.476120 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.476345 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.476478 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.476653 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.476741 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.476957 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.477045 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.477289 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.477380 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.477603 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.477695 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.477910 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.478132 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.478221 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.478481 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.478572 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.478798 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.478887 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.479102 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.479201 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.479412 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.479503 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.479725 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.479814 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.480033 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.480128 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.480358 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.480448 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.480667 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.480762 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.480973 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.481061 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.481308 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.481399 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.481619 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.481706 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.481922 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.482129 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.482220 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.482442 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.482531 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.482769 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.482858 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.483091 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.483180 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.483396 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.483490 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.483700 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.483788 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.484008 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.484097 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.484325 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.484411 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.484623 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.484716 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.484924 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.485040 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.485256 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.485360 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.485563 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.485661 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.485859 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.485950 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.486163 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.486250 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.486468 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.486570 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.486769 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.486857 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.487071 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.487159 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.487380 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.487477 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.487681 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.487909 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.487999 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.488251 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.488347 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.488564 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.488654 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.488886 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.488975 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.489230 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.489338 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.490086 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.490185 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.490391 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.490487 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.490707 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.490828 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.491023 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.491162 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.491347 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.491491 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.491663 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.491827 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.491976 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.492158 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.492325 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.492481 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.492643 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.492808 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.493115 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.493276 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.493468 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.493565 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.493785 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.493875 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.494108 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.494197 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.494426 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.494514 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.494768 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.494858 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.495075 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.495163 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.495386 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.495475 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.495699 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.495787 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.496015 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.496110 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.496323 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.496428 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.496632 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.496726 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.496942 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.497035 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.497278 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.497384 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.497593 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.497691 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.497901 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.497998 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.498213 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.498310 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.498522 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.498610 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.498834 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.498930 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.499143 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.499243 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.499451 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.499545 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.499762 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.499851 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.500079 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.500176 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.500417 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.500512 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.500727 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.500816 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.501043 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.501131 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.501387 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.501475 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.501704 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.501790 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.502019 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.502116 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.502330 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.502420 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.502642 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.502729 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.502952 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.503041 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.503267 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.503520 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.503610 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.503862 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.503952 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.504188 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.504276 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.504526 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.504621 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.504866 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.504955 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.505782 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.505879 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.506108 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.506208 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.506420 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.506508 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.506740 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.506827 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.507063 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.507208 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.507374 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.507463 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.507698 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.507794 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.508013 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.508343 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.508688 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.509019 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.509370 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.509679 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.509986 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.510294 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.510652 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.510928 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.511238 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.511394 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.511545 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.511749 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.511837 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.512091 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.512179 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.512429 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.512527 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.512730 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.513035 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.513363 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.513656 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.513752 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.513962 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.514052 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.514267 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.514356 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.514570 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.514659 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.514873 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.514962 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.515174 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.515269 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.515476 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.515574 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.515785 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.515904 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.516086 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.516238 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.516390 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.516570 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.516690 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.516901 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.516997 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.517254 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.517358 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.517580 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.517670 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.517900 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.517989 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.518221 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.518319 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.518539 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.518628 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.518851 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.518938 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.519173 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.519272 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.519483 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.519571 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.519792 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.519892 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.520108 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.520210 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.520422 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.520510 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.520756 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.520845 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.521088 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.521222 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.521424 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.521513 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.521735 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.521823 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.522044 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.522134 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.522354 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.522443 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.522664 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.522761 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.522978 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.523068 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.523305 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.523402 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.523630 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.523726 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.523938 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.524035 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.524265 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.524353 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.524573 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.524738 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.524883 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.525011 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.525214 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.525308 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.525535 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.525635 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.525858 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.525947 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.526205 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.526519 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.526837 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.527150 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.527463 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.527779 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.528099 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.528423 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.528631 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.528756 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.528978 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.529066 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.529336 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.529464 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.529718 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.529808 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.530046 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.530140 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.530366 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.530454 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.530716 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.531044 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.531277 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.531367 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.531615 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.531705 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.531945 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.532034 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.532185 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 10:15:20.532327 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.532650 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.532970 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.533916 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.534256 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.534584 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.534969 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.535296 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.535616 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.535934 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.536929 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.537280 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.537636 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.537988 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.538320 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.538654 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.538977 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.539310 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.539633 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.539964 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.540295 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.540617 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.540936 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.541302 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.541625 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.541944 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.542264 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.542582 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.542898 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.543216 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.543557 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.543889 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.544201 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.544535 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.544859 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.545208 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.545534 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.545853 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.546189 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.546506 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.546824 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.547145 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.547461 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.547780 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.548103 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.548426 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.548756 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.549086 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.549441 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.549772 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.550105 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.550458 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.550777 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.551126 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.551456 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.551774 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.552607 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.552914 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:15:20.553441 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 10:15:20.686052 n-d-master-1 devstack@n-api.service[104432]: INFO dbcounter [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Registered counter for database nova_api Jul 01 10:15:20.707150 n-d-master-1 devstack@n-api.service[104431]: INFO dbcounter [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Registered counter for database nova_api Jul 01 10:15:20.707627 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.714048 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writer thread running {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:20.728927 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_db.sqlalchemy.engines [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.735416 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writer thread running {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:20.770399 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.context [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=104432) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 10:15:20.774315 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:15:20.775890 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:15:20.776682 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:15:20.778646 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:15:20.780602 n-d-master-1 devstack@n-api.service[104432]: INFO dbcounter [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Registered counter for database nova_cell0 Jul 01 10:15:20.785964 n-d-master-1 devstack@n-api.service[104432]: INFO dbcounter [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Registered counter for database nova_cell1 Jul 01 10:15:20.791283 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.context [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=104431) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 10:15:20.793618 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.795281 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.795415 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_concurrency.lockutils [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:15:20.796878 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_concurrency.lockutils [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:15:20.797710 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_concurrency.lockutils [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:15:20.799664 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_concurrency.lockutils [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:15:20.800307 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writer thread running {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:20.801671 n-d-master-1 devstack@n-api.service[104431]: INFO dbcounter [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Registered counter for database nova_cell0 Jul 01 10:15:20.812671 n-d-master-1 devstack@n-api.service[104431]: INFO dbcounter [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Registered counter for database nova_cell1 Jul 01 10:15:20.819908 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_db.sqlalchemy.engines [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.821633 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_db.sqlalchemy.engines [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.826613 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writer thread running {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:20.832213 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writer thread running {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:20.938345 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writer thread running {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:20.948360 n-d-master-1 devstack@n-api.service[104432]: INFO dbcounter [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Registered counter for database nova_cell0 Jul 01 10:15:20.957228 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.961557 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writer thread running {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:20.973289 n-d-master-1 devstack@n-api.service[104431]: INFO dbcounter [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Registered counter for database nova_cell0 Jul 01 10:15:20.982384 n-d-master-1 devstack@n-api.service[104431]: DEBUG oslo_db.sqlalchemy.engines [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:15:20.986727 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writer thread running {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:15:21.413865 n-d-master-1 devstack@n-api.service[104432]: WARNING keystonemiddleware.auth_token [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:15:21.421048 n-d-master-1 devstack@n-api.service[104432]: WARNING keystonemiddleware.auth_token [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:15:21.534806 n-d-master-1 devstack@n-api.service[104431]: WARNING keystonemiddleware.auth_token [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:15:21.542013 n-d-master-1 devstack@n-api.service[104431]: WARNING keystonemiddleware.auth_token [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:15:21.759795 n-d-master-1 devstack@n-api.service[104432]: WARNING keystonemiddleware.auth_token [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:15:21.766451 n-d-master-1 devstack@n-api.service[104432]: WARNING keystonemiddleware.auth_token [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:15:21.772464 n-d-master-1 devstack@n-api.service[104432]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bd882259c0 pid: 104432 (default app) Jul 01 10:15:21.774773 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:15:21.775980 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001886 Jul 01 10:15:21.776400 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Fri Jul 1 10:15:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:15:21.876410 n-d-master-1 devstack@n-api.service[104431]: WARNING keystonemiddleware.auth_token [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:15:21.883029 n-d-master-1 devstack@n-api.service[104431]: WARNING keystonemiddleware.auth_token [None req-980bfaf3-2c1a-4e4c-a7ad-c0d2ce310201 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:15:21.888262 n-d-master-1 devstack@n-api.service[104431]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bd882259c0 pid: 104431 (default app) Jul 01 10:16:39.282789 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:39.283821 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 01 10:16:39.284211 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:39.296031 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writing DB stats nova_api:SELECT=3 {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:39.297311 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writing DB stats nova_cell1:SELECT=3 {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:39.298386 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writing DB stats nova_cell0:SELECT=3 {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:39.299225 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:39.730186 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-ce88a656-60ce-4379-bcd1-2ae17c838b3a admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:39.761090 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-ce88a656-60ce-4379-bcd1-2ae17c838b3a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.470178 Jul 01 10:16:39.769197 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:16:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:16:41.846526 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:41.847523 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-2dc61bb5-d794-47f5-805f-31797095ab32 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 01 10:16:41.848189 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:41.906663 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-00bdd4e1-6d9c-4ce7-b181-76d26b139e09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "id": "c1"}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:41.925035 n-d-master-1 devstack@n-api.service[104431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:16:41.925035 n-d-master-1 devstack@n-api.service[104431]: warnings.warn(msg) Jul 01 10:16:42.021724 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-00bdd4e1-6d9c-4ce7-b181-76d26b139e09 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.167621 Jul 01 10:16:42.022556 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:16:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:16:42.240611 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-0d7511dc-5760-4e20-812b-c9b2a80a9a20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:42.243057 n-d-master-1 devstack@n-api.service[104432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:16:42.243057 n-d-master-1 devstack@n-api.service[104432]: warnings.warn(msg) Jul 01 10:16:42.245712 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writing DB stats nova_api:SELECT=3 {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:42.246561 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writing DB stats nova_cell1:SELECT=3 {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:42.247754 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writing DB stats nova_cell0:SELECT=3 {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:42.248715 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:16:42.363122 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-0d7511dc-5760-4e20-812b-c9b2a80a9a20 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331748 Jul 01 10:16:42.363761 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Jul 1 10:16:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:16:44.456304 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-00bdd4e1-6d9c-4ce7-b181-76d26b139e09 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:44.468007 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-00bdd4e1-6d9c-4ce7-b181-76d26b139e09 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 01 10:16:44.468007 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:44.563673 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-619a17a4-5159-49ed-acf4-3917476afd26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1"}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:44.580696 n-d-master-1 devstack@n-api.service[104432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:16:44.580696 n-d-master-1 devstack@n-api.service[104432]: warnings.warn(msg) Jul 01 10:16:44.702744 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-619a17a4-5159-49ed-acf4-3917476afd26 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.239042 Jul 01 10:16:44.703310 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:16:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:16:44.716712 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-7f5ed3fa-cf23-4d6d-8874-0e1d6c5228bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:44.718913 n-d-master-1 devstack@n-api.service[104431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:16:44.718913 n-d-master-1 devstack@n-api.service[104431]: warnings.warn(msg) Jul 01 10:16:44.827220 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-7f5ed3fa-cf23-4d6d-8874-0e1d6c5228bc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114237 Jul 01 10:16:44.828413 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Jul 1 10:16:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:16:46.941842 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-619a17a4-5159-49ed-acf4-3917476afd26 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:46.943455 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-619a17a4-5159-49ed-acf4-3917476afd26 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Jul 01 10:16:46.944280 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:16:47.015622 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-96265305-34b5-4cd9-b2ce-d2eaddaa0b0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "vcpus": 1, "ram": 1024}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:47.104171 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-96265305-34b5-4cd9-b2ce-d2eaddaa0b0c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153994 Jul 01 10:16:47.104874 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:16:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:16:47.118954 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-bc60c272-53af-4f74-9276-86ad53d95372 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:47.223659 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-bc60c272-53af-4f74-9276-86ad53d95372 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109608 Jul 01 10:16:47.224682 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Jul 1 10:16:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:16:49.488023 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-96265305-34b5-4cd9-b2ce-d2eaddaa0b0c admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:49.489744 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-96265305-34b5-4cd9-b2ce-d2eaddaa0b0c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002883 Jul 01 10:16:49.493597 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:49.555520 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-ba1d6527-9d8b-462a-8da4-7b8150dfe51e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "disk": 10}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:49.665462 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-ba1d6527-9d8b-462a-8da4-7b8150dfe51e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167502 Jul 01 10:16:49.666347 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:16:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:16:49.678702 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-bb1a848a-91e3-4b2f-adc0-0958ab1197f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:49.757034 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-bb1a848a-91e3-4b2f-adc0-0958ab1197f4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082103 Jul 01 10:16:49.765347 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Jul 1 10:16:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:16:51.934327 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-ba1d6527-9d8b-462a-8da4-7b8150dfe51e admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:51.935330 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-ba1d6527-9d8b-462a-8da4-7b8150dfe51e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 01 10:16:51.935990 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:52.001223 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-f9117b2b-dce3-449b-b3a5-7718c6cd823e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:52.102832 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-f9117b2b-dce3-449b-b3a5-7718c6cd823e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160719 Jul 01 10:16:52.103389 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:16:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:16:52.116320 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-5551fc43-3b36-4101-a560-7a126721a03e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:52.205127 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-5551fc43-3b36-4101-a560-7a126721a03e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093341 Jul 01 10:16:52.206874 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Jul 1 10:16:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:16:54.311943 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-f9117b2b-dce3-449b-b3a5-7718c6cd823e admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:54.312950 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-f9117b2b-dce3-449b-b3a5-7718c6cd823e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 01 10:16:54.313549 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:54.387326 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-e547526b-de75-418e-878c-c08e07bebc4c admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:54.410626 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-e547526b-de75-418e-878c-c08e07bebc4c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090487 Jul 01 10:16:54.411377 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:16:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:16:56.631311 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-f9117b2b-dce3-449b-b3a5-7718c6cd823e admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:56.632864 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-f9117b2b-dce3-449b-b3a5-7718c6cd823e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Jul 01 10:16:56.645486 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:56.704376 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-fbdddd5a-ba81-40cd-a332-e33b58b84b90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "swap": 0, "ram": 512}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:56.768943 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-fbdddd5a-ba81-40cd-a332-e33b58b84b90 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.129084 Jul 01 10:16:56.770210 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:16:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:16:56.782003 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-02643476-1576-4318-83bb-05c50fdb7907 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:56.856446 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-02643476-1576-4318-83bb-05c50fdb7907 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078209 Jul 01 10:16:56.873680 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Jul 1 10:16:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:16:58.953010 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-fbdddd5a-ba81-40cd-a332-e33b58b84b90 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:16:58.954754 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-fbdddd5a-ba81-40cd-a332-e33b58b84b90 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Jul 01 10:16:58.966212 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:16:59.020739 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-6ceceb30-a1ac-4527-abd4-30b6b800ae56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:59.106422 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-6ceceb30-a1ac-4527-abd4-30b6b800ae56 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.144387 Jul 01 10:16:59.121184 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-73f28f7d-d17b-4ed0-b2b5-af23b495f928 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:16:59.127829 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:16:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:16:59.200963 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-73f28f7d-d17b-4ed0-b2b5-af23b495f928 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083572 Jul 01 10:16:59.215319 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Jul 1 10:16:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:17:01.533902 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-6ceceb30-a1ac-4527-abd4-30b6b800ae56 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:01.535961 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-6ceceb30-a1ac-4527-abd4-30b6b800ae56 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 01 10:17:01.535961 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:01.620059 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-a7ef7153-0918-4dc8-9598-8ce16ce97a76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:01.687133 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-a7ef7153-0918-4dc8-9598-8ce16ce97a76 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.145987 Jul 01 10:17:01.687712 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:17:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:17:01.704234 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-3ec1e978-7f15-412b-aa61-2b9766b6e948 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:01.787841 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-3ec1e978-7f15-412b-aa61-2b9766b6e948 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090887 Jul 01 10:17:01.788531 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Jul 1 10:17:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:17:03.871533 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-a7ef7153-0918-4dc8-9598-8ce16ce97a76 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:03.872596 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-a7ef7153-0918-4dc8-9598-8ce16ce97a76 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 01 10:17:03.873019 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:03.965003 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-b7d96f2f-c9b9-4be4-b66a-d6c8aa930b3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:04.047552 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-b7d96f2f-c9b9-4be4-b66a-d6c8aa930b3a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.168320 Jul 01 10:17:04.048112 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:17:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:17:04.066030 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-76230b22-a930-4542-b400-5c2b7d3e29a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:04.153391 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-76230b22-a930-4542-b400-5c2b7d3e29a5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091158 Jul 01 10:17:04.153993 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Jul 1 10:17:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:17:06.820776 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-b7d96f2f-c9b9-4be4-b66a-d6c8aa930b3a admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:06.822192 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-b7d96f2f-c9b9-4be4-b66a-d6c8aa930b3a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Jul 01 10:17:06.822737 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:06.884401 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-b7857d97-4513-4352-931d-3c2ed76e06a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "disk": 160}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:06.954672 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-b7857d97-4513-4352-931d-3c2ed76e06a8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.126023 Jul 01 10:17:06.955228 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Jul 1 10:17:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:17:06.966915 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-2fad94d6-f6c6-43b3-baf7-f2296d9f3ee9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:07.047382 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-2fad94d6-f6c6-43b3-baf7-f2296d9f3ee9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084090 Jul 01 10:17:07.047963 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Jul 1 10:17:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:17:35.808741 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-b7857d97-4513-4352-931d-3c2ed76e06a8 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:35.810128 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-b7857d97-4513-4352-931d-3c2ed76e06a8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 01 10:17:35.810226 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:35.821311 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:17:35.868549 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-92fa540f-ada2-4382-bf6c-12dd75753794 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:35.886145 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-92fa540f-ada2-4382-bf6c-12dd75753794 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069395 Jul 01 10:17:35.886677 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:17:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:17:36.794245 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-b7857d97-4513-4352-931d-3c2ed76e06a8 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:36.795260 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-b7857d97-4513-4352-931d-3c2ed76e06a8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 01 10:17:36.795657 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:37.003095 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-bd45ef60-f59a-49ca-a86b-1da60b719ee6 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:37.008824 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.wsgi [None req-bd45ef60-f59a-49ca-a86b-1da60b719ee6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-bd45ef60-f59a-49ca-a86b-1da60b719ee6 admin admin] Request method failure captured: Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: Accept: application/json Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: Accept-Encoding: gzip, deflate Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: Connection: keep-alive Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: Content-Length: 0 Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: Host: 10.222.0.23 Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: Openstack-Api-Version: compute 2.90 Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: Openstack-System-Scope: None Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: User-Agent: python-novaclient Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Auth-Token: gAAAAABivsnAOIlPyVgbNiOlmgKb49gp_IMNO0JZ3sQeK0er_bf92LUkl1lYA-OWQO2f-9oVwv-1I9fPhfdZWujWWzNHiB_g6Ll4plDYPT-DUTgKi9tX4ECJ-zr5UkczdYsLCr4dR5iuHath0WRDr73cjIRpe8TO12atnvgHu2CndJ2xrwFfUzU Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Domain-Id: None Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Domain-Name: None Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Identity-Status: Confirmed Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Is-Admin-Project: True Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Project-Domain-Id: default Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Project-Domain-Name: Default Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Project-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Project-Name: admin Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Role: reader,member,admin Jul 01 10:17:37.012310 n-d-master-1 devstack@n-api.service[104431]: X-Roles: reader,member,admin Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6cb82c0a74d142e5863e0680f5214967", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-Tenant: admin Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-Tenant-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-Tenant-Name: admin Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-User: admin Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-User-Domain-Id: default Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-User-Domain-Name: Default Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-User-Id: fbe130ec796c474789d273bf0ff56abc Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: X-User-Name: admin Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: method: > Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: exception: Flavor 42 could not be found. Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: action_args: {'id': '42'} Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:17:37.014068 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:37.016187 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.017525 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-bd45ef60-f59a-49ca-a86b-1da60b719ee6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:17:37.018901 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-bd45ef60-f59a-49ca-a86b-1da60b719ee6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063081 Jul 01 10:17:37.018901 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:17:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:17:37.023436 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-73898f15-f03a-4e20-906a-b703a1dfd783 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:37.026300 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:17:37.045932 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-73898f15-f03a-4e20-906a-b703a1dfd783 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025991 Jul 01 10:17:37.046478 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:17:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:17:37.057104 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-7ad58dbb-9294-4c69-9703-458d211cb9f2 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:37.078543 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-7ad58dbb-9294-4c69-9703-458d211cb9f2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025312 Jul 01 10:17:37.079080 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:17:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:17:37.088148 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-e666f54e-ba67-4a78-8ed4-9d5ac4c68458 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:37.094164 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.wsgi [None req-e666f54e-ba67-4a78-8ed4-9d5ac4c68458 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-e666f54e-ba67-4a78-8ed4-9d5ac4c68458 admin admin] Request method failure captured: Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: Accept: application/json Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: Accept-Encoding: gzip, deflate Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: Connection: keep-alive Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: Content-Length: 0 Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: Host: 10.222.0.23 Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: Openstack-Api-Version: compute 2.90 Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: Openstack-System-Scope: None Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: User-Agent: python-novaclient Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Auth-Token: gAAAAABivsnAOIlPyVgbNiOlmgKb49gp_IMNO0JZ3sQeK0er_bf92LUkl1lYA-OWQO2f-9oVwv-1I9fPhfdZWujWWzNHiB_g6Ll4plDYPT-DUTgKi9tX4ECJ-zr5UkczdYsLCr4dR5iuHath0WRDr73cjIRpe8TO12atnvgHu2CndJ2xrwFfUzU Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Domain-Id: None Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Domain-Name: None Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Identity-Status: Confirmed Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Is-Admin-Project: True Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Project-Domain-Id: default Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Project-Domain-Name: Default Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Project-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Project-Name: admin Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Role: reader,member,admin Jul 01 10:17:37.097927 n-d-master-1 devstack@n-api.service[104432]: X-Roles: reader,member,admin Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6cb82c0a74d142e5863e0680f5214967", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-Tenant: admin Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-Tenant-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-Tenant-Name: admin Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-User: admin Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-User-Domain-Id: default Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-User-Domain-Name: Default Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-User-Id: fbe130ec796c474789d273bf0ff56abc Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: X-User-Name: admin Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: method: > Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: exception: Flavor 42 could not be found. Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: action_args: {'id': '42'} Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:17:37.099519 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:37.100508 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:37.101837 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-e666f54e-ba67-4a78-8ed4-9d5ac4c68458 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:17:37.103093 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-e666f54e-ba67-4a78-8ed4-9d5ac4c68458 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014643 Jul 01 10:17:37.103093 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:17:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 01 10:17:37.914814 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-7ad58dbb-9294-4c69-9703-458d211cb9f2 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:37.915825 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-7ad58dbb-9294-4c69-9703-458d211cb9f2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 01 10:17:37.916218 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:38.106222 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-b0a1d298-a569-41af-b3b7-e28f3a77b8f7 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:38.112508 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.wsgi [None req-b0a1d298-a569-41af-b3b7-e28f3a77b8f7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-b0a1d298-a569-41af-b3b7-e28f3a77b8f7 admin admin] Request method failure captured: Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: Accept: application/json Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: Accept-Encoding: gzip, deflate Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: Connection: keep-alive Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: Content-Length: 0 Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: Host: 10.222.0.23 Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: Openstack-Api-Version: compute 2.90 Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: Openstack-System-Scope: None Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: User-Agent: python-novaclient Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Auth-Token: gAAAAABivsnB8LiVxbIqQnFvuCn5E1KguWg61tEEV-rbOFK6Uq3SDPMmeI7qJuDrYwrtV6FygH8LhaVg8dItFMbxhXWc2Yq9xLCpDc03Fb57Mb14BYaz7R0mL8J5MQg9pwg0X7cjUeNvCCKbfz7IjN-19oYXdmHWz84W8Hw9HAlvAnCSnWI1kNg Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Domain-Id: None Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Domain-Name: None Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Identity-Status: Confirmed Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Is-Admin-Project: True Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Project-Domain-Id: default Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Project-Domain-Name: Default Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Project-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Project-Name: admin Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Role: reader,member,admin Jul 01 10:17:38.114083 n-d-master-1 devstack@n-api.service[104432]: X-Roles: reader,member,admin Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6cb82c0a74d142e5863e0680f5214967", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-Tenant: admin Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-Tenant-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-Tenant-Name: admin Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-User: admin Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-User-Domain-Id: default Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-User-Domain-Name: Default Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-User-Id: fbe130ec796c474789d273bf0ff56abc Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: X-User-Name: admin Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: method: > Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: exception: Flavor 84 could not be found. Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: action_args: {'id': '84'} Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:17:38.115516 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:38.116348 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.117459 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-b0a1d298-a569-41af-b3b7-e28f3a77b8f7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:17:38.118578 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-b0a1d298-a569-41af-b3b7-e28f3a77b8f7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060203 Jul 01 10:17:38.118578 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:17:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:17:38.125295 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-9be86aab-0deb-44ae-8e80-2b31650c1347 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:38.140864 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-9be86aab-0deb-44ae-8e80-2b31650c1347 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019134 Jul 01 10:17:38.141423 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:17:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:17:38.150855 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-faa85a88-ea9d-4e68-8d5e-d151aebdf3f0 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:38.164383 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-faa85a88-ea9d-4e68-8d5e-d151aebdf3f0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017134 Jul 01 10:17:38.164925 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:17:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:17:38.174462 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-c9e7c1aa-fe9d-4b67-8ea9-53fe849af653 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:38.179984 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.wsgi [None req-c9e7c1aa-fe9d-4b67-8ea9-53fe849af653 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-c9e7c1aa-fe9d-4b67-8ea9-53fe849af653 admin admin] Request method failure captured: Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: Accept: application/json Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: Accept-Encoding: gzip, deflate Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: Connection: keep-alive Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: Content-Length: 0 Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: Host: 10.222.0.23 Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: Openstack-Api-Version: compute 2.90 Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: Openstack-System-Scope: None Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: User-Agent: python-novaclient Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Auth-Token: gAAAAABivsnB8LiVxbIqQnFvuCn5E1KguWg61tEEV-rbOFK6Uq3SDPMmeI7qJuDrYwrtV6FygH8LhaVg8dItFMbxhXWc2Yq9xLCpDc03Fb57Mb14BYaz7R0mL8J5MQg9pwg0X7cjUeNvCCKbfz7IjN-19oYXdmHWz84W8Hw9HAlvAnCSnWI1kNg Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Domain-Id: None Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Domain-Name: None Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Identity-Status: Confirmed Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Is-Admin-Project: True Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Project-Domain-Id: default Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Project-Domain-Name: Default Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Project-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Project-Name: admin Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Role: reader,member,admin Jul 01 10:17:38.181529 n-d-master-1 devstack@n-api.service[104431]: X-Roles: reader,member,admin Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6cb82c0a74d142e5863e0680f5214967", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-Tenant: admin Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-Tenant-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-Tenant-Name: admin Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-User: admin Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-User-Domain-Id: default Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-User-Domain-Name: Default Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-User-Id: fbe130ec796c474789d273bf0ff56abc Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: X-User-Name: admin Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: method: > Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: exception: Flavor 84 could not be found. Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: action_args: {'id': '84'} Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:17:38.182908 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:38.183814 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:38.185272 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-c9e7c1aa-fe9d-4b67-8ea9-53fe849af653 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:17:38.186602 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-c9e7c1aa-fe9d-4b67-8ea9-53fe849af653 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012485 Jul 01 10:17:38.186602 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:17:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:17:38.995429 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-faa85a88-ea9d-4e68-8d5e-d151aebdf3f0 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:38.996433 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-faa85a88-ea9d-4e68-8d5e-d151aebdf3f0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 01 10:17:38.996829 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:39.184705 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-f2b60c0a-261e-4ca2-9819-fc87a48eef69 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:39.190615 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.wsgi [None req-f2b60c0a-261e-4ca2-9819-fc87a48eef69 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-f2b60c0a-261e-4ca2-9819-fc87a48eef69 admin admin] Request method failure captured: Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: Accept: application/json Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: Accept-Encoding: gzip, deflate Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: Connection: keep-alive Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: Content-Length: 0 Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: Host: 10.222.0.23 Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: Openstack-Api-Version: compute 2.90 Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: Openstack-System-Scope: None Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: User-Agent: python-novaclient Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Auth-Token: gAAAAABivsnCBS2z0vzCHDbSOGoI8NuRXQA2SKK8vA_e8QEk0mWuzzBOLKl8GE_K2WRUufkZXYIXXdAPd1bzl_ThAwPDANZZ22zaFuY42P5Ipspp7sVVA5RNGb3duKh0FG_B3_mii3J7miEUNE6Q0ccqBLPWDX8uou1sBdC0uAJhdnH5ysHxkaE Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Domain-Id: None Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Domain-Name: None Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Identity-Status: Confirmed Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Is-Admin-Project: True Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Project-Domain-Id: default Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Project-Domain-Name: Default Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Project-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Project-Name: admin Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Role: reader,member,admin Jul 01 10:17:39.192124 n-d-master-1 devstack@n-api.service[104431]: X-Roles: reader,member,admin Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6cb82c0a74d142e5863e0680f5214967", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-Tenant: admin Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-Tenant-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-Tenant-Name: admin Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-User: admin Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-User-Domain-Id: default Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-User-Domain-Name: Default Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-User-Id: fbe130ec796c474789d273bf0ff56abc Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: X-User-Name: admin Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: method: > Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: exception: Flavor 451 could not be found. Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: action_args: {'id': '451'} Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:17:39.193774 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:39.194717 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.196031 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-f2b60c0a-261e-4ca2-9819-fc87a48eef69 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:17:39.197298 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-f2b60c0a-261e-4ca2-9819-fc87a48eef69 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060026 Jul 01 10:17:39.197298 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:17:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:17:39.202957 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-0a9969d9-4dc9-4fe9-bd11-4aaa09866a95 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:39.218461 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-0a9969d9-4dc9-4fe9-bd11-4aaa09866a95 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019025 Jul 01 10:17:39.218933 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:17:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:17:39.228712 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:39.241729 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017090 Jul 01 10:17:39.242243 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:17:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:17:39.251549 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-c5157ed1-5926-4604-a1f6-563402336a03 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:39.256822 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.wsgi [None req-c5157ed1-5926-4604-a1f6-563402336a03 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-c5157ed1-5926-4604-a1f6-563402336a03 admin admin] Request method failure captured: Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: Accept: application/json Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: Accept-Encoding: gzip, deflate Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: Connection: keep-alive Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: Content-Length: 0 Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: Host: 10.222.0.23 Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: Openstack-Api-Version: compute 2.90 Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: Openstack-System-Scope: None Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: User-Agent: python-novaclient Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Auth-Token: gAAAAABivsnCBS2z0vzCHDbSOGoI8NuRXQA2SKK8vA_e8QEk0mWuzzBOLKl8GE_K2WRUufkZXYIXXdAPd1bzl_ThAwPDANZZ22zaFuY42P5Ipspp7sVVA5RNGb3duKh0FG_B3_mii3J7miEUNE6Q0ccqBLPWDX8uou1sBdC0uAJhdnH5ysHxkaE Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Domain-Id: None Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Domain-Name: None Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Identity-Status: Confirmed Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Is-Admin-Project: True Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Project-Domain-Id: default Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Project-Domain-Name: Default Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Project-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Project-Name: admin Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Role: reader,member,admin Jul 01 10:17:39.258352 n-d-master-1 devstack@n-api.service[104432]: X-Roles: reader,member,admin Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6cb82c0a74d142e5863e0680f5214967", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cb82c0a74d142e5863e0680f5214967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-Tenant: admin Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-Tenant-Id: 6cb82c0a74d142e5863e0680f5214967 Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-Tenant-Name: admin Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-User: admin Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-User-Domain-Id: default Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-User-Domain-Name: Default Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-User-Id: fbe130ec796c474789d273bf0ff56abc Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: X-User-Name: admin Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: method: > Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: exception: Flavor 451 could not be found. Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: action_args: {'id': '451'} Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:17:39.259865 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:39.260838 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: ERROR nova.api.openstack.wsgi Jul 01 10:17:39.262182 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-c5157ed1-5926-4604-a1f6-563402336a03 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:17:39.263429 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-c5157ed1-5926-4604-a1f6-563402336a03 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012072 Jul 01 10:17:39.263429 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:17:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 01 10:17:40.074534 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:40.075559 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jul 01 10:17:40.075951 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:40.263852 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-e67aa087-666a-4d0d-a6c6-282ab8e39e82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:40.352109 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-e67aa087-666a-4d0d-a6c6-282ab8e39e82 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.139155 Jul 01 10:17:40.352576 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Jul 1 10:17:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:17:41.173133 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:41.174163 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Jul 01 10:17:41.176746 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:41.365358 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-8750b44f-b916-4ace-87ec-ba05c2bd42d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:41.433803 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-8750b44f-b916-4ace-87ec-ba05c2bd42d0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.120514 Jul 01 10:17:41.434314 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Jul 1 10:17:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:17:42.258219 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:42.259218 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 01 10:17:42.259613 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:42.453507 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-aa8a04ae-2434-40b0-8045-d5243cb6dd38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:42.513619 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-aa8a04ae-2434-40b0-8045-d5243cb6dd38 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.111401 Jul 01 10:17:42.514101 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Jul 1 10:17:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:17:43.336287 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:43.337310 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 01 10:17:43.337702 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:43.526788 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-4cdfa473-7746-45b0-8c14-b095749e79d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:17:43.692585 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-4cdfa473-7746-45b0-8c14-b095749e79d6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.217290 Jul 01 10:17:43.693129 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Jul 1 10:17:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:17:44.504371 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:44.505357 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 01 10:17:44.505737 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:17:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:17:44.692164 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-baf5ca02-ba9d-4799-bde9-7a840a3b6c0c admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:17:44.711791 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-baf5ca02-ba9d-4799-bde9-7a840a3b6c0c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070608 Jul 01 10:17:44.712338 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Fri Jul 1 10:17:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:18:31.974990 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:18:31.977539 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-db473bfa-7cdd-4363-bb46-9b0a7705de93 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 01 10:18:31.977539 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Fri Jul 1 10:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:18:31.988946 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:18:32.042134 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-aba1acae-ffc1-4d95-a0ea-eff6044dc011 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:18:32.061937 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-aba1acae-ffc1-4d95-a0ea-eff6044dc011 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077946 Jul 01 10:18:32.062511 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:18:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:18:32.085793 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-65c6584e-78cf-4aa7-b5b3-34bfff6baa04 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:18:32.089292 n-d-master-1 devstack@n-api.service[104431]: DEBUG dbcounter [-] [104431] Writing DB stats nova_api:SELECT=14 {{(pid=104431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:18:32.094218 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-65c6584e-78cf-4aa7-b5b3-34bfff6baa04 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012102 Jul 01 10:18:32.094728 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Fri Jul 1 10:18:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:18:32.106339 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-76015a09-964a-4afd-87e3-61e265fa91fc admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:18:32.115145 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-76015a09-964a-4afd-87e3-61e265fa91fc admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012439 Jul 01 10:18:32.115664 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Fri Jul 1 10:18:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:18:32.127622 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-3ad99db8-93dd-4801-9c18-f4dd883b1ec0 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:18:32.136230 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-3ad99db8-93dd-4801-9c18-f4dd883b1ec0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012581 Jul 01 10:18:32.136764 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Fri Jul 1 10:18:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:18:32.148274 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-4d296dff-304d-4bad-802b-d5b3d6f5db7f admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:18:32.155997 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-4d296dff-304d-4bad-802b-d5b3d6f5db7f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011275 Jul 01 10:18:32.156556 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Fri Jul 1 10:18:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:23:59.858813 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-3ad99db8-93dd-4801-9c18-f4dd883b1ec0 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:23:59.859823 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-3ad99db8-93dd-4801-9c18-f4dd883b1ec0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 01 10:23:59.860219 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:24:00.000307 n-d-master-1 devstack@n-api.service[104432]: DEBUG dbcounter [-] [104432] Writing DB stats nova_api:SELECT=6 {{(pid=104432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:24:00.112922 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-a42778cf-0f56-46d6-a829-47c19e53bb37 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:24:00.114096 n-d-master-1 devstack@n-api.service[104432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:24:00.114096 n-d-master-1 devstack@n-api.service[104432]: warnings.warn(msg) Jul 01 10:24:00.115285 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-a42778cf-0f56-46d6-a829-47c19e53bb37 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:00.115721 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-a42778cf-0f56-46d6-a829-47c19e53bb37 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:00.116528 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-a42778cf-0f56-46d6-a829-47c19e53bb37 admin admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:00.116955 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-a42778cf-0f56-46d6-a829-47c19e53bb37 admin admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:00.157833 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-a42778cf-0f56-46d6-a829-47c19e53bb37 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.158903 Jul 01 10:24:00.158393 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:23:59 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:24:00.977875 n-d-master-1 devstack@n-api.service[104431]: DEBUG nova.api.openstack.wsgi [None req-3ad99db8-93dd-4801-9c18-f4dd883b1ec0 admin admin] Calling method '>' {{(pid=104431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:24:00.978828 n-d-master-1 devstack@n-api.service[104431]: INFO nova.api.openstack.requestlog [None req-3ad99db8-93dd-4801-9c18-f4dd883b1ec0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 01 10:24:00.979435 n-d-master-1 devstack@n-api.service[104431]: [pid: 104431|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Jul 1 10:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:24:01.170388 n-d-master-1 devstack@n-api.service[104432]: DEBUG nova.api.openstack.wsgi [None req-8fb08ebe-0b04-4fba-a018-fa3ba0ff7be3 admin admin] Calling method '>' {{(pid=104432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:24:01.171744 n-d-master-1 devstack@n-api.service[104432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:24:01.171744 n-d-master-1 devstack@n-api.service[104432]: warnings.warn(msg) Jul 01 10:24:01.172961 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-8fb08ebe-0b04-4fba-a018-fa3ba0ff7be3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:01.173431 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-8fb08ebe-0b04-4fba-a018-fa3ba0ff7be3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:01.174214 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-8fb08ebe-0b04-4fba-a018-fa3ba0ff7be3 admin admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:01.180571 n-d-master-1 devstack@n-api.service[104432]: DEBUG oslo_concurrency.lockutils [None req-8fb08ebe-0b04-4fba-a018-fa3ba0ff7be3 admin admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:01.197598 n-d-master-1 devstack@n-api.service[104432]: INFO nova.api.openstack.requestlog [None req-8fb08ebe-0b04-4fba-a018-fa3ba0ff7be3 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.080779 Jul 01 10:24:01.198103 n-d-master-1 devstack@n-api.service[104432]: [pid: 104432|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:24:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:24:49.418509 n-d-master-1 devstack@n-api.service[104430]: Fri Jul 1 10:24:49 2022 - graceful shutdown triggered... Jul 01 10:24:49.419024 n-d-master-1 devstack@n-api.service[104431]: Gracefully killing worker 1 (pid: 104431)... Jul 01 10:24:49.418619 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 01 10:24:49.419836 n-d-master-1 devstack@n-api.service[104432]: Gracefully killing worker 2 (pid: 104432)... Jul 01 10:24:50.419723 n-d-master-1 devstack@n-api.service[104430]: worker 1 buried after 1 seconds Jul 01 10:24:50.419723 n-d-master-1 devstack@n-api.service[104430]: worker 2 buried after 1 seconds Jul 01 10:24:50.419723 n-d-master-1 devstack@n-api.service[104430]: goodbye to uWSGI. Jul 01 10:24:50.421319 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 01 10:24:50.421917 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 01 10:24:50.424619 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 10:24:50.445627 n-d-master-1 devstack@n-api.service[119748]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 10:24:50 2022] *** Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: nodename: n-d-master-1 Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: machine: x86_64 Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: clock source: unix Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: pcre jit disabled Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: detected number of CPU cores: 4 Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: current working directory: / Jul 01 10:24:50.447602 n-d-master-1 devstack@n-api.service[119748]: detected binary path: /usr/bin/uwsgi-core Jul 01 10:24:50.448385 n-d-master-1 devstack@n-api.service[119748]: your processes number limit is 47680 Jul 01 10:24:50.448385 n-d-master-1 devstack@n-api.service[119748]: your memory page size is 4096 bytes Jul 01 10:24:50.448385 n-d-master-1 devstack@n-api.service[119748]: detected max file descriptor number: 2048 Jul 01 10:24:50.448385 n-d-master-1 devstack@n-api.service[119748]: lock engine: pthread robust mutexes Jul 01 10:24:50.448385 n-d-master-1 devstack@n-api.service[119748]: thunder lock: enabled Jul 01 10:24:50.448385 n-d-master-1 devstack@n-api.service[119748]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 10:24:50.448385 n-d-master-1 devstack@n-api.service[119748]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 10:24:50.494729 n-d-master-1 devstack@n-api.service[119748]: Python main interpreter initialized at 0x560262b149c0 Jul 01 10:24:50.494729 n-d-master-1 devstack@n-api.service[119748]: python threads support enabled Jul 01 10:24:50.494729 n-d-master-1 devstack@n-api.service[119748]: your server socket listen backlog is limited to 100 connections Jul 01 10:24:50.494729 n-d-master-1 devstack@n-api.service[119748]: your mercy for graceful operations on workers is 90 seconds Jul 01 10:24:50.495164 n-d-master-1 devstack@n-api.service[119748]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 10:24:50.495164 n-d-master-1 devstack@n-api.service[119748]: *** Operational MODE: preforking *** Jul 01 10:24:50.495435 n-d-master-1 devstack@n-api.service[119748]: *** uWSGI is running in multiple interpreter mode *** Jul 01 10:24:50.495435 n-d-master-1 devstack@n-api.service[119748]: spawned uWSGI master process (pid: 119748) Jul 01 10:24:50.496181 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 01 10:24:50.496868 n-d-master-1 devstack@n-api.service[119748]: spawned uWSGI worker 1 (pid: 119764, cores: 1) Jul 01 10:24:50.497931 n-d-master-1 devstack@n-api.service[119748]: spawned uWSGI worker 2 (pid: 119765, cores: 1) Jul 01 10:24:50.498284 n-d-master-1 devstack@n-api.service[119748]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 10:24:51.155867 n-d-master-1 devstack@n-api.service[119764]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 10:24:51.160254 n-d-master-1 devstack@n-api.service[119765]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 10:24:52.376453 n-d-master-1 devstack@n-api.service[119764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:24:52.376453 n-d-master-1 devstack@n-api.service[119764]: from cryptography.utils import int_from_bytes Jul 01 10:24:52.377051 n-d-master-1 devstack@n-api.service[119764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:24:52.377051 n-d-master-1 devstack@n-api.service[119764]: from cryptography.utils import int_from_bytes Jul 01 10:24:52.379915 n-d-master-1 devstack@n-api.service[119765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:24:52.379915 n-d-master-1 devstack@n-api.service[119765]: from cryptography.utils import int_from_bytes Jul 01 10:24:52.380414 n-d-master-1 devstack@n-api.service[119765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 10:24:52.380414 n-d-master-1 devstack@n-api.service[119765]: from cryptography.utils import int_from_bytes Jul 01 10:24:54.824626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 10:24:54.825274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 10:24:54.825478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 10:24:54.825838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 10:24:54.826098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 10:24:54.826494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.826824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.827151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.827489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.827811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.828123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.828452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.828776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.829107 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.829400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.829720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.830047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.830373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.830684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.830998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.831321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.831628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.831950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.832258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.832775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.834084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.834084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.834084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.834359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.834542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.834807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.835131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.835442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.835773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.836084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.836496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.836821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.837137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.837478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.837911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.838238 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.838535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.838856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.839221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.839552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.839869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.840192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.840513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.840836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.841140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.841476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.841788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.842110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.842416 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.842729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.842982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.843290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.843614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.843937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.844262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.844593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.844860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.845375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.845930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.846500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.847072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.847650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.848234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.848888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.849483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.850061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.850665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.851277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.851884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.852494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.853102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.853749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.854538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.855059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.855644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.856296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.856910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.857540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.858170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.858788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.859362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.859822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.860322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.860908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.861302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.861628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.861893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.862210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.862529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.862873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.863185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.863501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.863815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.864127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.864443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.864758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.865071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.865425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.865728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.866038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.866353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.866663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.866973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.867300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.867715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.867943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.868251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.868641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.868872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.869218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.869536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.869847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.870346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.871192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.871507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.871832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.872145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.872458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.872782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.873085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.873430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.873752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.874062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 10:24:54.874550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.874770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 10:24:54.874904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.874904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.875157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 10:24:54.875286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.875423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 10:24:54.875562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.875717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 10:24:54.875924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.876059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.876187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.876331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.876461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.876590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.876731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.876909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.877049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.877214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.877355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.877492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.877643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.877849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.877982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.878111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.878237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.878373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.878500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.878640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.878872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.879057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.879200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.879337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.879467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.879610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.879822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.879966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.880108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.880255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.880384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.880549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.880696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.880832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.880976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.881100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.881269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.881444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.881618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.881761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.882010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.882156 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.882320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.882450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.882632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.882763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.882930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.883059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.883259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.883382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.883571 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.883733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.883875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.883994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.884193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.884313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.884498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.884625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.884818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.884943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.885124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.885269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.887705 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.887887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.888035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.888184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.888315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.888452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.888452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.888712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.888712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.889071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.889247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.889382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.889544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.889683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.889847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.890627 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.890770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.890909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.891040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.891166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.891305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.891448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.891584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.891714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.891842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.891970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.892181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.892431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.892566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.892695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.892824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.892961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.893103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.893264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.893401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.893559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.893700 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.893839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.893839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.894090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.894229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.894359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.894495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.894635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.894775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.894904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.895040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.895170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.895309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.895455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.895593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.895731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.895867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.895999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.896172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.896305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.896439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.896578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.896709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.896843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.896996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.897133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.897393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.897522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.897663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.897794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.897935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.898067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.898206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.898344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.898471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.898609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.898729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.898856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.898991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.899210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.899352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.899495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.899633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.899768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.899898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.900034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.900205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.900346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.900466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.900608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.900801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.900945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.901081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.901243 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.901382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.901520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.901763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.901907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.902053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.902189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.902318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.902447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.902590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.902727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.902866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.903005 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.903141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.903270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.903407 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.903550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.903694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.903831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.903969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.904106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.904278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.904420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.904633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.904633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.904883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.905024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.905197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.905331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.905471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.905611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.905741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.905949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.906082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.906221 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.906358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.906502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.906639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.906769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.906928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.907067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.907207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.907358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.907553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.907686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.907814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.907984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.908125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.908264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.908424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.908536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.908652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.908762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.908883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.909036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.909176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.909377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.910677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.910835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.911041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.911175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.911306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.911440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.911569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.911708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.911846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.911984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.912158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.912291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.912421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.912550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.912678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.912815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.912954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.913092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.913249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.913396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.913527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.913662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.913809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.913939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.914068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.914240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.914372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.914515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.914655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.914792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.914929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.915060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.915197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.915327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.915469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.915601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.915729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.915858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.915993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.916142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.916313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.916480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.916612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.916741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.916741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.917006 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.917135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.917324 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.917471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.917685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.917820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.917968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.918106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.918235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.918405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.918543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.918664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.918804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.918925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.919059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.919188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.919330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.919564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.919696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.919833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 10:24:54.919968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.920096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.920232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.920370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.920506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.920642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.920771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.920898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.921047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.921282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.921418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.921545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.921673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.921809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.921938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.922080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.922209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.922346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.922502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.922648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.922793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.922924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.923998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.924128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.924264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.924406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.924574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.924720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.924859 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.924997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.925127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.925298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.925449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.925581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.925718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.925855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.925999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.926130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.926265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.926402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.926563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.926701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.926844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.926975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.927112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.927256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.927385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.927520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.927678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.927870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928011 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928387 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.928896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.929288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.929435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.929581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.929793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.929926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.930061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.930206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.930343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.930754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.930754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.931004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.931142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.931296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.931493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.931616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.931751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.931889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.932018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.932156 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.932297 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.932434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.932596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.932726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.933392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.933525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.933525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.933789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.933789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.934045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.934183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.934322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.934322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.934573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.934733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.934873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.935944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.936984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.937112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.937286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.937418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.937555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.937685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.937813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938579 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.938962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.939099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.939235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.939372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.939507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.939636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.939830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.939969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.940154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.940268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.940456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.940735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.940858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.941061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.941202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.941393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.941494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.941708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.941874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.942030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.942172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.942327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.942475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.942629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.942802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.942958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.943106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.943245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.943398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.943545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.943698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.943837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.943986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.944140 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.944279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.944425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.944576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.944749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.944916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.945073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.945346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.945445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.945539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.945671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.945776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.945974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.946075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.946274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.946367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.946574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.946668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.946880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.946974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.947176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.947278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.947478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.947571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.947778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.947870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.948078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.948190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.948375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.948476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.949267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.949410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.949575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.949697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.949876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.950094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.950211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.950329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.950468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.950612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.950790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.950974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.951105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.951245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.951414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.951564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.951783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.951915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.952044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.952179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.952368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.952512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.952675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.952815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.952986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.953118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.953311 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.953442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.953615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.953755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.953919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.954059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.954226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.954359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.954536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.954674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.954844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.954973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.955154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.955285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.955460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.955597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.955769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.955904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.956078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.956208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.956379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.956510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.956713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.956849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.957062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.957233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.957366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.957496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.957632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.957776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.957912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.958042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.958246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.958379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.958510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.958649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.958809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.958974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.959105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.959234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.959443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.959588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.959726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.959856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.960009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.960249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.960383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.960521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.960663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.960793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.960929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.961059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.961229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.961363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.961507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.961639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.961819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.961969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.962150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.962264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.962462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.962563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.962769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.962860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.963074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.963175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.963392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.963483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.963699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.963809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.964004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.964115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.964340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.964440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.964648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.964753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.964960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.965058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.965291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.965389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.965597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.965699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.965900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.965992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.966205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.966296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.966512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.966618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.966820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.966913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.967122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.967212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.967424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.967515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.967729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.967827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.968034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.968131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.968334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.968434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.968636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.968750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.968947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.969050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.969277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.969386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.969588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.969689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.969889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.970000 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.970214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.970311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.970515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.970641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.970817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.970925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.971136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.971250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.971443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.971551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.971750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.971853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.972055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.972233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.972392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.972547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.972699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.972898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.973065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.973247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.973406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.973576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.973729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.973886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.974039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.974181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.974332 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.974482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.974671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.974828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.974980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.975133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.975284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.975425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.975578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.975727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.975871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.976031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.976738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.976901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.977061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.977251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.977414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.977560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.977560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.977863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.978020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.978172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.978343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.978343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.978701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.978853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.979012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.979156 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.979307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.979450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.979635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.980306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.980559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.980711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.980890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.981036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.981209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.981391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.981391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.981675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.981819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.981969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.982198 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.982439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.982604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.982749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.982892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.983053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.983244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.983403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.983547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.983701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.983852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.983996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.984147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.984291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.984445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.984602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.984761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.984905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.985054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.985235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.985725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.985887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.986041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.986193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.986344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.986486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.986643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.986799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.986944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.987095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.987246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.987390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.987570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.987734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.987734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.988023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.988167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.988308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.988451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.988715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.988911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.989069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.989236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.989393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.989537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.989693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.989838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.989989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.990133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.990274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.990429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.990599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.990848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.990998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.991141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.991298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.991453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.991597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.991740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.991883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.992033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.992203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.992361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.992514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.992665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.992837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.993059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.993233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.993396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.993396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.993669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.993812 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.993961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.994119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.994264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.994414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.994564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.994725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.994878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.995034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.995178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.995321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.996063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.996209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.996352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.996509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.996661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.996812 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.996955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.997098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.997291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.997450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.997595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.997745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.997897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.998047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.998205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.998351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.998494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.998637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.998878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.999041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.999041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.999380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.999525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.999666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.999816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:54.999959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.000110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.000253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.000402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.000559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.000703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.000872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.001117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.001305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.001461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.001605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.001774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.001977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.002125 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.002276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.002427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.002571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.002713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.002864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003177 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.003925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.004210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.004354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.004495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.004652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.004796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.004974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.005124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.005320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.005480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.005633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.005792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.005962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.006196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.006361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.006515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.006659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.006818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.006970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.007113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.007262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.007429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.007581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.007732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.007884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.008028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.008178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.008330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.008480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.008625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.008767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.009002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.009226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.009379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.009546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.009691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.009834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.009984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.010138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.010288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.010439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.010439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.010719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.010862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.011118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.011361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.011528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.011682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.011834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.011989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.012133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.012276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.012425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.012569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.012718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.012875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.013027 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.013230 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.013381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.013550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.013701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.013863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.014008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.014151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.014293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.014444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.014588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.014744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.014888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.015030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.015172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.015355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.015520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.015678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.015822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.015975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.016131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.016283 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.016426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.016575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.016725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.016885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.017029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.017199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.017350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.017503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.017645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.017788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.017930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.018089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.018240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.018393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.018542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.018686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.018841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.019004 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.019216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.019366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.019527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.019671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.019828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.019980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.020123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.020273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.020418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.020569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.020725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.020869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.021011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.021183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.021375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.021524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.021524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.021818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.021970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.022113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.022263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.022416 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.022561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.022704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.022846 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.022988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.023149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.023312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.023464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.023616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.023766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.023950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.024102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.024256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.024401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.024551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.024703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.024861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.025013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.025179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.025351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.025502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.025648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.025807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.025960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.026110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.026254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.026403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.026554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.026741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.026900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.027051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.027212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.027355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.027497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.027640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.027792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.027943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.028086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.028236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.028380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.028531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.028682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.028826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.028976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.029128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.029402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.029565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.029710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.029710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.030000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.030151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.030295 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.030455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.030605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.030756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.030900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.031053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.031203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.031392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.031549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.031549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.031836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.031988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.032214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.032214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.032502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.032502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.032789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.032944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.033106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.033290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.033446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.033590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.033741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.033898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.034051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.034194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.034338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.034480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.034623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.034778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.034933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.035077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.035219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.035362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.035505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.035660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.035804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.035946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.036097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.036097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.036368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.036524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.036678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.036827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.037010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.037010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.037337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.037482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.037631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.037775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.038021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.038169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.038328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.038472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.038615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.038771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.038921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.039071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.039237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.039472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.039633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.039790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.039790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.040081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.040081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.040370 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.040370 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.040650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.040802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.040959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.041103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.041310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.041467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.041619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.041619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.041913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.042065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.042729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.042884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.043028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.043191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.043344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.043504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.043652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.043803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.043994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.044156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.044314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.044459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.044459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.044744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.045029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.045230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.045400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.045552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.045701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.045857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.045857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.046170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.046327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.046476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.046625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.046774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.046931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.047109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.047817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.048042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.048207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.048359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.048518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.048518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.048816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.048974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.049124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.049324 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.049506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.049740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.049898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.050057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.050219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.050369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.050528 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.050686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.253548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.253859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254891 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.254974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255812 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.255981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.256151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.256269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.256398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.256540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.256726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.256812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.256879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.257960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.258956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.259961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.260860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.261984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262053 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262816 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.262883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.263961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264294 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.264974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.265973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266053 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266576 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.266980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.267940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.268988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.269949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270423 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.270926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.271987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.272957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.273777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.277967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278214 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.278965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.279800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.280604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.281022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.285616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.287019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.287019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.287019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.287019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.287019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.287019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288110 n-d-master-1 devstack@n-api.service[119764]: INFO dbcounter [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Registered counter for database nova_api Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.288392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.289513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.290694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.293520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.296866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.298426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.299977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.301117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.302460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.304408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.304408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.304408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.304408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 10:24:55.304408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 10:24:55.305278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_db.sqlalchemy.engines [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.314182 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writer thread running {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.364986 n-d-master-1 devstack@n-api.service[119765]: INFO dbcounter [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Registered counter for database nova_api Jul 01 10:24:55.373779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.context [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=119764) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 10:24:55.377925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:55.379510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:55.380581 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:55.382384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:55.384454 n-d-master-1 devstack@n-api.service[119764]: INFO dbcounter [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Registered counter for database nova_cell0 Jul 01 10:24:55.385010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_db.sqlalchemy.engines [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.388963 n-d-master-1 devstack@n-api.service[119764]: INFO dbcounter [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Registered counter for database nova_cell1 Jul 01 10:24:55.392826 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writer thread running {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.397369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_db.sqlalchemy.engines [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.398714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_db.sqlalchemy.engines [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.405522 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writer thread running {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.408082 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writer thread running {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.455956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.context [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=119765) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 10:24:55.460121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:55.461739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:55.462530 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:24:55.465042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:24:55.467043 n-d-master-1 devstack@n-api.service[119765]: INFO dbcounter [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Registered counter for database nova_cell0 Jul 01 10:24:55.471078 n-d-master-1 devstack@n-api.service[119765]: INFO dbcounter [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Registered counter for database nova_cell1 Jul 01 10:24:55.478791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_db.sqlalchemy.engines [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.480779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_db.sqlalchemy.engines [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.488313 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writer thread running {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.488657 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writer thread running {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.561291 n-d-master-1 devstack@n-api.service[119764]: INFO dbcounter [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Registered counter for database nova_cell0 Jul 01 10:24:55.568054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_db.sqlalchemy.engines [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.572396 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writer thread running {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.638056 n-d-master-1 devstack@n-api.service[119765]: INFO dbcounter [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Registered counter for database nova_cell0 Jul 01 10:24:55.646696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_db.sqlalchemy.engines [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 10:24:55.652164 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writer thread running {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 10:24:55.899452 n-d-master-1 devstack@n-api.service[119764]: WARNING keystonemiddleware.auth_token [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:24:55.907246 n-d-master-1 devstack@n-api.service[119764]: WARNING keystonemiddleware.auth_token [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:24:55.979462 n-d-master-1 devstack@n-api.service[119765]: WARNING keystonemiddleware.auth_token [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:24:55.986699 n-d-master-1 devstack@n-api.service[119765]: WARNING keystonemiddleware.auth_token [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:24:56.244977 n-d-master-1 devstack@n-api.service[119764]: WARNING keystonemiddleware.auth_token [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:24:56.251646 n-d-master-1 devstack@n-api.service[119764]: WARNING keystonemiddleware.auth_token [None req-cc8ee045-bd44-47cd-a98b-b3649663c4af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:24:56.257020 n-d-master-1 devstack@n-api.service[119764]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560262b149c0 pid: 119764 (default app) Jul 01 10:24:56.321895 n-d-master-1 devstack@n-api.service[119765]: WARNING keystonemiddleware.auth_token [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 10:24:56.328394 n-d-master-1 devstack@n-api.service[119765]: WARNING keystonemiddleware.auth_token [None req-1dccc155-0e4c-4c30-9b74-7d1c67615dcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 10:24:56.333744 n-d-master-1 devstack@n-api.service[119765]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560262b149c0 pid: 119765 (default app) Jul 01 10:25:43.015856 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:43.017090 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:43.018354 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:43.019748 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:43.560469 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:43.562562 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:43.563450 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:43.564515 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:44.578834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-288c033f-37f2-456b-8efe-7ee7ba011841 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Calling method '.version_select at 0x7f6f9484a3a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:44.581135 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:44.581135 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:44.582394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-288c033f-37f2-456b-8efe-7ee7ba011841 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:44.587557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-288c033f-37f2-456b-8efe-7ee7ba011841 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:44.588429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-288c033f-37f2-456b-8efe-7ee7ba011841 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:44.588865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-288c033f-37f2-456b-8efe-7ee7ba011841 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:44.640601 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-288c033f-37f2-456b-8efe-7ee7ba011841 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.630410 Jul 01 10:25:44.644361 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1127 bytes} [Fri Jul 1 10:25:43 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:25:44.767037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '.version_select at 0x7f6f94858ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:44.767841 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:44.767841 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:44.773928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=119764) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 01 10:25:44.774819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:44.775458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:44.803163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:44.804061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:44.821944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:44.827458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:44.835283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b60f53f-b410-42f6-9c4f-c66a4d08a43c tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.189716 Jul 01 10:25:44.836080 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Jul 1 10:25:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:44.965786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1013918169", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:45.088701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f00ccbfb-4ff5-426d-a7f9-9d71c2d97d5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:45.090179 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:45.090179 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:45.091777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f00ccbfb-4ff5-426d-a7f9-9d71c2d97d5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:45.092619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f00ccbfb-4ff5-426d-a7f9-9d71c2d97d5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:45.093729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f00ccbfb-4ff5-426d-a7f9-9d71c2d97d5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:45.094163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f00ccbfb-4ff5-426d-a7f9-9d71c2d97d5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:45.151672 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f00ccbfb-4ff5-426d-a7f9-9d71c2d97d5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.303978 Jul 01 10:25:45.152389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3/3] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:25:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:25:45.322597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:25:45.328124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Calling method '.version_select at 0x7f6f946c3ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:45.329802 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:45.329802 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:45.331150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:45.331650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:45.349385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:45.349833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:45.361001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:45.361484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:45.367985 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28bda893-2be7-4baf-b536-f04ce92997a1 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.213744 Jul 01 10:25:45.378045 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 4/4] 10.222.0.23 () {60 vars in 1207 bytes} [Fri Jul 1 10:25:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:25:45.586378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-faa85e87-0829-4705-bf46-32176e244006 tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1552815226", "id": 435984048, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:45.622202 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:45.622202 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:45.750595 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-faa85e87-0829-4705-bf46-32176e244006 tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.370716 Jul 01 10:25:45.763102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 5/5] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:25:45 2022] POST /compute/v2.1/flavors => generated 446 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-542f41da-06f1-4014-b0de-66c74d3c726f tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Calling method '.version_select at 0x7f6f946c3670>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-542f41da-06f1-4014-b0de-66c74d3c726f tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '85193a0c74fa49e2acc6d739c149f169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cc6d0ceb834b22bb647326810a9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-542f41da-06f1-4014-b0de-66c74d3c726f tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Request method failure captured: Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:25:46.087464 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuktMdDaizwjFVk32V8HJgTUn7jjuBWzF-EL0s36udXJb6OQICaX9rAPJadKSJgM56d703VOVNAUsRsSGs7pIv2o9ayo4xHmtGs_6tHO1DL1JdUouyzF9D_7YZxUM90hPTxzd8XLusbDIvU0TBdUuN1ZYEGUnMbidIprPvCmfd6D6c Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6cc6d0ceb834b22bb647326810a9abb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:46.088242 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 85193a0c74fa49e2acc6d739c149f169 Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: action_args: {} Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:25:46.089066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:46.090799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:25:46.091750 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:25:46.091750 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 01 10:25:46.091750 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.091750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-542f41da-06f1-4014-b0de-66c74d3c726f tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:46.091750 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-542f41da-06f1-4014-b0de-66c74d3c726f tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.324728 Jul 01 10:25:46.098363 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 6/6] 10.222.0.23 () {58 vars in 1127 bytes} [Fri Jul 1 10:25:45 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 335 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:25:46.106115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-849233e1-8f8c-445c-9849-5708fb2cdcde tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-549386938", "name": "tempest-test_aggregate-1654655589"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:46.159035 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:46.159035 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:46.160779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-849233e1-8f8c-445c-9849-5708fb2cdcde tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid dad42546-d5bd-4f7d-b5ed-1f2c73a7c7a0 for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:25:46.209440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:25:46.210687 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:25:46.211939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:25:46.212654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:25:46.213251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:25:46.249021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:46.252541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:46.254773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:46.255839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:46.363115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Getting quotas for project 09bf001745c54bcf8f59523da6e4228d. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:25:46.369655 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-849233e1-8f8c-445c-9849-5708fb2cdcde tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.270146 Jul 01 10:25:46.371349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 7/7] 10.222.0.23 () {60 vars in 1164 bytes} [Fri Jul 1 10:25:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:25:46.383559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Getting quotas for user cd130c04538f4f9a94125c266a9cc362 and project 09bf001745c54bcf8f59523da6e4228d. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:25:46.421688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:25:46.424620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:25:46.670750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d74ec79c-8886-4e57-b131-3290dd33c289 tempest-FlavorsV255TestJSON-1314867431 tempest-FlavorsV255TestJSON-1314867431-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:46.714010 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9a3679d1-7252-4cd9-a5c2-6a121adbba5b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.160424 Jul 01 10:25:46.717006 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1/8] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:25:46.718180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d74ec79c-8886-4e57-b131-3290dd33c289 tempest-FlavorsV255TestJSON-1314867431 tempest-FlavorsV255TestJSON-1314867431-project] 10.222.0.23 "GET /compute/v2.1/flavors/435984048" status: 200 len: 446 microversion: 2.55 time: 0.345641 Jul 01 10:25:46.719170 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 8/9] 10.222.0.23 () {60 vars in 1195 bytes} [Fri Jul 1 10:25:46 2022] GET /compute/v2.1/flavors/435984048 => generated 446 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:25:46.727796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c7e114d-2c98-4ea5-9d0f-85995afda0df tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:46.729958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87688087-fbdb-4ca7-9176-1baac74bfec6 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Calling method '.version_select at 0x7f6f946b80d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:46.731710 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:46.731710 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87688087-fbdb-4ca7-9176-1baac74bfec6 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '85193a0c74fa49e2acc6d739c149f169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cc6d0ceb834b22bb647326810a9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87688087-fbdb-4ca7-9176-1baac74bfec6 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Request method failure captured: Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuktMdDaizwjFVk32V8HJgTUn7jjuBWzF-EL0s36udXJb6OQICaX9rAPJadKSJgM56d703VOVNAUsRsSGs7pIv2o9ayo4xHmtGs_6tHO1DL1JdUouyzF9D_7YZxUM90hPTxzd8XLusbDIvU0TBdUuN1ZYEGUnMbidIprPvCmfd6D6c Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:25:46.739081 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6cc6d0ceb834b22bb647326810a9abb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 85193a0c74fa49e2acc6d739c149f169 Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'n-d-master-1'} Jul 01 10:25:46.740238 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:46.740897 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 01 10:25:46.743593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.744424 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:46.744424 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:46.744539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87688087-fbdb-4ca7-9176-1baac74bfec6 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:46.744539 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87688087-fbdb-4ca7-9176-1baac74bfec6 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018669 Jul 01 10:25:46.744539 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2/10] 10.222.0.23 () {58 vars in 1187 bytes} [Fri Jul 1 10:25:46 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:25:46.748999 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c7e114d-2c98-4ea5-9d0f-85995afda0df tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.028530 Jul 01 10:25:46.751177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8b295e3-79b9-4f7f-8150-4b4e5c1fe469 tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] Action: 'update', calling method: .version_select at 0x7f6f94c0ba60>, body: {"flavor": {"description": "new"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:46.756446 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 9/11] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:25:46 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:25:46.760172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a5ed9d5-27ee-4fac-b938-66c40554459d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:46.761712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a5ed9d5-27ee-4fac-b938-66c40554459d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:46.769888 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:46.769888 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:25:46.898609 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8b295e3-79b9-4f7f-8150-4b4e5c1fe469 tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/435984048" status: 200 len: 447 microversion: 2.55 time: 0.152264 Jul 01 10:25:46.912798 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3/12] 10.222.0.23 () {62 vars in 1215 bytes} [Fri Jul 1 10:25:46 2022] PUT /compute/v2.1/flavors/435984048 => generated 447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:25:46.923073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4bf9006-4911-4376-b2f6-e09489ff73cc tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Calling method '.version_select at 0x7f6f946a2f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:46.984459 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e4bf9006-4911-4376-b2f6-e09489ff73cc tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4bf9006-4911-4376-b2f6-e09489ff73cc tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:25:46.990236 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'nonexistent_hostname'} Jul 01 10:25:46.991628 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:25:46.992447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 01 10:25:46.993495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4bf9006-4911-4376-b2f6-e09489ff73cc tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4bf9006-4911-4376-b2f6-e09489ff73cc tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.077833 Jul 01 10:25:46.994371 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 4/13] 10.222.0.23 () {58 vars in 1211 bytes} [Fri Jul 1 10:25:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:25:47.005313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3b3042c5-5860-452a-ba5e-3c7a4e83b6d7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:47.012745 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:47.012745 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:25:47.031270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b3042c5-5860-452a-ba5e-3c7a4e83b6d7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:47.031723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b3042c5-5860-452a-ba5e-3c7a4e83b6d7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:47.325398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a5ed9d5-27ee-4fac-b938-66c40554459d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:47.370773 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a5ed9d5-27ee-4fac-b938-66c40554459d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1220 microversion: 2.1 time: 0.613906 Jul 01 10:25:47.374118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 10/14] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:46 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1220 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:47.396391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62926ccb-cb4d-4f53-86ba-fd7d4020ae0d tempest-FlavorsV255TestJSON-1314867431 tempest-FlavorsV255TestJSON-1314867431-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.508904 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62926ccb-cb4d-4f53-86ba-fd7d4020ae0d tempest-FlavorsV255TestJSON-1314867431 tempest-FlavorsV255TestJSON-1314867431-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.131160 Jul 01 10:25:47.511813 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 11/15] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:25:47.525092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ed38658-0ebf-4ced-af76-c31afae33792 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Calling method '.version_select at 0x7f6f92d9fdc0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.530794 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:47.530794 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ed38658-0ebf-4ced-af76-c31afae33792 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '85193a0c74fa49e2acc6d739c149f169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cc6d0ceb834b22bb647326810a9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ed38658-0ebf-4ced-af76-c31afae33792 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Request method failure captured: Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuktMdDaizwjFVk32V8HJgTUn7jjuBWzF-EL0s36udXJb6OQICaX9rAPJadKSJgM56d703VOVNAUsRsSGs7pIv2o9ayo4xHmtGs_6tHO1DL1JdUouyzF9D_7YZxUM90hPTxzd8XLusbDIvU0TBdUuN1ZYEGUnMbidIprPvCmfd6D6c Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:25:47.543029 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6cc6d0ceb834b22bb647326810a9abb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 85193a0c74fa49e2acc6d739c149f169 Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'n-d-master-1'} Jul 01 10:25:47.544127 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:47.544905 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 01 10:25:47.547126 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.548298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ed38658-0ebf-4ced-af76-c31afae33792 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:47.548298 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ed38658-0ebf-4ced-af76-c31afae33792 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.023181 Jul 01 10:25:47.548298 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 12/16] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:25:47.560211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2bb654b6-f562-4721-bba4-02044699a218 tempest-FlavorsV255TestJSON-1314867431 tempest-FlavorsV255TestJSON-1314867431-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.630715 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2bb654b6-f562-4721-bba4-02044699a218 tempest-FlavorsV255TestJSON-1314867431 tempest-FlavorsV255TestJSON-1314867431-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.088590 Jul 01 10:25:47.641392 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 13/17] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:25:47.655386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e34fc209-6041-45c2-b4b9-2c57f5f384ec tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Calling method '.version_select at 0x7f6f9465d3a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.673413 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e34fc209-6041-45c2-b4b9-2c57f5f384ec tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e34fc209-6041-45c2-b4b9-2c57f5f384ec tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:25:47.680430 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'nonexistent_hostname'} Jul 01 10:25:47.682056 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.683674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.684786 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.685859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e34fc209-6041-45c2-b4b9-2c57f5f384ec tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:47.685859 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e34fc209-6041-45c2-b4b9-2c57f5f384ec tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039675 Jul 01 10:25:47.685859 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 14/18] 10.222.0.23 () {58 vars in 1190 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:25:47.694216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fe99c92-b5e8-403d-80ff-76de4c25fd7b tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.695182 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:47.695182 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:47.799957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5fe99c92-b5e8-403d-80ff-76de4c25fd7b tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/435984048" status: 202 len: 0 microversion: 2.55 time: 0.115158 Jul 01 10:25:47.800544 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 15/19] 10.222.0.23 () {60 vars in 1198 bytes} [Fri Jul 1 10:25:47 2022] DELETE /compute/v2.1/flavors/435984048 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:25:47.809277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-384ffb7e-928c-4e35-b805-5822e01044fd tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Calling method '.version_select at 0x7f6f92d3e790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.810079 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:47.810079 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:47.814393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-384ffb7e-928c-4e35-b805-5822e01044fd tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '85193a0c74fa49e2acc6d739c149f169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cc6d0ceb834b22bb647326810a9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-384ffb7e-928c-4e35-b805-5822e01044fd tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Request method failure captured: Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuktMdDaizwjFVk32V8HJgTUn7jjuBWzF-EL0s36udXJb6OQICaX9rAPJadKSJgM56d703VOVNAUsRsSGs7pIv2o9ayo4xHmtGs_6tHO1DL1JdUouyzF9D_7YZxUM90hPTxzd8XLusbDIvU0TBdUuN1ZYEGUnMbidIprPvCmfd6D6c Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:25:47.815967 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6cc6d0ceb834b22bb647326810a9abb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 85193a0c74fa49e2acc6d739c149f169 Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'n-d-master-1'} Jul 01 10:25:47.816967 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:47.818237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 01 10:25:47.819123 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.819904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-384ffb7e-928c-4e35-b805-5822e01044fd tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:47.819904 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-384ffb7e-928c-4e35-b805-5822e01044fd tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012885 Jul 01 10:25:47.819904 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 16/20] 10.222.0.23 () {58 vars in 1193 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:25:47.834199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-efa672da-73cc-46cc-8714-90e5f4b3add4 tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.918078 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-efa672da-73cc-46cc-8714-90e5f4b3add4 tempest-FlavorsV255TestJSON-1883127515 tempest-FlavorsV255TestJSON-1883127515-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.098121 Jul 01 10:25:47.919682 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 17/21] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:25:47.931908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4cebaf5d-c331-4a89-acee-292f3810364d tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Calling method '.version_select at 0x7f6f92d3e9d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:47.942023 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-4cebaf5d-c331-4a89-acee-292f3810364d tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4cebaf5d-c331-4a89-acee-292f3810364d tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:25:47.947220 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'nonexistent_hostname'} Jul 01 10:25:47.948465 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:25:47.949084 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 01 10:25:47.950037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:47.950982 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:25:47.955261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4cebaf5d-c331-4a89-acee-292f3810364d tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:47.956548 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4cebaf5d-c331-4a89-acee-292f3810364d tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.035385 Jul 01 10:25:47.958014 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 18/22] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:25:48.048231 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3b3042c5-5860-452a-ba5e-3c7a4e83b6d7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.054341 Jul 01 10:25:48.049508 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 5/23] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:25:46 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:25:48.056695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb5b485c-5fab-4bb3-8b1b-b93482162653 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Calling method '.version_select at 0x7f6f92c38d30>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:48.057693 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:48.057693 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:25:48.059354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bb5b485c-5fab-4bb3-8b1b-b93482162653 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '85193a0c74fa49e2acc6d739c149f169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cc6d0ceb834b22bb647326810a9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb5b485c-5fab-4bb3-8b1b-b93482162653 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Request method failure captured: Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuktMdDaizwjFVk32V8HJgTUn7jjuBWzF-EL0s36udXJb6OQICaX9rAPJadKSJgM56d703VOVNAUsRsSGs7pIv2o9ayo4xHmtGs_6tHO1DL1JdUouyzF9D_7YZxUM90hPTxzd8XLusbDIvU0TBdUuN1ZYEGUnMbidIprPvCmfd6D6c Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:25:48.061569 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6cc6d0ceb834b22bb647326810a9abb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 85193a0c74fa49e2acc6d739c149f169 Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'n-d-master-1'} Jul 01 10:25:48.062623 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:48.063254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 01 10:25:48.064220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.066942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb5b485c-5fab-4bb3-8b1b-b93482162653 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:48.068079 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb5b485c-5fab-4bb3-8b1b-b93482162653 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.017354 Jul 01 10:25:48.070736 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 6/24] 10.222.0.23 () {58 vars in 1190 bytes} [Fri Jul 1 10:25:48 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:25:48.082518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-694a3674-bb51-42c8-aa94-5b3e5f1d5176 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Calling method '.version_select at 0x7f6f92d03940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:48.092855 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-694a3674-bb51-42c8-aa94-5b3e5f1d5176 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-694a3674-bb51-42c8-aa94-5b3e5f1d5176 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:25:48.094928 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'nonexistent_hostname'} Jul 01 10:25:48.096009 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:25:48.096646 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 01 10:25:48.097596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-694a3674-bb51-42c8-aa94-5b3e5f1d5176 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:48.099556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-694a3674-bb51-42c8-aa94-5b3e5f1d5176 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018129 Jul 01 10:25:48.102440 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 7/25] 10.222.0.23 () {58 vars in 1214 bytes} [Fri Jul 1 10:25:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:25:48.109511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4e37596-9b11-41a7-aa16-81d682e39938 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Action: 'update', calling method: .version_select at 0x7f6f92c3f5e0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4e37596-9b11-41a7-aa16-81d682e39938 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 51 Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:25:48.131190 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: {"status": "enable", "maintenance_mode": "invalid"} Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:48.132402 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'disable', Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'Enable', Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'Disable', Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance: Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'invalid' Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.140817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.143238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4e37596-9b11-41a7-aa16-81d682e39938 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a4e37596-9b11-41a7-aa16-81d682e39938 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.032546 Jul 01 10:25:48.144187 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 8/26] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:25:48 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:25:48.146308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39c5fb93-f839-4ecf-a053-81a7535cef44 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Action: 'update', calling method: .version_select at 0x7f6f92c3fa60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39c5fb93-f839-4ecf-a053-81a7535cef44 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 51 Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:25:48.149871 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: {"status": "invalid", "maintenance_mode": "enable"} Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:48.150994 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'disable', Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'Enable', Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'Disable', Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance: Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'invalid' Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.152281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.153567 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.154714 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.154714 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:25:48.154714 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:25:48.154714 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 01 10:25:48.154714 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.154714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39c5fb93-f839-4ecf-a053-81a7535cef44 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:48.156564 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39c5fb93-f839-4ecf-a053-81a7535cef44 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.009346 Jul 01 10:25:48.162944 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 9/27] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:25:48 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:25:48.168472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52007187-a89a-4197-8122-3607d1731395 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Action: 'update', calling method: .version_select at 0x7f6f92c38820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:48.172263 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:48.172263 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:25:48.172263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52007187-a89a-4197-8122-3607d1731395 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '85193a0c74fa49e2acc6d739c149f169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cc6d0ceb834b22bb647326810a9abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:48.173378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b971cfb-bcf3-42cd-9cc5-ee317f1cec5c tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52007187-a89a-4197-8122-3607d1731395 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Request method failure captured: Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 50 Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuktMdDaizwjFVk32V8HJgTUn7jjuBWzF-EL0s36udXJb6OQICaX9rAPJadKSJgM56d703VOVNAUsRsSGs7pIv2o9ayo4xHmtGs_6tHO1DL1JdUouyzF9D_7YZxUM90hPTxzd8XLusbDIvU0TBdUuN1ZYEGUnMbidIprPvCmfd6D6c Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:25:48.174751 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6cc6d0ceb834b22bb647326810a9abb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6cc6d0ceb834b22bb647326810a9abb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c6cc6d0ceb834b22bb647326810a9abb Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-508409979 Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 85193a0c74fa49e2acc6d739c149f169 Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-508409979-project Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: {"status": "enable", "maintenance_mode": "enable"} Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 01 10:25:48.176106 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:48.176964 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 01 10:25:48.178326 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.179535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b971cfb-bcf3-42cd-9cc5-ee317f1cec5c tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:48.179535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b971cfb-bcf3-42cd-9cc5-ee317f1cec5c tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:48.179535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b971cfb-bcf3-42cd-9cc5-ee317f1cec5c tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:48.179753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b971cfb-bcf3-42cd-9cc5-ee317f1cec5c tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:48.183296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52007187-a89a-4197-8122-3607d1731395 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:48.184508 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52007187-a89a-4197-8122-3607d1731395 tempest-HostsAdminNegativeTestJSON-508409979 tempest-HostsAdminNegativeTestJSON-508409979-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.020372 Jul 01 10:25:48.190741 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 10/28] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:25:48 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:25:48.197858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3c4713c5-fb92-4837-be8e-569c8c22f2f5 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Action: 'update', calling method: .version_select at 0x7f6f92c68b80>, body: {"status": null, "maintenance_mode": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3c4713c5-fb92-4837-be8e-569c8c22f2f5 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 42 Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:25:48.210370 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: {"status": null, "maintenance_mode": null} Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 01 10:25:48.211731 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'disable', Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'Enable', Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'Disable', Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance: Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi None Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.212894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.216855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.218008 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:25:48.218008 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:25:48.218008 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 01 10:25:48.218008 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.218008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3c4713c5-fb92-4837-be8e-569c8c22f2f5 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:48.218008 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3c4713c5-fb92-4837-be8e-569c8c22f2f5 tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.024591 Jul 01 10:25:48.219171 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 11/29] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:25:48 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:25:48.229023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4fc25d5f-dc4e-4c1e-98ab-7ac2382e738a tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Action: 'update', calling method: .version_select at 0x7f6f92c38820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:48.231504 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.hosts [None req-4fc25d5f-dc4e-4c1e-98ab-7ac2382e738a tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Enabling host nonexistent_hostname. Jul 01 10:25:48.242005 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4fc25d5f-dc4e-4c1e-98ab-7ac2382e738a tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4fc25d5f-dc4e-4c1e-98ab-7ac2382e738a tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Request method failure captured: Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 50 Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsumBkvQrrABr6TJV364vBgxRUjL8KaVo-LJ89zAAi-A94U1U4QjQJSCK3Uk32yhGYweRZT8aXFhdqWO2z-8NUJilvXdYEG5b313tBl5N-Ws55Mek72vfSVLzuEm8UVo-qpuSABAlZHwZ0lHH0ixsffMJbbhuS1d0v3IWB9D6wP-5eE Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:25:48.243858 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d5cee0f3bc8436f81c34327d6f2dcff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d5cee0f3bc8436f81c34327d6f2dcff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3d5cee0f3bc8436f81c34327d6f2dcff Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-672490214 Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5e946a04db4f4d37b490983c89b873d9 Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HostsAdminNegativeTestJSON-672490214-project-admin Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: {"status": "enable", "maintenance_mode": "enable"} Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.245259 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 01 10:25:48.245951 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:25:48.246846 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 01 10:25:48.247855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:25:48.248547 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b971cfb-bcf3-42cd-9cc5-ee317f1cec5c tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.284890 Jul 01 10:25:48.248547 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 19/30] 10.222.0.23 () {58 vars in 1163 bytes} [Fri Jul 1 10:25:47 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:25:48.248669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4fc25d5f-dc4e-4c1e-98ab-7ac2382e738a tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:25:48.248669 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4fc25d5f-dc4e-4c1e-98ab-7ac2382e738a tempest-HostsAdminNegativeTestJSON-672490214 tempest-HostsAdminNegativeTestJSON-672490214-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022079 Jul 01 10:25:48.248669 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 12/31] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:25:48 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:25:48.258927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b0e218e-c7ce-4a86-945e-d6973725fa36 tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:48.263159 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:48.263159 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:48.269240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b0e218e-c7ce-4a86-945e-d6973725fa36 tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:48.269240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b0e218e-c7ce-4a86-945e-d6973725fa36 tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:48.269240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b0e218e-c7ce-4a86-945e-d6973725fa36 tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:48.269240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b0e218e-c7ce-4a86-945e-d6973725fa36 tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:48.312513 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b0e218e-c7ce-4a86-945e-d6973725fa36 tempest-AZAdminV2TestJSON-106581789 tempest-AZAdminV2TestJSON-106581789-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.059814 Jul 01 10:25:48.313110 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 20/32] 10.222.0.23 () {58 vars in 1184 bytes} [Fri Jul 1 10:25:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:25:48.400128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1e82569a-8f7a-496b-96a7-de23aa910b47 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:48.401166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1e82569a-8f7a-496b-96a7-de23aa910b47 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:48.506661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1e82569a-8f7a-496b-96a7-de23aa910b47 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:48.514371 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1e82569a-8f7a-496b-96a7-de23aa910b47 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1220 microversion: 2.1 time: 0.118645 Jul 01 10:25:48.527954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 21/33] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:48 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:48.803225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1007798201", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "availability_zone": "tempest-test_az-549386938"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:25:48.828357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:48.828867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:48.830015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:48.830451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:48.980745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:25:49.243080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:25:49.243766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:25:49.243982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:25:49.244903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:25:49.246358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:25:49.259056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:49.259806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:49.260893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:49.262236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:49.280753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Getting quotas for project 8d92f0f11ec1407d99c417f17920d37d. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:25:49.285209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Getting quotas for user dc4aee1b97b944d981e1de6bb88f6dd4 and project 8d92f0f11ec1407d99c417f17920d37d. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:25:49.297201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:25:49.299986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:25:49.432531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a385dcd7-b687-4f69-ad96-338d26d9e0ce tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.136985 Jul 01 10:25:49.438735 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 13/34] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:25:49.443769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f15b65fc-9952-4a17-ad85-895933bb1ddd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:49.444222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f15b65fc-9952-4a17-ad85-895933bb1ddd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:49.541559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:49.543052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:49.564716 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:49.569800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:49.569800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:49.569800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:49.589845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f15b65fc-9952-4a17-ad85-895933bb1ddd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:49.598276 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f15b65fc-9952-4a17-ad85-895933bb1ddd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1242 microversion: 2.1 time: 0.158433 Jul 01 10:25:49.599730 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 22/35] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:49 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:49.779486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:49.802968 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d949628a-9a82-4b99-9aeb-4b35e9afe52b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1224 microversion: 2.1 time: 0.270557 Jul 01 10:25:49.804232 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 14/36] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:49 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1224 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:50.615194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-258090b6-a88e-4211-882a-ee5f032fc372 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:50.615817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-258090b6-a88e-4211-882a-ee5f032fc372 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:50.683273 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-258090b6-a88e-4211-882a-ee5f032fc372 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:50.690499 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-258090b6-a88e-4211-882a-ee5f032fc372 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1242 microversion: 2.1 time: 0.079010 Jul 01 10:25:50.691634 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 23/37] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:50 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:50.825366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:50.825996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:50.833747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:50.834202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:50.834978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:50.835421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:50.932250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:50.943490 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14502e03-e33b-4195-b2c7-8181301188df tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1272 microversion: 2.1 time: 0.122327 Jul 01 10:25:50.944264 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 15/38] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:50 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:51.712390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:51.713635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:51.732380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:51.733132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:51.734599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:51.735260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:51.939657 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:51.961559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:51.962647 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd37d9b2-c0cf-4e18-a8b4-5b804ea1a536 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1242 microversion: 2.1 time: 0.251818 Jul 01 10:25:51.962906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:51.965343 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 24/39] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:51 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1242 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:51.979176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:51.979857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:51.980919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:51.981677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:52.159785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:52.169138 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a80acea0-aac0-43c5-8f6c-9a7dbcd0207a tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1278 microversion: 2.1 time: 0.211237 Jul 01 10:25:52.173477 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 16/40] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:51 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:52.980777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:52.981544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:52.992266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:52.995532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:52.996630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:52.998084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:53.192808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:53.194084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:53.206125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:53.208098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:53.211061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:53.213548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:54.026512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:54.049858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:54.063544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79860cc9-2fcb-4f34-a9f4-0133b992ddec tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1290 microversion: 2.1 time: 1.059196 Jul 01 10:25:54.065669 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 25/41] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:52 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1290 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:54.067552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-341d0e75-0090-42e6-aba4-78e983db8087 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1278 microversion: 2.1 time: 0.874781 Jul 01 10:25:54.070346 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 17/42] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:53 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1278 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:55.091063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:55.091696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:55.092714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:55.093478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:55.117967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:55.119134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:55.121870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:55.123237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:55.123774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:55.127209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:55.131466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:55.133414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:55.439892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:55.448081 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ee871906-4db1-47bc-9554-1f19902a602a tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1296 microversion: 2.1 time: 0.365109 Jul 01 10:25:55.455513 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 26/43] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:55 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1296 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:55.691046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:55.699957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-508be7e4-a650-445f-b7c6-a05209c54482 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.617813 Jul 01 10:25:55.715050 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 18/44] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:55 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:56.471896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:56.473168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:56.480661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:56.483535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:56.484365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:56.484806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:56.598016 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:56.608660 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-22b8b02f-a80f-41c6-975e-842879ed5433 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1296 microversion: 2.1 time: 0.140638 Jul 01 10:25:56.611248 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 27/45] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:56 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1296 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:56.721736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:56.722301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:56.731800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:56.732246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:56.733014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:56.733474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:57.003710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:57.014242 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21ba23f5-1bfe-47ac-a5a5-32369e6c98cf tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.296362 Jul 01 10:25:57.016078 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 19/46] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:56 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:57.627112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:57.627994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:57.653159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:57.653159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:57.653159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:57.653159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:58.038214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:58.041639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:58.064335 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:58.070554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:58.071185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:58.072181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:58.072764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:58.085771 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ee9feac9-d1aa-494e-8f3c-ca10082cff97 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.458048 Jul 01 10:25:58.085771 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 28/47] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:57 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:58.733485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:25:58.750543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3548542-0585-4451-8c55-e7c5aae933b1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.721239 Jul 01 10:25:58.754074 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 20/48] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:58 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:25:58.754608 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:59.100695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:59.101953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:25:59.111664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:59.114787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:59.115832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:59.143888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:59.272254 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:59.292410 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:25:59.727750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Calling method '.version_select at 0x7f6f92be3e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:25:59.728776 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:25:59.728776 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:25:59.731444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:59.731898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:59.784744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:59.785396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:59.859938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:25:59.863329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:25:59.897138 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b212308-9abb-4b2f-b46a-dbecd0a2a032 tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.144941 Jul 01 10:25:59.904881 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 29/49] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:25:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:00.053953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:00.058099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-71b80b01-5ef5-4479-b94a-65b0d1e23bbf tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f92b8bdc0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:00.059585 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:00.059585 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:00.061973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71b80b01-5ef5-4479-b94a-65b0d1e23bbf tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.066470 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4bffa21e-7da2-49b1-803c-1385750e19a2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.966854 Jul 01 10:26:00.066759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71b80b01-5ef5-4479-b94a-65b0d1e23bbf tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.066759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71b80b01-5ef5-4479-b94a-65b0d1e23bbf tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.069459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71b80b01-5ef5-4479-b94a-65b0d1e23bbf tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.069685 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 21/50] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:25:59 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:00.074236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:00.074903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:00.112197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.114632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.115666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.116344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.195012 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-71b80b01-5ef5-4479-b94a-65b0d1e23bbf tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.288589 Jul 01 10:26:00.195715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 30/51] 10.222.0.23 () {58 vars in 1127 bytes} [Fri Jul 1 10:25:59 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:00.211559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec819269-466a-468e-80e1-c34995130dbc tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Calling method '.version_select at 0x7f6f92be30d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:00.212414 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:00.212414 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:00.214399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec819269-466a-468e-80e1-c34995130dbc tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.214965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec819269-466a-468e-80e1-c34995130dbc tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.302732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec819269-466a-468e-80e1-c34995130dbc tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.306205 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec819269-466a-468e-80e1-c34995130dbc tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.327858 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec819269-466a-468e-80e1-c34995130dbc tempest-HypervisorAdminV228Test-481812930 tempest-HypervisorAdminV228Test-481812930-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.124439 Jul 01 10:26:00.344188 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 31/52] 10.222.0.23 () {60 vars in 1192 bytes} [Fri Jul 1 10:26:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:00.442803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-76f6ef53-9255-469a-b848-769c556afef2 req-edf18dad-552d-41a8-8aeb-b09843c1a155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c01d5c-3c08-4d5e-b681-425d9872a475", "tag": "de5138d9-4086-423e-9472-1985b8c54a89"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:00.473455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-76f6ef53-9255-469a-b848-769c556afef2 req-edf18dad-552d-41a8-8aeb-b09843c1a155 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.473939 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-76f6ef53-9255-469a-b848-769c556afef2 req-edf18dad-552d-41a8-8aeb-b09843c1a155 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.539732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-76f6ef53-9255-469a-b848-769c556afef2 req-edf18dad-552d-41a8-8aeb-b09843c1a155 service nova] Creating event network-changed:de5138d9-4086-423e-9472-1985b8c54a89 for instance 63c01d5c-3c08-4d5e-b681-425d9872a475 on n-h1-master-1 Jul 01 10:26:00.540506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-76f6ef53-9255-469a-b848-769c556afef2 req-edf18dad-552d-41a8-8aeb-b09843c1a155 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:26:00.542647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed795956-3a59-482d-843b-3445b7144985 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.544593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed795956-3a59-482d-843b-3445b7144985 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.546533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed795956-3a59-482d-843b-3445b7144985 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.547629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed795956-3a59-482d-843b-3445b7144985 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.567317 n-d-master-1 devstack@n-api.service[119764]: INFO nova.compute.rpcapi [None req-ed795956-3a59-482d-843b-3445b7144985 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 10:26:00.569259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed795956-3a59-482d-843b-3445b7144985 None None] Releasing lock "compute-rpcapi-router" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:26:00.588918 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ed795956-3a59-482d-843b-3445b7144985 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232942 Jul 01 10:26:00.590537 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 32/53] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:00.687397 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:00.708057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd083e4a-64bd-49dd-8560-4a23e06c4b45 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:00.715203 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:00.715203 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:00.716422 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-dd083e4a-64bd-49dd-8560-4a23e06c4b45 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd083e4a-64bd-49dd-8560-4a23e06c4b45 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458-project-admin] Request method failure captured: Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsu3FAc_d4Zj8Swbw-zbs3I31KohOqeSYgUZTP0ZJP33qaNteS-_mUiC5ueAogUde48yOujpsmPhqqFjblRBxNaUSj0eEPEedEs2YlX-UaB9uhA56KTFWJ8dDocN1pK79tv59kfqCORmz1FzNQDUswYFNValzgQ37rtjzj_kjF_ziH4 Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 44e9d31df5ef48d9bc232b6ba15e3f33 Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:00.723019 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44e9d31df5ef48d9bc232b6ba15e3f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44e9d31df5ef48d9bc232b6ba15e3f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44e9d31df5ef48d9bc232b6ba15e3f33", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44e9d31df5ef48d9bc232b6ba15e3f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 44e9d31df5ef48d9bc232b6ba15e3f33 Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-740560458-project-admin Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0b1e092b53d644b1a11211f76dca16b3 Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-740560458-project-admin Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid timestamp for date invalid_time Jul 01 10:26:00.724545 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'invalid_time'} Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:00.725471 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 01 10:26:00.727139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:00.729711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd083e4a-64bd-49dd-8560-4a23e06c4b45 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:00.730785 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd083e4a-64bd-49dd-8560-4a23e06c4b45 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458 tempest-InstanceUsageAuditLogNegativeTestJSON-740560458-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.139349 Jul 01 10:26:00.731484 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 33/54] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Jul 1 10:26:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:26:00.741488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eaf0f030-e218-4f83-b0b3-f0e3048e03ab tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f92c9fe50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:00.743227 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:00.743227 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:00.749518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf0f030-e218-4f83-b0b3-f0e3048e03ab tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.759125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf0f030-e218-4f83-b0b3-f0e3048e03ab tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.760054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf0f030-e218-4f83-b0b3-f0e3048e03ab tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.761352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf0f030-e218-4f83-b0b3-f0e3048e03ab tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.819248 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:00.854505 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eaf0f030-e218-4f83-b0b3-f0e3048e03ab tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.121499 Jul 01 10:26:00.864848 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 34/55] 10.222.0.23 () {58 vars in 1138 bytes} [Fri Jul 1 10:26:00 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:00.865806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:00.876497 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af0627b7-f94a-40d5-9c34-3f0f8e677e91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.805893 Jul 01 10:26:00.878833 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 22/56] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:00 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:00.884638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f0a669f-2eee-4bd9-977c-9007d82e7aa9 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f92c3fb80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:00.897494 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:00.897494 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:00.899069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f0a669f-2eee-4bd9-977c-9007d82e7aa9 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.899768 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f0a669f-2eee-4bd9-977c-9007d82e7aa9 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.900738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f0a669f-2eee-4bd9-977c-9007d82e7aa9 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:00.901408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f0a669f-2eee-4bd9-977c-9007d82e7aa9 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:00.963650 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f0a669f-2eee-4bd9-977c-9007d82e7aa9 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.083428 Jul 01 10:26:00.970670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 23/57] 10.222.0.23 () {58 vars in 1144 bytes} [Fri Jul 1 10:26:00 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:01.091647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:01.092637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:01.123546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:01.127579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:01.136316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:01.137229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:01.184817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f8e47624-3992-4f9d-97be-a552f4b0cbfe tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:01.185882 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:01.185882 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:01.187079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f8e47624-3992-4f9d-97be-a552f4b0cbfe tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'c2b1607c28c9489891eda34e729b9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a445c9d3b3944f47bbf01ea6cf211a09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f8e47624-3992-4f9d-97be-a552f4b0cbfe tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Request method failure captured: Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsu0oF_TZx6h6vHKmDZsFeddNr2RSFes6cLvkQk5Rxw_Qb_Br7Xjky9VhXtgLdyvkzyLUdXCNYgtkMEdukQqN6xf_HoLwXG-ZwATOPPAES1PRqqZnYoDfYYAimi-JRxLri-_VUOl1e66lagQyLUExatFL-8P6RipxZUpOdOwouaM8UA Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a445c9d3b3944f47bbf01ea6cf211a09 Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:01.188663 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a445c9d3b3944f47bbf01ea6cf211a09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a445c9d3b3944f47bbf01ea6cf211a09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a445c9d3b3944f47bbf01ea6cf211a09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a445c9d3b3944f47bbf01ea6cf211a09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a445c9d3b3944f47bbf01ea6cf211a09 Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: c2b1607c28c9489891eda34e729b9fc8 Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:01.189955 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: action_args: {} Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:01.190636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 01 10:26:01.191947 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:01.195190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f8e47624-3992-4f9d-97be-a552f4b0cbfe tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:01.196160 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f8e47624-3992-4f9d-97be-a552f4b0cbfe tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.326557 Jul 01 10:26:01.196709 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 35/58] 10.222.0.23 () {58 vars in 1184 bytes} [Fri Jul 1 10:26:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 331 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:01.208621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99857734-f817-4465-ab8f-04d41dbf14b0 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:01.209852 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:01.209852 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:01.211896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99857734-f817-4465-ab8f-04d41dbf14b0 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'c2b1607c28c9489891eda34e729b9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a445c9d3b3944f47bbf01ea6cf211a09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99857734-f817-4465-ab8f-04d41dbf14b0 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Request method failure captured: Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-01%2010:26:01 HTTP/1.1 Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsu0oF_TZx6h6vHKmDZsFeddNr2RSFes6cLvkQk5Rxw_Qb_Br7Xjky9VhXtgLdyvkzyLUdXCNYgtkMEdukQqN6xf_HoLwXG-ZwATOPPAES1PRqqZnYoDfYYAimi-JRxLri-_VUOl1e66lagQyLUExatFL-8P6RipxZUpOdOwouaM8UA Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a445c9d3b3944f47bbf01ea6cf211a09 Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:01.218459 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a445c9d3b3944f47bbf01ea6cf211a09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a445c9d3b3944f47bbf01ea6cf211a09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a445c9d3b3944f47bbf01ea6cf211a09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a445c9d3b3944f47bbf01ea6cf211a09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a445c9d3b3944f47bbf01ea6cf211a09 Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: c2b1607c28c9489891eda34e729b9fc8 Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:01.219833 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '2022-07-01 10:26:01'} Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:01.220416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 01 10:26:01.221582 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:01.224789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99857734-f817-4465-ab8f-04d41dbf14b0 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:01.228773 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99857734-f817-4465-ab8f-04d41dbf14b0 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982 tempest-InstanceUsageAuditLogNegativeTestJSON-946672982-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-01 10:26:01" status: 403 len: 128 microversion: 2.1 time: 0.026213 Jul 01 10:26:01.230205 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 36/59] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:26:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-01%2010%3A26%3A01 => generated 128 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:26:01.604852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:01.615333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8452518e-10fe-41ae-9539-899e086ff927 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.533201 Jul 01 10:26:01.622981 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 24/60] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:01 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:01.896718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:01.897488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:01.914357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:01.914816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:01.915608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:01.916049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:02.392652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:02.408767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e253cdba-6896-464b-bd40-0d938699e5ec tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.515456 Jul 01 10:26:02.409597 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 37/61] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:01 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:02.640408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:02.641175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:02.654425 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:02.655213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:02.660144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:02.661957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:03.274122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:03.284760 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66538c74-ad88-4d2a-85b7-5cff2073302c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.648631 Jul 01 10:26:03.290639 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 25/62] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:02 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:03.445192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:03.446690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:03.462627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:03.463851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:03.466584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:03.467284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:03.992211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:04.006126 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-26991c53-8773-4153-ae68-9810c173cae7 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.577872 Jul 01 10:26:04.012887 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 38/63] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:03 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:04.306871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:04.308814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:04.316932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:04.317577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:04.318534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:04.319119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:04.652815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:04.667625 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-992a706b-428b-4c15-9b6f-b14d4fbcfa9f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.364757 Jul 01 10:26:04.682837 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 26/64] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:04 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:05.028951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:05.029887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:05.039096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:05.039549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:05.046948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:05.052544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:05.122954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-59d508e8-98f2-43a0-8725-4deacf30788f req-fa1efd49-8c63-4ee1-bacd-fde6842fd4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60268378-0b9e-479d-a21b-b273c292cf07", "tag": "d06f514c-d72f-4d43-80e7-d819e36d37ee"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:05.145192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-59d508e8-98f2-43a0-8725-4deacf30788f req-fa1efd49-8c63-4ee1-bacd-fde6842fd4d7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:05.146661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-59d508e8-98f2-43a0-8725-4deacf30788f req-fa1efd49-8c63-4ee1-bacd-fde6842fd4d7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:05.185096 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-59d508e8-98f2-43a0-8725-4deacf30788f req-fa1efd49-8c63-4ee1-bacd-fde6842fd4d7 service nova] Creating event network-changed:d06f514c-d72f-4d43-80e7-d819e36d37ee for instance 60268378-0b9e-479d-a21b-b273c292cf07 on n-h2-master-1 Jul 01 10:26:05.192639 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-59d508e8-98f2-43a0-8725-4deacf30788f req-fa1efd49-8c63-4ee1-bacd-fde6842fd4d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229734 Jul 01 10:26:05.194188 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 39/65] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:05.485136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:05.497872 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82390b78-2192-4923-b11e-20afe804d036 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.473050 Jul 01 10:26:05.498959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 27/66] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:05 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:05.689017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:05.690639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:05.704516 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:05.705619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:05.706878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:05.707574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:06.004698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:06.017104 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-789c21f6-283e-431a-a405-31b15a114f50 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.329844 Jul 01 10:26:06.017851 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 40/67] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:05 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:06.516261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:06.518298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:06.534439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:06.535533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:06.536712 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:06.537455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:06.728030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a471a1c-e7b1-42cd-9c00-18c372292223 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:06.741254 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a471a1c-e7b1-42cd-9c00-18c372292223 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.270702 Jul 01 10:26:06.757283 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 28/68] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:26:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:06.847282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8ccf3677-2e0d-47ca-a8d3-0b252a9cef94 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-114940695", "id": 1716007003, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:06.849448 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:06.849448 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:06.976155 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8ccf3677-2e0d-47ca-a8d3-0b252a9cef94 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.214778 Jul 01 10:26:06.984745 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 29/69] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:06 2022] POST /compute/v2.1/flavors => generated 424 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:06.998050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a9632e0-589e-45be-935f-53bad8cc8173 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:07.001597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:07.002683 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:07.010362 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7cb5b536-9846-48fe-aaeb-d0acb620877d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.498357 Jul 01 10:26:07.013721 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 41/70] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:06 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:07.017642 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5a9632e0-589e-45be-935f-53bad8cc8173 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031379 Jul 01 10:26:07.022407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 30/71] 10.222.0.23 () {58 vars in 1181 bytes} [Fri Jul 1 10:26:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:07.028806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8c7e5a2-120f-4eed-bd63-2e7fe80b806e tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-770199952", "id": 1498493286, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:07.030952 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:07.030952 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:07.035700 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:07.036708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:07.049031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:07.052166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:07.053237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:07.056938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:07.116025 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8c7e5a2-120f-4eed-bd63-2e7fe80b806e tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.092122 Jul 01 10:26:07.122455 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 42/72] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:07 2022] POST /compute/v2.1/flavors => generated 424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:07.129486 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a379e85-e697-4786-ab59-ece926c80a11 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:07.179443 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a379e85-e697-4786-ab59-ece926c80a11 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.050363 Jul 01 10:26:07.182900 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 43/73] 10.222.0.23 () {58 vars in 1181 bytes} [Fri Jul 1 10:26:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 10:26:07.202772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-15f05017-317e-4657-a151-21ed13bdca76 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Action: 'create', calling method: .version_select at 0x7f6f92b8b8b0>, body: {"keypair": {"name": "tempest-keypair-880502020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxgmJPrv7hzeiE6K0wZvR2HADdCrYV1keMHVX1nw+AcdZjra8rPvE6aUuex/PyLddhDtW0ohHO/IxGmcFc3Im6VkX12PYOvun2a3VyLAx0ukCtwy0K2lmZl+DXaNrxePw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:07.261924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-15f05017-317e-4657-a151-21ed13bdca76 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Getting quotas for project e215073c20cc458983a0912389cb4e44. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:07.282743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-15f05017-317e-4657-a151-21ed13bdca76 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Getting quotas for user d00b392abf154820b4e5bce216b7e406 and project e215073c20cc458983a0912389cb4e44. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:07.447491 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-15f05017-317e-4657-a151-21ed13bdca76 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.255993 Jul 01 10:26:07.448605 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 44/74] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:26:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:07.613315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:07.656770 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f75414e4-9cbf-46cc-91d8-46fe6839a779 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.624750 Jul 01 10:26:07.665006 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 31/75] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:07 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:08.028972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:08.029547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:08.047394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:08.047923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:08.049271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:08.050704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:08.348137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:08.356754 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:08.364429 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-efc97102-f7e7-4cb6-927b-da590c362627 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.339297 Jul 01 10:26:08.382035 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 45/76] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:08 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:08.679389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:08.680010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:08.691386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:08.694820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:08.701115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:08.705755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:08.753588 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:09.198447 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:09.214069 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-37987d29-8858-4a54-8fe7-63b0bc312f60 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.538240 Jul 01 10:26:09.215896 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 32/77] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:08 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:09.386467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:09.386949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:09.394548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:09.395540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:09.396501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:09.397138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:09.679890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:09.690019 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f8bfb2b2-a2e5-4d6b-9b35-4c23996024d6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.308865 Jul 01 10:26:09.700508 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 46/78] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:09 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:10.117559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Calling method '.version_select at 0x7f6f92d038b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:10.120703 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:10.120703 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:10.136010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=119765) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 01 10:26:10.137551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.138224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.180182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.181529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.234397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:10.235466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:10.247599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.248059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.249083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.249742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.296025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.298517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.323324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.325699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.392387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.392837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.414707 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba5a352b-db11-48d3-b31d-900afe7a9626 tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.855428 Jul 01 10:26:10.415307 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 33/79] 10.222.0.23 () {60 vars in 1242 bytes} [Fri Jul 1 10:26:09 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:26:10.434802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Calling method '.version_select at 0x7f6f92b7e670>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:10.436641 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:10.436641 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:10.438419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.439133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.454667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.458351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.484378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.485114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.513918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.514755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.537107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.537904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.540453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:10.547009 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1bb2c60-72d8-467c-96e7-85fdfe7953cc tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.120249 Jul 01 10:26:10.551317 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 34/80] 10.222.0.23 () {60 vars in 1221 bytes} [Fri Jul 1 10:26:10 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:10.558901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5dcd0a3e-639e-4c42-a116-5cea89486a2b tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.330478 Jul 01 10:26:10.559488 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 47/81] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:10 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:10.560367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3224636c-57c4-454a-bbbe-e9b79488d7bb tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Calling method '.version_select at 0x7f6f92b41a60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:10.582422 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:10.582422 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:10.586393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3224636c-57c4-454a-bbbe-e9b79488d7bb tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.586844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3224636c-57c4-454a-bbbe-e9b79488d7bb tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.611034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3224636c-57c4-454a-bbbe-e9b79488d7bb tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.611489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3224636c-57c4-454a-bbbe-e9b79488d7bb tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.618445 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3224636c-57c4-454a-bbbe-e9b79488d7bb tempest-HypervisorAdminV253TestBase-1400505101 tempest-HypervisorAdminV253TestBase-1400505101-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/9a46df94-15ee-4082-9fd9-1376d996471c" status: 200 len: 792 microversion: 2.53 time: 0.063205 Jul 01 10:26:10.619349 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 35/82] 10.222.0.23 () {60 vars in 1297 bytes} [Fri Jul 1 10:26:10 2022] GET /compute/v2.1/os-hypervisors/9a46df94-15ee-4082-9fd9-1376d996471c => generated 792 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:26:10.707481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:10.708390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:10.718969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.720091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.721375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:10.722034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:10.776751 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:10.990887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:11.000737 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c8e8314-0aa6-4454-a30a-b356fe8bdde8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.297199 Jul 01 10:26:11.010018 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 48/83] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:10 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:11.292978 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:11.514908 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0aae458f-df46-45bf-a474-cbc05ae6678e tempest-TenantUsagesNegativeTestJSON-1874152182 tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-30T10%3A26%3A11.280961&end=2022-07-02T10%3A26%3A11.280961" status: 404 len: 112 microversion: - time: 0.229590 Jul 01 10:26:11.515721 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 36/84] 10.222.0.23 () {58 vars in 1315 bytes} [Fri Jul 1 10:26:11 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-30T10%3A26%3A11.280961&end=2022-07-02T10%3A26%3A11.280961 => generated 112 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 10:26:11.528072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-66868e6e-3144-4c8b-be0a-9091c0d3cbe0 tempest-TenantUsagesNegativeTestJSON-1874152182 tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin] Calling method '.version_select at 0x7f6f92b8b8b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:11.533435 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-66868e6e-3144-4c8b-be0a-9091c0d3cbe0 tempest-TenantUsagesNegativeTestJSON-1874152182 tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-66868e6e-3144-4c8b-be0a-9091c0d3cbe0 tempest-TenantUsagesNegativeTestJSON-1874152182 tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin] Request method failure captured: Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-simple-tenant-usage/cd4dc7d8e512417f9d42c2083c112ed5?start=2022-07-02T10%3A26%3A11.280961&end=2022-06-30T10%3A26%3A11.280961 HTTP/1.1 Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvD5MUoYZUMHK3LtTkLWR4Rg6Zy8miDK3EYokVFpCxnjHeETIKBaiFD6l6XIremVXQHcSWCS6ipwNsh0-e6PKjcOMjmUzMXandyPjociSd7t2Yb8Xi3Umsq4fgoIm9gcNfezrYtkOJqUCChFpqJjqH2CtWwv4wVKPTNH9M-oAIjqSY Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 4328a22ff0684cf7969998af18c4a418 Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1874152182 Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:11.535641 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4328a22ff0684cf7969998af18c4a418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4328a22ff0684cf7969998af18c4a418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4328a22ff0684cf7969998af18c4a418", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4328a22ff0684cf7969998af18c4a418"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1874152182 Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 4328a22ff0684cf7969998af18c4a418 Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1874152182 Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 711b75562ec74dbbb802738ec1fde9a3 Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid start time. The start time cannot occur after the end time. Jul 01 10:26:11.536805 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'cd4dc7d8e512417f9d42c2083c112ed5'} Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 01 10:26:11.537523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 01 10:26:11.538505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:11.540455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-66868e6e-3144-4c8b-be0a-9091c0d3cbe0 tempest-TenantUsagesNegativeTestJSON-1874152182 tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:11.541580 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-66868e6e-3144-4c8b-be0a-9091c0d3cbe0 tempest-TenantUsagesNegativeTestJSON-1874152182 tempest-TenantUsagesNegativeTestJSON-1874152182-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/cd4dc7d8e512417f9d42c2083c112ed5?start=2022-07-02T10%3A26%3A11.280961&end=2022-06-30T10%3A26%3A11.280961" status: 400 len: 111 microversion: 2.1 time: 0.018078 Jul 01 10:26:11.543021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 49/85] 10.222.0.23 () {58 vars in 1411 bytes} [Fri Jul 1 10:26:11 2022] GET /compute/v2.1/os-simple-tenant-usage/cd4dc7d8e512417f9d42c2083c112ed5?start=2022-07-02T10%3A26%3A11.280961&end=2022-06-30T10%3A26%3A11.280961 => generated 111 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:26:11.584296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:11.588913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:11.611237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:11.613107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:11.615855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:11.618374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:11.812380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-189d8941-9a91-4f71-9e55-483db9f8c49a tempest-TenantUsagesNegativeTestJSON-1619158089 tempest-TenantUsagesNegativeTestJSON-1619158089-project] Calling method '.version_select at 0x7f6f92ba8f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:11.818069 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-189d8941-9a91-4f71-9e55-483db9f8c49a tempest-TenantUsagesNegativeTestJSON-1619158089 tempest-TenantUsagesNegativeTestJSON-1619158089-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'f79842f1fb114db0b6f6f29a03dc6875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4dc7d8e512417f9d42c2083c112ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-189d8941-9a91-4f71-9e55-483db9f8c49a tempest-TenantUsagesNegativeTestJSON-1619158089 tempest-TenantUsagesNegativeTestJSON-1619158089-project] Request method failure captured: Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-30T10%3A26%3A11.280961&end=2022-07-02T10%3A26%3A11.280961&detailed=1 HTTP/1.1 Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvBFfdR0Lc5M9Zwr9q3fmthFpWmsKakPdOGJxqenJ58K1jPiK36RPs_86q70YigTNDzXVggj2pV5VfEf4e3mcC32gYmgGQioy1OA8a1r7gURZva-dH5ShklfsKGxP9VR6aerOVAHXkFz-H4Ki1lkCxe868XNdsdJR0ogg6DgwQbHsY Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: cd4dc7d8e512417f9d42c2083c112ed5 Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1619158089 Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:11.820527 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd4dc7d8e512417f9d42c2083c112ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd4dc7d8e512417f9d42c2083c112ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd4dc7d8e512417f9d42c2083c112ed5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd4dc7d8e512417f9d42c2083c112ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1619158089 Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: cd4dc7d8e512417f9d42c2083c112ed5 Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1619158089 Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TenantUsagesNegativeTestJSON-1619158089-project Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: f79842f1fb114db0b6f6f29a03dc6875 Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1619158089-project Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: action_args: {} Jul 01 10:26:11.822253 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:11.823853 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:11.824906 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:11.854620 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 01 10:26:11.854620 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:11.854620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-189d8941-9a91-4f71-9e55-483db9f8c49a tempest-TenantUsagesNegativeTestJSON-1619158089 tempest-TenantUsagesNegativeTestJSON-1619158089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:11.854620 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-189d8941-9a91-4f71-9e55-483db9f8c49a tempest-TenantUsagesNegativeTestJSON-1619158089 tempest-TenantUsagesNegativeTestJSON-1619158089-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-30T10%3A26%3A11.280961&end=2022-07-02T10%3A26%3A11.280961&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.275779 Jul 01 10:26:11.854620 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 37/86] 10.222.0.23 () {58 vars in 1334 bytes} [Fri Jul 1 10:26:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-30T10%3A26%3A11.280961&end=2022-07-02T10%3A26%3A11.280961&detailed=1 => generated 123 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:11.854933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:11.854933 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d7d2e22-2bdf-4d32-8a1f-30aee4ef7cbf tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.271840 Jul 01 10:26:11.854933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 50/87] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:11 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:12.018497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:12.019358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:12.026180 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:12.026630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:12.027399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:12.027835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:12.160775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:12.168766 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-485bf7a0-c223-4446-815b-8f4ea703749b tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.154515 Jul 01 10:26:12.169357 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 38/88] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:12 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:12.583975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-299664652", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "1498493286", "adminPass": "***", "networks": [{"uuid": "229800ac-3106-4586-b921-a4584ed57044"}], "security_groups": [{"name": "tempest-securitygroup--1437882706"}], "key_name": "tempest-keypair-880502020", "user_data": "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:12.736727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] validate_networks() for [('229800ac-3106-4586-b921-a4584ed57044', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:26:12.862953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:12.863542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:12.869939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:12.870594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:12.872010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:12.872010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:13.148586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:13.162683 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-305d9e10-96cc-4ab4-9e52-3dd1daf64f10 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.303562 Jul 01 10:26:13.172846 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 39/89] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:12 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:13.191510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:13.193445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:13.210070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:13.214073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:13.215812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:13.216921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:13.506356 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:13.513921 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-28a9f18f-38e5-4d8b-b902-fe7df7997ad0 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.329309 Jul 01 10:26:13.514575 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 40/90] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:13 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:13.674438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:26:13.674877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:26:13.675317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:26:13.675718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:26:13.676134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:26:13.689949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:13.690770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:13.691259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:13.691696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:13.716710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Getting quotas for project e215073c20cc458983a0912389cb4e44. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:13.720952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Getting quotas for user d00b392abf154820b4e5bce216b7e406 and project e215073c20cc458983a0912389cb4e44. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:13.732908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:26:13.735683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:26:13.894578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ed9f2a7-e377-4f15-be9b-2692b570bcee tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.315191 Jul 01 10:26:13.895768 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 51/91] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:26:13.906865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96e26435-0fa1-4d1d-95c8-9b6c542e7d26 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:13.907475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96e26435-0fa1-4d1d-95c8-9b6c542e7d26 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:13.966716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96e26435-0fa1-4d1d-95c8-9b6c542e7d26 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:13.984506 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96e26435-0fa1-4d1d-95c8-9b6c542e7d26 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1263 microversion: 2.1 time: 0.081946 Jul 01 10:26:13.994710 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 41/92] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:13 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:14.180292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:14.181195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:14.194978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:14.194978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:14.194978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:14.194978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:14.327000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:14.334595 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef116ea1-ed4f-4123-8fdd-24a7d5f28abc tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.158651 Jul 01 10:26:14.335152 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 52/93] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:14 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:14.530500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:14.533286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:14.538726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:14.539194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:14.540122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:14.540564 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:14.769498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:14.781841 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-64359ba5-da60-44b5-a482-f212ab45da44 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.255227 Jul 01 10:26:14.794949 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 42/94] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:14 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:14.997413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f373cd40-f75e-4160-b343-0411e3e19c96 req-070856c7-b433-4077-a2e8-2fa7ab0f5d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60268378-0b9e-479d-a21b-b273c292cf07", "name": "network-vif-plugged", "status": "completed", "tag": "d06f514c-d72f-4d43-80e7-d819e36d37ee"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:15.003483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4ab9eaa-a1da-4106-8b8b-8280022ca7de tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:15.005387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4ab9eaa-a1da-4106-8b8b-8280022ca7de tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:15.007325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f373cd40-f75e-4160-b343-0411e3e19c96 req-070856c7-b433-4077-a2e8-2fa7ab0f5d07 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:15.009658 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f373cd40-f75e-4160-b343-0411e3e19c96 req-070856c7-b433-4077-a2e8-2fa7ab0f5d07 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:15.021416 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f373cd40-f75e-4160-b343-0411e3e19c96 req-070856c7-b433-4077-a2e8-2fa7ab0f5d07 service nova] Creating event network-vif-plugged:d06f514c-d72f-4d43-80e7-d819e36d37ee for instance 60268378-0b9e-479d-a21b-b273c292cf07 on n-h2-master-1 Jul 01 10:26:15.027764 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f373cd40-f75e-4160-b343-0411e3e19c96 req-070856c7-b433-4077-a2e8-2fa7ab0f5d07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170021 Jul 01 10:26:15.029412 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 53/95] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:15.078824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4ab9eaa-a1da-4106-8b8b-8280022ca7de tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:15.087499 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4ab9eaa-a1da-4106-8b8b-8280022ca7de tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1263 microversion: 2.1 time: 0.088567 Jul 01 10:26:15.088618 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 43/96] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:14 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:15.351825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:15.352465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:15.359057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:15.362132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:15.362132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:15.362132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:15.528928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:15.537814 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3b420a16-07d1-4f34-a3ba-ad8096623079 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.190148 Jul 01 10:26:15.538750 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 54/97] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:15 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:15.800326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:15.800918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:15.807937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:15.808882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:15.810402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:15.811055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:15.955756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:15.963615 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-38545819-66d7-483c-b03b-3ac70f4b433d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.167126 Jul 01 10:26:15.964491 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 44/98] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:15 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:16.105377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.106054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:16.112671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.118923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.118923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.118923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.131433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1db996eb-f5f0-405a-aef5-c373170bd4cc tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Calling method '.version_select at 0x7f6f92ad25e0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.132315 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.132315 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:16.133436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1db996eb-f5f0-405a-aef5-c373170bd4cc tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '1af57018bf4e452796e35fefae1966e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e95fde38384d929bce3c0c67fc5aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1db996eb-f5f0-405a-aef5-c373170bd4cc tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Request method failure captured: Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvGixnA_yk-TQAJhpDHoiQCgtKGviF5_IctQdoU9aG0YgT37vBzw_5dXNO5QhjfGMAP7QOfJl0tmXGZY0Qo7oKrZprFtDQBilnEW2191k7VPEg7xo6f-NymMzhbso91cMl4OfJMx_0L0_sHLdAccEjbvrU4jGEeO72xs3CglDG677o Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:16.136273 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20e95fde38384d929bce3c0c67fc5aa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1af57018bf4e452796e35fefae1966e8 Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: action_args: {} Jul 01 10:26:16.137848 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:16.139003 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 01 10:26:16.140029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.143042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1db996eb-f5f0-405a-aef5-c373170bd4cc tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:16.143042 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1db996eb-f5f0-405a-aef5-c373170bd4cc tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.261555 Jul 01 10:26:16.143042 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 55/99] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Jul 1 10:26:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:16.147410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ec3198f-162b-4568-a6f0-56d86c97ab31 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Calling method '.version_select at 0x7f6f92af6160>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.148386 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.148386 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:16.150299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ec3198f-162b-4568-a6f0-56d86c97ab31 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '1af57018bf4e452796e35fefae1966e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e95fde38384d929bce3c0c67fc5aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ec3198f-162b-4568-a6f0-56d86c97ab31 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Request method failure captured: Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvGixnA_yk-TQAJhpDHoiQCgtKGviF5_IctQdoU9aG0YgT37vBzw_5dXNO5QhjfGMAP7QOfJl0tmXGZY0Qo7oKrZprFtDQBilnEW2191k7VPEg7xo6f-NymMzhbso91cMl4OfJMx_0L0_sHLdAccEjbvrU4jGEeO72xs3CglDG677o Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:16.152207 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20e95fde38384d929bce3c0c67fc5aa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1af57018bf4e452796e35fefae1966e8 Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: action_args: {} Jul 01 10:26:16.153324 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:16.153992 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 01 10:26:16.154914 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.157496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ec3198f-162b-4568-a6f0-56d86c97ab31 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:16.158511 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ec3198f-162b-4568-a6f0-56d86c97ab31 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014860 Jul 01 10:26:16.159207 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 56/100] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:26:16.175249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8672f4f9-35dd-4a6e-85fa-f49cf2653f6a tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Calling method '.version_select at 0x7f6f92ac3ee0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.176106 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.176106 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:16.178282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8672f4f9-35dd-4a6e-85fa-f49cf2653f6a tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '1af57018bf4e452796e35fefae1966e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e95fde38384d929bce3c0c67fc5aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8672f4f9-35dd-4a6e-85fa-f49cf2653f6a tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Request method failure captured: Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvGixnA_yk-TQAJhpDHoiQCgtKGviF5_IctQdoU9aG0YgT37vBzw_5dXNO5QhjfGMAP7QOfJl0tmXGZY0Qo7oKrZprFtDQBilnEW2191k7VPEg7xo6f-NymMzhbso91cMl4OfJMx_0L0_sHLdAccEjbvrU4jGEeO72xs3CglDG677o Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:16.179954 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20e95fde38384d929bce3c0c67fc5aa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1af57018bf4e452796e35fefae1966e8 Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: action_args: {} Jul 01 10:26:16.181406 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:16.182962 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 01 10:26:16.184073 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.184909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8672f4f9-35dd-4a6e-85fa-f49cf2653f6a tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:16.184909 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8672f4f9-35dd-4a6e-85fa-f49cf2653f6a tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.017198 Jul 01 10:26:16.187853 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 57/101] 10.222.0.23 () {58 vars in 1178 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:16.199924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:16.207733 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8bd417b-142d-41f1-b630-6efb2a16bb9c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1315 microversion: 2.1 time: 0.106567 Jul 01 10:26:16.208310 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 45/102] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1315 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:16.299694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Calling method '.version_select at 0x7f6f92ad2b80>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.304020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.304597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.330495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.331195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.343926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.344377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.350238 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7523da7a-188b-47fe-bf56-5aaecd1b9ab4 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.161415 Jul 01 10:26:16.350799 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 58/103] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:16.361394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78f777ec-ce40-45c9-b1e6-87c9393cd431 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Calling method '.version_select at 0x7f6f92a8f700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.362256 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.362256 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:16.363315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78f777ec-ce40-45c9-b1e6-87c9393cd431 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '1af57018bf4e452796e35fefae1966e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e95fde38384d929bce3c0c67fc5aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78f777ec-ce40-45c9-b1e6-87c9393cd431 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Request method failure captured: Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvGixnA_yk-TQAJhpDHoiQCgtKGviF5_IctQdoU9aG0YgT37vBzw_5dXNO5QhjfGMAP7QOfJl0tmXGZY0Qo7oKrZprFtDQBilnEW2191k7VPEg7xo6f-NymMzhbso91cMl4OfJMx_0L0_sHLdAccEjbvrU4jGEeO72xs3CglDG677o Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:16.365218 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20e95fde38384d929bce3c0c67fc5aa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 1af57018bf4e452796e35fefae1966e8 Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1'} Jul 01 10:26:16.366630 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:16.369719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 01 10:26:16.370710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.371568 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78f777ec-ce40-45c9-b1e6-87c9393cd431 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:16.371568 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78f777ec-ce40-45c9-b1e6-87c9393cd431 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009153 Jul 01 10:26:16.371568 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 46/104] 10.222.0.23 () {58 vars in 1172 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:16.376972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c82368b4-3396-4a2f-a681-2ff83b026185 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Calling method '.version_select at 0x7f6f92ad25e0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.377903 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.377903 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:16.386565 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-c82368b4-3396-4a2f-a681-2ff83b026185 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] HTTP exception thrown: Hypervisor with ID '2e2be798-fb12-466b-b63b-49056682c0ce' could not be found. Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c82368b4-3396-4a2f-a681-2ff83b026185 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Request method failure captured: Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hypervisors/2e2be798-fb12-466b-b63b-49056682c0ce/uptime HTTP/1.1 Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvH2K1xq1jpjQXTdW97adqCT2mC0lH3mfL7yXupBLgJfHZZCeQRFJqmE2FPbH8whbrdAhxv75HLHMjzHztuTvbmqMxK72G0CD7l0k6aOFdyneenLK0c8LrIUVUEbBRey3sBB4uYuRio2d0ang2lXTmExmTq5fWfeZ0_CEjd76EWM6E Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 10056388a6ce4235ab94d46457a998ec Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-217307785 Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:16.391565 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10056388a6ce4235ab94d46457a998ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10056388a6ce4235ab94d46457a998ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10056388a6ce4235ab94d46457a998ec", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10056388a6ce4235ab94d46457a998ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-217307785 Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 10056388a6ce4235ab94d46457a998ec Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-217307785 Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 86aa8e586b3e4ce4894bb1002b9e4020 Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: exception: Hypervisor with ID '2e2be798-fb12-466b-b63b-49056682c0ce' could not be found. Jul 01 10:26:16.392790 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '2e2be798-fb12-466b-b63b-49056682c0ce'} Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2e2be798-fb12-466b-b63b-49056682c0ce' Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 01 10:26:16.393513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2e2be798-fb12-466b-b63b-49056682c0ce' could not be found. Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.394654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2e2be798-fb12-466b-b63b-49056682c0ce' could not be found. Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c82368b4-3396-4a2f-a681-2ff83b026185 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Returning 404 to user: Hypervisor with ID '2e2be798-fb12-466b-b63b-49056682c0ce' could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c82368b4-3396-4a2f-a681-2ff83b026185 tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2e2be798-fb12-466b-b63b-49056682c0ce/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020094 Jul 01 10:26:16.395719 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 59/105] 10.222.0.23 () {58 vars in 1277 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors/2e2be798-fb12-466b-b63b-49056682c0ce/uptime => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:16.407433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Calling method '.version_select at 0x7f6f92ac6c10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.408453 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.408453 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:16.410885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.411391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.434870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.435186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.448673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.449455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.458639 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-171bdaff-8dd6-4b40-8bb4-135cbc21c65f tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059669 Jul 01 10:26:16.459332 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 47/106] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:16.471602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-98936f88-a6ac-4bac-86d5-9809ac66bc38 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Calling method '.version_select at 0x7f6f92af6f70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.472481 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.472481 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:16.473971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-98936f88-a6ac-4bac-86d5-9809ac66bc38 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '1af57018bf4e452796e35fefae1966e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e95fde38384d929bce3c0c67fc5aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-98936f88-a6ac-4bac-86d5-9809ac66bc38 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Request method failure captured: Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvGixnA_yk-TQAJhpDHoiQCgtKGviF5_IctQdoU9aG0YgT37vBzw_5dXNO5QhjfGMAP7QOfJl0tmXGZY0Qo7oKrZprFtDQBilnEW2191k7VPEg7xo6f-NymMzhbso91cMl4OfJMx_0L0_sHLdAccEjbvrU4jGEeO72xs3CglDG677o Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:16.475544 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20e95fde38384d929bce3c0c67fc5aa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20e95fde38384d929bce3c0c67fc5aa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 20e95fde38384d929bce3c0c67fc5aa1 Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516 Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1af57018bf4e452796e35fefae1966e8 Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2143029516-project Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '1'} Jul 01 10:26:16.477550 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:16.478594 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 01 10:26:16.480236 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.481529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-98936f88-a6ac-4bac-86d5-9809ac66bc38 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:16.481529 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-98936f88-a6ac-4bac-86d5-9809ac66bc38 tempest-HypervisorAdminNegativeTestJSON-2143029516 tempest-HypervisorAdminNegativeTestJSON-2143029516-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010714 Jul 01 10:26:16.481529 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 60/107] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:16.487498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6d8f4ae-4627-4c0f-9ba7-3cebabd3469e tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Calling method '.version_select at 0x7f6f92a8fee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.488500 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:16.488500 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:16.489483 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b6d8f4ae-4627-4c0f-9ba7-3cebabd3469e tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] HTTP exception thrown: Hypervisor with ID 'd650533f-ea6d-4e61-8b55-4df7f3689b22' could not be found. Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6d8f4ae-4627-4c0f-9ba7-3cebabd3469e tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Request method failure captured: Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hypervisors/d650533f-ea6d-4e61-8b55-4df7f3689b22 HTTP/1.1 Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvH2K1xq1jpjQXTdW97adqCT2mC0lH3mfL7yXupBLgJfHZZCeQRFJqmE2FPbH8whbrdAhxv75HLHMjzHztuTvbmqMxK72G0CD7l0k6aOFdyneenLK0c8LrIUVUEbBRey3sBB4uYuRio2d0ang2lXTmExmTq5fWfeZ0_CEjd76EWM6E Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 10056388a6ce4235ab94d46457a998ec Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-217307785 Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:16.492416 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10056388a6ce4235ab94d46457a998ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10056388a6ce4235ab94d46457a998ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10056388a6ce4235ab94d46457a998ec", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10056388a6ce4235ab94d46457a998ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-217307785 Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 10056388a6ce4235ab94d46457a998ec Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-217307785 Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 86aa8e586b3e4ce4894bb1002b9e4020 Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: exception: Hypervisor with ID 'd650533f-ea6d-4e61-8b55-4df7f3689b22' could not be found. Jul 01 10:26:16.496817 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'd650533f-ea6d-4e61-8b55-4df7f3689b22'} Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd650533f-ea6d-4e61-8b55-4df7f3689b22' Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 01 10:26:16.497733 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:26:16.499522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd650533f-ea6d-4e61-8b55-4df7f3689b22' could not be found. Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd650533f-ea6d-4e61-8b55-4df7f3689b22' could not be found. Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6d8f4ae-4627-4c0f-9ba7-3cebabd3469e tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] Returning 404 to user: Hypervisor with ID 'd650533f-ea6d-4e61-8b55-4df7f3689b22' could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6d8f4ae-4627-4c0f-9ba7-3cebabd3469e tempest-HypervisorAdminNegativeTestJSON-217307785 tempest-HypervisorAdminNegativeTestJSON-217307785-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/d650533f-ea6d-4e61-8b55-4df7f3689b22" status: 404 len: 123 microversion: 2.1 time: 0.010796 Jul 01 10:26:16.500854 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 48/108] 10.222.0.23 () {58 vars in 1256 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/os-hypervisors/d650533f-ea6d-4e61-8b55-4df7f3689b22 => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:16.556384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.557039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:16.563404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.563855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.564812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.565282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.903038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:16.911067 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77a7971d-bfc4-4bf5-af38-21d8ff3788bd tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.360205 Jul 01 10:26:16.911941 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 61/109] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:16.980008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:16.980715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:16.989884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.990560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:16.994898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:16.994898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:17.218335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:17.224493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:17.225105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:17.238021 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-272b62ce-6845-4a7f-8a03-5ce21b9d2dc2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.259698 Jul 01 10:26:17.239943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:17.240382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:17.241165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:17.241387 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 49/110] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:16 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:17.241956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:17.346618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:17.356055 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbce1e50-b782-4660-a26f-93a63a263f1f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1321 microversion: 2.1 time: 0.135321 Jul 01 10:26:17.365734 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 62/111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:17 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:17.927409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:17.927960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:17.934343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:17.934785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:17.935535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:17.935962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:18.192596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:18.196672 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-efd70b7a-a43f-4dea-80dd-f39f14814d62 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1338 microversion: 2.1 time: 0.273035 Jul 01 10:26:18.199986 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 50/112] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:17 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:18.255892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:18.257342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:18.266677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:18.267339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:18.268128 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:18.268706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:18.374604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:18.375139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:18.383482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:18.384020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:18.387041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:18.388037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:18.724849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:18.732356 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-815c2d00-c278-41bc-b3cf-ccb41a76cd16 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.480647 Jul 01 10:26:18.732933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 63/113] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:18 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:18.864092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:18.875978 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39b1481a-ffbc-4306-a508-4d4256232e24 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.506036 Jul 01 10:26:18.877622 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 51/114] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:18 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:19.216751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:19.223582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:19.226683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:19.227235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:19.230317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:19.231489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:19.620604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:19.647987 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f181cf0-6c45-4bd7-98ee-8027de0ca45c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1488 microversion: 2.1 time: 0.428949 Jul 01 10:26:19.649306 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 64/115] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:19 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1488 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:19.668982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6021b80e-b3bb-4715-9441-7dce3b48bc8e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:19.669654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6021b80e-b3bb-4715-9441-7dce3b48bc8e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:19.679554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6021b80e-b3bb-4715-9441-7dce3b48bc8e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:19.680096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6021b80e-b3bb-4715-9441-7dce3b48bc8e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:19.681017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6021b80e-b3bb-4715-9441-7dce3b48bc8e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:19.681495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6021b80e-b3bb-4715-9441-7dce3b48bc8e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:19.752381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:19.753191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:19.770186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:19.770642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:19.771435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:19.772052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:20.400538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:20.416820 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-22324d6c-8b5a-4f64-8643-4e77810f6b91 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.669671 Jul 01 10:26:20.419166 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 65/116] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:19 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:20.428054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:20.430016 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:20.442098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:20.445919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:20.447773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:20.449277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:20.935222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:20.951277 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:20.963729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6021b80e-b3bb-4715-9441-7dce3b48bc8e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1639 microversion: 2.1 time: 1.297479 Jul 01 10:26:20.964930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f791b4f6-79d7-42fb-a0a6-2975a70a94a5 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.541913 Jul 01 10:26:20.965491 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 52/117] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:19 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1639 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:20.967826 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 66/118] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:20 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:20.978452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ee256626-6b18-4f00-81f4-c9235335ab50 req-1bb70bec-9546-4499-b6dd-b9d3dcf1ebcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671d0a80-8e15-49a6-8f16-eb2e010d24cc", "tag": "2cffdcd3-a5cd-424f-b85c-e885009b8f47"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:20.986038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:20.988091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:20.991717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ee256626-6b18-4f00-81f4-c9235335ab50 req-1bb70bec-9546-4499-b6dd-b9d3dcf1ebcf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:20.992758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ee256626-6b18-4f00-81f4-c9235335ab50 req-1bb70bec-9546-4499-b6dd-b9d3dcf1ebcf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.001006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.001742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.003292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.004167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.019398 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ee256626-6b18-4f00-81f4-c9235335ab50 req-1bb70bec-9546-4499-b6dd-b9d3dcf1ebcf service nova] Creating event network-changed:2cffdcd3-a5cd-424f-b85c-e885009b8f47 for instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc on n-h1-master-1 Jul 01 10:26:21.021360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ee256626-6b18-4f00-81f4-c9235335ab50 req-1bb70bec-9546-4499-b6dd-b9d3dcf1ebcf service nova] Acquired lock "compute-rpcapi-router" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:26:21.021816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0889c50-efb7-4817-9afa-b5770e5de947 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.022423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0889c50-efb7-4817-9afa-b5770e5de947 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.024578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0889c50-efb7-4817-9afa-b5770e5de947 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.025063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0889c50-efb7-4817-9afa-b5770e5de947 None None] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.037734 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.rpcapi [None req-a0889c50-efb7-4817-9afa-b5770e5de947 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 10:26:21.038743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0889c50-efb7-4817-9afa-b5770e5de947 None None] Releasing lock "compute-rpcapi-router" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:26:21.052117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:26:21.078739 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a0889c50-efb7-4817-9afa-b5770e5de947 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109731 Jul 01 10:26:21.079806 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 53/119] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:21.244203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-35e89546-6c24-4803-bf07-5c747425e2d0 req-c3199690-e736-4d93-a0ab-f44b1a91c684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c01d5c-3c08-4d5e-b681-425d9872a475", "name": "network-vif-plugged", "status": "completed", "tag": "de5138d9-4086-423e-9472-1985b8c54a89"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:21.254194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-35e89546-6c24-4803-bf07-5c747425e2d0 req-c3199690-e736-4d93-a0ab-f44b1a91c684 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.254843 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-35e89546-6c24-4803-bf07-5c747425e2d0 req-c3199690-e736-4d93-a0ab-f44b1a91c684 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.282676 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-35e89546-6c24-4803-bf07-5c747425e2d0 req-c3199690-e736-4d93-a0ab-f44b1a91c684 service nova] Creating event network-vif-plugged:de5138d9-4086-423e-9472-1985b8c54a89 for instance 63c01d5c-3c08-4d5e-b681-425d9872a475 on n-h1-master-1 Jul 01 10:26:21.287886 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-35e89546-6c24-4803-bf07-5c747425e2d0 req-c3199690-e736-4d93-a0ab-f44b1a91c684 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047801 Jul 01 10:26:21.288722 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 54/120] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:21.415250 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af490a99-63a6-4714-b48e-8d4ec5b7ef9c tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "DELETE /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 204 len: 0 microversion: 2.1 time: 0.432793 Jul 01 10:26:21.415250 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 67/121] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:20 2022] DELETE /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:26:21.423224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:21.424014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:21.435467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:21.436275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:21.437383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.438023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.439805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.440731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.445709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.446164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.452009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:21.452009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:21.452791 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:21.675762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:21.682816 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:21.685303 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-115c6c8d-de81-402b-815e-38fce9684288 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1494 microversion: 2.1 time: 0.266784 Jul 01 10:26:21.685891 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 55/122] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:21 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1494 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:21.690486 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-add9a972-f3ae-40d1-9f3f-cd09b023d3f6 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.259762 Jul 01 10:26:21.691046 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 68/123] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:21 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:21.950548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c490ee9-5f4e-45c2-ae08-637492267977 tempest-InstanceUsageAuditLogTestJSON-17071945 tempest-InstanceUsageAuditLogTestJSON-17071945-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:21.951860 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:21.951860 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:21.972360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c490ee9-5f4e-45c2-ae08-637492267977 tempest-InstanceUsageAuditLogTestJSON-17071945 tempest-InstanceUsageAuditLogTestJSON-17071945-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-01 10:26:21" status: 200 len: 318 microversion: 2.1 time: 0.141517 Jul 01 10:26:21.972978 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 56/124] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:26:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-01%2010%3A26%3A21 => generated 318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:21.984482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:21.985099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:21.996020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1847a164-caa8-40f5-93a7-be81700e98f5 tempest-InstanceUsageAuditLogTestJSON-17071945 tempest-InstanceUsageAuditLogTestJSON-17071945-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:21.996783 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:21.996783 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:22.001907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:22.002353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:22.003330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:22.003766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:22.008844 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1847a164-caa8-40f5-93a7-be81700e98f5 tempest-InstanceUsageAuditLogTestJSON-17071945 tempest-InstanceUsageAuditLogTestJSON-17071945-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.016441 Jul 01 10:26:22.009586 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 57/125] 10.222.0.23 () {58 vars in 1184 bytes} [Fri Jul 1 10:26:21 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:22.372059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:22.386089 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e2b5ad88-2b9c-433d-a568-5590adc75345 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.405707 Jul 01 10:26:22.386833 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 69/126] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:21 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:22.714166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:22.715084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:22.717836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:22.718401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:22.726937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:22.728981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:22.729648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:22.730579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:22.731010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:22.733663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:22.734457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:22.735083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:23.117163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:23.129353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87ee632f-26a5-4579-8283-dc5d477a1ab2 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1494 microversion: 2.1 time: 0.427707 Jul 01 10:26:23.131413 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 58/127] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:22 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1494 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:23.148054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:23.160848 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09ebc419-5681-4b33-819a-706274bca330 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.457928 Jul 01 10:26:23.162562 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 70/128] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:22 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:23.402829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:23.403614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:23.410986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:23.411657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:23.412651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:23.413366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:23.611171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:23.619158 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3c7b92a7-1f3c-4d67-b35d-3a0537e3e71a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.220080 Jul 01 10:26:23.621362 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 59/129] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:23 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:24.148187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:24.148813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:24.154518 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:24.155408 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:24.157137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:24.157671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:24.158464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:24.158907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:24.182634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:24.186355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:24.207787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:24.207787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:24.210828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:24.212228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:24.353976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:24.367056 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cef1e5fe-2bbd-4cf9-8776-73bbdad0f4d1 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1452 microversion: 2.1 time: 0.222725 Jul 01 10:26:24.381435 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 71/130] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:24 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1452 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:24.396305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-19c9f11c-8ff6-4a6e-88f2-a5e2a1923b5e req-01a47c5e-c632-440c-89f8-c83cc7458c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60268378-0b9e-479d-a21b-b273c292cf07", "name": "network-vif-deleted", "tag": "d06f514c-d72f-4d43-80e7-d819e36d37ee"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:24.421811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-19c9f11c-8ff6-4a6e-88f2-a5e2a1923b5e req-01a47c5e-c632-440c-89f8-c83cc7458c17 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:24.422606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-19c9f11c-8ff6-4a6e-88f2-a5e2a1923b5e req-01a47c5e-c632-440c-89f8-c83cc7458c17 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:24.452448 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-19c9f11c-8ff6-4a6e-88f2-a5e2a1923b5e req-01a47c5e-c632-440c-89f8-c83cc7458c17 service nova] Creating event network-vif-deleted:d06f514c-d72f-4d43-80e7-d819e36d37ee for instance 60268378-0b9e-479d-a21b-b273c292cf07 on n-h2-master-1 Jul 01 10:26:24.460367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-19c9f11c-8ff6-4a6e-88f2-a5e2a1923b5e req-01a47c5e-c632-440c-89f8-c83cc7458c17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077597 Jul 01 10:26:24.461639 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 72/131] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:24.560068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:24.581441 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2ec9ef33-63cc-41d3-9717-4ce1164341d8 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1320 microversion: 2.1 time: 0.403822 Jul 01 10:26:24.582239 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 60/132] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:24 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:24.639397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:24.640406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:24.658919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:24.659369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:24.660160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:24.660601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:24.876829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:24.887094 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb2d1a02-4c54-4b5f-abb5-8b8fc70d204a tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.253278 Jul 01 10:26:24.888043 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 73/133] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:24 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:25.263867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2069380634", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "975aed5a-ead4-42b8-bef2-98c17c6465a5"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:25.324779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] validate_networks() for [('975aed5a-ead4-42b8-bef2-98c17c6465a5', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:26:25.388425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:25.389358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:25.396383 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:25.398609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:25.399261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:25.401583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:25.402316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:25.436028 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:25.436619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:25.437570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lazy-loading 'fault' on Instance uuid 60268378-0b9e-479d-a21b-b273c292cf07 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:26:25.509172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4aee1b97b944d981e1de6bb88f6dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d92f0f11ec1407d99c417f17920d37d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:25.518935 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-470d16cb-bed3-4ba2-ab35-3f3dccffd57f tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 200 len: 1328 microversion: 2.1 time: 0.135920 Jul 01 10:26:25.520004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 74/134] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:25 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:25.606524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:25.609280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:25.616720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:25.618646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:25.620004 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:25.621031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:25.919569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:25.934947 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2f217a0c-da79-489c-adfd-06a7dcd29741 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1469 microversion: 2.1 time: 0.339701 Jul 01 10:26:25.948274 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 75/135] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:25 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:25.955130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:25.956019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:25.963655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:25.964364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:25.965371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:25.966003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.056918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:26:26.057415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:26:26.057886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:26:26.058432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:26:26.058835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:26:26.068920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.069635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.070318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.070746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.088829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Getting quotas for project 3ee68fc7093d488cb454028927c6a20b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:26.092851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Getting quotas for user 568b383bb8fc4759bfa3bc87528cf761 and project 3ee68fc7093d488cb454028927c6a20b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:26.105252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:26:26.108123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:26:26.124160 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:26.146780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-27f971a2-b92a-4c77-a536-3f1e28bbf03b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.195267 Jul 01 10:26:26.147578 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 76/136] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:25 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:26.262259 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6182cf9e-a087-4113-8b57-e9c40e3cee48 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141020 Jul 01 10:26:26.271501 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 61/137] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:26:26.278910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6b61f697-33ac-4d14-9575-247bb68be734 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:26.283958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6b61f697-33ac-4d14-9575-247bb68be734 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:26.343080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6b61f697-33ac-4d14-9575-247bb68be734 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:26.352175 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6b61f697-33ac-4d14-9575-247bb68be734 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1216 microversion: 2.1 time: 0.078875 Jul 01 10:26:26.353065 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 62/138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:26 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:26.408709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:26.409375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:26.421889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.421889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.422670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.423245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.513789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:26:26.537350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:26.538693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:26.548698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.549970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.551027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.551729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.570039 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] HTTP exception thrown: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Request method failure captured: Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 HTTP/1.1 Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsulB2DRXB6VgRSilVKazYSinutAkv-9zmTb67MXOWeIMxpEARcBMdZz1vXP2lSMliqkl7SWNn4FVkUQPJbKS8iCFbIV0Lin5hx3maBiQu3BZM7Igy3O3L-usRqiWPcZTvbFsy7tHVMOORx3DvbrIt4kD6fPffAU4xmy9ECy4rHqnV8 Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8d92f0f11ec1407d99c417f17920d37d Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:26.573315 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8d92f0f11ec1407d99c417f17920d37d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8d92f0f11ec1407d99c417f17920d37d Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminTestJSON-1613727012-project Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: dc4aee1b97b944d981e1de6bb88f6dd4 Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminTestJSON-1613727012-project Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:26.574801 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '60268378-0b9e-479d-a21b-b273c292cf07'} Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:26.575653 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:26.576985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:26.580336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Returning 404 to user: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:26.581399 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48a60126-b7fe-4a5a-b28b-b030cfa46c58 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 404 len: 111 microversion: 2.1 time: 0.049443 Jul 01 10:26:26.582497 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 63/139] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:26 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:26:26.594220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74452f9e-5df6-4411-9645-fdbe896abe6b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:26.595835 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:26.595835 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:26.605516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74452f9e-5df6-4411-9645-fdbe896abe6b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.606021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74452f9e-5df6-4411-9645-fdbe896abe6b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.872409 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74452f9e-5df6-4411-9645-fdbe896abe6b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.281790 Jul 01 10:26:26.873011 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 64/140] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:26 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:26.886044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-375d19b9-8b76-4d58-8bb2-529a989a79e8 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:26.887439 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:26.887439 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:26.893479 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:26.966386 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7912e1ac-451b-4e97-a38f-98e57c140217 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 204 len: 0 microversion: 2.1 time: 0.816095 Jul 01 10:26:26.969313 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 77/141] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:26 2022] DELETE /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:26:26.975560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:26.976879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:26.984284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.984824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.985610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:26.986046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:26.995369 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-375d19b9-8b76-4d58-8bb2-529a989a79e8 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.114940 Jul 01 10:26:26.998603 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 65/142] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:26 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 01 10:26:27.014406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d086f9dd-5e96-406a-a7ed-ab946b62ef57 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1177652824"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:27.015916 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:27.015916 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:27.016910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-d086f9dd-5e96-406a-a7ed-ab946b62ef57 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid ee5b3925-7cf1-4c46-8de7-1151ea6534c0 for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:27.131039 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d086f9dd-5e96-406a-a7ed-ab946b62ef57 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.122761 Jul 01 10:26:27.132036 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 66/143] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:27.144382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-49605b8e-6064-42b8-9f49-e220fde76cfa tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:27.147669 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:27.147669 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:27.158935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:27.169427 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a573bb77-ab1a-455b-82d3-39b9037592c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1475 microversion: 2.1 time: 0.197354 Jul 01 10:26:27.169427 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 78/144] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:26 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1475 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:27.179367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:27.181051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49605b8e-6064-42b8-9f49-e220fde76cfa tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:27.181248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:27.181559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49605b8e-6064-42b8-9f49-e220fde76cfa tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:27.195478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:27.198291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:27.199150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:27.200973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:27.419148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:27.427917 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93a2040c-06dc-4b53-ac2d-553547418741 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.257432 Jul 01 10:26:27.428819 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 79/145] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:27 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:27.438856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6e684b02-e9be-4d38-b199-de2aac8c26d4 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:27.439517 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6e684b02-e9be-4d38-b199-de2aac8c26d4 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:27.478003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-49605b8e-6064-42b8-9f49-e220fde76cfa tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.339929 Jul 01 10:26:27.481665 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 67/146] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:27 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:27.483301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f075a615-7ee4-473d-a2e4-f28e3feda30e req-b90dbf86-a7e1-47b6-a78a-6d75ff695b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671d0a80-8e15-49a6-8f16-eb2e010d24cc", "name": "network-vif-plugged", "status": "completed", "tag": "2cffdcd3-a5cd-424f-b85c-e885009b8f47"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:27.503841 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f075a615-7ee4-473d-a2e4-f28e3feda30e req-b90dbf86-a7e1-47b6-a78a-6d75ff695b03 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:27.504290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f075a615-7ee4-473d-a2e4-f28e3feda30e req-b90dbf86-a7e1-47b6-a78a-6d75ff695b03 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:27.518565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6e684b02-e9be-4d38-b199-de2aac8c26d4 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:27.523252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f075a615-7ee4-473d-a2e4-f28e3feda30e req-b90dbf86-a7e1-47b6-a78a-6d75ff695b03 service nova] Creating event network-vif-plugged:2cffdcd3-a5cd-424f-b85c-e885009b8f47 for instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc on n-h1-master-1 Jul 01 10:26:27.526544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6e684b02-e9be-4d38-b199-de2aac8c26d4 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1216 microversion: 2.1 time: 0.096232 Jul 01 10:26:27.527251 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 80/147] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:27 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:27.533113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-448139c6-2571-48ff-8cb1-f47411c9d090 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:27.538721 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:27.538721 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:27.539284 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f075a615-7ee4-473d-a2e4-f28e3feda30e req-b90dbf86-a7e1-47b6-a78a-6d75ff695b03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058682 Jul 01 10:26:27.539551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 68/148] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:27.709173 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-448139c6-2571-48ff-8cb1-f47411c9d090 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.180382 Jul 01 10:26:27.709753 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 81/149] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:26:27 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:27.721738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c2c99e7-0024-4231-bf35-8d885bc32d70 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:27.723393 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:27.723393 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:27.731965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c2c99e7-0024-4231-bf35-8d885bc32d70 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:27.732419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c2c99e7-0024-4231-bf35-8d885bc32d70 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:27.791261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bcd3b1d7-737c-4acf-9dac-be3854b8a5d6 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Action: 'create', calling method: .version_select at 0x7f6f9293cca0>, body: {"keypair": {"name": "tempest-keypair-1556857561", "type": "ssh", "user_id": "a658e7f89ee744b1aa319aaa3db8a742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBjFTtYGDIs5QI30q655AOeSmZ3I4ZakOvEH1goJ4DHnkImqsdIauVaqgNveZYJ0u35gePfEdQXLhxdqUVwFh6ulmJdWCE67irtmQxH+PV/0XZK/PAkDT/pF3pYSlULGA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:27.812520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bcd3b1d7-737c-4acf-9dac-be3854b8a5d6 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Getting quotas for project c7aed07e762944db84fe7d8d548dc2ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:27.817091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bcd3b1d7-737c-4acf-9dac-be3854b8a5d6 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Getting quotas for user ef17e8e7bf89495aad59ea0b62a6eeba and project c7aed07e762944db84fe7d8d548dc2ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:27.960394 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bcd3b1d7-737c-4acf-9dac-be3854b8a5d6 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.327125 Jul 01 10:26:27.961092 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 69/150] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:26:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:26:27.975244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-389a313b-5600-4faf-ab8b-fa6280b59486 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Action: 'create', calling method: .version_select at 0x7f6f9296dd30>, body: {"keypair": {"name": "tempest-keypair-835550788", "type": "ssh", "user_id": "a658e7f89ee744b1aa319aaa3db8a742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMjc+OBrpH9U7IZxahXDhNFTjwoFXIbTslh5XK/6m88I9wXeNO6pvNts/ZXq9wFlgokiWxZN49COhShHmPQRBn51qfghdS+wI+JK/KGA1bPOrO+nriuvO/Jgjhy0SilAQ=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:28.000599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-389a313b-5600-4faf-ab8b-fa6280b59486 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Getting quotas for project c7aed07e762944db84fe7d8d548dc2ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:28.019235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-389a313b-5600-4faf-ab8b-fa6280b59486 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Getting quotas for user ef17e8e7bf89495aad59ea0b62a6eeba and project c7aed07e762944db84fe7d8d548dc2ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:28.149055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-389a313b-5600-4faf-ab8b-fa6280b59486 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.178384 Jul 01 10:26:28.155683 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 70/151] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:26:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 01 10:26:28.160867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b571658-295f-4fd0-a9b4-0599b5f7d677 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Calling method '.version_select at 0x7f6f928c73a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:28.170400 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b571658-295f-4fd0-a9b4-0599b5f7d677 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1556857561?user_id=a658e7f89ee744b1aa319aaa3db8a742" status: 200 len: 512 microversion: 2.10 time: 0.013308 Jul 01 10:26:28.180373 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 71/152] 10.222.0.23 () {60 vars in 1339 bytes} [Fri Jul 1 10:26:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1556857561?user_id=a658e7f89ee744b1aa319aaa3db8a742 => generated 512 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:28.186524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1ce7654-090d-4a31-8f7e-20bd5f8a437c tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Action: 'create', calling method: .version_select at 0x7f6f928c7550>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1800841491", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqXGQswb3B+N3gfBCkcqJ9rTf3poq3QWibYWeYI1Xahc30JzqUKC59ZsmVdDnzCrWJIgcB6cvmoke1ltDYf6Z0xmoUjI/Mubc9PcPXjXCqmy9EOaLsVSWyYVuCSlgVvZw=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:28.218857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d1ce7654-090d-4a31-8f7e-20bd5f8a437c tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Getting quotas for project c7aed07e762944db84fe7d8d548dc2ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:28.222855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d1ce7654-090d-4a31-8f7e-20bd5f8a437c tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Getting quotas for user ef17e8e7bf89495aad59ea0b62a6eeba and project c7aed07e762944db84fe7d8d548dc2ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:28.311271 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c2c99e7-0024-4231-bf35-8d885bc32d70 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.593969 Jul 01 10:26:28.312332 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 82/153] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:27 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:28.322458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:28.323233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:28.329901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:28.330422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:28.331268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:28.331770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:28.394312 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1ce7654-090d-4a31-8f7e-20bd5f8a437c tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.214253 Jul 01 10:26:28.394880 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 72/154] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:26:28 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:26:28.401354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c05d507e-4147-4ceb-88fd-456381591938 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:28.402468 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:28.402468 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:28.522437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c05d507e-4147-4ceb-88fd-456381591938 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.126476 Jul 01 10:26:28.523594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 73/155] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:28 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:28.534772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dd490db5-16f7-4aa8-b9a4-8a1da5bc5230 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Calling method '.version_select at 0x7f6f928d15e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:28.537385 n-d-master-1 devstack@n-api.service[119765]: WARNING oslo_db.sqlalchemy.utils [None req-dd490db5-16f7-4aa8-b9a4-8a1da5bc5230 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 01 10:26:28.547945 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dd490db5-16f7-4aa8-b9a4-8a1da5bc5230 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=a658e7f89ee744b1aa319aaa3db8a742" status: 200 len: 725 microversion: 2.10 time: 0.017047 Jul 01 10:26:28.548510 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 74/156] 10.222.0.23 () {60 vars in 1258 bytes} [Fri Jul 1 10:26:28 2022] GET /compute/v2.1/os-keypairs?user_id=a658e7f89ee744b1aa319aaa3db8a742 => generated 725 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:28.553674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:28.554549 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:28.564812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:28.565593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:28.566542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:28.567122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:28.614964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:28.623313 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f2e6463-a540-4350-be1e-da93eba14633 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1475 microversion: 2.1 time: 0.304939 Jul 01 10:26:28.624197 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 83/157] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:28 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1475 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:28.629432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5526df5a-2b08-4d75-9e40-30b579847260 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1057295886"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:28.631532 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:28.631532 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:28.632815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-5526df5a-2b08-4d75-9e40-30b579847260 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid 6bd264aa-6154-4b88-8698-00bd7812427e for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:28.734533 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5526df5a-2b08-4d75-9e40-30b579847260 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109002 Jul 01 10:26:28.740362 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 84/158] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:28.740888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:28.741850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:28.749289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:28.749736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:28.751123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:28.751584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:28.922672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:28.930974 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7b5980f-09d4-41c9-be24-0849963db34a tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1268 microversion: 2.1 time: 0.194024 Jul 01 10:26:28.932830 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 85/159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:28 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:28.947264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5010b48-4777-4f31-88c6-cf92e766849b tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Calling method '.version_select at 0x7f6f92af6820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:29.046868 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5010b48-4777-4f31-88c6-cf92e766849b tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1800841491" status: 204 len: 0 microversion: 2.10 time: 0.104742 Jul 01 10:26:29.048291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:29.049476 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 86/160] 10.222.0.23 () {60 vars in 1324 bytes} [Fri Jul 1 10:26:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1800841491 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:26:29.057267 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-866df3cf-fc68-4614-ab30-0bd4bd639c78 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:29.059044 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:29.059044 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:29.073763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-866df3cf-fc68-4614-ab30-0bd4bd639c78 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:29.074600 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fdf13c63-0da6-495e-b3fe-1ca29395c31c tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1389 microversion: 2.1 time: 0.524858 Jul 01 10:26:29.076931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-866df3cf-fc68-4614-ab30-0bd4bd639c78 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:29.085511 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 75/161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:28 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1389 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:29.091723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3b0a4394-07fc-4941-981b-33fc33055b90 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Calling method '.version_select at 0x7f6f928c73a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:29.200062 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3b0a4394-07fc-4941-981b-33fc33055b90 tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835550788?user_id=a658e7f89ee744b1aa319aaa3db8a742" status: 204 len: 0 microversion: 2.10 time: 0.113195 Jul 01 10:26:29.200640 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 76/162] 10.222.0.23 () {60 vars in 1339 bytes} [Fri Jul 1 10:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835550788?user_id=a658e7f89ee744b1aa319aaa3db8a742 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:26:29.208520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e24f07b9-dcbb-4574-98de-80b79b5b219d tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] Calling method '.version_select at 0x7f6f9293caf0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:29.331910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e24f07b9-dcbb-4574-98de-80b79b5b219d tempest-KeyPairsV210TestJSON-95992504 tempest-KeyPairsV210TestJSON-95992504-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556857561?user_id=a658e7f89ee744b1aa319aaa3db8a742" status: 204 len: 0 microversion: 2.10 time: 0.126717 Jul 01 10:26:29.340333 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 77/163] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556857561?user_id=a658e7f89ee744b1aa319aaa3db8a742 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 10:26:29.406234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-648bd41d-ab4f-47ca-9c8b-23f1aa637bdb req-3330c290-4170-4ba5-ae7c-1f8c5e73df86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c01d5c-3c08-4d5e-b681-425d9872a475", "name": "network-vif-deleted", "tag": "de5138d9-4086-423e-9472-1985b8c54a89"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:29.418577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-648bd41d-ab4f-47ca-9c8b-23f1aa637bdb req-3330c290-4170-4ba5-ae7c-1f8c5e73df86 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:29.423135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-648bd41d-ab4f-47ca-9c8b-23f1aa637bdb req-3330c290-4170-4ba5-ae7c-1f8c5e73df86 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:29.436223 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-648bd41d-ab4f-47ca-9c8b-23f1aa637bdb req-3330c290-4170-4ba5-ae7c-1f8c5e73df86 service nova] Creating event network-vif-deleted:de5138d9-4086-423e-9472-1985b8c54a89 for instance 63c01d5c-3c08-4d5e-b681-425d9872a475 on n-h1-master-1 Jul 01 10:26:29.447563 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-648bd41d-ab4f-47ca-9c8b-23f1aa637bdb req-3330c290-4170-4ba5-ae7c-1f8c5e73df86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040859 Jul 01 10:26:29.447563 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 78/164] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:29.529535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-866df3cf-fc68-4614-ab30-0bd4bd639c78 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.478646 Jul 01 10:26:29.530206 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 87/165] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:29.540729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-425d9258-9188-42e3-8df2-b4cfa33b5138 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:29.541736 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:29.541736 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:29.558266 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-425d9258-9188-42e3-8df2-b4cfa33b5138 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.021546 Jul 01 10:26:29.559054 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 79/166] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:26:29 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:29.573761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc363ed2-1b99-437c-8f05-9c34ff76ccff tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:29.575099 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:29.575099 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:29.583589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc363ed2-1b99-437c-8f05-9c34ff76ccff tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:29.584038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc363ed2-1b99-437c-8f05-9c34ff76ccff tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:29.587090 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:29.647952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:29.648872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:29.673229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:29.673904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:29.674704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:29.675941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:29.744324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:29.752127 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-44620bfc-ac54-4d01-a5b1-939af3001f49 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1433 microversion: 2.1 time: 0.114524 Jul 01 10:26:29.752688 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 80/167] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:29 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1433 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:29.848588 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc363ed2-1b99-437c-8f05-9c34ff76ccff tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.279186 Jul 01 10:26:29.849928 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 88/168] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:29.859772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa25b93e-5ae0-4167-981f-ce9770a916fe tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:29.860516 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:29.860516 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:29.956732 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa25b93e-5ae0-4167-981f-ce9770a916fe tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.100509 Jul 01 10:26:29.957743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:29.957943 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 81/169] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:29 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:29.959352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:29.970023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-308c71d4-28c7-47c1-bcbd-717f8a9140ab tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-905210429"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:29.971861 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:29.971861 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:29.973052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-308c71d4-28c7-47c1-bcbd-717f8a9140ab tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid 2544c5da-b611-4ae2-9c49-0427d391df0a for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:29.985339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:29.986413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:29.987229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:29.990782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.077640 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-308c71d4-28c7-47c1-bcbd-717f8a9140ab tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.111369 Jul 01 10:26:30.079301 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 82/170] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:30.091260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca6cbd58-0d21-4a1a-b6d2-96ce505a8a7f tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:30.094126 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:30.094126 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:30.102752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca6cbd58-0d21-4a1a-b6d2-96ce505a8a7f tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.107578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca6cbd58-0d21-4a1a-b6d2-96ce505a8a7f tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.211603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:30.220555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c328234-a552-454d-bca9-aab942a10722 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.273974 Jul 01 10:26:30.221252 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 89/171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:29 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:30.226186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:30.226792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:30.238862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.239321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.240087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.240511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.416816 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:30.437313 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ef080b3-4e98-4de5-b569-74abd47a7515 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1589 microversion: 2.1 time: 0.214246 Jul 01 10:26:30.449517 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 90/172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:30 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1589 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:30.455113 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca6cbd58-0d21-4a1a-b6d2-96ce505a8a7f tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.369630 Jul 01 10:26:30.456148 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 83/173] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:30 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:30.458759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08b0e17e-4bca-4b6b-b8c0-85ff0301bc43 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:30.458991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08b0e17e-4bca-4b6b-b8c0-85ff0301bc43 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:30.465934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07f86132-ac0b-4548-92a9-a5ee1f2cf795 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:30.466134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b0e17e-4bca-4b6b-b8c0-85ff0301bc43 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.466623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b0e17e-4bca-4b6b-b8c0-85ff0301bc43 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.467268 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:30.467268 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:30.467602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b0e17e-4bca-4b6b-b8c0-85ff0301bc43 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.468291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b0e17e-4bca-4b6b-b8c0-85ff0301bc43 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.476616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07f86132-ac0b-4548-92a9-a5ee1f2cf795 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.477534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07f86132-ac0b-4548-92a9-a5ee1f2cf795 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.490220 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:30.563465 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08b0e17e-4bca-4b6b-b8c0-85ff0301bc43 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110429 Jul 01 10:26:30.571325 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 91/174] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:26:30 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:30.710620 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07f86132-ac0b-4548-92a9-a5ee1f2cf795 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.247956 Jul 01 10:26:30.711489 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 84/175] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:30 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:30.721375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d8c4f6c-2a99-4e1a-93cc-3669c76f49bc tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:30.724248 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:30.724248 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:30.769785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:30.770391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:30.777253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.777834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.778598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.779021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.811275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:30.811757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:30.812362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lazy-loading 'fault' on Instance uuid 63c01d5c-3c08-4d5e-b681-425d9872a475 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:26:30.824825 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d8c4f6c-2a99-4e1a-93cc-3669c76f49bc tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.106905 Jul 01 10:26:30.830145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 92/176] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:30 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:30.842826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0dd6f3aa-4346-497e-8ee3-070c70d90e2b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1826239555"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:30.844458 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:30.844458 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:30.845422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-0dd6f3aa-4346-497e-8ee3-070c70d90e2b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid 6499da07-3694-4b0b-8152-56a9429dcd25 for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:30.908578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:30.913288 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-039442a1-dbd9-4c10-a70f-9a61cd75c10f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 200 len: 1310 microversion: 2.1 time: 0.146632 Jul 01 10:26:30.913888 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 85/177] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:30 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 1310 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:30.929932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4112f4c6-6ea2-4c05-84f5-84c3877e480a tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-743134443"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:30.935269 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:30.935269 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:30.935269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-4112f4c6-6ea2-4c05-84f5-84c3877e480a tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Generated uuid aa2fd951-7d9d-4300-8a57-96145da33983 for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:30.946405 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0dd6f3aa-4346-497e-8ee3-070c70d90e2b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.108716 Jul 01 10:26:30.953314 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 93/178] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:30.958851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-92676144-78c8-4b49-93b0-64892b6eb141 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:30.959611 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:30.959611 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:31.037694 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4112f4c6-6ea2-4c05-84f5-84c3877e480a tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.111862 Jul 01 10:26:31.038392 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 86/179] 10.222.0.23 () {62 vars in 1204 bytes} [Fri Jul 1 10:26:30 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:31.048389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4390512-1f42-43ca-bd48-b5c39e692a9e tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-29240219"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:31.091527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-92676144-78c8-4b49-93b0-64892b6eb141 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.135973 Jul 01 10:26:31.093796 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 94/180] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:30 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:31.107505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-860514a0-507e-4e2f-b16d-210235e4f726 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.110175 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.110175 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:31.124335 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-860514a0-507e-4e2f-b16d-210235e4f726 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-860514a0-507e-4e2f-b16d-210235e4f726 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Request method failure captured: Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuo2Imp9mOFsicoq8J6_12dVABo_TQLo8x2gFNcYCVdjZv0y1Sbo3uAQ0SGHT52jdBQTYL7JqiFpCcfltgMUK9D6KC84xQeJt785mhQ1c2SgPE32SXwaoM0fNcLOX2WcNXcnJYdDX9xV7Ej_7k_xpx1tou2vhH0A6nUkvDsWTapfA0 Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:31.135664 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bcd8317d2b24817a6fd8ec6ffbabe9d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 14091372011e44b181c9f056938bb799 Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: exception: Aggregate 5 could not be found. Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '5'} Jul 01 10:26:31.137069 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.137816 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 01 10:26:31.138883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.142110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-860514a0-507e-4e2f-b16d-210235e4f726 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:31.151423 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-860514a0-507e-4e2f-b16d-210235e4f726 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.045180 Jul 01 10:26:31.151423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 95/181] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:26:31 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:26:31.155202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8951878a-79aa-468f-9bc9-d56d6b2a85b8 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.157903 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.157903 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:31.173554 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8951878a-79aa-468f-9bc9-d56d6b2a85b8 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8951878a-79aa-468f-9bc9-d56d6b2a85b8 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Request method failure captured: Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuo2Imp9mOFsicoq8J6_12dVABo_TQLo8x2gFNcYCVdjZv0y1Sbo3uAQ0SGHT52jdBQTYL7JqiFpCcfltgMUK9D6KC84xQeJt785mhQ1c2SgPE32SXwaoM0fNcLOX2WcNXcnJYdDX9xV7Ej_7k_xpx1tou2vhH0A6nUkvDsWTapfA0 Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:31.175837 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bcd8317d2b24817a6fd8ec6ffbabe9d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 14091372011e44b181c9f056938bb799 Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: exception: Aggregate 5 could not be found. Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '5'} Jul 01 10:26:31.181944 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:31.182799 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.184309 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8951878a-79aa-468f-9bc9-d56d6b2a85b8 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8951878a-79aa-468f-9bc9-d56d6b2a85b8 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.029976 Jul 01 10:26:31.185706 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 96/182] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:31 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:26:31.191095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6f74a06-edd2-4983-b748-594dff8ce28b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-477607657", "name": "tempest-test_aggregate-110108726"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:31.194017 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.194017 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:31.195284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-f6f74a06-edd2-4983-b748-594dff8ce28b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid 627fd468-1144-4825-a7fe-4731e016004d for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:31.315158 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6f74a06-edd2-4983-b748-594dff8ce28b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.126729 Jul 01 10:26:31.325806 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 97/183] 10.222.0.23 () {60 vars in 1164 bytes} [Fri Jul 1 10:26:31 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:31.343153 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.343153 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.349936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.351677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:31.359888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:31.360601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:31.361574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:31.362201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:31.468683 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4390512-1f42-43ca-bd48-b5c39e692a9e tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 297 microversion: 2.41 time: 0.423879 Jul 01 10:26:31.469722 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 87/184] 10.222.0.23 () {62 vars in 1209 bytes} [Fri Jul 1 10:26:31 2022] PUT /compute/v2.1/os-aggregates/6 => generated 297 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:26:31.474660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17d47347-b6e7-4289-82d3-3a4ab02aec9e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.475705 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.475705 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.517050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:31.526795 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45b013d0-acef-4808-9127-24b14666603d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.186700 Jul 01 10:26:31.527884 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 98/185] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:31 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:31.532506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-795658c3-e9ac-4a64-b078-5d1b29be85e9 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.533512 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.533512 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:31.540818 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-795658c3-e9ac-4a64-b078-5d1b29be85e9 tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 297 microversion: 2.41 time: 0.011738 Jul 01 10:26:31.541390 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 99/186] 10.222.0.23 () {60 vars in 1189 bytes} [Fri Jul 1 10:26:31 2022] GET /compute/v2.1/os-aggregates/6 => generated 297 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:31.551500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d0efcbe-0956-49e9-a83a-bcc9da3e34dc tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:31.552719 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.552719 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:31.562493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d0efcbe-0956-49e9-a83a-bcc9da3e34dc tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:31.562941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d0efcbe-0956-49e9-a83a-bcc9da3e34dc tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:31.568051 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17d47347-b6e7-4289-82d3-3a4ab02aec9e tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.096735 Jul 01 10:26:31.568908 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 88/187] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:31 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:31.575807 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:31.577699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5f85de5-8000-42fb-8889-06ea40fa7ed9 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.579521 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.579521 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.587312 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d5f85de5-8000-42fb-8889-06ea40fa7ed9 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5f85de5-8000-42fb-8889-06ea40fa7ed9 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Request method failure captured: Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuo2Imp9mOFsicoq8J6_12dVABo_TQLo8x2gFNcYCVdjZv0y1Sbo3uAQ0SGHT52jdBQTYL7JqiFpCcfltgMUK9D6KC84xQeJt785mhQ1c2SgPE32SXwaoM0fNcLOX2WcNXcnJYdDX9xV7Ej_7k_xpx1tou2vhH0A6nUkvDsWTapfA0 Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:31.589712 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bcd8317d2b24817a6fd8ec6ffbabe9d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 14091372011e44b181c9f056938bb799 Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: exception: Aggregate 7 could not be found. Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7'} Jul 01 10:26:31.591110 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.592362 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 01 10:26:31.593592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.595472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5f85de5-8000-42fb-8889-06ea40fa7ed9 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:31.596404 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5f85de5-8000-42fb-8889-06ea40fa7ed9 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.022702 Jul 01 10:26:31.597333 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 89/188] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:26:31 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:26:31.609085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c34b86a3-b1c9-4125-96e7-db7115d6ca90 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.609918 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.609918 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.620935 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c34b86a3-b1c9-4125-96e7-db7115d6ca90 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c34b86a3-b1c9-4125-96e7-db7115d6ca90 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Request method failure captured: Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuo2Imp9mOFsicoq8J6_12dVABo_TQLo8x2gFNcYCVdjZv0y1Sbo3uAQ0SGHT52jdBQTYL7JqiFpCcfltgMUK9D6KC84xQeJt785mhQ1c2SgPE32SXwaoM0fNcLOX2WcNXcnJYdDX9xV7Ej_7k_xpx1tou2vhH0A6nUkvDsWTapfA0 Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:31.622614 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bcd8317d2b24817a6fd8ec6ffbabe9d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bcd8317d2b24817a6fd8ec6ffbabe9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7bcd8317d2b24817a6fd8ec6ffbabe9d Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-452888195 Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 14091372011e44b181c9f056938bb799 Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminTestJSON-452888195-project-admin Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: exception: Aggregate 7 could not be found. Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7'} Jul 01 10:26:31.624265 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:31.626029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:31.627569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c34b86a3-b1c9-4125-96e7-db7115d6ca90 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c34b86a3-b1c9-4125-96e7-db7115d6ca90 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.019311 Jul 01 10:26:31.629549 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 90/189] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:31 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:26:31.633870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-85fc8478-ab6d-4d22-b36e-3652d8ad8afc tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1530591193"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:31.639990 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.639990 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.639990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-85fc8478-ab6d-4d22-b36e-3652d8ad8afc tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid 7e6da2cd-4ba5-4cf0-a1dd-e071ead3921f for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:31.704311 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-85fc8478-ab6d-4d22-b36e-3652d8ad8afc tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073985 Jul 01 10:26:31.710809 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 91/190] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:31.715760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-015422e5-3154-4af5-bc1d-0ce45ffb32a7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.716537 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.716537 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.726336 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-015422e5-3154-4af5-bc1d-0ce45ffb32a7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.014367 Jul 01 10:26:31.726904 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 92/191] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:26:31 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:31.737933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7763614-a8c7-43c6-940a-3cfd8d125f06 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:31.739480 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.739480 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.854099 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7763614-a8c7-43c6-940a-3cfd8d125f06 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.119077 Jul 01 10:26:31.860658 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 93/192] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Jul 1 10:26:31 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:31.866673 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-92805f10-ed45-4bbf-abc5-3b433ee4b0c7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.867604 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.867604 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.878836 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-92805f10-ed45-4bbf-abc5-3b433ee4b0c7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.016658 Jul 01 10:26:31.878996 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d0efcbe-0956-49e9-a83a-bcc9da3e34dc tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 312 microversion: 2.41 time: 0.330758 Jul 01 10:26:31.889349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 100/193] 10.222.0.23 () {62 vars in 1231 bytes} [Fri Jul 1 10:26:31 2022] POST /compute/v2.1/os-aggregates/6/action => generated 312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:26:31.889491 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 94/194] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:26:31 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:31.894190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-441ce177-9c67-4db4-ae9e-46f1820ecc5f tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:31.895498 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.895498 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:31.898496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8449d389-1842-4b73-bbaa-08643146ebdf tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:31.899619 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:31.899619 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:31.905126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-441ce177-9c67-4db4-ae9e-46f1820ecc5f tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:31.905615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-441ce177-9c67-4db4-ae9e-46f1820ecc5f tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.022890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8449d389-1842-4b73-bbaa-08643146ebdf tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.130487 Jul 01 10:26:32.026009 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 95/195] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:31 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:32.041484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-537bd656-1dce-4497-9547-99100b281b9a req-f823adbb-0a70-4a36-88f3-1b6d9cbde5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4cab3c-78f9-4d96-910b-cdbe82e1964a", "tag": "caa4423a-fb8f-4925-bd22-d38cd8526da5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:32.071413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-537bd656-1dce-4497-9547-99100b281b9a req-f823adbb-0a70-4a36-88f3-1b6d9cbde5bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.071904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-537bd656-1dce-4497-9547-99100b281b9a req-f823adbb-0a70-4a36-88f3-1b6d9cbde5bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.096889 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-537bd656-1dce-4497-9547-99100b281b9a req-f823adbb-0a70-4a36-88f3-1b6d9cbde5bf service nova] Creating event network-changed:caa4423a-fb8f-4925-bd22-d38cd8526da5 for instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a on n-h2-master-1 Jul 01 10:26:32.119435 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-537bd656-1dce-4497-9547-99100b281b9a req-f823adbb-0a70-4a36-88f3-1b6d9cbde5bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085526 Jul 01 10:26:32.119435 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 96/196] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:32.126790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:32.127798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:32.138011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.138609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.139734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.140275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.157000 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] HTTP exception thrown: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Request method failure captured: Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 HTTP/1.1 Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsukYBCvDef396w1qqNe2qYVdL2dHaqJlFr6dhkpU_SVLA_5Q80n455R4E6HZ3taY4USwqtBSM7pKQ2os5ZWTI474gNIfzju6lj5XcY1qLOvEencqnOlQJPAjdCkWLMDpIfu1h2Qcf4HGr-EF9gp07WoM5sXhA954Q2kh2FdX4MvWw0 Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:32.158918 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09bf001745c54bcf8f59523da6e4228d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cd130c04538f4f9a94125c266a9cc362 Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:32.160353 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '63c01d5c-3c08-4d5e-b681-425d9872a475'} Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:32.161412 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:32.162740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:32.164945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Returning 404 to user: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:32.164945 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-833e3a2b-4ab6-491a-946a-4b6ca5a64ded tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 404 len: 111 microversion: 2.1 time: 0.041619 Jul 01 10:26:32.164945 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 97/197] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:32 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:32.168373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-56d8f1fb-8d24-4b3c-97f4-d4551dc61baa tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1752509779", "availability_zone": "tempest-test_az-885863137"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:32.189825 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:32.189825 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:32.190890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-56d8f1fb-8d24-4b3c-97f4-d4551dc61baa tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid dd0f5974-edfb-40df-a07c-f7145ce114ad for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:32.254340 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-441ce177-9c67-4db4-ae9e-46f1820ecc5f tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 297 microversion: 2.41 time: 0.363840 Jul 01 10:26:32.255933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 101/198] 10.222.0.23 () {62 vars in 1231 bytes} [Fri Jul 1 10:26:31 2022] POST /compute/v2.1/os-aggregates/6/action => generated 297 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:26:32.266812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b0dd77e-26be-4dad-b138-fa75952503ba tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:32.267918 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:32.267918 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:32.311948 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-56d8f1fb-8d24-4b3c-97f4-d4551dc61baa tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.147912 Jul 01 10:26:32.313637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 98/199] 10.222.0.23 () {60 vars in 1164 bytes} [Fri Jul 1 10:26:32 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:32.318326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-472042249", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:32.385916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:26:32.395403 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b0dd77e-26be-4dad-b138-fa75952503ba tempest-AggregatesAdminTestV241-1781543692 tempest-AggregatesAdminTestV241-1781543692-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.132243 Jul 01 10:26:32.401330 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 102/200] 10.222.0.23 () {60 vars in 1192 bytes} [Fri Jul 1 10:26:32 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:32.402724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a854e8a0-b678-4070-8ebb-a40b0673a430 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1752509779_new", "availability_zone": "tempest-test_az-885863137_new"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:32.493308 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:32.493308 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:32.617816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a854e8a0-b678-4070-8ebb-a40b0673a430 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.621188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a854e8a0-b678-4070-8ebb-a40b0673a430 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.669103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:26:32.669828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:26:32.670444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:26:32.671014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:26:32.671721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:26:32.685856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.686578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.687560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.688248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.708820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Getting quotas for project 09bf001745c54bcf8f59523da6e4228d. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:32.713815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Getting quotas for user cd130c04538f4f9a94125c266a9cc362 and project 09bf001745c54bcf8f59523da6e4228d. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:32.726186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:26:32.728814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:26:32.841855 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a854e8a0-b678-4070-8ebb-a40b0673a430 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.443504 Jul 01 10:26:32.845818 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 103/201] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:26:32 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:32.854328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aae127fa-fd70-472f-8ce1-a2b8956433ad tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f92a6e9d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:32.860390 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:32.860390 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:32.860390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae127fa-fd70-472f-8ce1-a2b8956433ad tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.860390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae127fa-fd70-472f-8ce1-a2b8956433ad tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.860390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae127fa-fd70-472f-8ce1-a2b8956433ad tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.860806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae127fa-fd70-472f-8ce1-a2b8956433ad tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.890786 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aae127fa-fd70-472f-8ce1-a2b8956433ad tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.042914 Jul 01 10:26:32.891965 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 104/202] 10.222.0.23 () {58 vars in 1127 bytes} [Fri Jul 1 10:26:32 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:32.897133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:32.897957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:32.905003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.905747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.906548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.907132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.926767 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-12f201e7-554b-4966-9c9a-7a703c8911e4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610726 Jul 01 10:26:32.946621 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 99/203] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:26:32.952300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:32.952920 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:32.961533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.962255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:32.963879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:32.965858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.214993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:33.227767 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46a562d8-2e47-4c15-b658-8c915b62c73f tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 200 len: 1589 microversion: 2.1 time: 0.280938 Jul 01 10:26:33.228531 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 100/204] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:32 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 1589 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:33.230215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:33.244547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1bad00e6-543b-40f5-9ee6-0b021d3df928 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.245451 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.245451 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:33.245991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-175bc10d-e156-4219-a1de-a918783365fc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.351217 Jul 01 10:26:33.252852 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1bad00e6-543b-40f5-9ee6-0b021d3df928 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.014421 Jul 01 10:26:33.253741 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 101/205] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:26:33 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.257942 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 105/206] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:32 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:33.262052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a64f65e5-47f9-4ed4-be41-96efbdcfb59c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f9293c040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.263328 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.263328 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:33.264466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a64f65e5-47f9-4ed4-be41-96efbdcfb59c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.272813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a64f65e5-47f9-4ed4-be41-96efbdcfb59c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.273029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a697efa-5177-41a1-9cae-99a0d5df7864 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.273029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a697efa-5177-41a1-9cae-99a0d5df7864 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:33.273629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a64f65e5-47f9-4ed4-be41-96efbdcfb59c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.273629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a64f65e5-47f9-4ed4-be41-96efbdcfb59c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.329618 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a64f65e5-47f9-4ed4-be41-96efbdcfb59c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.074595 Jul 01 10:26:33.335954 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 102/207] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:33 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.344650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-013df5f0-69fb-4048-82ab-f93517a622b7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.345766 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.345766 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:33.362693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a697efa-5177-41a1-9cae-99a0d5df7864 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:33.370196 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a697efa-5177-41a1-9cae-99a0d5df7864 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1219 microversion: 2.1 time: 0.109473 Jul 01 10:26:33.370819 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 106/208] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:33 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:33.384029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-424c724d-750a-432d-a6a1-dcd51d204d6a tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f92963ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.386299 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.386299 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:33.387940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-424c724d-750a-432d-a6a1-dcd51d204d6a tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.388403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-424c724d-750a-432d-a6a1-dcd51d204d6a tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.389987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-424c724d-750a-432d-a6a1-dcd51d204d6a tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.390122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-424c724d-750a-432d-a6a1-dcd51d204d6a tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.422984 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-424c724d-750a-432d-a6a1-dcd51d204d6a tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.044365 Jul 01 10:26:33.423593 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 107/209] 10.222.0.23 () {58 vars in 1127 bytes} [Fri Jul 1 10:26:33 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.428539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81a8d46f-f70a-4b52-85d4-d53030d840cd tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1017321800"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:33.429501 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.429501 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:33.430446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-81a8d46f-f70a-4b52-85d4-d53030d840cd tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid 1ef988bc-8ccd-4c14-8d79-e50a2f93aec7 for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:33.454556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-013df5f0-69fb-4048-82ab-f93517a622b7 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.117726 Jul 01 10:26:33.456767 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 103/210] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:33 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:33.461520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cd997a05-961d-4fcd-a504-07a26fb2a63c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f92946940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.462297 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.462297 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:33.480854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd997a05-961d-4fcd-a504-07a26fb2a63c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.481772 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd997a05-961d-4fcd-a504-07a26fb2a63c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.511579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd997a05-961d-4fcd-a504-07a26fb2a63c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.512024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd997a05-961d-4fcd-a504-07a26fb2a63c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.517714 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81a8d46f-f70a-4b52-85d4-d53030d840cd tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.092974 Jul 01 10:26:33.518621 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 108/211] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.528439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8df9b53f-316a-4501-aa9b-545f984dca9b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-889988843"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:33.529813 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.529813 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:33.530670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-8df9b53f-316a-4501-aa9b-545f984dca9b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Generated uuid 9477d240-c214-4648-8e90-178cad4879e4 for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:33.535034 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cd997a05-961d-4fcd-a504-07a26fb2a63c tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.077161 Jul 01 10:26:33.536131 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 104/212] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Jul 1 10:26:33 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 467 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.548187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-687a74d5-8362-4c16-b1c9-87ce46b199a9 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:33.549802 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.549802 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:33.559999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-687a74d5-8362-4c16-b1c9-87ce46b199a9 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.560738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-687a74d5-8362-4c16-b1c9-87ce46b199a9 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.677367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8df9b53f-316a-4501-aa9b-545f984dca9b tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.157677 Jul 01 10:26:33.678731 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 109/213] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.685459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64b9c7ce-b9d7-4708-bf9d-94ef9be5edb2 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Calling method '.version_select at 0x7f6f92b8b0d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.687547 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.687547 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:33.699332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b9c7ce-b9d7-4708-bf9d-94ef9be5edb2 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.700028 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b9c7ce-b9d7-4708-bf9d-94ef9be5edb2 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.730377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b9c7ce-b9d7-4708-bf9d-94ef9be5edb2 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:33.730887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b9c7ce-b9d7-4708-bf9d-94ef9be5edb2 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:33.766447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64b9c7ce-b9d7-4708-bf9d-94ef9be5edb2 tempest-HostsAdminTestJSON-170377137 tempest-HostsAdminTestJSON-170377137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.086497 Jul 01 10:26:33.767338 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 110/214] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Jul 1 10:26:33 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 467 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.772572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7cbebc73-528a-44fa-aa31-356fb066ad54 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.773824 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.773824 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:33.786261 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7cbebc73-528a-44fa-aa31-356fb066ad54 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 460 microversion: 2.1 time: 0.016916 Jul 01 10:26:33.787105 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 111/215] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:26:33 2022] GET /compute/v2.1/os-aggregates => generated 460 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.807909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d4cd67b-910a-4212-b7e6-52283b50fff6 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.809844 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.809844 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:33.961434 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-687a74d5-8362-4c16-b1c9-87ce46b199a9 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.424023 Jul 01 10:26:33.963753 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 105/216] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:33.964253 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d4cd67b-910a-4212-b7e6-52283b50fff6 tempest-AggregatesAdminTestJSON-452888195 tempest-AggregatesAdminTestJSON-452888195-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.169257 Jul 01 10:26:33.965091 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 112/217] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:33 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 01 10:26:33.979393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70331818-b608-4cd1-89ff-e52f324ee3b2 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:33.980423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:33.991703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:33.993086 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:33.993086 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:34.003631 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=7,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:34.009001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.011764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.015288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.015868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.016443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70331818-b608-4cd1-89ff-e52f324ee3b2 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.018993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70331818-b608-4cd1-89ff-e52f324ee3b2 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.028106 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:34.047705 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] HTTP exception thrown: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Request method failure captured: Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 HTTP/1.1 Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsulB2DRXB6VgRSilVKazYSinutAkv-9zmTb67MXOWeIMxpEARcBMdZz1vXP2lSMliqkl7SWNn4FVkUQPJbKS8iCFbIV0Lin5hx3maBiQu3BZM7Igy3O3L-usRqiWPcZTvbFsy7tHVMOORx3DvbrIt4kD6fPffAU4xmy9ECy4rHqnV8 Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8d92f0f11ec1407d99c417f17920d37d Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:34.049700 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8d92f0f11ec1407d99c417f17920d37d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8d92f0f11ec1407d99c417f17920d37d Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminTestJSON-1613727012-project Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: dc4aee1b97b944d981e1de6bb88f6dd4 Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminTestJSON-1613727012-project Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.050870 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '60268378-0b9e-479d-a21b-b273c292cf07'} Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:34.051503 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.052507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.057435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Returning 404 to user: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:34.058947 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e51c1011-90d3-4862-8e09-699e4092cc74 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "DELETE /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 404 len: 111 microversion: 2.1 time: 0.088386 Jul 01 10:26:34.059625 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 106/218] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:33 2022] DELETE /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:34.096132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:34.096132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] [instance: 60268378-0b9e-479d-a21b-b273c292cf07] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:34.096132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.096132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.096993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.097519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.115598 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-70331818-b608-4cd1-89ff-e52f324ee3b2 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] HTTP exception thrown: Aggregate 10 already has host n-h2-master-1. Jul 01 10:26:34.125411 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] HTTP exception thrown: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Request method failure captured: Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 HTTP/1.1 Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsulB2DRXB6VgRSilVKazYSinutAkv-9zmTb67MXOWeIMxpEARcBMdZz1vXP2lSMliqkl7SWNn4FVkUQPJbKS8iCFbIV0Lin5hx3maBiQu3BZM7Igy3O3L-usRqiWPcZTvbFsy7tHVMOORx3DvbrIt4kD6fPffAU4xmy9ECy4rHqnV8 Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8d92f0f11ec1407d99c417f17920d37d Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:34.127670 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8d92f0f11ec1407d99c417f17920d37d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d92f0f11ec1407d99c417f17920d37d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8d92f0f11ec1407d99c417f17920d37d Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1613727012 Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminTestJSON-1613727012-project Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: dc4aee1b97b944d981e1de6bb88f6dd4 Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminTestJSON-1613727012-project Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.128808 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '60268378-0b9e-479d-a21b-b273c292cf07'} Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:34.129577 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. Jul 01 10:26:34.130607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70331818-b608-4cd1-89ff-e52f324ee3b2 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 39 Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:34.131536 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: {"add_host": {"host": "n-h2-master-1"}} Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:34.132702 n-d-master-1 devstack@n-api.service[119764]: exception: Aggregate 10 already has host n-h2-master-1. Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result.read() Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 10:26:34.137416 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-master-1-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi session.flush() Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 10:26:34.138604 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 10:26:34.139583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 10:26:34.140523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result.read() Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-master-1-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 1, 10, 26, 34, 55328), 'updated_at': None, 'host': 'n-h2-master-1', 'aggregate_id': 10}] Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.141449 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 10 already has host n-h2-master-1. Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.142318 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 10 already has host n-h2-master-1. Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:34.143421 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:34.146895 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 already has host n-h2-master-1. Jul 01 10:26:34.146895 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:34.146895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70331818-b608-4cd1-89ff-e52f324ee3b2 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 409 to user: Aggregate 10 already has host n-h2-master-1. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:34.148539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] Returning 404 to user: Instance 60268378-0b9e-479d-a21b-b273c292cf07 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:34.150733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-70331818-b608-4cd1-89ff-e52f324ee3b2 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 409 len: 96 microversion: 2.1 time: 0.164272 Jul 01 10:26:34.153640 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 113/219] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 96 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 01 10:26:34.154617 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9af8d6d7-d833-4012-a7ae-9ed7dec65b18 tempest-AggregatesAdminTestJSON-1613727012 tempest-AggregatesAdminTestJSON-1613727012-project] 10.222.0.23 "GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07" status: 404 len: 111 microversion: 2.1 time: 0.073598 Jul 01 10:26:34.156345 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 107/220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:34 2022] GET /compute/v2.1/servers/60268378-0b9e-479d-a21b-b273c292cf07 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:34.162389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a050554-fb0f-4593-b42f-80b1f4d3765d tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:34.163686 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:34.163686 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:34.173681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a050554-fb0f-4593-b42f-80b1f4d3765d tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.179439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-54192cdf-1e89-4fb4-a42f-71c15dba0925 req-5befa796-8f69-4aa3-8f09-83bf5ef55501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671d0a80-8e15-49a6-8f16-eb2e010d24cc", "tag": "2cffdcd3-a5cd-424f-b85c-e885009b8f47"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:34.181134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a050554-fb0f-4593-b42f-80b1f4d3765d tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.198225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-54192cdf-1e89-4fb4-a42f-71c15dba0925 req-5befa796-8f69-4aa3-8f09-83bf5ef55501 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.198976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-54192cdf-1e89-4fb4-a42f-71c15dba0925 req-5befa796-8f69-4aa3-8f09-83bf5ef55501 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.212333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-54192cdf-1e89-4fb4-a42f-71c15dba0925 req-5befa796-8f69-4aa3-8f09-83bf5ef55501 service nova] Creating event network-changed:2cffdcd3-a5cd-424f-b85c-e885009b8f47 for instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc on n-h1-master-1 Jul 01 10:26:34.219616 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-54192cdf-1e89-4fb4-a42f-71c15dba0925 req-5befa796-8f69-4aa3-8f09-83bf5ef55501 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061363 Jul 01 10:26:34.220389 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 108/221] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:34.265830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:34.266528 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:34.281382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.283012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.284309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.284793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.444456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:34.454448 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e33766d-b88f-44e9-bedc-0a2353ae89c6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.193124 Jul 01 10:26:34.455216 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 109/222] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:34 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:34.459477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:34.460081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:34.466347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.466795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.467561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:34.467990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:34.508541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a050554-fb0f-4593-b42f-80b1f4d3765d tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.351856 Jul 01 10:26:34.509266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 114/223] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:34 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:34.523199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e13fdfdd-b9eb-45b9-9db6-236bc304c856 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:34.523980 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:34.523980 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:34.589092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:34.620576 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68d9526e-4976-461b-9f3d-60510076c524 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1223 microversion: 2.1 time: 0.162678 Jul 01 10:26:34.635169 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 110/224] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:34 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1223 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:34.651376 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e13fdfdd-b9eb-45b9-9db6-236bc304c856 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.133348 Jul 01 10:26:34.656047 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 115/225] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:34 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:34.671988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aaab02d8-36ac-47e1-ab73-f492fd2aa13d tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-241512916"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:34.673448 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:34.673448 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:34.674344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-aaab02d8-36ac-47e1-ab73-f492fd2aa13d tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid 55fd8011-d9cb-4be5-bce3-2984278b7978 for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:34.764547 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aaab02d8-36ac-47e1-ab73-f492fd2aa13d tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098634 Jul 01 10:26:34.769478 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 111/226] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:35.204026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-274a74e4-bffe-4b1a-86e1-12c19f8ff460 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:35.208033 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:35.208033 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:35.211767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-274a74e4-bffe-4b1a-86e1-12c19f8ff460 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd20f6740e89840018b95e820cca68f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50566fe20d5a49e88825d247eec72837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-274a74e4-bffe-4b1a-86e1-12c19f8ff460 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Request method failure captured: Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 39 Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsulPWcbsRkzdlz3uA54iziJ7FjvlT8wi8dQwOBFxGMRPiREmBZW9Kk9gyDa1ykrapP-NG3EIyx4cG2RaOC-LR26-_Uea4NiHjFeW-fkibcqIMhsYq81Sm88ZetngX_TEQvhOH69jUEepCwD8W5Y1SODqlk_3FdsFN_IAcHdSkLHYfs Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:35.218750 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/50566fe20d5a49e88825d247eec72837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_50566fe20d5a49e88825d247eec72837", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: d20f6740e89840018b95e820cca68f9d Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: {"add_host": {"host": "n-h2-master-1"}} Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:35.220973 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:35.222357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 01 10:26:35.224353 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.229190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-274a74e4-bffe-4b1a-86e1-12c19f8ff460 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:35.230837 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-274a74e4-bffe-4b1a-86e1-12c19f8ff460 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.458631 Jul 01 10:26:35.231782 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 116/227] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:34 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 460 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:35.242027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-24f87a59-6212-4b7e-8040-57a21f5aef6f tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:35.242776 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:35.242776 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:35.373848 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-24f87a59-6212-4b7e-8040-57a21f5aef6f tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.134692 Jul 01 10:26:35.373848 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 112/228] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:35 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:35.383943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-135d0bf5-929f-4f9b-a6e7-b1adda3aae5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-877318777"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:35.386589 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:35.386589 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:35.387715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-135d0bf5-929f-4f9b-a6e7-b1adda3aae5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid 867ef55e-9b55-46aa-bfbc-cf930a58ac77 for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:35.473654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:35.474924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:35.486832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:35.487498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:35.488421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:35.489115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:35.512028 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-135d0bf5-929f-4f9b-a6e7-b1adda3aae5a tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.133787 Jul 01 10:26:35.512612 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 117/229] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:35.522974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1130771041"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:35.524204 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:35.524204 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:35.535216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:35.535487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:35.543507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:35.544163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:35.552906 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1130771041 could not be found. Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 58 Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:35.555097 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: {"add_host": {"host": "tempest-nonexist_host-1130771041"}} Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:35.557529 n-d-master-1 devstack@n-api.service[119764]: exception: Compute host tempest-nonexist_host-1130771041 could not be found. Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1130771041'}}} Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1130771041' is not mapped to any cell Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.563317 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 01 10:26:35.564409 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1130771041 could not be found. Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1130771041 could not be found. Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.565631 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1130771041 could not be found. Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1130771041 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba3b0b48-a605-435d-8843-c0e69864a1fb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.038066 Jul 01 10:26:35.567509 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 118/230] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:35 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:26:35.569033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b297e08d-a8d9-4b74-a5c1-937bf2be8c5e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:35.569033 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:35.569033 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:35.680320 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b297e08d-a8d9-4b74-a5c1-937bf2be8c5e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.118138 Jul 01 10:26:35.681196 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 119/231] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:35 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 01 10:26:35.689292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:35.690146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:35.698527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:35.700225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:35.701392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:35.702068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:35.728810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:35.738286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-45782b74-2f16-4bc0-8130-95fd9c0c84bd tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.270241 Jul 01 10:26:35.739191 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 113/232] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:35 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:35.753753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4df1eb4-7555-4000-a4c1-da38e6cf34ba tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4df1eb4-7555-4000-a4c1-da38e6cf34ba tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 283 Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:35.757463 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:35.758781 n-d-master-1 devstack@n-api.service[119765]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:26:35.760077 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:26:35.760994 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:26:35.762795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:26:35.763658 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:26:35.763658 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.764695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4df1eb4-7555-4000-a4c1-da38e6cf34ba tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:35.766166 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4df1eb4-7555-4000-a4c1-da38e6cf34ba tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016228 Jul 01 10:26:35.767453 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 114/233] 10.222.0.23 () {60 vars in 1164 bytes} [Fri Jul 1 10:26:35 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:26:35.788148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-04170829-25ee-49fb-8674-5abd0699b9be tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-04170829-25ee-49fb-8674-5abd0699b9be tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 27 Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:35.794047 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: {"aggregate": {"name": ""}} Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:35.801248 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '' Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:35.802443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:26:35.804833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.807148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-04170829-25ee-49fb-8674-5abd0699b9be tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:35.807148 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-04170829-25ee-49fb-8674-5abd0699b9be tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019677 Jul 01 10:26:35.811535 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 115/234] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:35 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:26:35.831334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a780ef20-deff-4a0a-83fe-c6e8ba80513d tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-148382538"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:35.840317 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:35.840317 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:35.840317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a780ef20-deff-4a0a-83fe-c6e8ba80513d tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd20f6740e89840018b95e820cca68f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50566fe20d5a49e88825d247eec72837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a780ef20-deff-4a0a-83fe-c6e8ba80513d tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Request method failure captured: Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 59 Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsulPWcbsRkzdlz3uA54iziJ7FjvlT8wi8dQwOBFxGMRPiREmBZW9Kk9gyDa1ykrapP-NG3EIyx4cG2RaOC-LR26-_Uea4NiHjFeW-fkibcqIMhsYq81Sm88ZetngX_TEQvhOH69jUEepCwD8W5Y1SODqlk_3FdsFN_IAcHdSkLHYfs Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:35.841551 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/50566fe20d5a49e88825d247eec72837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_50566fe20d5a49e88825d247eec72837", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d20f6740e89840018b95e820cca68f9d Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: {"aggregate": {"name": "tempest-test_aggregate-148382538"}} Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:35.842983 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-148382538'}}} Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:35.843790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:35.845195 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 01 10:26:35.846501 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:35.846501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a780ef20-deff-4a0a-83fe-c6e8ba80513d tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:35.846501 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a780ef20-deff-4a0a-83fe-c6e8ba80513d tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.026310 Jul 01 10:26:35.847714 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 116/235] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:35 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:35.860758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d996492-d6f9-4a16-8d08-d758e1937bb6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1389583293"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:35.872023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-2d996492-d6f9-4a16-8d08-d758e1937bb6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid 010d636b-ce53-45de-a248-88d0f5d7c20a for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:35.911983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:35.922228 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da234c28-755f-4c35-bd4e-196d0b9a2ddd tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1271 microversion: 2.1 time: 0.239777 Jul 01 10:26:35.924104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 120/236] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:35 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:36.012727 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d996492-d6f9-4a16-8d08-d758e1937bb6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.162649 Jul 01 10:26:36.018055 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 117/237] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:36.027930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4f72782-aab6-4547-ac77-865fe33d3c67 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1389583293"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:36.030108 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.030108 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:36.033112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-f4f72782-aab6-4547-ac77-865fe33d3c67 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid ebeef867-b3af-4a7c-8e78-b9b26a988e68 for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:36.043065 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f4f72782-aab6-4547-ac77-865fe33d3c67 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1389583293 already exists. Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4f72782-aab6-4547-ac77-865fe33d3c67 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 60 Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:36.045430 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: {"aggregate": {"name": "tempest-test_aggregate-1389583293"}} Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:36.046955 n-d-master-1 devstack@n-api.service[119764]: exception: Aggregate tempest-test_aggregate-1389583293 already exists. Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1389583293'}}} Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 01 10:26:36.047652 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1389583293 already exists. Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:36.048616 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1389583293 already exists. Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1389583293 already exists. Jul 01 10:26:36.049670 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.051747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4f72782-aab6-4547-ac77-865fe33d3c67 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1389583293 already exists. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:36.052817 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4f72782-aab6-4547-ac77-865fe33d3c67 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.031936 Jul 01 10:26:36.054157 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 121/238] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:36 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 34 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:26:36.064533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1562b3bf-3e9c-4182-90b2-bc417d21339c tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.065321 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.065321 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:36.191639 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1562b3bf-3e9c-4182-90b2-bc417d21339c tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.129627 Jul 01 10:26:36.199430 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 118/239] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:36 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:36.212066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90192d30-dd57-4d07-985e-7a46188d5f4f tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-812983460"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:36.219096 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.219096 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:36.220337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-90192d30-dd57-4d07-985e-7a46188d5f4f tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid 43a72d6f-660e-4965-a14e-2d6d63df0cd0 for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:36.365198 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-90192d30-dd57-4d07-985e-7a46188d5f4f tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.164520 Jul 01 10:26:36.366625 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 119/240] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:36.377521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8fc653f2-3984-48cd-9b47-4af7089128e7 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.378558 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.378558 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:36.379392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8fc653f2-3984-48cd-9b47-4af7089128e7 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd20f6740e89840018b95e820cca68f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50566fe20d5a49e88825d247eec72837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8fc653f2-3984-48cd-9b47-4af7089128e7 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Request method failure captured: Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsulPWcbsRkzdlz3uA54iziJ7FjvlT8wi8dQwOBFxGMRPiREmBZW9Kk9gyDa1ykrapP-NG3EIyx4cG2RaOC-LR26-_Uea4NiHjFeW-fkibcqIMhsYq81Sm88ZetngX_TEQvhOH69jUEepCwD8W5Y1SODqlk_3FdsFN_IAcHdSkLHYfs Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:36.380959 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/50566fe20d5a49e88825d247eec72837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_50566fe20d5a49e88825d247eec72837", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d20f6740e89840018b95e820cca68f9d Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 01 10:26:36.382158 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '15'} Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:36.382861 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.383856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8fc653f2-3984-48cd-9b47-4af7089128e7 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:36.385920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8fc653f2-3984-48cd-9b47-4af7089128e7 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.009325 Jul 01 10:26:36.388339 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 120/241] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:26:36.393011 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-028dc01d-f635-401c-a13f-1f8fa19cee1f tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.446133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6e9162fc-4e76-4ddb-bf2e-11e5d85670e5 tempest-NetworksTest-2091652037 tempest-NetworksTest-2091652037-project-admin] Calling method '.version_select at 0x7f6f9261c280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.480715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-028dc01d-f635-401c-a13f-1f8fa19cee1f tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.090986 Jul 01 10:26:36.481858 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 121/242] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:36.492367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6320229-60fa-4bc5-822e-4161f0ffe730 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.494363 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.494363 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:36.517008 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a6320229-60fa-4bc5-822e-4161f0ffe730 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6320229-60fa-4bc5-822e-4161f0ffe730 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:36.519171 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: exception: Aggregate -1 could not be found. Jul 01 10:26:36.520579 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '-1'} Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 01 10:26:36.521364 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.522387 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6320229-60fa-4bc5-822e-4161f0ffe730 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a6320229-60fa-4bc5-822e-4161f0ffe730 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035642 Jul 01 10:26:36.523501 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 122/243] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:36 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:26:36.533725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c17721bf-3f09-4135-967e-ba4c70bbd172 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-863033179"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:36.535397 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.535397 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:36.536301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-c17721bf-3f09-4135-967e-ba4c70bbd172 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid b5538e95-78e2-4350-83cc-1a04b9fe2edb for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:36.684146 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c17721bf-3f09-4135-967e-ba4c70bbd172 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.153369 Jul 01 10:26:36.685375 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 123/244] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:36.695866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb371850-a9be-43d9-99a3-d5a51e6395cf tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.697703 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.697703 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eb371850-a9be-43d9-99a3-d5a51e6395cf tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd20f6740e89840018b95e820cca68f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50566fe20d5a49e88825d247eec72837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb371850-a9be-43d9-99a3-d5a51e6395cf tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Request method failure captured: Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsulPWcbsRkzdlz3uA54iziJ7FjvlT8wi8dQwOBFxGMRPiREmBZW9Kk9gyDa1ykrapP-NG3EIyx4cG2RaOC-LR26-_Uea4NiHjFeW-fkibcqIMhsYq81Sm88ZetngX_TEQvhOH69jUEepCwD8W5Y1SODqlk_3FdsFN_IAcHdSkLHYfs Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:36.703310 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/50566fe20d5a49e88825d247eec72837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_50566fe20d5a49e88825d247eec72837", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d20f6740e89840018b95e820cca68f9d Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 01 10:26:36.704631 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '16'} Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:36.705476 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 01 10:26:36.706494 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.708966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb371850-a9be-43d9-99a3-d5a51e6395cf tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:36.711030 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eb371850-a9be-43d9-99a3-d5a51e6395cf tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.018781 Jul 01 10:26:36.711993 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 124/245] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:36 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:36.726610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-209fba2c-d9d7-4188-9fd6-2acd89b758ca tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.734234 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.734234 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:36.840137 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-209fba2c-d9d7-4188-9fd6-2acd89b758ca tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.122066 Jul 01 10:26:36.841614 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 125/246] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:36 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:36.851986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.852705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:36.867295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:36.869981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:36.872141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:36.874947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:36.912546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6e9162fc-4e76-4ddb-bf2e-11e5d85670e5 tempest-NetworksTest-2091652037 tempest-NetworksTest-2091652037-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 4012 microversion: 2.1 time: 0.790221 Jul 01 10:26:36.913473 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 122/247] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:26:36 2022] GET /compute/v2.1/os-networks => generated 4012 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:36.918636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c921e4c2-11ad-4c50-8dca-061687a58ba6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:36.919391 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:36.919391 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:36.929484 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-c921e4c2-11ad-4c50-8dca-061687a58ba6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c921e4c2-11ad-4c50-8dca-061687a58ba6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:36.931352 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: exception: Aggregate -1 could not be found. Jul 01 10:26:36.932751 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '-1'} Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.933557 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 01 10:26:36.934581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:36.935523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c921e4c2-11ad-4c50-8dca-061687a58ba6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:36.935523 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c921e4c2-11ad-4c50-8dca-061687a58ba6 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018398 Jul 01 10:26:36.935523 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 123/248] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:26:36 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:26:36.938278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ed163422-cd5f-4b1d-923e-2e855b8dbe5d tempest-NetworksTest-2091652037 tempest-NetworksTest-2091652037-project-admin] Calling method '.version_select at 0x7f6f94efe790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:37.171947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:37.178917 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ed163422-cd5f-4b1d-923e-2e855b8dbe5d tempest-NetworksTest-2091652037 tempest-NetworksTest-2091652037-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/ad3f20c2-d831-42e1-81e8-72b2d1385618" status: 200 len: 652 microversion: 2.1 time: 0.243903 Jul 01 10:26:37.181908 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b6d3407-7156-481c-87b5-87b7d7254e67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.338573 Jul 01 10:26:37.184517 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 124/249] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:26:36 2022] GET /compute/v2.1/os-networks/ad3f20c2-d831-42e1-81e8-72b2d1385618 => generated 652 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:37.186834 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 126/250] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:36 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:37.197682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50b4e1db-86a2-4861-a90e-d6f4266aea5e tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:37.199260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:37.202532 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:37.202532 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:37.202733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:37.202823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50b4e1db-86a2-4861-a90e-d6f4266aea5e tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd20f6740e89840018b95e820cca68f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50566fe20d5a49e88825d247eec72837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50b4e1db-86a2-4861-a90e-d6f4266aea5e tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Request method failure captured: Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsulPWcbsRkzdlz3uA54iziJ7FjvlT8wi8dQwOBFxGMRPiREmBZW9Kk9gyDa1ykrapP-NG3EIyx4cG2RaOC-LR26-_Uea4NiHjFeW-fkibcqIMhsYq81Sm88ZetngX_TEQvhOH69jUEepCwD8W5Y1SODqlk_3FdsFN_IAcHdSkLHYfs Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:37.207048 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/50566fe20d5a49e88825d247eec72837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_50566fe20d5a49e88825d247eec72837", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d20f6740e89840018b95e820cca68f9d Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 01 10:26:37.208326 n-d-master-1 devstack@n-api.service[119765]: action_args: {} Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:37.208962 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:37.209989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50b4e1db-86a2-4861-a90e-d6f4266aea5e tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:37.210917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-50b4e1db-86a2-4861-a90e-d6f4266aea5e tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020473 Jul 01 10:26:37.210917 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 127/251] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:26:37 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:37.219144 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:37.223388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-338447d0-4f90-4bf5-847c-c5bdf24e7281 tempest-NetworksTest-2091652037 tempest-NetworksTest-2091652037-project-admin] Calling method '.version_select at 0x7f6f92bf2a60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:37.230264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:37.240468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:37.240468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:37.240468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:37.369822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:37.379947 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-16bed142-9052-4f98-8c2f-87850ebc3794 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1277 microversion: 2.1 time: 0.193286 Jul 01 10:26:37.381269 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 125/252] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:37 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:37.386413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0461a377-c01b-484e-8599-d9a281df9c1e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-532506834"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:37.388507 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:37.388507 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:37.397851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-0461a377-c01b-484e-8599-d9a281df9c1e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid 53953806-86a0-475b-910a-78964c6fb11e for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:37.516060 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-338447d0-4f90-4bf5-847c-c5bdf24e7281 tempest-NetworksTest-2091652037 tempest-NetworksTest-2091652037-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 4012 microversion: 2.1 time: 0.304539 Jul 01 10:26:37.517407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 128/253] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:26:37 2022] GET /compute/v2.1/os-networks => generated 4012 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:37.536106 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0461a377-c01b-484e-8599-d9a281df9c1e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.153576 Jul 01 10:26:37.537428 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 126/254] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:37.548431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cae16777-6034-40f7-b97b-bf68ae7295cb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:37.549688 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:37.549688 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:37.561110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cae16777-6034-40f7-b97b-bf68ae7295cb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:37.561798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cae16777-6034-40f7-b97b-bf68ae7295cb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:37.942557 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cae16777-6034-40f7-b97b-bf68ae7295cb tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.397695 Jul 01 10:26:37.950419 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 129/255] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:37.954533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdccdda0-3aa2-4f6f-8fb5-9885d2608454 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:37.955967 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:37.955967 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:37.956999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bdccdda0-3aa2-4f6f-8fb5-9885d2608454 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd20f6740e89840018b95e820cca68f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50566fe20d5a49e88825d247eec72837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdccdda0-3aa2-4f6f-8fb5-9885d2608454 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Request method failure captured: Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 42 Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsulPWcbsRkzdlz3uA54iziJ7FjvlT8wi8dQwOBFxGMRPiREmBZW9Kk9gyDa1ykrapP-NG3EIyx4cG2RaOC-LR26-_Uea4NiHjFeW-fkibcqIMhsYq81Sm88ZetngX_TEQvhOH69jUEepCwD8W5Y1SODqlk_3FdsFN_IAcHdSkLHYfs Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:37.959046 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/50566fe20d5a49e88825d247eec72837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_50566fe20d5a49e88825d247eec72837", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/50566fe20d5a49e88825d247eec72837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 50566fe20d5a49e88825d247eec72837 Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763 Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: d20f6740e89840018b95e820cca68f9d Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1787921763-project Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: {"remove_host": {"host": "n-h2-master-1"}} Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:37.960186 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-master-1'}}} Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:37.960884 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 01 10:26:37.961904 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:37.964246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdccdda0-3aa2-4f6f-8fb5-9885d2608454 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:37.965440 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bdccdda0-3aa2-4f6f-8fb5-9885d2608454 tempest-AggregatesAdminNegativeTestJSON-1787921763 tempest-AggregatesAdminNegativeTestJSON-1787921763-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.014885 Jul 01 10:26:37.966335 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 127/256] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:26:37.984049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2ccb2a2-c52f-41e7-8998-57279a0f5b99 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:37.985437 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:37.985437 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:37.996179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2ccb2a2-c52f-41e7-8998-57279a0f5b99 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:37.996723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2ccb2a2-c52f-41e7-8998-57279a0f5b99 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.200481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:38.202219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:38.208590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:38.209123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.209951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:38.210399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.413123 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2ccb2a2-c52f-41e7-8998-57279a0f5b99 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.434918 Jul 01 10:26:38.414590 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 130/257] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:38.420786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:38.421684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:38.430244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:38.433306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.433306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:38.433306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.640181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:38.657599 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bb7064c9-0109-46ae-8b1e-f8b590b33eb8 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.461556 Jul 01 10:26:38.658460 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 128/258] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:38 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:38.662815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fe964a1b-339a-45ba-8a4a-beca34ca74c1 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:38.663575 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:38.663575 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:38.763190 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fe964a1b-339a-45ba-8a4a-beca34ca74c1 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.103657 Jul 01 10:26:38.764163 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 129/259] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:38 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:38.784086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e34c06ac-6156-4626-93a3-2a555eae570e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1572291357"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:38.785621 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:38.785621 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:38.786655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.aggregate [None req-e34c06ac-6156-4626-93a3-2a555eae570e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Generated uuid 175339e4-8107-410f-a684-d8f73910a1ce for aggregate {{(pid=119764) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 10:26:38.810649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:38.818335 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ce0e4273-33dd-43c1-a1a8-59ae80090b89 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.402381 Jul 01 10:26:38.819253 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 131/260] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:38 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:38.847554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-50f43518-3d12-4fc4-848a-57d3af25a9f0 req-5aa4ea5c-e97c-41b2-9da8-84ef3cf1937d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4cab3c-78f9-4d96-910b-cdbe82e1964a", "name": "network-vif-plugged", "status": "completed", "tag": "caa4423a-fb8f-4925-bd22-d38cd8526da5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:38.858123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-50f43518-3d12-4fc4-848a-57d3af25a9f0 req-5aa4ea5c-e97c-41b2-9da8-84ef3cf1937d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:38.858589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-50f43518-3d12-4fc4-848a-57d3af25a9f0 req-5aa4ea5c-e97c-41b2-9da8-84ef3cf1937d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.872560 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-50f43518-3d12-4fc4-848a-57d3af25a9f0 req-5aa4ea5c-e97c-41b2-9da8-84ef3cf1937d service nova] Creating event network-vif-plugged:caa4423a-fb8f-4925-bd22-d38cd8526da5 for instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a on n-h2-master-1 Jul 01 10:26:38.878672 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-50f43518-3d12-4fc4-848a-57d3af25a9f0 req-5aa4ea5c-e97c-41b2-9da8-84ef3cf1937d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036245 Jul 01 10:26:38.879130 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 132/261] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:38.897089 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e34c06ac-6156-4626-93a3-2a555eae570e tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.118654 Jul 01 10:26:38.904983 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 130/262] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 10:26:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:38.914690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:38.923085 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:38.923085 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:38.953348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:38.954788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.977255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:38.978390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:38.994394 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.compute.aggregates [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 01 10:26:38.995828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Request method failure captured: Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 42 Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsuoRqUY1s_BNvHeyC4cyt6OtNYQs9dvQn7vgg3t9FTe6s-kiSlBIg5MYzlzxC-YKXt7_hzbQbl_cD6tiiWR-Af2py9-L-aZMTW6ULBSErrfUUUoGrfG0PMl9PeaGrvZpy0OY5Se705XUJ8Ey3sOcfzHBNZ9dF9AIybZ_-zasM5SMvg Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:39.002702 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9712b81b9b6d462d904c8ce032e9bbb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9712b81b9b6d462d904c8ce032e9bbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 9712b81b9b6d462d904c8ce032e9bbb4 Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-188522257 Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7e60e744ccda46b8a8f2a75ba451829d Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: {"remove_host": {"host": "nonexist_host"}} Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:39.004224 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 01 10:26:39.005083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 01 10:26:39.006425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.007735 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f269776-be6e-4c2c-ab7d-fb36fd1da59b tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.095214 Jul 01 10:26:39.009009 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 133/263] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 10:26:38 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:26:39.014764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ebf24561-65a5-490d-afe5-ffc48a1d9755 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:39.015551 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:39.015551 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:39.121723 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ebf24561-65a5-490d-afe5-ffc48a1d9755 tempest-AggregatesAdminNegativeTestJSON-188522257 tempest-AggregatesAdminNegativeTestJSON-188522257-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.110806 Jul 01 10:26:39.122314 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 131/264] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:26:39 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:26:39.344871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a68affef-9e26-4529-a4e8-baf35a344a0e req-5328f290-3b19-4995-b7c7-ef536c7fed05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9e8233d-6667-4e9f-b6ba-0626378e5a5f", "tag": "9bd2db0e-3715-477a-9ebc-1c4ee77cff3d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:39.354915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a68affef-9e26-4529-a4e8-baf35a344a0e req-5328f290-3b19-4995-b7c7-ef536c7fed05 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:39.355341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a68affef-9e26-4529-a4e8-baf35a344a0e req-5328f290-3b19-4995-b7c7-ef536c7fed05 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:39.370292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a68affef-9e26-4529-a4e8-baf35a344a0e req-5328f290-3b19-4995-b7c7-ef536c7fed05 service nova] Creating event network-changed:9bd2db0e-3715-477a-9ebc-1c4ee77cff3d for instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f on n-h1-master-1 Jul 01 10:26:39.376151 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a68affef-9e26-4529-a4e8-baf35a344a0e req-5328f290-3b19-4995-b7c7-ef536c7fed05 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037019 Jul 01 10:26:39.377303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 134/265] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:39.674601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:39.675207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:39.683436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:39.683927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:39.684696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:39.685134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:39.838434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:39.839282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:39.846275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:39.846703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:39.847471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:39.847899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:40.204022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:40.214471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:40.217308 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56c727a2-9648-41bd-bf22-d1cd9a4e63af tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1316 microversion: 2.1 time: 0.546831 Jul 01 10:26:40.218130 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 132/266] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:39 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:40.218855 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d8fdc8eb-7b58-4c50-99b0-f05e0e29415e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.385542 Jul 01 10:26:40.219433 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 135/267] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:39 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:41.235500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:41.236090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:41.236642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:41.237634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:41.243907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.244067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.244680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.248766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.248903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.249003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.249092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.249199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.448354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:41.449234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:41.456408 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-92652428-1492-4e37-bb40-c4392326ade1 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1505 microversion: 2.1 time: 0.225359 Jul 01 10:26:41.456979 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 133/268] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:41 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:41.458251 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-873a3f50-667e-467d-a1ee-ebb2f423e861 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.226499 Jul 01 10:26:41.458819 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 136/269] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:41 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:41.473409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:41.473899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:41.480368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.481000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.481804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.482255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.507555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:26:41.543444 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:41.775335 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01f7baba-21d1-4bf4-acb6-27c8f8688c52 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 204 len: 0 microversion: 2.1 time: 0.304836 Jul 01 10:26:41.776160 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 134/270] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:41 2022] DELETE /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:26:41.784088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:41.784697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:41.790701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.791143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.791892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:41.792324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:41.928003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:41.936484 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec53fa4f-9756-4d8a-b3b3-9f83907b5474 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1511 microversion: 2.1 time: 0.156172 Jul 01 10:26:41.937054 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 137/271] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:41 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:42.428819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2038826613", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:42.476960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:42.478792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:42.486915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:42.487528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:42.488656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:42.489267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:42.517854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:26:42.720928 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=38 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:42.791455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:42.801055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48d090a6-33b0-4904-8242-52e2d2ddd14d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.329326 Jul 01 10:26:42.801667 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:42 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:42.858140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:26:42.858553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:26:42.860152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:26:42.860152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:26:42.860152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:26:42.870824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:42.871270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:42.872103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:42.872537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:42.894080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:42.898806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:42.913674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:26:42.916951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:26:43.051727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-861bcb09-dd64-427f-af92-2c35f4f62d99 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069476 Jul 01 10:26:43.057714 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 135/273] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:26:43.058469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:43.059287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:43.068982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:43.069444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:43.070216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:43.070640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:43.119839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7cc4b3b2-d787-4bcb-aca4-25375e9052c6 tempest-AZAdminNegativeTestJSON-1549524737 tempest-AZAdminNegativeTestJSON-1549524737-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:43.120745 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:43.120745 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:43.126770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7cc4b3b2-d787-4bcb-aca4-25375e9052c6 tempest-AZAdminNegativeTestJSON-1549524737 tempest-AZAdminNegativeTestJSON-1549524737-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c65f19306b7d44e6aa295c50b94f8f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ea9285cc6c4adabf37bb12703b1ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7cc4b3b2-d787-4bcb-aca4-25375e9052c6 tempest-AZAdminNegativeTestJSON-1549524737 tempest-AZAdminNegativeTestJSON-1549524737-project] Request method failure captured: Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvg3tpzFC52K8WmkDeA176PkjUetj7yEeP4fMQnSBO88_G65g-WJE2VMC28QwPBuxYxHCUMHRi2ascnLgzHDgNbN6mBXBPgyKSzMwPR61sHmuOGWXFmDOFYQ8Wfk9iL2jwXRYim7qeykGTCpopg93P-n73E9vmZzHpommRzhM0eJLw Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 71ea9285cc6c4adabf37bb12703b1ad3 Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1549524737 Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:43.128711 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71ea9285cc6c4adabf37bb12703b1ad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/71ea9285cc6c4adabf37bb12703b1ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_71ea9285cc6c4adabf37bb12703b1ad3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/71ea9285cc6c4adabf37bb12703b1ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AZAdminNegativeTestJSON-1549524737 Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 71ea9285cc6c4adabf37bb12703b1ad3 Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1549524737 Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AZAdminNegativeTestJSON-1549524737-project Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c65f19306b7d44e6aa295c50b94f8f34 Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AZAdminNegativeTestJSON-1549524737-project Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 01 10:26:43.129927 n-d-master-1 devstack@n-api.service[119765]: action_args: {} Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:43.130598 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:43.131607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7cc4b3b2-d787-4bcb-aca4-25375e9052c6 tempest-AZAdminNegativeTestJSON-1549524737 tempest-AZAdminNegativeTestJSON-1549524737-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:43.132534 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7cc4b3b2-d787-4bcb-aca4-25375e9052c6 tempest-AZAdminNegativeTestJSON-1549524737 tempest-AZAdminNegativeTestJSON-1549524737-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.327345 Jul 01 10:26:43.132534 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 139/274] 10.222.0.23 () {58 vars in 1184 bytes} [Fri Jul 1 10:26:42 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 328 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:43.264166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:43.281396 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa416ac3-8b9a-4db5-96e8-ebec44471d5d tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1511 microversion: 2.1 time: 0.217553 Jul 01 10:26:43.281396 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 136/275] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:43 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:43.281396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-460c0dba-8cc0-4b19-90db-f72806f2a869 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:43.281396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-460c0dba-8cc0-4b19-90db-f72806f2a869 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:43.330042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-460c0dba-8cc0-4b19-90db-f72806f2a869 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:43.336802 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-460c0dba-8cc0-4b19-90db-f72806f2a869 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1217 microversion: 2.1 time: 0.063907 Jul 01 10:26:43.337421 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 137/276] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:43 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:43.770011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6cb001f5-1f1a-4000-900d-3ff0983b5a4d req-60e59410-8eb8-4bcf-af28-7d410094999a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4cab3c-78f9-4d96-910b-cdbe82e1964a", "name": "network-vif-deleted", "tag": "caa4423a-fb8f-4925-bd22-d38cd8526da5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:43.778570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6cb001f5-1f1a-4000-900d-3ff0983b5a4d req-60e59410-8eb8-4bcf-af28-7d410094999a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:43.779061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6cb001f5-1f1a-4000-900d-3ff0983b5a4d req-60e59410-8eb8-4bcf-af28-7d410094999a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:43.796092 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6cb001f5-1f1a-4000-900d-3ff0983b5a4d req-60e59410-8eb8-4bcf-af28-7d410094999a service nova] Creating event network-vif-deleted:caa4423a-fb8f-4925-bd22-d38cd8526da5 for instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a on n-h2-master-1 Jul 01 10:26:43.798339 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6cb001f5-1f1a-4000-900d-3ff0983b5a4d req-60e59410-8eb8-4bcf-af28-7d410094999a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031607 Jul 01 10:26:43.799687 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 138/277] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:43.826383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:43.827249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:43.836473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:43.836925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:43.837774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:43.838206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:43.992442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:44.000924 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51826f44-fd61-4cd2-8d10-ea86031f7ea1 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.179728 Jul 01 10:26:44.002209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 139/278] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:43 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:44.023408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1709666360", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:44.110516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:26:44.301299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:44.301299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:44.301299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:44.304900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:44.306525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:44.310997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:44.364420 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:26:44.365773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:26:44.367097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:26:44.367754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:26:44.368813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:26:44.373308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:44.373308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:44.373308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lazy-loading 'fault' on Instance uuid 6a4cab3c-78f9-4d96-910b-cdbe82e1964a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:26:44.382654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:44.383483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:44.384976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:44.385988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:44.395919 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=11 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:44.428893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:44.434425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for user 0dcb8296a8934a8cbc89d6df73d4a526 and project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:44.448736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:26:44.449979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568b383bb8fc4759bfa3bc87528cf761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee68fc7093d488cb454028927c6a20b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:44.451335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:26:44.462695 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99b5312a-8163-4b93-b9a1-f8ee5c46714e tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 200 len: 1306 microversion: 2.1 time: 0.173195 Jul 01 10:26:44.463769 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 140/279] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:44 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 1306 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:44.468722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cfc85071-cf1d-4467-9ab8-08fcd815e70e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:44.469527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cfc85071-cf1d-4467-9ab8-08fcd815e70e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:44.527551 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:44.551055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cfc85071-cf1d-4467-9ab8-08fcd815e70e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:44.558566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cfc85071-cf1d-4467-9ab8-08fcd815e70e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1217 microversion: 2.1 time: 0.093446 Jul 01 10:26:44.559457 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 141/280] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:44 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:44.654057 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b5f3048e-8376-4c12-99f2-5bfb05f27a56 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.521587 Jul 01 10:26:44.657233 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 140/281] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:26:44.665349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-039756e3-07d6-4aed-9efa-86dbcb2abf44 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:44.666223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-039756e3-07d6-4aed-9efa-86dbcb2abf44 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:44.753218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-039756e3-07d6-4aed-9efa-86dbcb2abf44 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:44.763082 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-039756e3-07d6-4aed-9efa-86dbcb2abf44 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1213 microversion: 2.1 time: 0.101638 Jul 01 10:26:44.765407 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 142/282] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:44 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:45.020975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:45.021915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:45.040503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.042874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.044962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.045599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.202726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:45.219981 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87c4ee32-8f5c-4902-8575-34ef0392e17f tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.200994 Jul 01 10:26:45.219981 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 141/283] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:45 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:45.480793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:45.481499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:45.487665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.488110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.488898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.489357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.519484 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] HTTP exception thrown: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Request method failure captured: Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a HTTP/1.1 Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvQXLbILNAwvKktDxaGubJeB0o5gQLQGHVI7Lq9PFQxfOiUNJebtMlZhIkbCHcwmFMiW143ykYRVzZDTYOqhyhvivSM041RRH-sLdx926eACEo1jF3ddNVk1f3eiQGRdqQUDRm4NVMQUqhGTgXysag1nY5Hra9CQ45FdH4V8_DPH9M Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:45.522036 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ee68fc7093d488cb454028927c6a20b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 568b383bb8fc4759bfa3bc87528cf761 Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.523288 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6a4cab3c-78f9-4d96-910b-cdbe82e1964a'} Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:45.524016 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.526451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.527958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Returning 404 to user: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:45.527958 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a1c55da-69c1-40cd-ad8f-cb7edaa068dc tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 404 len: 111 microversion: 2.1 time: 0.047058 Jul 01 10:26:45.527958 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 143/284] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:45 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:45.533911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-65396178", "metadata": {"image_type": "test"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:45.535160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:45.543086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.543710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.544495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.545039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.561238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] HTTP exception thrown: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Request method failure captured: Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a/action HTTP/1.1 Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 110 Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvQXLbILNAwvKktDxaGubJeB0o5gQLQGHVI7Lq9PFQxfOiUNJebtMlZhIkbCHcwmFMiW143ykYRVzZDTYOqhyhvivSM041RRH-sLdx926eACEo1jF3ddNVk1f3eiQGRdqQUDRm4NVMQUqhGTgXysag1nY5Hra9CQ45FdH4V8_DPH9M Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:45.563562 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ee68fc7093d488cb454028927c6a20b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 568b383bb8fc4759bfa3bc87528cf761 Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-65396178", "metadata": {"image_type": "test"}}} Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:45.564970 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '6a4cab3c-78f9-4d96-910b-cdbe82e1964a', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-65396178', 'metadata': {'image_type': 'test'}}}} Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.566372 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.567391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.568764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:45.568764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:45.568764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.568764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.568764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Returning 404 to user: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:45.568764 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d3974175-5460-4856-af43-754fc82d0154 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "POST /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a/action" status: 404 len: 111 microversion: 2.1 time: 0.036256 Jul 01 10:26:45.568764 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 142/285] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Jul 1 10:26:45 2022] POST /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:45.576397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:45.577454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:45.579012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77f6b588-0c6a-43e4-91c7-a246b4b16223 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1480417557", "metadata": {"image_type": "test"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:45.580218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77f6b588-0c6a-43e4-91c7-a246b4b16223 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Failed to fetch instance by id tempest-invalid-724039034 {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 01 10:26:45.580764 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-77f6b588-0c6a-43e4-91c7-a246b4b16223 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] HTTP exception thrown: Instance tempest-invalid-724039034 could not be found. Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77f6b588-0c6a-43e4-91c7-a246b4b16223 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Request method failure captured: Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/tempest-invalid-724039034/action HTTP/1.1 Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 112 Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvQXLbILNAwvKktDxaGubJeB0o5gQLQGHVI7Lq9PFQxfOiUNJebtMlZhIkbCHcwmFMiW143ykYRVzZDTYOqhyhvivSM041RRH-sLdx926eACEo1jF3ddNVk1f3eiQGRdqQUDRm4NVMQUqhGTgXysag1nY5Hra9CQ45FdH4V8_DPH9M Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:45.586594 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ee68fc7093d488cb454028927c6a20b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 568b383bb8fc4759bfa3bc87528cf761 Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1480417557", "metadata": {"image_type": "test"}}} Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:45.588444 n-d-master-1 devstack@n-api.service[119765]: exception: Instance tempest-invalid-724039034 could not be found. Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'tempest-invalid-724039034', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1480417557', 'metadata': {'image_type': 'test'}}}} Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-724039034 could not be found. Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.589140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-724039034 could not be found. Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-724039034 could not be found. Jul 01 10:26:45.590267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.591281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77f6b588-0c6a-43e4-91c7-a246b4b16223 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Returning 404 to user: Instance tempest-invalid-724039034 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:45.591281 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77f6b588-0c6a-43e4-91c7-a246b4b16223 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-724039034/action" status: 404 len: 100 microversion: 2.1 time: 0.014329 Jul 01 10:26:45.595824 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 143/286] 10.222.0.23 () {60 vars in 1245 bytes} [Fri Jul 1 10:26:45 2022] POST /compute/v2.1/servers/tempest-invalid-724039034/action => generated 100 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:45.597811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.598432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.601464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.601947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69d8bf08-0263-4d5b-ac4a-061ac1b9f528 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-945214405"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:45.603476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.603646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-69d8bf08-0263-4d5b-ac4a-061ac1b9f528 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 01 10:26:45.604362 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-69d8bf08-0263-4d5b-ac4a-061ac1b9f528 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69d8bf08-0263-4d5b-ac4a-061ac1b9f528 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Request method failure captured: Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 56 Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvQXLbILNAwvKktDxaGubJeB0o5gQLQGHVI7Lq9PFQxfOiUNJebtMlZhIkbCHcwmFMiW143ykYRVzZDTYOqhyhvivSM041RRH-sLdx926eACEo1jF3ddNVk1f3eiQGRdqQUDRm4NVMQUqhGTgXysag1nY5Hra9CQ45FdH4V8_DPH9M Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:45.606763 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ee68fc7093d488cb454028927c6a20b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 568b383bb8fc4759bfa3bc87528cf761 Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: {"createImage": {"name": "tempest-test-snap-945214405"}} Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:45.608244 n-d-master-1 devstack@n-api.service[119765]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-945214405'}}} Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.609135 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.610468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.613287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69d8bf08-0263-4d5b-ac4a-061ac1b9f528 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:45.614364 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-69d8bf08-0263-4d5b-ac4a-061ac1b9f528 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017102 Jul 01 10:26:45.620074 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 144/287] 10.222.0.23 () {60 vars in 1274 bytes} [Fri Jul 1 10:26:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:45.635314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1ed4b7d6-6afc-4afb-8f46-f10eb6acdca6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-160042469"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:45.636657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1ed4b7d6-6afc-4afb-8f46-f10eb6acdca6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 01 10:26:45.644831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-1ed4b7d6-6afc-4afb-8f46-f10eb6acdca6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1ed4b7d6-6afc-4afb-8f46-f10eb6acdca6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Request method failure captured: Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 56 Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvQXLbILNAwvKktDxaGubJeB0o5gQLQGHVI7Lq9PFQxfOiUNJebtMlZhIkbCHcwmFMiW143ykYRVzZDTYOqhyhvivSM041RRH-sLdx926eACEo1jF3ddNVk1f3eiQGRdqQUDRm4NVMQUqhGTgXysag1nY5Hra9CQ45FdH4V8_DPH9M Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:45.647067 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ee68fc7093d488cb454028927c6a20b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 568b383bb8fc4759bfa3bc87528cf761 Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: {"createImage": {"name": "tempest-test-snap-160042469"}} Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:45.648220 n-d-master-1 devstack@n-api.service[119765]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-160042469'}}} Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.649037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 01 10:26:45.650668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.653183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1ed4b7d6-6afc-4afb-8f46-f10eb6acdca6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:45.654506 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1ed4b7d6-6afc-4afb-8f46-f10eb6acdca6 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.023044 Jul 01 10:26:45.656866 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 145/288] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Jul 1 10:26:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:45.672538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:45.673455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:45.680033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.680609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.681944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.682633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.696964 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] HTTP exception thrown: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Request method failure captured: Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a HTTP/1.1 Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvQXLbILNAwvKktDxaGubJeB0o5gQLQGHVI7Lq9PFQxfOiUNJebtMlZhIkbCHcwmFMiW143ykYRVzZDTYOqhyhvivSM041RRH-sLdx926eACEo1jF3ddNVk1f3eiQGRdqQUDRm4NVMQUqhGTgXysag1nY5Hra9CQ45FdH4V8_DPH9M Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:45.698978 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ee68fc7093d488cb454028927c6a20b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 568b383bb8fc4759bfa3bc87528cf761 Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.700142 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '6a4cab3c-78f9-4d96-910b-cdbe82e1964a'} Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:45.700786 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.701992 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.704567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Returning 404 to user: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:45.705684 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7c92248e-1ad5-4377-82c3-8491fcaaff29 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 404 len: 111 microversion: 2.1 time: 0.038580 Jul 01 10:26:45.706431 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 146/289] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:45 2022] DELETE /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:26:45.733600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:45.734483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] [instance: 6a4cab3c-78f9-4d96-910b-cdbe82e1964a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:45.742323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.743196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.744259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:45.744909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:45.763634 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] HTTP exception thrown: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Request method failure captured: Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a HTTP/1.1 Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvQXLbILNAwvKktDxaGubJeB0o5gQLQGHVI7Lq9PFQxfOiUNJebtMlZhIkbCHcwmFMiW143ykYRVzZDTYOqhyhvivSM041RRH-sLdx926eACEo1jF3ddNVk1f3eiQGRdqQUDRm4NVMQUqhGTgXysag1nY5Hra9CQ45FdH4V8_DPH9M Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:45.765960 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ee68fc7093d488cb454028927c6a20b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ee68fc7093d488cb454028927c6a20b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3ee68fc7093d488cb454028927c6a20b Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-356391446 Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 568b383bb8fc4759bfa3bc87528cf761 Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesNegativeTestJSON-356391446-project Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.767158 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '6a4cab3c-78f9-4d96-910b-cdbe82e1964a'} Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:45.767826 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. Jul 01 10:26:45.768857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:45.771501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] Returning 404 to user: Instance 6a4cab3c-78f9-4d96-910b-cdbe82e1964a could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:45.772627 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81eee20b-905a-45cc-961c-0ef14fa1ab67 tempest-ImagesNegativeTestJSON-356391446 tempest-ImagesNegativeTestJSON-356391446-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a" status: 404 len: 111 microversion: 2.1 time: 0.055797 Jul 01 10:26:45.778427 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 147/290] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:45 2022] GET /compute/v2.1/servers/6a4cab3c-78f9-4d96-910b-cdbe82e1964a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:45.784574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-998488cf-cbef-49b0-ac8f-f4fb5ae8ebbc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:45.792566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-998488cf-cbef-49b0-ac8f-f4fb5ae8ebbc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:45.798386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:45.820312 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25490aca-06d3-4316-bf73-c5f520f1c1f6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1269 microversion: 2.1 time: 0.241083 Jul 01 10:26:45.830165 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 144/291] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:45 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:45.882207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-998488cf-cbef-49b0-ac8f-f4fb5ae8ebbc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:45.891920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-998488cf-cbef-49b0-ac8f-f4fb5ae8ebbc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1213 microversion: 2.1 time: 0.112137 Jul 01 10:26:45.901348 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 148/292] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:45 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:46.234484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:46.235002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:46.244522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:46.251615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:46.251615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:46.251615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:46.472500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:46.480956 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1688927-f82d-4e2c-b588-d94711b3503e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.250762 Jul 01 10:26:46.497652 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 145/293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:46 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:46.846470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:46.848027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:46.857192 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:46.858132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:46.864245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:46.872547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:46.921882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:46.921882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:46.947491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:46.952975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:46.952975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:46.952975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:47.099728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:47.169122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:47.178085 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d2a525a-206d-409d-840a-aec3d5a25b40 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1275 microversion: 2.1 time: 0.299874 Jul 01 10:26:47.182010 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 149/294] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:46 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:47.206508 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a7377968-f8c0-4ec6-bac0-5330a37d6bd2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1265 microversion: 2.1 time: 0.292952 Jul 01 10:26:47.210765 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 146/295] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:46 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:47.380808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3991b573-971a-4f31-b52f-937a469055ab req-e9bb7b31-92fe-4d23-990f-e71e1a590375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e8233d-6667-4e9f-b6ba-0626378e5a5f", "name": "network-vif-plugged", "status": "completed", "tag": "9bd2db0e-3715-477a-9ebc-1c4ee77cff3d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:47.405622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3991b573-971a-4f31-b52f-937a469055ab req-e9bb7b31-92fe-4d23-990f-e71e1a590375 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:47.410451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3991b573-971a-4f31-b52f-937a469055ab req-e9bb7b31-92fe-4d23-990f-e71e1a590375 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:47.426402 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3991b573-971a-4f31-b52f-937a469055ab req-e9bb7b31-92fe-4d23-990f-e71e1a590375 service nova] Creating event network-vif-plugged:9bd2db0e-3715-477a-9ebc-1c4ee77cff3d for instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f on n-h1-master-1 Jul 01 10:26:47.434760 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3991b573-971a-4f31-b52f-937a469055ab req-e9bb7b31-92fe-4d23-990f-e71e1a590375 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059729 Jul 01 10:26:47.436076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 150/296] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:47.511555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:47.514000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:47.544020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:47.548880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:47.551763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:47.552479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:47.895658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:47.904156 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7097d7c1-fbb6-4ebb-9d0a-379f4739f8c9 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.401448 Jul 01 10:26:47.907660 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 147/297] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:47 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:48.209393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:48.210051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:48.223071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:48.223518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:48.224458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:48.225787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:48.231509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77fe1a55-1c90-4ead-b10b-7f3d14500f67 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1912738941", "id": 1909348449, "os-flavor-access:is_public": "False"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:48.234920 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:48.234920 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:48.331032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77fe1a55-1c90-4ead-b10b-7f3d14500f67 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.322753 Jul 01 10:26:48.335552 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 151/298] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:48 2022] POST /compute/v2.1/flavors => generated 439 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:48.357164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:48.362722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:48.406562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:48.411138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:48.412230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:48.412685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:48.546120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:48.550262 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:48.555248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-384c0a36-002e-4b45-84b2-28f58f698a2f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1271 microversion: 2.1 time: 0.218149 Jul 01 10:26:48.560411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:48.575061 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 152/299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:48 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:48.577628 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62750fee-82f8-4c6c-8108-9e38201a935a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1317 microversion: 2.1 time: 0.375025 Jul 01 10:26:48.578194 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 148/300] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:48 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:48.579866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2ae293a-a3b1-472b-8e06-5d780f077f43 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:48.581414 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:48.581414 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:48.932451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:48.933162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:48.954577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:48.957112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:48.963868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:48.964329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:49.281881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:49.289659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38fc52dd-71da-4a33-b83b-67200ec3dac2 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1319 microversion: 2.1 time: 0.369595 Jul 01 10:26:49.296516 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 149/301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:48 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:49.334715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2ae293a-a3b1-472b-8e06-5d780f077f43 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1909348449/action" status: 200 len: 97 microversion: 2.1 time: 0.754687 Jul 01 10:26:49.334715 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 153/302] 10.222.0.23 () {60 vars in 1199 bytes} [Fri Jul 1 10:26:48 2022] POST /compute/v2.1/flavors/1909348449/action => generated 97 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:49.341010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e28dfa64-990b-4536-a239-536fcfb63253 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:49.342427 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:49.342427 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:49.592651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:49.594677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:49.601927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:49.602778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:49.603686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:49.604392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:49.700543 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e28dfa64-990b-4536-a239-536fcfb63253 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project 1927edf9ff58432da303ae3a1d1a9e66 combination. Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e28dfa64-990b-4536-a239-536fcfb63253 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Request method failure captured: Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/flavors/1909348449/action HTTP/1.1 Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 67 Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvnZje67x87-NbgTwPh70ClwlRY5y8IsCEzqfJaoaf9gQOSYkMgxkVcm8UAB8tWBDfl3Px3DgqK6ogr4qsUNMVFLWq8M4nJiXxgG8D31mvTQooNXA9NJElEN7U48vCSz6LmAIinEfsY79-BfXn_SASoOJzbNHta4fP9kJQKpnk4tXw Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e3b1e292e848482db584d2151709346f Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:26:49.703878 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3b1e292e848482db584d2151709346f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3b1e292e848482db584d2151709346f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3b1e292e848482db584d2151709346f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3b1e292e848482db584d2151709346f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e3b1e292e848482db584d2151709346f Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 474d554d3cb140e8bcfdac30528ceb8e Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: {"addTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} Jul 01 10:26:49.705133 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: exception: Flavor access already exists for flavor 18 and project 1927edf9ff58432da303ae3a1d1a9e66 combination. Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '1909348449', 'body': {'addTenantAccess': {'tenant': '1927edf9ff58432da303ae3a1d1a9e66'}}} Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result.read() Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 10:26:49.705856 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-1927edf9ff58432da303ae3a1d1a9e66' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi session.flush() Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 10:26:49.718189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 10:26:49.719853 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 10:26:49.720850 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result.read() Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-1927edf9ff58432da303ae3a1d1a9e66' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 1, 10, 26, 49, 632735), 'updated_at': None, 'flavor_id': 18, 'project_id': '1927edf9ff58432da303ae3a1d1a9e66'}] Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:49.722782 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project 1927edf9ff58432da303ae3a1d1a9e66 combination. Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:49.723877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project 1927edf9ff58432da303ae3a1d1a9e66 combination. Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:49.725172 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:49.726394 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project 1927edf9ff58432da303ae3a1d1a9e66 combination. Jul 01 10:26:49.726394 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:49.726394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e28dfa64-990b-4536-a239-536fcfb63253 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project 1927edf9ff58432da303ae3a1d1a9e66 combination. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:49.726394 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e28dfa64-990b-4536-a239-536fcfb63253 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1909348449/action" status: 409 len: 152 microversion: 2.1 time: 0.368180 Jul 01 10:26:49.726394 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 150/303] 10.222.0.23 () {60 vars in 1199 bytes} [Fri Jul 1 10:26:49 2022] POST /compute/v2.1/flavors/1909348449/action => generated 152 bytes in 369 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:26:49.726394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:49.726872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:49.738814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:49.747774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:49.747774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:49.747774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:49.788358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:49.807353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2dd40c65-7965-460d-9b68-45859736a38b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.219738 Jul 01 10:26:49.808724 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 154/304] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:49 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:49.822802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3e68f178-9b93-4d0e-b6eb-589d2de6dd83 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:49.827500 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:49.827500 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:49.941918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:49.954841 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09469ea1-4a6e-47f1-9d51-fac13cfc4107 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1317 microversion: 2.1 time: 0.246201 Jul 01 10:26:49.969633 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 151/305] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:49 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:50.177928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-049576ae-02b9-49e1-97f5-7fbb6dc34764 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2083901530", "id": 1206570979, "os-flavor-access:is_public": "False"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:50.181804 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:50.181804 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:50.279283 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3e68f178-9b93-4d0e-b6eb-589d2de6dd83 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1909348449/action" status: 200 len: 21 microversion: 2.1 time: 0.466922 Jul 01 10:26:50.280393 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 155/306] 10.222.0.23 () {60 vars in 1199 bytes} [Fri Jul 1 10:26:49 2022] POST /compute/v2.1/flavors/1909348449/action => generated 21 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:50.281117 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-049576ae-02b9-49e1-97f5-7fbb6dc34764 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.207667 Jul 01 10:26:50.289858 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 152/307] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:50 2022] POST /compute/v2.1/flavors => generated 431 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:50.300499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d8f4b5c9-12c0-43e1-a301-38a6501d9fab tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:50.302824 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:50.302824 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:50.308851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-754481ca-03d2-414b-abe5-012b018ffeaa tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e965155a73aa47fa90321f5b42bbb059"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:50.312640 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:50.312640 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:50.422858 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d8f4b5c9-12c0-43e1-a301-38a6501d9fab tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1909348449" status: 202 len: 0 microversion: 2.1 time: 0.135633 Jul 01 10:26:50.423910 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 156/308] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:26:50 2022] DELETE /compute/v2.1/flavors/1909348449 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:50.429317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:50.430168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:50.435368 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:50.454069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:50.456844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:50.460083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:50.460757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:50.514602 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-754481ca-03d2-414b-abe5-012b018ffeaa tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1206570979/action" status: 200 len: 97 microversion: 2.1 time: 0.222444 Jul 01 10:26:50.516563 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 153/309] 10.222.0.23 () {60 vars in 1199 bytes} [Fri Jul 1 10:26:50 2022] POST /compute/v2.1/flavors/1206570979/action => generated 97 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:50.523466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65042853-3e9f-4387-a4c6-3cd00d7e2f1d tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:50.552159 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65042853-3e9f-4387-a4c6-3cd00d7e2f1d tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.033481 Jul 01 10:26:50.565716 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 154/310] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:50 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:50.811917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a0c5e13-9d58-439a-9b7e-c61b31e19387 tempest-FlavorsAccessTestJSON-545362374 tempest-FlavorsAccessTestJSON-545362374-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:50.871370 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a0c5e13-9d58-439a-9b7e-c61b31e19387 tempest-FlavorsAccessTestJSON-545362374 tempest-FlavorsAccessTestJSON-545362374-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6240 microversion: 2.1 time: 0.311348 Jul 01 10:26:50.882681 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 155/311] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:50 2022] GET /compute/v2.1/flavors/detail => generated 6240 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:50.887199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:50.891008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1857481-7ed1-4187-8c65-291450c22b54 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1794723129", "id": 582784780, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:50.903105 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4399492d-5a9b-42be-9e96-233cc3c93964 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1468 microversion: 2.1 time: 0.477883 Jul 01 10:26:50.908239 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 157/312] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:50 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:50.931494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a11c8a3f-766e-43ee-8304-a9c27417b3a1 req-7edf2325-a0c8-44c3-825b-2a532360d6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b54469-ddac-4b10-a1b4-61a4c7be16d9", "tag": "e7c61238-8bcf-4fa1-86a7-287c7981ba37"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:50.948413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a11c8a3f-766e-43ee-8304-a9c27417b3a1 req-7edf2325-a0c8-44c3-825b-2a532360d6de service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:50.955548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a11c8a3f-766e-43ee-8304-a9c27417b3a1 req-7edf2325-a0c8-44c3-825b-2a532360d6de service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:50.971286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a11c8a3f-766e-43ee-8304-a9c27417b3a1 req-7edf2325-a0c8-44c3-825b-2a532360d6de service nova] Creating event network-changed:e7c61238-8bcf-4fa1-86a7-287c7981ba37 for instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 on n-h2-master-1 Jul 01 10:26:50.982510 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a11c8a3f-766e-43ee-8304-a9c27417b3a1 req-7edf2325-a0c8-44c3-825b-2a532360d6de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072465 Jul 01 10:26:50.984186 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 158/313] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:50.987585 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b1857481-7ed1-4187-8c65-291450c22b54 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.103443 Jul 01 10:26:50.988255 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 156/314] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:50 2022] POST /compute/v2.1/flavors => generated 435 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:50.999791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:50.999791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:51.000008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3a1e48c-5e5d-4a11-9c8b-098763de5219 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e965155a73aa47fa90321f5b42bbb059"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:51.001844 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:51.001844 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:51.024758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.037697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.040632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.043837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.397368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:51.407055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9d2eaa4-e290-41be-9e81-6b7213a8912d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.421424 Jul 01 10:26:51.420594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 159/315] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:50 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:51.426472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ddd3975d-1c5b-44f9-9875-970ee0758a02 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:51.427421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ddd3975d-1c5b-44f9-9875-970ee0758a02 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:51.447531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddd3975d-1c5b-44f9-9875-970ee0758a02 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.447980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddd3975d-1c5b-44f9-9875-970ee0758a02 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.449773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddd3975d-1c5b-44f9-9875-970ee0758a02 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.450229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddd3975d-1c5b-44f9-9875-970ee0758a02 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.638407 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3a1e48c-5e5d-4a11-9c8b-098763de5219 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1206570979/action" status: 200 len: 21 microversion: 2.1 time: 0.648493 Jul 01 10:26:51.644281 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 157/316] 10.222.0.23 () {60 vars in 1199 bytes} [Fri Jul 1 10:26:50 2022] POST /compute/v2.1/flavors/1206570979/action => generated 21 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:51.657879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:51.660345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:51.669218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.669962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.672405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.673002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.821069 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ddd3975d-1c5b-44f9-9875-970ee0758a02 tempest-DeleteServersAdminTestJSON-40520481 tempest-DeleteServersAdminTestJSON-40520481-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.404449 Jul 01 10:26:51.822960 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 160/317] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:26:51 2022] POST /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:51.829389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82d025de-e73b-4a02-a864-08f406f523d9 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:51.830529 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:51.830529 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:51.838915 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-82d025de-e73b-4a02-a864-08f406f523d9 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82d025de-e73b-4a02-a864-08f406f523d9 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Request method failure captured: Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/flavors/582784780/os-flavor-access HTTP/1.1 Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvnZje67x87-NbgTwPh70ClwlRY5y8IsCEzqfJaoaf9gQOSYkMgxkVcm8UAB8tWBDfl3Px3DgqK6ogr4qsUNMVFLWq8M4nJiXxgG8D31mvTQooNXA9NJElEN7U48vCSz6LmAIinEfsY79-BfXn_SASoOJzbNHta4fP9kJQKpnk4tXw Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e3b1e292e848482db584d2151709346f Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:51.840903 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3b1e292e848482db584d2151709346f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3b1e292e848482db584d2151709346f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3b1e292e848482db584d2151709346f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3b1e292e848482db584d2151709346f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e3b1e292e848482db584d2151709346f Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 474d554d3cb140e8bcfdac30528ceb8e Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: exception: Access list not available for public flavors. Jul 01 10:26:51.842223 n-d-master-1 devstack@n-api.service[119765]: action_args: {'flavor_id': '582784780'} Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 01 10:26:51.842892 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:51.845266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82d025de-e73b-4a02-a864-08f406f523d9 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:51.846278 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82d025de-e73b-4a02-a864-08f406f523d9 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/582784780/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022105 Jul 01 10:26:51.846977 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 161/318] 10.222.0.23 () {58 vars in 1205 bytes} [Fri Jul 1 10:26:51 2022] GET /compute/v2.1/flavors/582784780/os-flavor-access => generated 91 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:26:51.866326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7e9130f8-2544-4c53-a463-c337c11fa01c req-ed468fc9-a96b-438f-9764-59b7dee0f044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0327eb-9856-41c6-a66c-3833fb79f56c", "tag": "66607fcc-6805-4701-81e1-1a67c103b4d0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:51.877293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7e9130f8-2544-4c53-a463-c337c11fa01c req-ed468fc9-a96b-438f-9764-59b7dee0f044 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.878046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7e9130f8-2544-4c53-a463-c337c11fa01c req-ed468fc9-a96b-438f-9764-59b7dee0f044 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.893057 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7e9130f8-2544-4c53-a463-c337c11fa01c req-ed468fc9-a96b-438f-9764-59b7dee0f044 service nova] Creating event network-changed:66607fcc-6805-4701-81e1-1a67c103b4d0 for instance 0a0327eb-9856-41c6-a66c-3833fb79f56c on n-h2-master-1 Jul 01 10:26:51.898704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7e9130f8-2544-4c53-a463-c337c11fa01c req-ed468fc9-a96b-438f-9764-59b7dee0f044 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039986 Jul 01 10:26:51.899760 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 162/319] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:51.905286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c5463dd-a0fc-4e07-86b0-848db9a2357c tempest-FlavorsAccessTestJSON-545362374 tempest-FlavorsAccessTestJSON-545362374-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:51.939415 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c5463dd-a0fc-4e07-86b0-848db9a2357c tempest-FlavorsAccessTestJSON-545362374 tempest-FlavorsAccessTestJSON-545362374-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6244 microversion: 2.1 time: 0.038197 Jul 01 10:26:51.940134 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 163/320] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:51 2022] GET /compute/v2.1/flavors/detail => generated 6244 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:51.945135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:51.946168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:51.952863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.953650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.955332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.956005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.994279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:51.995353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:51.996103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lazy-loading 'fault' on Instance uuid e9e8233d-6667-4e9f-b6ba-0626378e5a5f {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:26:52.174524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:52.185791 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-de8059c8-f675-4aa0-b1fb-9dabb13e01ae tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1317 microversion: 2.1 time: 0.540346 Jul 01 10:26:52.195728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 158/321] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:51 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:52.203047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-305265ec-302a-48ba-8cf9-f534d40b9813 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.204010 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:52.204010 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:52.211509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:52.218261 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c685c6f-0fac-45c0-8961-29e21d6e5e43 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1451 microversion: 2.1 time: 0.276842 Jul 01 10:26:52.218891 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 164/322] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:51 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1451 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:52.224620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6d86177-18da-4401-81d2-64bc60bcc46f tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.225772 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:52.225772 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:52.375746 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-305265ec-302a-48ba-8cf9-f534d40b9813 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/582784780" status: 202 len: 0 microversion: 2.1 time: 0.178364 Jul 01 10:26:52.376056 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6d86177-18da-4401-81d2-64bc60bcc46f tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1206570979" status: 202 len: 0 microversion: 2.1 time: 0.155913 Jul 01 10:26:52.376749 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 159/324] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:26:52 2022] DELETE /compute/v2.1/flavors/582784780 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:52.376959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 165/324] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:26:52 2022] DELETE /compute/v2.1/flavors/1206570979 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:52.381997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.382518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:52.386996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae5be34d-5279-4106-9c53-5e16aaffd497 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.391615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:52.392061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:52.392827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:52.393331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:52.416038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae5be34d-5279-4106-9c53-5e16aaffd497 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.032887 Jul 01 10:26:52.421702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:26:52.427841 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 166/325] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:52.432698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c1483bc-ca03-4ef5-b119-e3fc81cf7089 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.454606 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c1483bc-ca03-4ef5-b119-e3fc81cf7089 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.025625 Jul 01 10:26:52.455529 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 167/326] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:52.460254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.461124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:52.470774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:52.473265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:52.473265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:52.473265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:52.614077 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:52.621540 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21950fdf-a98b-4e54-bbf9-ed3d020746b2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.164822 Jul 01 10:26:52.622088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 168/327] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:52 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:52.626402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a82f837d-054c-44f5-8d7d-08d01cd58552 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1745603363", "id": 121632728, "os-flavor-access:is_public": "False"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:52.627883 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:52.627883 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:52.702076 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a82f837d-054c-44f5-8d7d-08d01cd58552 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.078935 Jul 01 10:26:52.702824 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 169/328] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:52 2022] POST /compute/v2.1/flavors => generated 428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:52.708081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-186e9ccd-656b-45e0-98fc-bdf420f9f1a9 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1057546263", "id": 2055760726, "os-flavor-access:is_public": "False"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:52.779131 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e20567e-25fb-440c-bac3-b28ca8fe358e tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 204 len: 0 microversion: 2.1 time: 0.399183 Jul 01 10:26:52.784048 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 160/329] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:52 2022] DELETE /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:26:52.796408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-84bb251e-6c27-4af1-875b-4eab240469c6 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.797464 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:52.797464 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:52.807374 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-186e9ccd-656b-45e0-98fc-bdf420f9f1a9 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.103156 Jul 01 10:26:52.808617 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 170/330] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:52 2022] POST /compute/v2.1/flavors => generated 439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:52.815192 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:52.815997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:52.841928 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-84bb251e-6c27-4af1-875b-4eab240469c6 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/121632728/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.056121 Jul 01 10:26:52.842855 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 161/331] 10.222.0.23 () {58 vars in 1205 bytes} [Fri Jul 1 10:26:52 2022] GET /compute/v2.1/flavors/121632728/os-flavor-access => generated 21 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:52.857722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:52.858191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:52.859265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:52.859758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:52.881407 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:52.915634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:52.916079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:52.916591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lazy-loading 'fault' on Instance uuid e9e8233d-6667-4e9f-b6ba-0626378e5a5f {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:26:53.084148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95020ba3-0924-4562-98e6-48e81b7fe249 tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:53.085636 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.085636 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:53.087080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-95020ba3-0924-4562-98e6-48e81b7fe249 tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b94d45371bce4859a350192d30b04247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1927edf9ff58432da303ae3a1d1a9e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95020ba3-0924-4562-98e6-48e81b7fe249 tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Request method failure captured: Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/flavors/2055760726/action HTTP/1.1 Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 67 Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvlaqpnb0TKwgvj2qR_lOS-SsrW0nR7ZUP53DZHllEEydr7GFa-B8R3dTQwZReS6sE8idxh3-28Ql1wIDmRmWXs7IQ2uuzOAPf8PnLexKyk_BNnH6LnupyTvF3kXPL-zYMq9RaMoSOBOwa5GZuOeKwDTvl9pJ-9NZr1YINHmQd4KvI Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 1927edf9ff58432da303ae3a1d1a9e66 Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-603341166 Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:53.088792 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1927edf9ff58432da303ae3a1d1a9e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1927edf9ff58432da303ae3a1d1a9e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1927edf9ff58432da303ae3a1d1a9e66", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1927edf9ff58432da303ae3a1d1a9e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-603341166 Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 1927edf9ff58432da303ae3a1d1a9e66 Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-603341166 Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsAccessNegativeTestJSON-603341166-project Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b94d45371bce4859a350192d30b04247 Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-603341166-project Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: {"addTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} Jul 01 10:26:53.089999 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '2055760726', 'body': {'addTenantAccess': {'tenant': '1927edf9ff58432da303ae3a1d1a9e66'}}} Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:53.090661 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 01 10:26:53.092243 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:53.093398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95020ba3-0924-4562-98e6-48e81b7fe249 tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:53.093398 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95020ba3-0924-4562-98e6-48e81b7fe249 tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] 10.222.0.23 "POST /compute/v2.1/flavors/2055760726/action" status: 403 len: 130 microversion: 2.1 time: 0.246543 Jul 01 10:26:53.095099 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 162/332] 10.222.0.23 () {60 vars in 1199 bytes} [Fri Jul 1 10:26:52 2022] POST /compute/v2.1/flavors/2055760726/action => generated 130 bytes in 251 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:53.100044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e391d3a5-647e-4036-8395-860cc68763fd tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.101232 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.101232 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:53.144186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:53.153207 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f2646da0-547a-4ef2-901a-51c7b8eb0814 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1457 microversion: 2.1 time: 0.343039 Jul 01 10:26:53.153907 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 171/333] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:52 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1457 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:53.202228 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e391d3a5-647e-4036-8395-860cc68763fd tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/121632728" status: 202 len: 0 microversion: 2.1 time: 0.105948 Jul 01 10:26:53.203916 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 163/334] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:26:53 2022] DELETE /compute/v2.1/flavors/121632728 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:53.214136 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3e1973b-278a-4a53-96dd-06cf844f8cfe tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.230903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99087c53-3474-4042-ac12-d6fc63509755 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.232351 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.232351 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:53.233868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99087c53-3474-4042-ac12-d6fc63509755 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.234319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99087c53-3474-4042-ac12-d6fc63509755 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.235127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99087c53-3474-4042-ac12-d6fc63509755 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.235553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99087c53-3474-4042-ac12-d6fc63509755 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.273075 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99087c53-3474-4042-ac12-d6fc63509755 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.117905 Jul 01 10:26:53.280368 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 172/335] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:53.285395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.286244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:53.293110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.299387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.299387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.299387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.346099 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3e1973b-278a-4a53-96dd-06cf844f8cfe tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2055760726" status: 202 len: 0 microversion: 2.1 time: 0.140706 Jul 01 10:26:53.350987 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 164/336] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:26:53 2022] DELETE /compute/v2.1/flavors/2055760726 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:53.355978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-321e98e1-1c7e-40e6-8fcb-14f7c6cb8af0 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.393241 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-321e98e1-1c7e-40e6-8fcb-14f7c6cb8af0 tempest-FlavorsAccessTestJSON-1312783450 tempest-FlavorsAccessTestJSON-1312783450-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.040782 Jul 01 10:26:53.394014 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 165/337] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:53.408935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-923b569d-ce89-4dcb-9857-7314eeb285d2 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.408935 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.408935 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:53.409772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-923b569d-ce89-4dcb-9857-7314eeb285d2 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.410439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-923b569d-ce89-4dcb-9857-7314eeb285d2 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.411572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-923b569d-ce89-4dcb-9857-7314eeb285d2 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.412424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-923b569d-ce89-4dcb-9857-7314eeb285d2 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.443154 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-923b569d-ce89-4dcb-9857-7314eeb285d2 tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047891 Jul 01 10:26:53.443837 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 166/338] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:53.448398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d8d5100-d664-432c-9df8-f470479b6e04 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.468125 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d8d5100-d664-432c-9df8-f470479b6e04 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.022954 Jul 01 10:26:53.468775 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 167/339] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:53.473286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dfac0688-565e-47c7-8a57-951cc01f746f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.474646 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.474646 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:53.475843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfac0688-565e-47c7-8a57-951cc01f746f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.476288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfac0688-565e-47c7-8a57-951cc01f746f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.477088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfac0688-565e-47c7-8a57-951cc01f746f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.478090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfac0688-565e-47c7-8a57-951cc01f746f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.503027 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dfac0688-565e-47c7-8a57-951cc01f746f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.032933 Jul 01 10:26:53.504070 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 168/340] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:53.508640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05eea7a1-9ef5-4104-8bd5-1ffae7e2735d tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-148634869", "id": 360261426, "os-flavor-access:is_public": "False"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:53.510163 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.510163 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:53.591335 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-05eea7a1-9ef5-4104-8bd5-1ffae7e2735d tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.086181 Jul 01 10:26:53.591982 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 169/341] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:53.596442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-18df5610-6ee8-482b-b2e1-0b7d7763e2fc tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.597638 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.597638 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:53.598824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18df5610-6ee8-482b-b2e1-0b7d7763e2fc tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.599264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18df5610-6ee8-482b-b2e1-0b7d7763e2fc tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.600043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18df5610-6ee8-482b-b2e1-0b7d7763e2fc tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.600467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18df5610-6ee8-482b-b2e1-0b7d7763e2fc tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.605612 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:53.624049 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-18df5610-6ee8-482b-b2e1-0b7d7763e2fc tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.031091 Jul 01 10:26:53.624814 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 170/342] 10.222.0.23 () {58 vars in 1193 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:53.628958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c80f6b2b-0d67-422e-9b97-02029cefbe15 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:53.630179 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.630179 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:53.776799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:53.790454 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-12c32241-3efe-4b2b-b8c5-60b7e71674f9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1317 microversion: 2.1 time: 0.508009 Jul 01 10:26:53.800360 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 173/343] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:53.805177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-210feeac-1fce-4145-9ee1-de042544915b tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.807107 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.807107 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:53.808512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210feeac-1fce-4145-9ee1-de042544915b tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.809075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210feeac-1fce-4145-9ee1-de042544915b tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.810000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210feeac-1fce-4145-9ee1-de042544915b tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.810651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210feeac-1fce-4145-9ee1-de042544915b tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.826254 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c80f6b2b-0d67-422e-9b97-02029cefbe15 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/360261426/action" status: 200 len: 96 microversion: 2.1 time: 0.200541 Jul 01 10:26:53.827423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 171/344] 10.222.0.23 () {60 vars in 1196 bytes} [Fri Jul 1 10:26:53 2022] POST /compute/v2.1/flavors/360261426/action => generated 96 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:53.833554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.834491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:53.835370 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-210feeac-1fce-4145-9ee1-de042544915b tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.033753 Jul 01 10:26:53.836358 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 174/345] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:53.841788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46895946-be43-4c17-aec0-b4a941455c9c tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:53.843238 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.843238 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:53.844084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46895946-be43-4c17-aec0-b4a941455c9c tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b94d45371bce4859a350192d30b04247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1927edf9ff58432da303ae3a1d1a9e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46895946-be43-4c17-aec0-b4a941455c9c tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Request method failure captured: Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/flavors/360261426/action HTTP/1.1 Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 70 Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvlaqpnb0TKwgvj2qR_lOS-SsrW0nR7ZUP53DZHllEEydr7GFa-B8R3dTQwZReS6sE8idxh3-28Ql1wIDmRmWXs7IQ2uuzOAPf8PnLexKyk_BNnH6LnupyTvF3kXPL-zYMq9RaMoSOBOwa5GZuOeKwDTvl9pJ-9NZr1YINHmQd4KvI Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1927edf9ff58432da303ae3a1d1a9e66 Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-603341166 Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:53.846145 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1927edf9ff58432da303ae3a1d1a9e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1927edf9ff58432da303ae3a1d1a9e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1927edf9ff58432da303ae3a1d1a9e66", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1927edf9ff58432da303ae3a1d1a9e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-603341166 Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1927edf9ff58432da303ae3a1d1a9e66 Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-603341166 Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FlavorsAccessNegativeTestJSON-603341166-project Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b94d45371bce4859a350192d30b04247 Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-603341166-project Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: {"removeTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} Jul 01 10:26:53.847338 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '360261426', 'body': {'removeTenantAccess': {'tenant': '1927edf9ff58432da303ae3a1d1a9e66'}}} Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can( Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:53.848021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 01 10:26:53.849184 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:53.853241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46895946-be43-4c17-aec0-b4a941455c9c tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:53.853241 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46895946-be43-4c17-aec0-b4a941455c9c tempest-FlavorsAccessNegativeTestJSON-603341166 tempest-FlavorsAccessNegativeTestJSON-603341166-project] 10.222.0.23 "POST /compute/v2.1/flavors/360261426/action" status: 403 len: 133 microversion: 2.1 time: 0.009573 Jul 01 10:26:53.853241 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 175/346] 10.222.0.23 () {60 vars in 1196 bytes} [Fri Jul 1 10:26:53 2022] POST /compute/v2.1/flavors/360261426/action => generated 133 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:53.854322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.855006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.855989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.856745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.860180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3fceecba-a1a0-42ba-aa4d-36e4725b7a7f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:53.862865 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.862865 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:53.864135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fceecba-a1a0-42ba-aa4d-36e4725b7a7f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.864595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fceecba-a1a0-42ba-aa4d-36e4725b7a7f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.865429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fceecba-a1a0-42ba-aa4d-36e4725b7a7f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:53.865863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fceecba-a1a0-42ba-aa4d-36e4725b7a7f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:53.885713 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:53.892646 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3fceecba-a1a0-42ba-aa4d-36e4725b7a7f tempest-ServicesAdminNegativeTestJSON-2132446545 tempest-ServicesAdminNegativeTestJSON-2132446545-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.040010 Jul 01 10:26:53.893575 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 176/347] 10.222.0.23 () {58 vars in 1197 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:53.898600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5d31432e-9bc8-4b81-a1da-28fb0b96d764 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1927edf9ff58432da303ae3a1d1a9e66"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:53.899904 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:53.899904 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:54.184643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:54.198166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-227de14d-6ac0-4482-81d9-fcc4d900f8b5 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.366227 Jul 01 10:26:54.202702 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 172/348] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:53 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:54.342454 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5d31432e-9bc8-4b81-a1da-28fb0b96d764 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/360261426/action" status: 200 len: 21 microversion: 2.1 time: 0.447805 Jul 01 10:26:54.343644 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 177/349] 10.222.0.23 () {60 vars in 1196 bytes} [Fri Jul 1 10:26:53 2022] POST /compute/v2.1/flavors/360261426/action => generated 21 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:26:54.351969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:54.352940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:54.360501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:54.361597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:54.362846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:54.363639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:54.411021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:54.411954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:54.411954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lazy-loading 'fault' on Instance uuid e9e8233d-6667-4e9f-b6ba-0626378e5a5f {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:26:54.437286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e94a2fd0-3348-448d-ac46-426fde42de85 tempest-ServicesAdminNegativeTestJSON-559879733 tempest-ServicesAdminNegativeTestJSON-559879733-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:54.438512 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:54.438512 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e94a2fd0-3348-448d-ac46-426fde42de85 tempest-ServicesAdminNegativeTestJSON-559879733 tempest-ServicesAdminNegativeTestJSON-559879733-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '30bf8c6433ef4f4289c5bec4c13c2a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc8ab5db331467883680d83a1bd3b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e94a2fd0-3348-448d-ac46-426fde42de85 tempest-ServicesAdminNegativeTestJSON-559879733 tempest-ServicesAdminNegativeTestJSON-559879733-project] Request method failure captured: Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvroc_ijN5ShS_WGHVfBLf3H-JtOIxgdr0f3Nnq69-CSP3T0V-FxwLuDQJQCCWYmXYAoU0uAO9NzdAw_gJU62z6Hpz2YrTMgm0EtGcUU79PMSmoHsns_yNN30TGG5K6bqmqWJZ1sto9lcWj1OshjZUoT_GYbTp8OTFico_RExg_hiM Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 6fc8ab5db331467883680d83a1bd3b6e Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-559879733 Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:54.442769 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6fc8ab5db331467883680d83a1bd3b6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6fc8ab5db331467883680d83a1bd3b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6fc8ab5db331467883680d83a1bd3b6e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6fc8ab5db331467883680d83a1bd3b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-559879733 Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 6fc8ab5db331467883680d83a1bd3b6e Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-559879733 Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServicesAdminNegativeTestJSON-559879733-project Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 30bf8c6433ef4f4289c5bec4c13c2a34 Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-559879733-project Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 01 10:26:54.444348 n-d-master-1 devstack@n-api.service[119764]: action_args: {} Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:26:54.445033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 01 10:26:54.448461 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:54.449930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e94a2fd0-3348-448d-ac46-426fde42de85 tempest-ServicesAdminNegativeTestJSON-559879733 tempest-ServicesAdminNegativeTestJSON-559879733-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:54.449930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e94a2fd0-3348-448d-ac46-426fde42de85 tempest-ServicesAdminNegativeTestJSON-559879733 tempest-ServicesAdminNegativeTestJSON-559879733-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.237932 Jul 01 10:26:54.449930 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 173/350] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:26:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:54.454745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1ef573eb-7ea7-4a7b-8e4d-5d362a54e5cb tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:54.455647 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:54.455647 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:54.576550 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1ef573eb-7ea7-4a7b-8e4d-5d362a54e5cb tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/360261426" status: 202 len: 0 microversion: 2.1 time: 0.125084 Jul 01 10:26:54.580928 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 174/351] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:26:54 2022] DELETE /compute/v2.1/flavors/360261426 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:54.586760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4509b62f-9b2c-42ff-bb34-b69f95633e5e tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:54.650947 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4509b62f-9b2c-42ff-bb34-b69f95633e5e tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.066018 Jul 01 10:26:54.655755 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 175/352] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:54 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:54.689298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-904fec7f-c380-494b-adc7-dfd32f6c47a8 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1817737850", "id": 1746413458, "os-flavor-access:is_public": "False"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:54.693381 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:54.693381 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:26:54.762681 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=16 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:54.836114 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-904fec7f-c380-494b-adc7-dfd32f6c47a8 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.156118 Jul 01 10:26:54.836739 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 176/353] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:54 2022] POST /compute/v2.1/flavors => generated 439 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:54.846181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:54.846181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:54.862724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:54.868889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:54.869459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:54.870332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:54.870770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:54.872913 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-33ecc2bb-dca8-410e-ac84-21bd6e21fcd4 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1457 microversion: 2.1 time: 0.528039 Jul 01 10:26:54.874219 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 178/354] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:54 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1457 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:54.879498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b1a8c122-04da-4b73-939e-b3e7bf416297 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01fded62271d46159c3856e8cee3bda3"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:54.880981 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:54.880981 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:55.166604 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b1a8c122-04da-4b73-939e-b3e7bf416297 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] HTTP exception thrown: Flavor access not found for 24 / 01fded62271d46159c3856e8cee3bda3 combination. Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b1a8c122-04da-4b73-939e-b3e7bf416297 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Request method failure captured: Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/flavors/1746413458/action HTTP/1.1 Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 70 Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvnZje67x87-NbgTwPh70ClwlRY5y8IsCEzqfJaoaf9gQOSYkMgxkVcm8UAB8tWBDfl3Px3DgqK6ogr4qsUNMVFLWq8M4nJiXxgG8D31mvTQooNXA9NJElEN7U48vCSz6LmAIinEfsY79-BfXn_SASoOJzbNHta4fP9kJQKpnk4tXw Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e3b1e292e848482db584d2151709346f Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:26:55.173395 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3b1e292e848482db584d2151709346f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3b1e292e848482db584d2151709346f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3b1e292e848482db584d2151709346f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3b1e292e848482db584d2151709346f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e3b1e292e848482db584d2151709346f Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-659896764 Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 474d554d3cb140e8bcfdac30528ceb8e Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: {"removeTenantAccess": {"tenant": "01fded62271d46159c3856e8cee3bda3"}} Jul 01 10:26:55.179889 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: exception: Flavor access not found for 24 / 01fded62271d46159c3856e8cee3bda3 combination. Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1746413458', 'body': {'removeTenantAccess': {'tenant': '01fded62271d46159c3856e8cee3bda3'}}} Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 01 10:26:55.181835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 01fded62271d46159c3856e8cee3bda3 combination. Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 01fded62271d46159c3856e8cee3bda3 combination. Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:55.183115 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 01fded62271d46159c3856e8cee3bda3 combination. Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b1a8c122-04da-4b73-939e-b3e7bf416297 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Returning 404 to user: Flavor access not found for 24 / 01fded62271d46159c3856e8cee3bda3 combination. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b1a8c122-04da-4b73-939e-b3e7bf416297 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1746413458/action" status: 404 len: 124 microversion: 2.1 time: 0.302488 Jul 01 10:26:55.184219 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 179/355] 10.222.0.23 () {60 vars in 1199 bytes} [Fri Jul 1 10:26:54 2022] POST /compute/v2.1/flavors/1746413458/action => generated 124 bytes in 308 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:55.201287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0db707d-f4b1-49dd-9ff2-89995f0e97f1 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:55.204060 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:26:55.204060 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:26:55.219881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:55.230442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-caf231dd-ccb3-4572-9408-13ae7ef5adb2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1317 microversion: 2.1 time: 0.392544 Jul 01 10:26:55.244794 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 177/356] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:54 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:55.250000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:55.250313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:55.256534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:55.256964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:55.257931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:55.258378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:55.381691 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0db707d-f4b1-49dd-9ff2-89995f0e97f1 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1746413458" status: 202 len: 0 microversion: 2.1 time: 0.194016 Jul 01 10:26:55.382883 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 180/357] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:26:55 2022] DELETE /compute/v2.1/flavors/1746413458 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:26:55.390570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3b020ee-0135-4056-84ce-29655b65ecd3 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:55.418395 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a3b020ee-0135-4056-84ce-29655b65ecd3 tempest-FlavorsAccessNegativeTestJSON-659896764 tempest-FlavorsAccessNegativeTestJSON-659896764-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.031310 Jul 01 10:26:55.428186 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 181/358] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:26:55 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:55.455373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:55.466166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65497e2c-35f5-4dd7-83d9-66169f8dc81c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.220036 Jul 01 10:26:55.466832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 178/359] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:55 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:55.621358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5483e278-ebaf-446d-a74f-f213bf5cb785 req-a9c26393-1f4c-49fc-b06b-c44eb27a8d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e8233d-6667-4e9f-b6ba-0626378e5a5f", "name": "network-vif-deleted", "tag": "9bd2db0e-3715-477a-9ebc-1c4ee77cff3d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:55.634419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5483e278-ebaf-446d-a74f-f213bf5cb785 req-a9c26393-1f4c-49fc-b06b-c44eb27a8d08 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:55.638959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5483e278-ebaf-446d-a74f-f213bf5cb785 req-a9c26393-1f4c-49fc-b06b-c44eb27a8d08 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:55.647991 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5483e278-ebaf-446d-a74f-f213bf5cb785 req-a9c26393-1f4c-49fc-b06b-c44eb27a8d08 service nova] Creating event network-vif-deleted:9bd2db0e-3715-477a-9ebc-1c4ee77cff3d for instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f on n-h1-master-1 Jul 01 10:26:55.661467 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5483e278-ebaf-446d-a74f-f213bf5cb785 req-a9c26393-1f4c-49fc-b06b-c44eb27a8d08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044714 Jul 01 10:26:55.662930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 182/360] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:55.891686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:55.897344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:55.898770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:55.899774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:55.900557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:55.900989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:55.930287 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=13,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:55.934812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:55.935527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:55.936134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lazy-loading 'fault' on Instance uuid e9e8233d-6667-4e9f-b6ba-0626378e5a5f {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:26:55.988213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd130c04538f4f9a94125c266a9cc362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bf001745c54bcf8f59523da6e4228d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:55.995700 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c59b0a3c-acbf-452f-b4e4-77956a4f4e8c tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 200 len: 1287 microversion: 2.1 time: 0.108097 Jul 01 10:26:55.996254 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 179/361] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:55 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 1287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:56.244992 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:56.249090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:56.249807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:56.255875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:56.256309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:56.257051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:56.257518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:56.483687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:56.490615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:56.492600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:56.494328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:56.495340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:56.496037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:56.705834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:56.719036 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9183be40-1f5b-4d9c-9e0f-1d6c6422bf50 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1317 microversion: 2.1 time: 0.472378 Jul 01 10:26:56.719661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 183/362] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:56 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:56.748583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:56.761135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-85af5d7e-221c-4b28-9119-0dd781abaec8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.281338 Jul 01 10:26:56.762169 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 180/363] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:56 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:57.015276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:57.016504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:57.029662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.033671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.036531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.037493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.089828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] HTTP exception thrown: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Request method failure captured: Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f HTTP/1.1 Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsukYBCvDef396w1qqNe2qYVdL2dHaqJlFr6dhkpU_SVLA_5Q80n455R4E6HZ3taY4USwqtBSM7pKQ2os5ZWTI474gNIfzju6lj5XcY1qLOvEencqnOlQJPAjdCkWLMDpIfu1h2Qcf4HGr-EF9gp07WoM5sXhA954Q2kh2FdX4MvWw0 Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:57.091599 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09bf001745c54bcf8f59523da6e4228d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cd130c04538f4f9a94125c266a9cc362 Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.092788 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e9e8233d-6667-4e9f-b6ba-0626378e5a5f'} Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:57.093505 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.094689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.095635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Returning 404 to user: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:57.095635 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82b29e55-c182-4aa2-a09b-d8441169310d tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 404 len: 111 microversion: 2.1 time: 0.084988 Jul 01 10:26:57.095635 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 184/364] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:57 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:57.108005 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:57.109219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:57.116812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.117617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.118631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.119291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.135075 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] HTTP exception thrown: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Request method failure captured: Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f HTTP/1.1 Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsukYBCvDef396w1qqNe2qYVdL2dHaqJlFr6dhkpU_SVLA_5Q80n455R4E6HZ3taY4USwqtBSM7pKQ2os5ZWTI474gNIfzju6lj5XcY1qLOvEencqnOlQJPAjdCkWLMDpIfu1h2Qcf4HGr-EF9gp07WoM5sXhA954Q2kh2FdX4MvWw0 Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:57.137206 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09bf001745c54bcf8f59523da6e4228d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cd130c04538f4f9a94125c266a9cc362 Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: exception: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.138462 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'e9e8233d-6667-4e9f-b6ba-0626378e5a5f'} Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:57.139158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.140252 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.145218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Returning 404 to user: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:57.146931 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5ee937a-ba0d-4a92-a423-34c650a9d151 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 404 len: 111 microversion: 2.1 time: 0.044636 Jul 01 10:26:57.148884 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 181/365] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:57 2022] DELETE /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:57.157387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:57.157885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: e9e8233d-6667-4e9f-b6ba-0626378e5a5f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:57.166891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.167333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.177288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.177945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.193810 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] HTTP exception thrown: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Request method failure captured: Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f HTTP/1.1 Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsukYBCvDef396w1qqNe2qYVdL2dHaqJlFr6dhkpU_SVLA_5Q80n455R4E6HZ3taY4USwqtBSM7pKQ2os5ZWTI474gNIfzju6lj5XcY1qLOvEencqnOlQJPAjdCkWLMDpIfu1h2Qcf4HGr-EF9gp07WoM5sXhA954Q2kh2FdX4MvWw0 Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:26:57.195577 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09bf001745c54bcf8f59523da6e4228d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cd130c04538f4f9a94125c266a9cc362 Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.197487 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e9e8233d-6667-4e9f-b6ba-0626378e5a5f'} Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:57.198150 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. Jul 01 10:26:57.199462 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.200417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Returning 404 to user: Instance e9e8233d-6667-4e9f-b6ba-0626378e5a5f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:57.200417 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02e29937-7fb7-4b30-bb3b-4d988160aa75 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f" status: 404 len: 111 microversion: 2.1 time: 0.044909 Jul 01 10:26:57.200417 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 185/366] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:57 2022] GET /compute/v2.1/servers/e9e8233d-6667-4e9f-b6ba-0626378e5a5f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:57.206928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:57.207616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:57.219727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.220178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.220963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.221428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.233396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-801c7642-49e8-4bf5-b47e-a2b6ca44b27e req-5c7ddcd7-fd47-491d-adde-4415eb969cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b54469-ddac-4b10-a1b4-61a4c7be16d9", "name": "network-vif-plugged", "status": "completed", "tag": "e7c61238-8bcf-4fa1-86a7-287c7981ba37"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:57.250238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-801c7642-49e8-4bf5-b47e-a2b6ca44b27e req-5c7ddcd7-fd47-491d-adde-4415eb969cb5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.250238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-801c7642-49e8-4bf5-b47e-a2b6ca44b27e req-5c7ddcd7-fd47-491d-adde-4415eb969cb5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.254963 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] HTTP exception thrown: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Request method failure captured: Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 HTTP/1.1 Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsukYBCvDef396w1qqNe2qYVdL2dHaqJlFr6dhkpU_SVLA_5Q80n455R4E6HZ3taY4USwqtBSM7pKQ2os5ZWTI474gNIfzju6lj5XcY1qLOvEencqnOlQJPAjdCkWLMDpIfu1h2Qcf4HGr-EF9gp07WoM5sXhA954Q2kh2FdX4MvWw0 Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:57.256552 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09bf001745c54bcf8f59523da6e4228d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cd130c04538f4f9a94125c266a9cc362 Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.257786 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '63c01d5c-3c08-4d5e-b681-425d9872a475'} Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:57.260159 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.261873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.263570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Returning 404 to user: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:57.263570 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d2ce0e0-9c12-4da0-83a5-b648b1bf7992 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 404 len: 111 microversion: 2.1 time: 0.059387 Jul 01 10:26:57.263570 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 182/367] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:26:57 2022] DELETE /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:57.268177 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-801c7642-49e8-4bf5-b47e-a2b6ca44b27e req-5c7ddcd7-fd47-491d-adde-4415eb969cb5 service nova] Creating event network-vif-plugged:e7c61238-8bcf-4fa1-86a7-287c7981ba37 for instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 on n-h2-master-1 Jul 01 10:26:57.271085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:57.273772 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-801c7642-49e8-4bf5-b47e-a2b6ca44b27e req-5c7ddcd7-fd47-491d-adde-4415eb969cb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043922 Jul 01 10:26:57.275395 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 186/368] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:26:57.275850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] [instance: 63c01d5c-3c08-4d5e-b681-425d9872a475] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:57.285356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.286000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.286979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.287564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.302979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] HTTP exception thrown: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Request method failure captured: Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 HTTP/1.1 Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsukYBCvDef396w1qqNe2qYVdL2dHaqJlFr6dhkpU_SVLA_5Q80n455R4E6HZ3taY4USwqtBSM7pKQ2os5ZWTI474gNIfzju6lj5XcY1qLOvEencqnOlQJPAjdCkWLMDpIfu1h2Qcf4HGr-EF9gp07WoM5sXhA954Q2kh2FdX4MvWw0 Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:26:57.305524 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09bf001745c54bcf8f59523da6e4228d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09bf001745c54bcf8f59523da6e4228d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 09bf001745c54bcf8f59523da6e4228d Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-583886809 Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cd130c04538f4f9a94125c266a9cc362 Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersAdminTestJSON-583886809-project Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.307216 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '63c01d5c-3c08-4d5e-b681-425d9872a475'} Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:26:57.308007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. Jul 01 10:26:57.309279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:26:57.311203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] Returning 404 to user: Instance 63c01d5c-3c08-4d5e-b681-425d9872a475 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:26:57.312187 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb0f1789-9206-4cfc-8cb7-1123c6f7cf87 tempest-DeleteServersAdminTestJSON-583886809 tempest-DeleteServersAdminTestJSON-583886809-project] 10.222.0.23 "GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475" status: 404 len: 111 microversion: 2.1 time: 0.045201 Jul 01 10:26:57.313173 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 183/369] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:57 2022] GET /compute/v2.1/servers/63c01d5c-3c08-4d5e-b681-425d9872a475 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:26:57.737879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:57.738760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:57.748838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.748838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.748838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.748838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.777356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:57.777969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:57.783952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.784392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.785178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:57.785625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:57.937753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:57.945840 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86b3dad0-38e7-47de-b54f-655ff1179c11 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1317 microversion: 2.1 time: 0.213158 Jul 01 10:26:57.946678 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 187/370] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:57 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:57.965331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:57.974424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a067a42-bb35-4e69-bbb8-427bb5c83f39 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.200846 Jul 01 10:26:57.974983 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 184/371] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:57 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:58.962520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:58.963767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:58.970509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:58.970879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:58.972007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:58.972439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.134305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:59.141834 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b264d51-017c-4ac8-9f3f-823354593d0c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1466 microversion: 2.1 time: 0.183147 Jul 01 10:26:59.142547 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 185/372] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:58 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1466 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:26:59.147005 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:59.147597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:59.157743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:59.158278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.159156 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:59.159647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.169765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-81700950", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:59.226837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:26:59.374844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:59.383021 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7d51df45-a5aa-4480-9bde-f5d9a87dcfd8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.239399 Jul 01 10:26:59.383613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 186/373] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:59 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:26:59.463358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:26:59.463943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:26:59.464519 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:26:59.465572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:26:59.465663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:26:59.477260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:59.477760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.478610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:59.480133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.488585 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:26:59.499062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Getting quotas for project 0312d8a40c804b1b9f413780b01253c0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:26:59.503682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Getting quotas for user 4fdab3d8f0b143cd97b918b91429e73a and project 0312d8a40c804b1b9f413780b01253c0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:26:59.515594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:26:59.517944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:26:59.674954 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-28d8b67b-bf78-4cb7-8eb9-a519465742de tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805548 Jul 01 10:26:59.681248 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 188/374] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:26:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:26:59.686251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2f7c44cc-fec2-4e85-ae26-567f29f34ba7 req-cc479675-6db0-4127-ae66-18e1e8801917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0327eb-9856-41c6-a66c-3833fb79f56c", "name": "network-vif-plugged", "status": "completed", "tag": "66607fcc-6805-4701-81e1-1a67c103b4d0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:26:59.696805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2f7c44cc-fec2-4e85-ae26-567f29f34ba7 req-cc479675-6db0-4127-ae66-18e1e8801917 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:59.698081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2f7c44cc-fec2-4e85-ae26-567f29f34ba7 req-cc479675-6db0-4127-ae66-18e1e8801917 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.709376 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2f7c44cc-fec2-4e85-ae26-567f29f34ba7 req-cc479675-6db0-4127-ae66-18e1e8801917 service nova] Creating event network-vif-plugged:66607fcc-6805-4701-81e1-1a67c103b4d0 for instance 0a0327eb-9856-41c6-a66c-3833fb79f56c on n-h2-master-1 Jul 01 10:26:59.716572 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2f7c44cc-fec2-4e85-ae26-567f29f34ba7 req-cc479675-6db0-4127-ae66-18e1e8801917 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033826 Jul 01 10:26:59.717185 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 189/375] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:26:59.726328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-23bd84d2-6fb9-41f7-bb71-ac44f05ae986 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:59.726989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-23bd84d2-6fb9-41f7-bb71-ac44f05ae986 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:59.785822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-42ca8169-351f-472d-b245-029b8fb0b28e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:26:59.789320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-42ca8169-351f-472d-b245-029b8fb0b28e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:26:59.789786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-23bd84d2-6fb9-41f7-bb71-ac44f05ae986 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:26:59.796583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-23bd84d2-6fb9-41f7-bb71-ac44f05ae986 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1215 microversion: 2.1 time: 0.075362 Jul 01 10:26:59.801926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42ca8169-351f-472d-b245-029b8fb0b28e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:59.802671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42ca8169-351f-472d-b245-029b8fb0b28e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.803652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42ca8169-351f-472d-b245-029b8fb0b28e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:26:59.804225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42ca8169-351f-472d-b245-029b8fb0b28e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:26:59.804762 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 190/376] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:59 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:00.145273 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-42ca8169-351f-472d-b245-029b8fb0b28e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1617 microversion: 2.1 time: 0.760547 Jul 01 10:27:00.146685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 187/377] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:26:59 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1617 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:00.162553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4fa8eca2-5b9b-48b0-a8e2-bbf0d08fe3f2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: .version_select at 0x7f6f9288e1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1604413741", "policies": ["affinity"]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:00.198940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4fa8eca2-5b9b-48b0-a8e2-bbf0d08fe3f2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:00.204788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4fa8eca2-5b9b-48b0-a8e2-bbf0d08fe3f2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:00.400202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:00.401200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:00.413840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:00.414414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:00.424765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:00.424765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:00.425130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4fa8eca2-5b9b-48b0-a8e2-bbf0d08fe3f2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:00.425130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4fa8eca2-5b9b-48b0-a8e2-bbf0d08fe3f2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:00.439827 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4fa8eca2-5b9b-48b0-a8e2-bbf0d08fe3f2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.281267 Jul 01 10:27:00.441443 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 191/378] 10.222.0.23 () {60 vars in 1173 bytes} [Fri Jul 1 10:27:00 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:00.586345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:00.594901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20a07516-753c-4abe-bd4d-0b8a149cc7ab tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1313 microversion: 2.1 time: 0.199030 Jul 01 10:27:00.595543 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 188/379] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:00 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:00.703310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1121771350", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b77eb36d-a0ec-491e-8dcb-c83920fd1264"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:00.764839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:27:00.821255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7215679f-f494-43b9-b1cf-b2ebeff490a2 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:00.821874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7215679f-f494-43b9-b1cf-b2ebeff490a2 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:00.906583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7215679f-f494-43b9-b1cf-b2ebeff490a2 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:00.913539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7215679f-f494-43b9-b1cf-b2ebeff490a2 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1215 microversion: 2.1 time: 0.096186 Jul 01 10:27:00.914471 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 189/380] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:00 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:01.010504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:27:01.011353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:27:01.011959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:27:01.012419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:27:01.012886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:27:01.038636 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:01.039188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:01.040081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:01.040571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:01.060973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:01.065175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:01.077650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Going to run 2 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:27:01.080164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:27:01.094075 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:01.212802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119765) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 01 10:27:01.265101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:01.272457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:01.428797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:01.437593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:01.475409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=1104472d-27ae-4dfc-afaa-fc1f4c6d52a7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:27:01.605228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:01.609623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:01.616144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:01.618154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:01.629112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:01.630009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:01.630960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:01.631856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:01.715075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:01.719553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:01.755186 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dddd3403-ed08-4c92-876f-7717bc50a49b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.056327 Jul 01 10:27:01.758796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 192/381] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:00 2022] POST /compute/v2.1/servers => generated 32 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:27:01.883520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:01.892232 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4b156f8b-4fa3-4488-b3ec-64b55af53f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1462 microversion: 2.1 time: 0.283069 Jul 01 10:27:01.892821 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 190/382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:01 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1462 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:01.907627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:01.929718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:01.932934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Searching by: {'deleted': False, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:27:01.969997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:01.971052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:01.971954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:01.973062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:02.106521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:27:02.134101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19cbb77e-7150-48f2-b2c3-6bb52794f2d3 tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1396520035", "id": 332656665, "os-flavor-access:is_public": "True"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:02.147057 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:02.147057 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:02.233139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4475f637-fe49-4a7d-8b23-f62a90dfe947 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.339189 Jul 01 10:27:02.233927 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 191/383] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:27:01 2022] GET /compute/v2.1/servers => generated 1004 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:02.280724 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-19cbb77e-7150-48f2-b2c3-6bb52794f2d3 tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.523516 Jul 01 10:27:02.281768 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 193/384] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:27:01 2022] POST /compute/v2.1/flavors => generated 468 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:27:02.292665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:02.293288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:02.300237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:02.300688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:02.301501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:02.301974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:02.369194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:02.382885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5da0950-76b9-4c00-9f27-375d65568db1 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:02.384367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5da0950-76b9-4c00-9f27-375d65568db1 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:02.394037 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f399b0d8-a5cd-486f-82d2-426c9e111226 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1267 microversion: 2.1 time: 0.111588 Jul 01 10:27:02.396136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5da0950-76b9-4c00-9f27-375d65568db1 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:02.396600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5da0950-76b9-4c00-9f27-375d65568db1 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:02.397804 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 194/385] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:02 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:02.401605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5da0950-76b9-4c00-9f27-375d65568db1 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:02.402279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5da0950-76b9-4c00-9f27-375d65568db1 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:02.423643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-53ffc47e-d702-482d-8223-0cb4fa8becd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:02.425305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-53ffc47e-d702-482d-8223-0cb4fa8becd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:02.522202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53ffc47e-d702-482d-8223-0cb4fa8becd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:02.540507 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-53ffc47e-d702-482d-8223-0cb4fa8becd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1219 microversion: 2.1 time: 0.121768 Jul 01 10:27:02.541341 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 195/386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:02 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:02.557266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4edd62d9-38b8-4890-8145-a75cbc01b809 tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:02.563526 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:02.563526 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:02.855980 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4edd62d9-38b8-4890-8145-a75cbc01b809 tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/332656665/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.307332 Jul 01 10:27:02.860572 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 196/387] 10.222.0.23 () {62 vars in 1261 bytes} [Fri Jul 1 10:27:02 2022] POST /compute/v2.1/flavors/332656665/os-extra_specs => generated 62 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:02.871577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-afcf0c84-f4e4-4944-8245-73cdbca71caa tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:02.880709 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:02.880709 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:03.035885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-afcf0c84-f4e4-4944-8245-73cdbca71caa tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/332656665" status: 202 len: 0 microversion: 2.86 time: 0.168691 Jul 01 10:27:03.036654 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 197/388] 10.222.0.23 () {60 vars in 1198 bytes} [Fri Jul 1 10:27:02 2022] DELETE /compute/v2.1/flavors/332656665 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:27:03.054242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52ebd506-027a-4fcc-ae50-8216f04c6e1d tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:03.104548 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52ebd506-027a-4fcc-ae50-8216f04c6e1d tempest-FlavorMetadataValidation-382509783 tempest-FlavorMetadataValidation-382509783-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.062106 Jul 01 10:27:03.105683 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 198/389] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:27:03 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:27:03.166099 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5da0950-76b9-4c00-9f27-375d65568db1 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1613 microversion: 2.1 time: 0.931103 Jul 01 10:27:03.182716 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 192/390] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:02 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1613 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:03.187493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:03.188071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:03.198064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:03.198559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:03.202620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:03.203031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:03.334957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc93ddc48d9b42e99facdd6a1dc08815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d42bbbf8b6456a9206d9702bba80a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:03.336199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] flavor_id is None. Assuming migration. {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 01 10:27:03.337463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 10:27:03.419081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:03.421043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:03.437976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:03.440537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:03.444666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:03.445231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:03.541756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:03.554991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0017c9a6-0fd3-40b0-b4e3-6ca90eb8bb5f tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1273 microversion: 2.1 time: 0.140232 Jul 01 10:27:03.558140 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 193/391] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:03 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:03.570202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa047cda-71b9-4c59-a8ec-5769807fab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:03.573177 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa047cda-71b9-4c59-a8ec-5769807fab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:03.732765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa047cda-71b9-4c59-a8ec-5769807fab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:03.741016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa047cda-71b9-4c59-a8ec-5769807fab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1219 microversion: 2.1 time: 0.181642 Jul 01 10:27:03.743979 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 194/392] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:03 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:04.574461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:04.576080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:04.585275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:04.587515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:04.589031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:04.589742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:04.719086 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77113d65-a2b5-42ff-abad-425e122747a3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c/action" status: 202 len: 0 microversion: 2.1 time: 1.535048 Jul 01 10:27:04.723004 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 199/393] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:27:03 2022] POST /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c/action => generated 0 bytes in 1540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:04.732452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:04.734304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:04.742355 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:04.743693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:04.744791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:04.745597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:05.243746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:05.248542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:05.249881 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:05.256625 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a56c1234-cf0a-4104-b674-330da4095cb1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 0.686579 Jul 01 10:27:05.258927 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc824543-42aa-4d34-8986-a864a7b5eb71 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1471 microversion: 2.1 time: 0.530973 Jul 01 10:27:05.259160 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 195/394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:04 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:05.263848 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 200/395] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:04 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1471 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:05.268428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:05.269040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:05.287140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:05.287265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:05.288253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:05.288851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:05.592832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e48c55c6-be44-407b-b045-94f9e2a21030 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1780954641", "id": 332078166, "os-flavor-access:is_public": "True"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:05.646683 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:05.646683 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:05.798978 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e48c55c6-be44-407b-b045-94f9e2a21030 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.532420 Jul 01 10:27:05.806750 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 201/396] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:05 2022] POST /compute/v2.1/flavors => generated 427 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:05.937029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f926eb0d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:05.938070 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:05.938070 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:05.939272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:05.941706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:05.978636 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:05.979517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:05.997762 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:06.048902 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-18a934f3-0da6-47df-8e55-ae21f41b3d4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1271 microversion: 2.1 time: 0.783601 Jul 01 10:27:06.050898 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 196/397] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:05 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1271 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:06.056274 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=11,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:06.060612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.061821 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.068538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-919e5f4a-e5a8-40b0-b1d0-2962da01567c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:06.069988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cbc54247-054c-4beb-be60-6f4de618b13b tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.262329 Jul 01 10:27:06.073623 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 202/398] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:06.074456 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:06.074456 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:06.082901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f926eb4c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:06.084495 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:06.084495 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:06.086266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.086965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.115611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.116395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.147422 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.147866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.161770 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f79934d-09ad-48dc-937f-e68a9e395f92 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.079269 Jul 01 10:27:06.166324 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 203/399] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Jul 1 10:27:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:06.189824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f926de940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:06.192260 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:06.192260 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:06.197403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.197979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.238922 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-919e5f4a-e5a8-40b0-b1d0-2962da01567c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/332078166" status: 202 len: 0 microversion: 2.1 time: 0.184332 Jul 01 10:27:06.239715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 197/400] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:27:06 2022] DELETE /compute/v2.1/flavors/332078166 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:06.241807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.243943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.249978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-625353cc-8629-4575-bead-466de0504439 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:06.294616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.295347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.315057 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-625353cc-8629-4575-bead-466de0504439 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.069299 Jul 01 10:27:06.315466 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf4352fa-70f0-4ed0-b6a3-e3abb9a656e3 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.142356 Jul 01 10:27:06.316695 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 204/401] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:06.320104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 198/402] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:06 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:06.327715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:06.349091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:06.349091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:06.349608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:06.363163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.364881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.365471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.366045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.366928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.368480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.369036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.370981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.920161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:06.932003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e331e76e-745a-41d4-82e4-ce13c0a1856e tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 0.613900 Jul 01 10:27:06.932789 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 205/403] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:06 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:06.939694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7b1d817-10fa-428f-a318-78fdc91b1b01 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f925fd9d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:06.940743 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:06.940743 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:06.942279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7b1d817-10fa-428f-a318-78fdc91b1b01 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.942893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7b1d817-10fa-428f-a318-78fdc91b1b01 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.968392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:06.981358 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c34b6a4-b281-4e1a-b35e-715ff9716d6e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1471 microversion: 2.1 time: 0.655607 Jul 01 10:27:06.981973 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 199/404] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:06 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1471 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:06.992002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cbe2b8d0-cb7b-4b38-85d8-b2f4e76262af tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1022931062", "id": 2043758728, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:06.993063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7b1d817-10fa-428f-a318-78fdc91b1b01 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:06.994371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7b1d817-10fa-428f-a318-78fdc91b1b01 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:06.996930 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:06.996930 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:07.006282 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7b1d817-10fa-428f-a318-78fdc91b1b01 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.071827 Jul 01 10:27:07.007866 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 206/405] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:27:06 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.028813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b43e8ef1-06f8-4b26-9c04-91e1887a7dfb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f925fd8b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.028813 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.028813 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:07.028813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b43e8ef1-06f8-4b26-9c04-91e1887a7dfb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.028813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b43e8ef1-06f8-4b26-9c04-91e1887a7dfb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.062957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b43e8ef1-06f8-4b26-9c04-91e1887a7dfb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.044683 Jul 01 10:27:07.066453 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 207/406] 10.222.0.23 () {58 vars in 1178 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.071549 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.073734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:07.089534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.090061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.090930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.091507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.165748 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cbe2b8d0-cb7b-4b38-85d8-b2f4e76262af tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.181449 Jul 01 10:27:07.171458 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 200/407] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:06 2022] POST /compute/v2.1/flavors => generated 417 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.172401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f9253c940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.173255 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.173255 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:07.177597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.178033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.198873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.199357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.212986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.213683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.221025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:07.246291 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f4b37ea9-132b-4e11-9cb1-e535a89b170d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1277 microversion: 2.1 time: 0.178731 Jul 01 10:27:07.257930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a857d90a-4cc8-4ab2-a300-990e73e1dbad tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089892 Jul 01 10:27:07.262378 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 208/408] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:07.262641 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 201/409] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.267972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c248fdb-7040-4f69-bae4-86811414e867 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.277064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-221ac0c4-2705-4e51-b112-317729dd0b2b req-16235a11-41d9-4a15-b96a-a0213d6a9c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c34990-434f-4eba-8949-58aef875f13e", "tag": "4c664d29-f533-4d28-9279-920175ff5640"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:07.297288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-221ac0c4-2705-4e51-b112-317729dd0b2b req-16235a11-41d9-4a15-b96a-a0213d6a9c9b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.299045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-221ac0c4-2705-4e51-b112-317729dd0b2b req-16235a11-41d9-4a15-b96a-a0213d6a9c9b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.304017 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c248fdb-7040-4f69-bae4-86811414e867 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.040364 Jul 01 10:27:07.306157 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 209/410] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:07.314726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86e3a722-fb61-46ee-a0c4-9b859747ccb2 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f928c7700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.315900 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.315900 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:07.317811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e3a722-fb61-46ee-a0c4-9b859747ccb2 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.318547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e3a722-fb61-46ee-a0c4-9b859747ccb2 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.340260 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-221ac0c4-2705-4e51-b112-317729dd0b2b req-16235a11-41d9-4a15-b96a-a0213d6a9c9b service nova] Creating event network-changed:4c664d29-f533-4d28-9279-920175ff5640 for instance 13c34990-434f-4eba-8949-58aef875f13e on n-h1-master-1 Jul 01 10:27:07.341293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e3a722-fb61-46ee-a0c4-9b859747ccb2 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.342022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e3a722-fb61-46ee-a0c4-9b859747ccb2 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.360007 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86e3a722-fb61-46ee-a0c4-9b859747ccb2 tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.043892 Jul 01 10:27:07.360007 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 210/411] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.360258 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-221ac0c4-2705-4e51-b112-317729dd0b2b req-16235a11-41d9-4a15-b96a-a0213d6a9c9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089518 Jul 01 10:27:07.360348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-171d6397-9378-40f6-9dbb-3731c646dbb6 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.360602 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.360602 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:07.360800 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 202/412] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.401554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7171542-e848-4ebb-b9c2-16bec8dbffeb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f92604430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.404314 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.404314 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:07.412596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7171542-e848-4ebb-b9c2-16bec8dbffeb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.415295 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7171542-e848-4ebb-b9c2-16bec8dbffeb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.465701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7171542-e848-4ebb-b9c2-16bec8dbffeb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.468387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7171542-e848-4ebb-b9c2-16bec8dbffeb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.474638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-171d6397-9378-40f6-9dbb-3731c646dbb6 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2043758728" status: 202 len: 0 microversion: 2.1 time: 0.120473 Jul 01 10:27:07.475484 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 211/413] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:27:07 2022] DELETE /compute/v2.1/flavors/2043758728 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:07.484337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4ed809d-78c6-4e2d-890f-09e996484479 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.496292 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7171542-e848-4ebb-b9c2-16bec8dbffeb tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.133866 Jul 01 10:27:07.500497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 203/414] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.515829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Calling method '.version_select at 0x7f6f9249dd30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.518045 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.518045 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:07.520537 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4ed809d-78c6-4e2d-890f-09e996484479 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.039781 Jul 01 10:27:07.521634 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 212/415] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:07.524374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.525004 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.556999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.557643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:07.564360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.564798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.565602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.566027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.573495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.575097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.605690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.606125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.619148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:27:07.666374 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a6dbd02-0ccc-478b-aad0-ef91ed31c45a tempest-HypervisorAdminTestJSON-1973113538 tempest-HypervisorAdminTestJSON-1973113538-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.154909 Jul 01 10:27:07.667018 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 204/416] 10.222.0.23 () {58 vars in 1172 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:27:07.684113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52c104cd-494d-4723-808c-361ea6c9bb61 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1129118009", "id": 160130018, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:07.689766 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.689766 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:07.800659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-52c104cd-494d-4723-808c-361ea6c9bb61 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.130159 Jul 01 10:27:07.806986 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 205/417] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:07 2022] POST /compute/v2.1/flavors => generated 426 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:07.814081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a30c1672-9cb4-408e-adf3-60f700b40e68 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.815796 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:07.815796 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:07.889835 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a30c1672-9cb4-408e-adf3-60f700b40e68 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/160130018" status: 202 len: 0 microversion: 2.1 time: 0.081552 Jul 01 10:27:07.890903 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 206/418] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:27:07 2022] DELETE /compute/v2.1/flavors/160130018 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:07.898490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81a34034-b9c9-483f-b3d4-ef9c447f874f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.951401 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81a34034-b9c9-483f-b3d4-ef9c447f874f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.056221 Jul 01 10:27:07.954638 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 207/419] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:07.963280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:07.963280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:07.984536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.985750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:07.986550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:07.986982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:08.144537 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d4087abc-86eb-462d-b1c9-920459665d40 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 204 len: 0 microversion: 2.1 time: 0.602561 Jul 01 10:27:08.145524 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 213/420] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:27:07 2022] DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:27:08.160129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-584d45a7-395d-48af-bff7-bfab48f20001 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-538812400", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:08.166545 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:08.166545 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:08.261664 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-584d45a7-395d-48af-bff7-bfab48f20001 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.111260 Jul 01 10:27:08.264331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 214/421] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:08 2022] POST /compute/v2.1/flavors => generated 506 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:08.277255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:08.278663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:08.295446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:08.300293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:08.300293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:08.300293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:08.455493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:08.469359 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5208c0b4-c3e6-4938-ad14-b7f420582071 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 0.513523 Jul 01 10:27:08.478070 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 208/422] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:07 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:08.497279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:08.504502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:08.507749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:08.508941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:08.509909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:08.510492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:08.675970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:08.688900 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95ae2ebf-3b94-4ef3-aebb-b83c566a7606 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1277 microversion: 2.1 time: 0.204772 Jul 01 10:27:08.702370 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 209/423] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:08 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:08.713211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-388135ec-af4d-49a2-a344-8f0a78ab96a4 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:08.716421 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:08.716421 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:08.748090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:08.756535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2f532ec4-c3a1-420f-adf0-aebe58234c26 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1471 microversion: 2.1 time: 0.490771 Jul 01 10:27:08.757121 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 215/424] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:08 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1471 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:08.772331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-692950898", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "1716007003", "adminPass": "***", "networks": [{"uuid": "229800ac-3106-4586-b921-a4584ed57044"}], "security_groups": [{"name": "tempest-securitygroup--1437882706"}], "key_name": "tempest-keypair-880502020", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:08.788814 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-388135ec-af4d-49a2-a344-8f0a78ab96a4 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/5ba50653-d199-4fef-8bf7-607c3993e050" status: 202 len: 0 microversion: 2.1 time: 0.084933 Jul 01 10:27:08.789987 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 210/425] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:27:08 2022] DELETE /compute/v2.1/flavors/5ba50653-d199-4fef-8bf7-607c3993e050 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:08.800000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38cc5366-4c8f-4999-a12e-ab39152816ab tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:08.837780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38cc5366-4c8f-4999-a12e-ab39152816ab tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.043282 Jul 01 10:27:08.839168 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 211/426] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:08 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:08.862150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4f2c4d9-c31b-4298-acc6-7256585f9844 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1946496246", "id": "2310108f-3dd2-4fa7-9664-675e490f1d47", "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:08.865945 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:08.865945 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:08.964733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4f2c4d9-c31b-4298-acc6-7256585f9844 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.111704 Jul 01 10:27:08.965676 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 212/427] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:08 2022] POST /compute/v2.1/flavors => generated 507 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:08.975956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b190aae-8e84-486e-84d4-c439cfae52c0 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:08.987237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] validate_networks() for [('229800ac-3106-4586-b921-a4584ed57044', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:27:08.999832 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=11,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:09.088961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b190aae-8e84-486e-84d4-c439cfae52c0 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2310108f-3dd2-4fa7-9664-675e490f1d47" status: 202 len: 0 microversion: 2.1 time: 0.116982 Jul 01 10:27:09.089717 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 213/428] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:27:08 2022] DELETE /compute/v2.1/flavors/2310108f-3dd2-4fa7-9664-675e490f1d47 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:27:09.097994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-47ad8eee-4a4f-4f96-84d7-9b47c3f1f351 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:09.160691 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-47ad8eee-4a4f-4f96-84d7-9b47c3f1f351 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.066269 Jul 01 10:27:09.194873 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 214/429] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:09 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:09.201913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f675e420-3350-456c-b936-71f16b3ec269 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-33565309", "id": 160942057, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:09.320464 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f675e420-3350-456c-b936-71f16b3ec269 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.124160 Jul 01 10:27:09.328641 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 215/430] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:09.357217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6dc219c7-56a2-42c2-b358-4227feba85e7 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:09.371514 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6dc219c7-56a2-42c2-b358-4227feba85e7 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/160942057" status: 200 len: 409 microversion: 2.1 time: 0.039427 Jul 01 10:27:09.372329 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 216/431] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:27:09 2022] GET /compute/v2.1/flavors/160942057 => generated 409 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:09.847250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6479f50e-37d0-4590-881c-d3e5110e0f2f tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:09.902879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6479f50e-37d0-4590-881c-d3e5110e0f2f tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.522144 Jul 01 10:27:09.906867 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 217/432] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:09 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:09.932155 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:09.932788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:09.952925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:09.961829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:09.961829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:09.961829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:10.175313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:27:10.175808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:27:10.176188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:27:10.182904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:27:10.182904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:27:10.204438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:10.204880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:10.210651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:10.213338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:10.256953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Getting quotas for project e215073c20cc458983a0912389cb4e44. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:10.270740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:10.279535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Getting quotas for user d00b392abf154820b4e5bce216b7e406 and project e215073c20cc458983a0912389cb4e44. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:10.285506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-afdd7c6f-1fef-4f63-a9e6-5ed238951ccb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 0.376917 Jul 01 10:27:10.286522 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 218/433] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:09 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:10.294897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:10.295825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:10.319855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:27:10.322862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:10.323315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:10.323824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:27:10.329967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:10.330591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:10.561987 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6194e253-59c3-46cb-96c6-94ed1f727e71 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.794247 Jul 01 10:27:10.563319 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 216/434] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:27:10.576068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:10.576934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:10.589937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:10.589937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:10.589937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:10.589937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:10.609129 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:11.288342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:11.322953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e92e9d4e-8f26-4354-bb95-b7d8d1814978 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 1.033046 Jul 01 10:27:11.324165 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 219/435] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:10 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:11.330757 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f21c2918-3ac8-4e26-95ab-147568ede2cd tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:11.332034 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:11.332034 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:11.440630 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f21c2918-3ac8-4e26-95ab-147568ede2cd tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/160942057" status: 202 len: 0 microversion: 2.1 time: 0.114437 Jul 01 10:27:11.441819 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 220/436] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:27:11 2022] DELETE /compute/v2.1/flavors/160942057 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:11.449433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ab5fa3c-0901-44f0-b385-f2bd12b40217 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:11.454830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4ab5fa3c-0901-44f0-b385-f2bd12b40217 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:11.638980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:11.649455 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9431e3a4-c100-40a1-b7d8-77b9aa2ac5c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1471 microversion: 2.1 time: 1.084110 Jul 01 10:27:11.655642 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 217/437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:10 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1471 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:11.664144 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:11.669071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:11.705931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:11.709075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:11.711102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:11.712498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:11.889051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4ab5fa3c-0901-44f0-b385-f2bd12b40217 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:11.904718 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4ab5fa3c-0901-44f0-b385-f2bd12b40217 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1263 microversion: 2.1 time: 0.459739 Jul 01 10:27:11.941557 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 221/438] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:11 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1263 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:11.959547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd927893-a185-4e22-bbf3-dc0e0fca3218 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:12.030278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd927893-a185-4e22-bbf3-dc0e0fca3218 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.087217 Jul 01 10:27:12.059807 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 222/439] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:11 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:12.073430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bd74021d-e29e-48f8-ae0d-9fe3dbbea64c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-175684076", "id": 303593761, "os-flavor-access:is_public": "False"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:12.074980 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:12.074980 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:12.088673 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:12.157870 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bd74021d-e29e-48f8-ae0d-9fe3dbbea64c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.097012 Jul 01 10:27:12.158712 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 223/440] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:12 2022] POST /compute/v2.1/flavors => generated 426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:12.169902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad09533f-1c5a-4842-97be-76df998222ff tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "303593761"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:12.215890 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ad09533f-1c5a-4842-97be-76df998222ff tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] HTTP exception thrown: Flavor 303593761 could not be found. Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad09533f-1c5a-4842-97be-76df998222ff tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] Request method failure captured: Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 106 Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsv274R1rTEjYmzsqKKHmjtQfWC0KSg9_Xo12mWS9vlyQAkJOQo-Ov94khtcPl5p-SQbn3Pj7f-RUt4Syq7PquDB5R6Z9_4-mU7eUG5G8t0e3AIaRJd1YR6AuJDAIRfLeVGrRjBU_Dcyy5MqbKBcYNXsEaLkV_7UL09wWOPMMl4CH-8 Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: de10cfb503e0413a97c1dcf82c226783 Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsAdminTestJSON-832515492 Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:27:12.218151 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de10cfb503e0413a97c1dcf82c226783"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de10cfb503e0413a97c1dcf82c226783"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de10cfb503e0413a97c1dcf82c226783", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de10cfb503e0413a97c1dcf82c226783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsAdminTestJSON-832515492 Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: de10cfb503e0413a97c1dcf82c226783 Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-832515492 Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsAdminTestJSON-832515492-project Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: ab80fb01e73f430cb2e506d1c6cdd23c Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsAdminTestJSON-832515492-project Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "test", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "303593761"}} Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:27:12.219394 n-d-master-1 devstack@n-api.service[119764]: exception: Flavor 303593761 could not be found. Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '303593761'}}} Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 303593761 could not be found. Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:12.220598 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 303593761 could not be found. Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:12.222274 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:12.224804 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:12.224804 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:27:12.224804 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:27:12.224804 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 303593761 could not be found. Jul 01 10:27:12.224804 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:12.224804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad09533f-1c5a-4842-97be-76df998222ff tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] Returning 400 to user: Flavor 303593761 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:12.224804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad09533f-1c5a-4842-97be-76df998222ff tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.053708 Jul 01 10:27:12.231518 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 224/441] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:12 2022] POST /compute/v2.1/servers => generated 80 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:27:12.233737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a531a065-443c-4b7f-8c5e-a9fcca758295 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:12.240352 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:12.240352 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:12.389102 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a531a065-443c-4b7f-8c5e-a9fcca758295 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/303593761" status: 202 len: 0 microversion: 2.1 time: 0.161236 Jul 01 10:27:12.391409 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 225/442] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:27:12 2022] DELETE /compute/v2.1/flavors/303593761 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:12.397869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:12.399275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:12.407406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:12.408277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:12.409296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:12.409978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:12.809393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:12.818870 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7abba274-cf87-4b23-836b-ac4a445d7ede tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 1.161679 Jul 01 10:27:12.820015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 218/443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:11 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:12.834590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f0b2e63-5ac2-44df-97e5-8fa2ffca34ca tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:12.873717 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f0b2e63-5ac2-44df-97e5-8fa2ffca34ca tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.040045 Jul 01 10:27:12.873717 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 219/444] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:12 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:12.873717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:12.873717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:12.876967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:12.877437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:12.878209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:12.878633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:13.592880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:13.603479 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51411f05-6527-43e2-915e-06fba26678a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1471 microversion: 2.1 time: 0.739947 Jul 01 10:27:13.607455 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 220/445] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:12 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1471 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:13.631289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20388ca1-97fe-4ba5-a465-7f6d57bd781e tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-106028298", "id": 1013372500, "os-flavor-access:is_public": "False"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:13.637071 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:13.637071 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:13.743033 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20388ca1-97fe-4ba5-a465-7f6d57bd781e tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.129336 Jul 01 10:27:13.744206 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 221/446] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:13 2022] POST /compute/v2.1/flavors => generated 414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:13.751636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:13.755207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:13.769271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:13.769959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:13.775357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:13.779029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:13.795271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:13.816989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d635a05f-6e6f-4986-b03a-f68f9b7449cd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 1.424139 Jul 01 10:27:13.833989 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 226/447] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:12 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:13.846631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f1536d56-9602-47e9-add9-1017b7b9a76b req-9c382f36-4399-475e-b986-051841d3b7dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56be635-1bd7-40c9-b62e-c6d3710f52c6", "tag": "72946124-356f-475a-8aef-b673fc28b874"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:13.893918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f1536d56-9602-47e9-add9-1017b7b9a76b req-9c382f36-4399-475e-b986-051841d3b7dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:13.898410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f1536d56-9602-47e9-add9-1017b7b9a76b req-9c382f36-4399-475e-b986-051841d3b7dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:13.940432 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f1536d56-9602-47e9-add9-1017b7b9a76b req-9c382f36-4399-475e-b986-051841d3b7dc service nova] Creating event network-changed:72946124-356f-475a-8aef-b673fc28b874 for instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 on n-h1-master-1 Jul 01 10:27:13.956932 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f1536d56-9602-47e9-add9-1017b7b9a76b req-9c382f36-4399-475e-b986-051841d3b7dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121281 Jul 01 10:27:13.957883 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 227/448] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:13.974110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:13.995929 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0821bcfc-0cf1-4f01-bb09-db1bec8b0698 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1323 microversion: 2.1 time: 0.250112 Jul 01 10:27:13.997104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 222/449] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:13 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:14.007639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-835ce452-475d-47b5-8988-4c0e40567ce1 req-2847d013-d4f0-44c6-baf5-61852a321f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1104472d-27ae-4dfc-afaa-fc1f4c6d52a7", "tag": "29d02663-dbc8-4074-aafb-728f803f4182"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:14.026626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-835ce452-475d-47b5-8988-4c0e40567ce1 req-2847d013-d4f0-44c6-baf5-61852a321f5a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:14.029895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-835ce452-475d-47b5-8988-4c0e40567ce1 req-2847d013-d4f0-44c6-baf5-61852a321f5a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:14.056349 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-835ce452-475d-47b5-8988-4c0e40567ce1 req-2847d013-d4f0-44c6-baf5-61852a321f5a service nova] Creating event network-changed:29d02663-dbc8-4074-aafb-728f803f4182 for instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 on n-h1-master-1 Jul 01 10:27:14.066238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-835ce452-475d-47b5-8988-4c0e40567ce1 req-2847d013-d4f0-44c6-baf5-61852a321f5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067585 Jul 01 10:27:14.070221 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 223/450] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:14.081044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9b646ddc-ec0a-4bef-a1af-0af58346a1cb tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1103651150", "id": 1359427840, "os-flavor-access:is_public": "True"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:14.088690 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:14.088690 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:14.394203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9b646ddc-ec0a-4bef-a1af-0af58346a1cb tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.200181 Jul 01 10:27:14.394203 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 224/451] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:14 2022] POST /compute/v2.1/flavors => generated 414 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:14.394203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:14.394203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:14.394203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:14.395380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:14.395380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:14.395380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:14.412769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d312d5b3-e790-4d57-a56f-65e54d1df29d tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-111219449", "ram": 512, "vcpus": 1, "disk": 10, "id": 1050969650, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:14.415097 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:14.415097 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:14.705175 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d312d5b3-e790-4d57-a56f-65e54d1df29d tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.744829 Jul 01 10:27:14.706962 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 228/452] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:13 2022] POST /compute/v2.1/flavors => generated 415 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:14.723845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b9ceebe0-39ba-4e0c-9c25-5ff76fa28aa1 req-12a36ed3-af57-411d-b4b8-37a146e672fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671d0a80-8e15-49a6-8f16-eb2e010d24cc", "name": "network-vif-unplugged", "status": "completed", "tag": "2cffdcd3-a5cd-424f-b85c-e885009b8f47"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:14.749951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b9ceebe0-39ba-4e0c-9c25-5ff76fa28aa1 req-12a36ed3-af57-411d-b4b8-37a146e672fd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:14.749951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b9ceebe0-39ba-4e0c-9c25-5ff76fa28aa1 req-12a36ed3-af57-411d-b4b8-37a146e672fd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:14.759386 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b9ceebe0-39ba-4e0c-9c25-5ff76fa28aa1 req-12a36ed3-af57-411d-b4b8-37a146e672fd service nova] Creating event network-vif-unplugged:2cffdcd3-a5cd-424f-b85c-e885009b8f47 for instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc on n-h1-master-1 Jul 01 10:27:14.764887 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b9ceebe0-39ba-4e0c-9c25-5ff76fa28aa1 req-12a36ed3-af57-411d-b4b8-37a146e672fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055598 Jul 01 10:27:14.765612 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 229/453] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:14.786706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-61d4f928-7928-4d88-94f2-43ee68534da1 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:14.825961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-61d4f928-7928-4d88-94f2-43ee68534da1 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.059126 Jul 01 10:27:14.833956 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 230/454] 10.222.0.23 () {58 vars in 1168 bytes} [Fri Jul 1 10:27:14 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:14.833956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:14.834864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:14.861374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:14.862091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:14.864640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:14.866556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:14.944097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:14.954844 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b4d6f1a-7032-4e07-8a7d-2ebec8b49b0c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 0.680258 Jul 01 10:27:14.957922 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 225/455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:14 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:14.968423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a0904c4f-ae98-423c-b2a1-bca189d7361e tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:14.976232 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:14.976232 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:15.101049 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a0904c4f-ae98-423c-b2a1-bca189d7361e tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1050969650/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.143949 Jul 01 10:27:15.104841 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 226/456] 10.222.0.23 () {60 vars in 1223 bytes} [Fri Jul 1 10:27:14 2022] POST /compute/v2.1/flavors/1050969650/os-extra_specs => generated 66 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:15.109593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f348df6e-8af5-4789-988c-80a83d27ad65 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.168057 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f348df6e-8af5-4789-988c-80a83d27ad65 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.064655 Jul 01 10:27:15.174202 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 227/457] 10.222.0.23 () {58 vars in 1176 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:15.174202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.174202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:15.187438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:15.187633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:15.188480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:15.188860 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:15.221953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:15.238327 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e5e4d8d-6c80-48f6-a8b5-6e006cd773a3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1471 microversion: 2.1 time: 0.405523 Jul 01 10:27:15.249719 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 231/458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:14 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:15.254980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.256521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:15.262682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:15.265106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:15.266138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:15.266720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:15.408415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:15.417790 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6e32378-173e-4199-9a75-3a4c159bd73d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1321 microversion: 2.1 time: 0.166620 Jul 01 10:27:15.424146 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 232/459] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:15.526372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:15.537520 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-122a075f-f417-42c6-903f-ab581d125f26 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 0.367341 Jul 01 10:27:15.538112 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 228/460] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:15.550217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e76e57d6-08e1-4781-8c11-f4ddf2461f04 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.563479 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:15.565753 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e76e57d6-08e1-4781-8c11-f4ddf2461f04 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.026557 Jul 01 10:27:15.567596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-775e1bf3-fb1e-486d-a328-389e2d48ffe6 tempest-FlavorsExtraSpecsTestJSON-1295767655 tempest-FlavorsExtraSpecsTestJSON-1295767655-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.579973 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-775e1bf3-fb1e-486d-a328-389e2d48ffe6 tempest-FlavorsExtraSpecsTestJSON-1295767655 tempest-FlavorsExtraSpecsTestJSON-1295767655-project] 10.222.0.23 "GET /compute/v2.1/flavors/1050969650/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.154107 Jul 01 10:27:15.580742 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 233/461] 10.222.0.23 () {58 vars in 1202 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/1050969650/os-extra_specs => generated 66 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:15.585355 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 229/462] 10.222.0.23 () {58 vars in 1170 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:15.596421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19c9137f-ece3-407f-bea0-67700638a25b tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:15.603786 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:15.603786 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:15.605384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-88ff1464-a6f2-4ae4-b4c1-4c3989a7b8d0 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.638586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-88ff1464-a6f2-4ae4-b4c1-4c3989a7b8d0 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.046145 Jul 01 10:27:15.639909 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 234/463] 10.222.0.23 () {58 vars in 1168 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:15.665720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f6fd713-6dc2-494a-99d4-c81b4a7edc6f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.705128 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-19c9137f-ece3-407f-bea0-67700638a25b tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1050969650/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.117607 Jul 01 10:27:15.705785 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 230/464] 10.222.0.23 () {60 vars in 1223 bytes} [Fri Jul 1 10:27:15 2022] POST /compute/v2.1/flavors/1050969650/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 10:27:15.718803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90881db8-2107-4a4e-b63b-50af0c1270c4 tempest-FlavorsExtraSpecsTestJSON-1295767655 tempest-FlavorsExtraSpecsTestJSON-1295767655-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.735960 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-90881db8-2107-4a4e-b63b-50af0c1270c4 tempest-FlavorsExtraSpecsTestJSON-1295767655 tempest-FlavorsExtraSpecsTestJSON-1295767655-project] 10.222.0.23 "GET /compute/v2.1/flavors/1050969650/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023117 Jul 01 10:27:15.741959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 231/465] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/1050969650/os-extra_specs/hw:numa_nodes => generated 22 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 10:27:15.747120 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f6fd713-6dc2-494a-99d4-c81b4a7edc6f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6628 microversion: 2.1 time: 0.099559 Jul 01 10:27:15.753402 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 235/466] 10.222.0.23 () {58 vars in 1168 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6628 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:15.756585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57f4514f-1829-49a4-8f52-ed2635994564 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:15.771236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5dbc757-dd39-4108-b29b-afe2c296b49d tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.821195 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-57f4514f-1829-49a4-8f52-ed2635994564 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1050969650/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.077932 Jul 01 10:27:15.821811 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 232/467] 10.222.0.23 () {60 vars in 1223 bytes} [Fri Jul 1 10:27:15 2022] POST /compute/v2.1/flavors/1050969650/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:15.836965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-410d8a25-b05a-44a7-bf0f-9af10e957fcb tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.850563 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5dbc757-dd39-4108-b29b-afe2c296b49d tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6628 microversion: 2.1 time: 0.083307 Jul 01 10:27:15.853750 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 236/468] 10.222.0.23 () {58 vars in 1174 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6628 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:15.867864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53994f02-acdc-4bb6-b4fe-28ca7078e71c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:15.871720 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-410d8a25-b05a-44a7-bf0f-9af10e957fcb tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1050969650/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040419 Jul 01 10:27:15.873835 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 233/469] 10.222.0.23 () {58 vars in 1202 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/1050969650/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:15.891167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c69bb4ae-bfa7-48d6-b01d-aa0d09e44c9f tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:15.899484 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:15.899484 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:15.940398 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53994f02-acdc-4bb6-b4fe-28ca7078e71c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6628 microversion: 2.1 time: 0.075631 Jul 01 10:27:15.943405 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 237/470] 10.222.0.23 () {58 vars in 1172 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6628 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:15.965943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-606acb5d-26f0-432c-a326-0550ee4533c7 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.038490 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-606acb5d-26f0-432c-a326-0550ee4533c7 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6628 microversion: 2.1 time: 0.083232 Jul 01 10:27:16.039924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 238/471] 10.222.0.23 () {58 vars in 1168 bytes} [Fri Jul 1 10:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6628 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:16.049391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.050336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:16.064717 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c69bb4ae-bfa7-48d6-b01d-aa0d09e44c9f tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1050969650/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.181859 Jul 01 10:27:16.065521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:16.066103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:16.067024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:16.067696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:16.068086 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 234/472] 10.222.0.23 () {60 vars in 1264 bytes} [Fri Jul 1 10:27:15 2022] PUT /compute/v2.1/flavors/1050969650/os-extra_specs/hw:numa_nodes => generated 22 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 10:27:16.079939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3e702c6-5e03-48af-90fe-0b7924274976 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.080774 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:16.080774 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:16.199740 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3e702c6-5e03-48af-90fe-0b7924274976 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1359427840" status: 202 len: 0 microversion: 2.1 time: 0.130508 Jul 01 10:27:16.203370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 235/473] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:27:16 2022] DELETE /compute/v2.1/flavors/1359427840 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:16.206980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad0ef5bf-a88b-484c-b897-4c71d992111c tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.229174 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad0ef5bf-a88b-484c-b897-4c71d992111c tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1050969650/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027267 Jul 01 10:27:16.230103 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 236/474] 10.222.0.23 () {58 vars in 1202 bytes} [Fri Jul 1 10:27:16 2022] GET /compute/v2.1/flavors/1050969650/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:16.242952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af03f88f-f340-45e5-bf8c-89fbc69cc01f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.303070 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af03f88f-f340-45e5-bf8c-89fbc69cc01f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.071812 Jul 01 10:27:16.309201 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 237/475] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:16 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:16.314061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca8524b1-640d-4dee-90ac-d443078dde6c tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.315979 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:16.315979 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:16.474211 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca8524b1-640d-4dee-90ac-d443078dde6c tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1050969650/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.163523 Jul 01 10:27:16.475504 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 238/476] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:27:16 2022] DELETE /compute/v2.1/flavors/1050969650/os-extra_specs/hw:numa_nodes => generated 0 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:27:16.484184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.486401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:16.495054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:16.498840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:16.498840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:16.498840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:16.545327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:16.562059 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23fdf0ef-470b-41e1-89cf-f23cc242b76d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 0.514571 Jul 01 10:27:16.562059 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 239/477] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:16 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:16.569822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79925aa1-88f7-428a-b910-dff3ad386411 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.571247 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:16.571247 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:16.672662 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79925aa1-88f7-428a-b910-dff3ad386411 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1013372500" status: 202 len: 0 microversion: 2.1 time: 0.111616 Jul 01 10:27:16.673253 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 240/478] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:27:16 2022] DELETE /compute/v2.1/flavors/1013372500 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:16.680805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:16.682683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:16.695582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:16.698463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:16.702379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:16.703040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:17.038390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:17.049911 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d057f54e-d0d9-42fd-94fd-d5f73119795e tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.374804 Jul 01 10:27:17.052672 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 241/479] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:16 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:17.061722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0d1b1b06-487f-4ec0-9f28-52345c32d812 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.062483 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:17.062483 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:17.070585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:17.082526 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e172b2d3-bf8d-4ed2-92b5-6aa7eb3df739 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.605594 Jul 01 10:27:17.099393 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 239/480] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:16 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:17.110149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.114897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:17.139006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:17.139478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:17.140586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:17.141022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:17.200322 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0d1b1b06-487f-4ec0-9f28-52345c32d812 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1050969650/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.142754 Jul 01 10:27:17.201246 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 242/481] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:27:17 2022] DELETE /compute/v2.1/flavors/1050969650/os-extra_specs/hw:cpu_policy => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 10:27:17.208740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7db49496-f2f6-4249-a28b-997892da2f1c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.245032 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7db49496-f2f6-4249-a28b-997892da2f1c tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.042287 Jul 01 10:27:17.246313 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 243/482] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:17.251647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a0743fc7-d2c7-4693-bb96-91a19667aa62 req-72727351-89a4-4710-8ef5-47440226f270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671d0a80-8e15-49a6-8f16-eb2e010d24cc", "name": "network-vif-deleted", "tag": "2cffdcd3-a5cd-424f-b85c-e885009b8f47"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:17.276518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a0743fc7-d2c7-4693-bb96-91a19667aa62 req-72727351-89a4-4710-8ef5-47440226f270 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:17.277909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a0743fc7-d2c7-4693-bb96-91a19667aa62 req-72727351-89a4-4710-8ef5-47440226f270 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:17.302708 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a0743fc7-d2c7-4693-bb96-91a19667aa62 req-72727351-89a4-4710-8ef5-47440226f270 service nova] Creating event network-vif-deleted:2cffdcd3-a5cd-424f-b85c-e885009b8f47 for instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc on n-h1-master-1 Jul 01 10:27:17.309740 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a0743fc7-d2c7-4693-bb96-91a19667aa62 req-72727351-89a4-4710-8ef5-47440226f270 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061923 Jul 01 10:27:17.313112 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 244/483] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:17.317773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2854eee8-f77a-4352-9c29-4eb5bfff87a6 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.327701 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2854eee8-f77a-4352-9c29-4eb5bfff87a6 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1050969650/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014769 Jul 01 10:27:17.328531 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 245/484] 10.222.0.23 () {58 vars in 1202 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/flavors/1050969650/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:17.337054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7802e724-49de-4a1a-96f9-e0f2c8567b8f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1959909714", "id": 1213374004, "os-flavor-access:is_public": "False"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:17.339177 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:17.339177 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:17.431702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7802e724-49de-4a1a-96f9-e0f2c8567b8f tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.100983 Jul 01 10:27:17.434657 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 246/485] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:17 2022] POST /compute/v2.1/flavors => generated 415 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:17.448090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c90f641-4d3e-42a4-86c9-9b01b6bedc07 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.449312 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:17.449312 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:17.492640 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:17.593887 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c90f641-4d3e-42a4-86c9-9b01b6bedc07 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1050969650" status: 202 len: 0 microversion: 2.1 time: 0.156315 Jul 01 10:27:17.595877 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 247/486] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:27:17 2022] DELETE /compute/v2.1/flavors/1050969650 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:17.604944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e783fe8c-a612-4322-bb96-7ea6c67cb8e3 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.642509 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e783fe8c-a612-4322-bb96-7ea6c67cb8e3 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.044731 Jul 01 10:27:17.644017 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 248/487] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:17.651196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.652171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:17.659556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:17.660236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:17.666624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:17.666624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:17.698329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:17.711643 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-50f2d5dc-0327-4773-a17c-a7407eb1026a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 0.613734 Jul 01 10:27:17.712539 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 240/488] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:17.722170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-031e41a1-6013-4f78-9aae-e411100cfff1 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.771571 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-031e41a1-6013-4f78-9aae-e411100cfff1 tempest-FlavorsExtraSpecsTestJSON-1472122985 tempest-FlavorsExtraSpecsTestJSON-1472122985-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.057120 Jul 01 10:27:17.772908 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 241/489] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:17.779064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7770a5b-12b9-444d-babd-83592bc569eb tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.810234 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7770a5b-12b9-444d-babd-83592bc569eb tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.035155 Jul 01 10:27:17.817817 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 242/490] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:17.828288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2baa62fd-77e5-47de-a071-146e15f4c8bd tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.829492 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:17.829492 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:17.932442 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2baa62fd-77e5-47de-a071-146e15f4c8bd tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1213374004" status: 202 len: 0 microversion: 2.1 time: 0.108488 Jul 01 10:27:17.933525 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 243/491] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:27:17 2022] DELETE /compute/v2.1/flavors/1213374004 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:17.947257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91e2e356-b5e3-4e27-8055-13a17f1a9c84 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:17.985085 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91e2e356-b5e3-4e27-8055-13a17f1a9c84 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.045931 Jul 01 10:27:18.013710 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 244/492] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:18.024814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-83f4b9a0-c36c-4d49-9353-67dbb9c1269a tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2050661571", "id": 1592060599, "os-flavor-access:is_public": "True"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:18.027217 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:18.027217 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:18.130463 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-83f4b9a0-c36c-4d49-9353-67dbb9c1269a tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.111837 Jul 01 10:27:18.132003 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 245/493] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:27:18.137752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:18.145935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:18.159000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:18.163507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:18.163507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:18.163507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:18.736481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:18.748477 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d5b01c7e-88a2-4f09-8001-65846e9221b8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 1.102784 Jul 01 10:27:18.757703 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 249/494] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:17 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:18.764550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:18.765240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:18.775983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:18.778146 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:18.779479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:18.780974 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:18.829048 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:19.253224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:19.265330 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f280c00-5a77-4352-a38a-a8506f612320 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 1.132109 Jul 01 10:27:19.266070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 246/495] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:18 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:19.279389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e3c51d0-e9d5-419b-b9c3-1cd7bff0c0a0 tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:19.336802 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e3c51d0-e9d5-419b-b9c3-1cd7bff0c0a0 tempest-FlavorsAdminTestJSON-832515492 tempest-FlavorsAdminTestJSON-832515492-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.067422 Jul 01 10:27:19.338547 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 247/496] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:19 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:19.367979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a212b86a-f75c-4d50-a09f-f7d1a3a1f1b2 req-065cb1aa-de80-42cf-bcaa-e49e92fbfed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de87ae39-30f0-4c4d-8396-ed1f999f302e", "tag": "e20185bf-09da-41f5-99ac-f8a4268d19f5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:19.385384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a212b86a-f75c-4d50-a09f-f7d1a3a1f1b2 req-065cb1aa-de80-42cf-bcaa-e49e92fbfed1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:19.385993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a212b86a-f75c-4d50-a09f-f7d1a3a1f1b2 req-065cb1aa-de80-42cf-bcaa-e49e92fbfed1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:19.412608 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a212b86a-f75c-4d50-a09f-f7d1a3a1f1b2 req-065cb1aa-de80-42cf-bcaa-e49e92fbfed1 service nova] Creating event network-changed:e20185bf-09da-41f5-99ac-f8a4268d19f5 for instance de87ae39-30f0-4c4d-8396-ed1f999f302e on n-h2-master-1 Jul 01 10:27:19.421238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a212b86a-f75c-4d50-a09f-f7d1a3a1f1b2 req-065cb1aa-de80-42cf-bcaa-e49e92fbfed1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080724 Jul 01 10:27:19.421982 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 248/497] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:19.439723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-04e1d548-fdb8-4798-9f7f-cd52e7fe1e6e req-c8a73362-acb3-4517-ad5b-6dacf3bd7bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c34990-434f-4eba-8949-58aef875f13e", "name": "network-vif-plugged", "status": "completed", "tag": "4c664d29-f533-4d28-9279-920175ff5640"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:19.468188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-04e1d548-fdb8-4798-9f7f-cd52e7fe1e6e req-c8a73362-acb3-4517-ad5b-6dacf3bd7bf0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:19.469599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-04e1d548-fdb8-4798-9f7f-cd52e7fe1e6e req-c8a73362-acb3-4517-ad5b-6dacf3bd7bf0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:19.497885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-04e1d548-fdb8-4798-9f7f-cd52e7fe1e6e req-c8a73362-acb3-4517-ad5b-6dacf3bd7bf0 service nova] Creating event network-vif-plugged:4c664d29-f533-4d28-9279-920175ff5640 for instance 13c34990-434f-4eba-8949-58aef875f13e on n-h1-master-1 Jul 01 10:27:19.512157 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-04e1d548-fdb8-4798-9f7f-cd52e7fe1e6e req-c8a73362-acb3-4517-ad5b-6dacf3bd7bf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084786 Jul 01 10:27:19.514728 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 249/498] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:19.527399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:19.528142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:19.545730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:19.546412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:19.553259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:19.553259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:20.040223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:20.051675 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a693d160-714f-4f31-b352-18663e8744ac tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 0.532487 Jul 01 10:27:20.052721 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 250/499] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:19 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:20.062284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2153f1ec-b6e5-4af3-af40-345542dc5a49 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:20.070178 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:20.070178 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:27:20.100852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:20.124923 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-73dfd126-182e-489d-a461-7d3862ee896b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 1.365204 Jul 01 10:27:20.125589 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 250/500] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:18 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:20.140637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:20.141277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:20.174653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:20.175540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:20.176530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:20.177104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:20.228178 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=13 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:20.248880 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2153f1ec-b6e5-4af3-af40-345542dc5a49 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1592060599" status: 202 len: 0 microversion: 2.1 time: 0.194456 Jul 01 10:27:20.251292 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 251/501] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:27:20 2022] DELETE /compute/v2.1/flavors/1592060599 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:20.260713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36cddc40-c998-4bd6-81d7-d339aeee4971 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:20.301984 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-36cddc40-c998-4bd6-81d7-d339aeee4971 tempest-FlavorsAdminTestJSON-933265560 tempest-FlavorsAdminTestJSON-933265560-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.043578 Jul 01 10:27:20.305344 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 252/502] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:20 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:20.307741 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=46 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:20.324065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:20.325095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:20.342283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:20.346655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:20.347767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:20.348368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:20.689979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:20.690967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:20.700355 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff5e5c40-f70e-41d3-9e3a-ee7adeec857d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.393061 Jul 01 10:27:20.701371 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 253/503] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:20 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:20.703289 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ceab502-4f73-4de7-9bf2-05cfc764a968 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1315 microversion: 2.1 time: 0.566445 Jul 01 10:27:20.703932 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 251/504] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:20 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:21.073465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:21.074632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:21.089500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.090683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.098066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.098989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.143010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:21.143624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:21.165197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.165197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.165925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.166899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.766838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:21.777248 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3dee2b50-9fe1-4a47-ae85-102db41a9e18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.638480 Jul 01 10:27:21.778349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 252/505] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:21 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:21.783377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:21.786693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:21.791219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.791968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.792980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.793660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.800601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:21.810199 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c2c63ec2-ebff-433b-ae7b-59f32c95bd05 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 0.743588 Jul 01 10:27:21.822028 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 254/506] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:21 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:21.828661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:21.829569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:21.836177 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.836966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.838061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:21.838784 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:21.901737 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:22.145810 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=74,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=10,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:22.151012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:22.156733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:22.171167 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6cdcb46-5384-4b96-9502-ccc522deea88 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.391428 Jul 01 10:27:22.174464 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 253/507] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:21 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:22.187593 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0dae3e2-8b1d-4f14-a5fe-32a2d5221a3c tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1464 microversion: 2.1 time: 0.350566 Jul 01 10:27:22.187593 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 255/508] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:21 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:22.196061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1920385126", "metadata": {"image_type": "test"}}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:22.197870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:22.213928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:22.213928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:22.213928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:22.213928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:22.260745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Getting quotas for project 0312d8a40c804b1b9f413780b01253c0. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:22.266374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Getting quotas for user 4fdab3d8f0b143cd97b918b91429e73a and project 0312d8a40c804b1b9f413780b01253c0. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:22.798742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:22.799588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:22.809298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:22.813856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:22.817609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:22.817609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:23.029702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a8b5e9e-75e9-450e-9d5f-334b356dbbbe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "POST /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e/action" status: 202 len: 0 microversion: 2.1 time: 0.837793 Jul 01 10:27:23.032926 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 254/509] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:27:22 2022] POST /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e/action => generated 0 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:27:23.044207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:23.049778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:23.104741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:23.110332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:23.112164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:23.113374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:23.298228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:23.326003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-94f772e8-e15b-48e0-abbd-7540b5349b41 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.535218 Jul 01 10:27:23.331386 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 256/510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:22 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:23.351929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c11f93a2-5e37-4c29-b12f-2b0a2092c574 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f925d15e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:23.456324 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c11f93a2-5e37-4c29-b12f-2b0a2092c574 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.122736 Jul 01 10:27:23.462825 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 257/511] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:23 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:23.479566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:23.480584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:23.520829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:23.523706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:23.526152 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:23.528249 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:23.648270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:23.658807 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7644217e-eeea-45f8-88bc-8d5136f2bdec tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 0.624413 Jul 01 10:27:23.663497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 255/512] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:23 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:24.093558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:24.108241 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b316b58b-b0c9-4b59-9c27-b09b0c6feaaa tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.643509 Jul 01 10:27:24.119290 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 258/513] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:23 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:24.348912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:24.350309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:24.379208 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:24.380406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:24.381769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:24.382433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:24.471235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-188a3280-8028-4ae8-b2fc-23babea8694a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f9259adc0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:24.562118 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-188a3280-8028-4ae8-b2fc-23babea8694a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.095614 Jul 01 10:27:24.578809 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 259/514] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:24 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:24.680808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:24.682870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:24.691189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:24.691635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:24.696154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:24.698226 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:24.754368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:24.775145 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-13c52596-8386-4c74-8194-56ace97e7028 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.430844 Jul 01 10:27:24.776768 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 256/515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:24 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:24.854902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0db07dc7-057c-4e4b-a15c-92d554c00ce4 req-2c6b2116-21d5-44c8-aa7a-21c78e9d9ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56be635-1bd7-40c9-b62e-c6d3710f52c6", "name": "network-vif-plugged", "status": "completed", "tag": "72946124-356f-475a-8aef-b673fc28b874"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:24.872357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0db07dc7-057c-4e4b-a15c-92d554c00ce4 req-2c6b2116-21d5-44c8-aa7a-21c78e9d9ce9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:24.873172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0db07dc7-057c-4e4b-a15c-92d554c00ce4 req-2c6b2116-21d5-44c8-aa7a-21c78e9d9ce9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:24.891092 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0db07dc7-057c-4e4b-a15c-92d554c00ce4 req-2c6b2116-21d5-44c8-aa7a-21c78e9d9ce9 service nova] Creating event network-vif-plugged:72946124-356f-475a-8aef-b673fc28b874 for instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 on n-h1-master-1 Jul 01 10:27:24.897078 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0db07dc7-057c-4e4b-a15c-92d554c00ce4 req-2c6b2116-21d5-44c8-aa7a-21c78e9d9ce9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051768 Jul 01 10:27:24.898033 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 257/516] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:25.131156 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:25.131864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:25.134826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:25.149318 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67f17c89-f783-4e82-a202-7b6da1094011 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 0.471562 Jul 01 10:27:25.149932 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 260/517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:24 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:25.150934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:25.151960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:25.153114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:25.158131 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:25.565084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:25.576260 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9cb2ddb1-389c-4c8a-98d2-576c79aaf45d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.454092 Jul 01 10:27:25.577230 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 258/518] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:25 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:25.585554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5f54ce2-087f-4cd0-afb1-f14d0f86a0fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92625280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:25.668476 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b5f54ce2-087f-4cd0-afb1-f14d0f86a0fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.088939 Jul 01 10:27:25.669106 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 261/519] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:25 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:25.797544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:25.799106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:25.840110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:25.840597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:25.841647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:25.846732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:26.168640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:26.169432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:26.183245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:26.183979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:26.187351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:26.187920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:26.228611 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:26.574315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:26.582484 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.794407 Jul 01 10:27:26.583068 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 259/520] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:25 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:26.599169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:26.600154 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10773130-3c86-4918-84f6-7acad540c572 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.016304 Jul 01 10:27:26.606770 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 260/521] 10.222.0.23 () {56 vars in 885 bytes} [Fri Jul 1 10:27:26 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 01 10:27:26.625023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:26.628290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:26.670501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:26.671241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:26.673433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:26.674929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:27.036508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:27.049675 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8f25bac-a3f1-4c4f-b262-cd4598e64a74 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1319 microversion: 2.1 time: 0.885000 Jul 01 10:27:27.051219 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 262/522] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:26 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1319 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:27.062109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8186e75e-7dec-477d-bed6-6d1d194b2217 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f927cc280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:27.144139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:27.146646 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8186e75e-7dec-477d-bed6-6d1d194b2217 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.092565 Jul 01 10:27:27.147609 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 263/523] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:27 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:27.157717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-326e9fea-8cd6-45f7-bfab-96759507565e req-6538148b-82ef-4efa-8ed1-bf823872957c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1104472d-27ae-4dfc-afaa-fc1f4c6d52a7", "name": "network-vif-plugged", "status": "completed", "tag": "29d02663-dbc8-4074-aafb-728f803f4182"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:27.160856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ea7cf39-0577-4ed1-94da-277c28ed35cc tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.552505 Jul 01 10:27:27.161423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 261/524] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:26 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:27.186484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-326e9fea-8cd6-45f7-bfab-96759507565e req-6538148b-82ef-4efa-8ed1-bf823872957c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:27.190162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-326e9fea-8cd6-45f7-bfab-96759507565e req-6538148b-82ef-4efa-8ed1-bf823872957c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:27.215790 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-326e9fea-8cd6-45f7-bfab-96759507565e req-6538148b-82ef-4efa-8ed1-bf823872957c service nova] Creating event network-vif-plugged:29d02663-dbc8-4074-aafb-728f803f4182 for instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 on n-h1-master-1 Jul 01 10:27:27.223053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-326e9fea-8cd6-45f7-bfab-96759507565e req-6538148b-82ef-4efa-8ed1-bf823872957c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072020 Jul 01 10:27:27.225487 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 264/525] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:27.603020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:27.603740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:27.629645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:27.629645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:27.630520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:27.630520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:28.068577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:28.069465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:28.085171 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:28.085779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:28.087592 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:28.088288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:28.198481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:28.210086 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1455bc5a-d9ff-4b53-b863-63935dab5e99 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.611899 Jul 01 10:27:28.223850 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 262/526] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:27 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:28.238328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3bd89619-bd30-4d9d-9256-749657502d36 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923d15e0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:28.435755 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:28.448042 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de4c14a5-4b8e-4208-9b9a-71860df2dc6d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1469 microversion: 2.1 time: 0.380100 Jul 01 10:27:28.448938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 265/527] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:28 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1469 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:28.459697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:28.461005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:28.474569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:28.475016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:28.475799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:28.481328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:28.816815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:28.847994 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdc22270-09b3-491f-b395-9049cc0e6d36 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.395790 Jul 01 10:27:28.871935 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 266/528] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:28 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:28.946095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:28.970233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:29.007043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:29.016393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:29.017548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:29.021051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:29.315308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:29.325500 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc4f7daf-ce33-4131-8679-84d38f81d62f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1319 microversion: 2.1 time: 0.452327 Jul 01 10:27:29.326479 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 267/529] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:28 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:29.331452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:29.332614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:29.340795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:29.341678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:29.342698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:29.343288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:29.682692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:29.704822 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51767ef7-5bd8-402a-ab6a-29564c9af633 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.367157 Jul 01 10:27:29.710432 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 268/530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:29 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:29.718781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4637c59a-695e-439b-b83e-02d01c60e2ba req-7437cbb8-44b5-4aca-b7f8-6b65f10c6830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de87ae39-30f0-4c4d-8396-ed1f999f302e", "name": "network-vif-plugged", "status": "completed", "tag": "e20185bf-09da-41f5-99ac-f8a4268d19f5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:29.745827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4637c59a-695e-439b-b83e-02d01c60e2ba req-7437cbb8-44b5-4aca-b7f8-6b65f10c6830 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:29.746346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4637c59a-695e-439b-b83e-02d01c60e2ba req-7437cbb8-44b5-4aca-b7f8-6b65f10c6830 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:29.778479 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4637c59a-695e-439b-b83e-02d01c60e2ba req-7437cbb8-44b5-4aca-b7f8-6b65f10c6830 service nova] Creating event network-vif-plugged:e20185bf-09da-41f5-99ac-f8a4268d19f5 for instance de87ae39-30f0-4c4d-8396-ed1f999f302e on n-h2-master-1 Jul 01 10:27:29.819109 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4637c59a-695e-439b-b83e-02d01c60e2ba req-7437cbb8-44b5-4aca-b7f8-6b65f10c6830 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099846 Jul 01 10:27:29.824342 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 269/531] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:29.896393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:29.897776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:29.917129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:29.917129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:29.921663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:29.923629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:30.444295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:30.508088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-893db970-079c-4414-b2bf-53e129f0133b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1389 microversion: 2.1 time: 0.586933 Jul 01 10:27:30.532662 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 270/532] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:29 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1389 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:30.557299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:30.566457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:30.596443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:30.598852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:30.600902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:30.604305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:31.024530 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:31.039846 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f78a82de-3384-4cab-b31b-f515354f7478 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1469 microversion: 2.1 time: 0.497442 Jul 01 10:27:31.039846 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 271/533] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:30 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1469 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:31.046615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:31.047543 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:31.062271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:31.068268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:31.068268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:31.068268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:31.558544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:31.566650 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6ef5ec3-c7e2-43b4-b106-01be80797c5f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1476 microversion: 2.1 time: 0.528812 Jul 01 10:27:31.570663 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 272/534] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:31 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1476 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:31.592019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:31.600649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:31.602837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Searching by: {'reservation_id': 'r-8d0s86a4', 'deleted': False, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:27:31.634280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:31.638090 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:31.642633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:31.648635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:32.326519 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:27:32.822748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:32.855635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:32.863966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:34.023469 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7536ac6b-b8a9-4a10-b159-1071883b1dd1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-8d0s86a4" status: 200 len: 2931 microversion: 2.1 time: 2.448025 Jul 01 10:27:34.033328 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 273/535] 10.222.0.23 () {58 vars in 1196 bytes} [Fri Jul 1 10:27:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8d0s86a4 => generated 2931 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:34.033328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:34.033328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:34.052060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:34.053650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:34.058350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:34.060083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:34.368898 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3bd89619-bd30-4d9d-9256-749657502d36 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 6.143042 Jul 01 10:27:34.371303 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 263/536] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:28 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 6146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:34.917034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab5a63fa-d207-49d5-aae1-41870c2d468c tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1151228732", "ram": 512, "vcpus": 1, "disk": 10, "id": 1009701653, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:34.917034 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:34.917034 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:35.073093 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab5a63fa-d207-49d5-aae1-41870c2d468c tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.700443 Jul 01 10:27:35.082788 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 264/537] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:34 2022] POST /compute/v2.1/flavors => generated 416 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:35.131202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:35.132089 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:35.180697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:35.185356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:35.191374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:35.193699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:35.594511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:35.610432 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e0438135-abd4-4152-9a1b-7b4363f4eeef tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1589 microversion: 2.1 time: 1.584638 Jul 01 10:27:35.626940 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 274/538] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:34 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1589 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:35.660115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-aaf9a1fd-6ce2-4ed1-890f-636c20344138 req-fbdaec13-c55d-4e2e-aa80-a137b95d235d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c34990-434f-4eba-8949-58aef875f13e", "name": "network-vif-plugged", "status": "completed", "tag": "4c664d29-f533-4d28-9279-920175ff5640"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:35.699735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-aaf9a1fd-6ce2-4ed1-890f-636c20344138 req-fbdaec13-c55d-4e2e-aa80-a137b95d235d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:35.703506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-aaf9a1fd-6ce2-4ed1-890f-636c20344138 req-fbdaec13-c55d-4e2e-aa80-a137b95d235d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:35.745545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-aaf9a1fd-6ce2-4ed1-890f-636c20344138 req-fbdaec13-c55d-4e2e-aa80-a137b95d235d service nova] Creating event network-vif-plugged:4c664d29-f533-4d28-9279-920175ff5640 for instance 13c34990-434f-4eba-8949-58aef875f13e on n-h1-master-1 Jul 01 10:27:35.768296 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-aaf9a1fd-6ce2-4ed1-890f-636c20344138 req-fbdaec13-c55d-4e2e-aa80-a137b95d235d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139043 Jul 01 10:27:35.776925 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 275/539] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:35.796886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7f43b750-58c9-4bf1-884e-bb97e6a4e2e1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:35.876198 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.compute.server_groups [None req-7f43b750-58c9-4bf1-884e-bb97e6a4e2e1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Querying cell dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) for 2 instances {{(pid=119765) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 01 10:27:35.881509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f43b750-58c9-4bf1-884e-bb97e6a4e2e1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:35.885050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f43b750-58c9-4bf1-884e-bb97e6a4e2e1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:35.979803 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7f43b750-58c9-4bf1-884e-bb97e6a4e2e1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/b77eb36d-a0ec-491e-8dcb-c83920fd1264" status: 200 len: 266 microversion: 2.1 time: 0.204169 Jul 01 10:27:35.986916 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 276/540] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:27:35 2022] GET /compute/v2.1/os-server-groups/b77eb36d-a0ec-491e-8dcb-c83920fd1264 => generated 266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:36.530124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-596a2684-19fa-4167-b004-0e0c9e0aeb7d tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:36.553852 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-596a2684-19fa-4167-b004-0e0c9e0aeb7d tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] HTTP exception thrown: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-596a2684-19fa-4167-b004-0e0c9e0aeb7d tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Request method failure captured: Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/flavors/1009701653/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivswQEW2qi7YyK4jlH5XMejHxEp77uoDLuBREwEYOl5nq1uRRHDmxd0ZnU17Lv56uW9Y79bx3kSy2I_5DWgxz0kLpR0-w6QS8dxKggq8WmyU_uPP4KP6BPyXu3HXjMh9_48dhZDarlQ3OxAc0Obndh5YoDUn574QkgGHJWKLxT5sh898 Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:27:36.556993 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fe73633364454e27bf54a5c54aa9c87b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a7e74aa4470641d4bd7116260f2ffde4 Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:27:36.559627 n-d-master-1 devstack@n-api.service[119765]: exception: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: action_args: {'flavor_id': '1009701653', 'id': 'hw:cpu_thread_policy'} Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:36.561292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-596a2684-19fa-4167-b004-0e0c9e0aeb7d tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Returning 404 to user: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:36.564126 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-596a2684-19fa-4167-b004-0e0c9e0aeb7d tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] 10.222.0.23 "GET /compute/v2.1/flavors/1009701653/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.572849 Jul 01 10:27:36.565108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 277/541] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:27:35 2022] GET /compute/v2.1/flavors/1009701653/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 577 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:27:36.572221 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb722e2b-9b9f-4338-bbb3-7d22eba8c768 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f925d11f0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:36.666951 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb722e2b-9b9f-4338-bbb3-7d22eba8c768 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.099863 Jul 01 10:27:36.673676 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 278/542] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:36 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:36.680520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f279fcf7-d262-419a-88e8-1989c480ff65 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:36.681815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f279fcf7-d262-419a-88e8-1989c480ff65 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:36.690020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f279fcf7-d262-419a-88e8-1989c480ff65 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:36.690713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f279fcf7-d262-419a-88e8-1989c480ff65 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:36.691734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f279fcf7-d262-419a-88e8-1989c480ff65 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:36.699105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f279fcf7-d262-419a-88e8-1989c480ff65 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:37.201887 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f279fcf7-d262-419a-88e8-1989c480ff65 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.526854 Jul 01 10:27:37.202474 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 279/543] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:27:36 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e/os-interface => generated 285 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:37.207384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d17daf5b-ba91-409c-89b8-feef073f7bc4 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:37.208149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d17daf5b-ba91-409c-89b8-feef073f7bc4 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:37.238033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:37.239138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17daf5b-ba91-409c-89b8-feef073f7bc4 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:37.239138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17daf5b-ba91-409c-89b8-feef073f7bc4 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:37.239138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17daf5b-ba91-409c-89b8-feef073f7bc4 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:37.239138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17daf5b-ba91-409c-89b8-feef073f7bc4 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:37.267101 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-255b5e35-6f39-4d9d-8be1-495d5f31e479 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1475 microversion: 2.1 time: 2.181902 Jul 01 10:27:37.285050 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 265/544] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:35 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1475 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:37.305284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa7bf5ea-2c22-4e26-ab75-19da0a2397dc tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:37.310421 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:37.310421 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:37.315111 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa7bf5ea-2c22-4e26-ab75-19da0a2397dc tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a7e74aa4470641d4bd7116260f2ffde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe73633364454e27bf54a5c54aa9c87b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa7bf5ea-2c22-4e26-ab75-19da0a2397dc tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Request method failure captured: Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/flavors/1009701653/os-extra_specs HTTP/1.1 Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 66 Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswQEW2qi7YyK4jlH5XMejHxEp77uoDLuBREwEYOl5nq1uRRHDmxd0ZnU17Lv56uW9Y79bx3kSy2I_5DWgxz0kLpR0-w6QS8dxKggq8WmyU_uPP4KP6BPyXu3HXjMh9_48dhZDarlQ3OxAc0Obndh5YoDUn574QkgGHJWKLxT5sh898 Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:27:37.327430 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fe73633364454e27bf54a5c54aa9c87b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a7e74aa4470641d4bd7116260f2ffde4 Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 01 10:27:37.336008 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: action_args: {'flavor_id': '1009701653', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:27:37.336985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 01 10:27:37.339380 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.340566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa7bf5ea-2c22-4e26-ab75-19da0a2397dc tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:37.340566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa7bf5ea-2c22-4e26-ab75-19da0a2397dc tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] 10.222.0.23 "POST /compute/v2.1/flavors/1009701653/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.044441 Jul 01 10:27:37.344786 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 266/545] 10.222.0.23 () {60 vars in 1223 bytes} [Fri Jul 1 10:27:37 2022] POST /compute/v2.1/flavors/1009701653/os-extra_specs => generated 124 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:27:37.358374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81e85711-cb7e-4941-ba0f-6ed5b7fc8f52 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:37.536554 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81e85711-cb7e-4941-ba0f-6ed5b7fc8f52 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1009701653/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.188410 Jul 01 10:27:37.539677 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 267/546] 10.222.0.23 () {60 vars in 1223 bytes} [Fri Jul 1 10:27:37 2022] POST /compute/v2.1/flavors/1009701653/os-extra_specs => generated 66 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:37.551156 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e85364f6-a521-4c39-a12a-00eb80c95498 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:37.553712 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:37.553712 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:37.560389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e85364f6-a521-4c39-a12a-00eb80c95498 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a7e74aa4470641d4bd7116260f2ffde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe73633364454e27bf54a5c54aa9c87b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e85364f6-a521-4c39-a12a-00eb80c95498 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Request method failure captured: Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswQEW2qi7YyK4jlH5XMejHxEp77uoDLuBREwEYOl5nq1uRRHDmxd0ZnU17Lv56uW9Y79bx3kSy2I_5DWgxz0kLpR0-w6QS8dxKggq8WmyU_uPP4KP6BPyXu3HXjMh9_48dhZDarlQ3OxAc0Obndh5YoDUn574QkgGHJWKLxT5sh898 Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:27:37.566392 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fe73633364454e27bf54a5c54aa9c87b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a7e74aa4470641d4bd7116260f2ffde4 Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:27:37.568012 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: action_args: {'flavor_id': '1009701653', 'id': 'hw:numa_nodes'} Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:27:37.568867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 01 10:27:37.570322 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.574660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e85364f6-a521-4c39-a12a-00eb80c95498 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:37.581020 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e85364f6-a521-4c39-a12a-00eb80c95498 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034280 Jul 01 10:27:37.581451 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 268/547] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:27:37 2022] DELETE /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:27:37.593871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ccdeffd-d09a-49b3-ab80-09af146dba60 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:37.706579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ccdeffd-d09a-49b3-ab80-09af146dba60 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1009701653/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.118868 Jul 01 10:27:37.709484 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 269/548] 10.222.0.23 () {60 vars in 1223 bytes} [Fri Jul 1 10:27:37 2022] POST /compute/v2.1/flavors/1009701653/os-extra_specs => generated 66 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:27:37.728606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9e8b352d-6274-490e-bc9f-3d58986b8c7a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f9253c820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:37.814443 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9e8b352d-6274-490e-bc9f-3d58986b8c7a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.103024 Jul 01 10:27:37.821266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 270/549] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:37 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:37.833773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e81a3b8-29b4-4596-a443-9e8be34ee87f tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:37.837299 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:37.837299 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:37.839241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e81a3b8-29b4-4596-a443-9e8be34ee87f tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a7e74aa4470641d4bd7116260f2ffde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe73633364454e27bf54a5c54aa9c87b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e81a3b8-29b4-4596-a443-9e8be34ee87f tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Request method failure captured: Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 22 Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswQEW2qi7YyK4jlH5XMejHxEp77uoDLuBREwEYOl5nq1uRRHDmxd0ZnU17Lv56uW9Y79bx3kSy2I_5DWgxz0kLpR0-w6QS8dxKggq8WmyU_uPP4KP6BPyXu3HXjMh9_48dhZDarlQ3OxAc0Obndh5YoDUn574QkgGHJWKLxT5sh898 Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:27:37.850472 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fe73633364454e27bf54a5c54aa9c87b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe73633364454e27bf54a5c54aa9c87b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: fe73633364454e27bf54a5c54aa9c87b Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a7e74aa4470641d4bd7116260f2ffde4 Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: {"hw:numa_nodes": "1"} Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:27:37.852131 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: action_args: {'flavor_id': '1009701653', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:27:37.853071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 01 10:27:37.854513 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.857585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e81a3b8-29b4-4596-a443-9e8be34ee87f tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:37.858574 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e81a3b8-29b4-4596-a443-9e8be34ee87f tempest-FlavorsExtraSpecsNegativeTestJSON-68562285 tempest-FlavorsExtraSpecsNegativeTestJSON-68562285-project] 10.222.0.23 "PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.036124 Jul 01 10:27:37.861007 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 271/550] 10.222.0.23 () {60 vars in 1264 bytes} [Fri Jul 1 10:27:37 2022] PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:27:37.874940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-271343b6-1eed-4916-9a97-a078e06f7a98 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:37.907249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-271343b6-1eed-4916-9a97-a078e06f7a98 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] HTTP exception thrown: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-271343b6-1eed-4916-9a97-a078e06f7a98 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Request method failure captured: Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/flavors/1009701653/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswTqXNt33GHZWWI4wEkCLKtVkgHZ7laX2ObTijhWr_6f0_ypHvg-5Vmx9wOBU82AUtyN2qPshIE7-n8UpiyIs2lwT0TAw2btZIsFlskabIx6iqZ-2sCROY5UQzwzv91HQMfAAfL1GfRSNwDXStyZAf6EYUwHwpOX3PAh6FL9V78gSs Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f99a8f7cf3004c2db49facbac0cf7381 Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:27:37.915836 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f99a8f7cf3004c2db49facbac0cf7381", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f99a8f7cf3004c2db49facbac0cf7381 Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 4fb4dd4921a84bed93b8481226f7163d Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:27:37.917491 n-d-master-1 devstack@n-api.service[119764]: exception: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: action_args: {'flavor_id': '1009701653', 'id': 'hw:cpu_thread_policy'} Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:37.918343 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.919865 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.919865 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.919865 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.919865 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:27:37.919865 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:27:37.919865 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. Jul 01 10:27:37.919865 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.920758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-271343b6-1eed-4916-9a97-a078e06f7a98 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Returning 404 to user: Flavor 1009701653 has no extra specs with key hw:cpu_thread_policy. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:37.931716 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-271343b6-1eed-4916-9a97-a078e06f7a98 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1009701653/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.065081 Jul 01 10:27:37.936353 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 272/551] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:27:37 2022] DELETE /compute/v2.1/flavors/1009701653/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:27:37.942192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a04f709-b66f-4719-9191-d6c297d1675d tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:37.955515 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9a04f709-b66f-4719-9191-d6c297d1675d tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a04f709-b66f-4719-9191-d6c297d1675d tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Request method failure captured: Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 27 Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswTqXNt33GHZWWI4wEkCLKtVkgHZ7laX2ObTijhWr_6f0_ypHvg-5Vmx9wOBU82AUtyN2qPshIE7-n8UpiyIs2lwT0TAw2btZIsFlskabIx6iqZ-2sCROY5UQzwzv91HQMfAAfL1GfRSNwDXStyZAf6EYUwHwpOX3PAh6FL9V78gSs Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f99a8f7cf3004c2db49facbac0cf7381 Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:27:37.971049 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f99a8f7cf3004c2db49facbac0cf7381", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f99a8f7cf3004c2db49facbac0cf7381 Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 4fb4dd4921a84bed93b8481226f7163d Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: {"hw:cpu_policy": "shared"} Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:27:37.972824 n-d-master-1 devstack@n-api.service[119764]: exception: Request body and URI mismatch Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: action_args: {'flavor_id': '1009701653', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:37.973800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:37.975170 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:27:37.975170 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:27:37.975170 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 01 10:27:37.975170 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:37.979415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a04f709-b66f-4719-9191-d6c297d1675d tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:37.991033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a04f709-b66f-4719-9191-d6c297d1675d tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.053032 Jul 01 10:27:37.992378 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 273/552] 10.222.0.23 () {60 vars in 1264 bytes} [Fri Jul 1 10:27:37 2022] PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes => generated 73 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:27:38.010358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f439814e-7624-46ee-b731-738f9a232b49 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f439814e-7624-46ee-b731-738f9a232b49 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Request method failure captured: Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 49 Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswTqXNt33GHZWWI4wEkCLKtVkgHZ7laX2ObTijhWr_6f0_ypHvg-5Vmx9wOBU82AUtyN2qPshIE7-n8UpiyIs2lwT0TAw2btZIsFlskabIx6iqZ-2sCROY5UQzwzv91HQMfAAfL1GfRSNwDXStyZAf6EYUwHwpOX3PAh6FL9V78gSs Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f99a8f7cf3004c2db49facbac0cf7381 Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:27:38.021768 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f99a8f7cf3004c2db49facbac0cf7381", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99a8f7cf3004c2db49facbac0cf7381"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f99a8f7cf3004c2db49facbac0cf7381 Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 4fb4dd4921a84bed93b8481226f7163d Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 01 10:27:38.030367 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: action_args: {'flavor_id': '1009701653', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance: Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 01 10:27:38.031272 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:38.032615 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f439814e-7624-46ee-b731-738f9a232b49 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:27:38.035506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f439814e-7624-46ee-b731-738f9a232b49 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026850 Jul 01 10:27:38.037484 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 274/553] 10.222.0.23 () {60 vars in 1264 bytes} [Fri Jul 1 10:27:37 2022] PUT /compute/v2.1/flavors/1009701653/os-extra_specs/hw:numa_nodes => generated 117 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:27:38.060992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0326f0e2-5b2a-4946-bed3-9f75c37681db tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:38.060992 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:38.060992 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:38.170177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0326f0e2-5b2a-4946-bed3-9f75c37681db tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1009701653" status: 202 len: 0 microversion: 2.1 time: 0.130330 Jul 01 10:27:38.171117 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 275/554] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:27:38 2022] DELETE /compute/v2.1/flavors/1009701653 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:27:38.180124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-befec1c5-6535-42ff-b789-6c6af5267a44 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:38.235715 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-befec1c5-6535-42ff-b789-6c6af5267a44 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708 tempest-FlavorsExtraSpecsNegativeTestJSON-881641708-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.060044 Jul 01 10:27:38.239615 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 276/555] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:38 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:38.288580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2b8785ed-5129-46da-b455-fab0fdb0f320 req-61537bc4-f786-45cf-91f9-f8117cfe96e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0327eb-9856-41c6-a66c-3833fb79f56c", "name": "network-vif-unplugged", "status": "completed", "tag": "66607fcc-6805-4701-81e1-1a67c103b4d0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:38.320264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2b8785ed-5129-46da-b455-fab0fdb0f320 req-61537bc4-f786-45cf-91f9-f8117cfe96e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:38.326743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2b8785ed-5129-46da-b455-fab0fdb0f320 req-61537bc4-f786-45cf-91f9-f8117cfe96e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:38.398684 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2b8785ed-5129-46da-b455-fab0fdb0f320 req-61537bc4-f786-45cf-91f9-f8117cfe96e3 service nova] Creating event network-vif-unplugged:66607fcc-6805-4701-81e1-1a67c103b4d0 for instance 0a0327eb-9856-41c6-a66c-3833fb79f56c on n-h1-master-1 Jul 01 10:27:38.428077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-2b8785ed-5129-46da-b455-fab0fdb0f320 req-61537bc4-f786-45cf-91f9-f8117cfe96e3 service nova] Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:27:38.460687 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2b8785ed-5129-46da-b455-fab0fdb0f320 req-61537bc4-f786-45cf-91f9-f8117cfe96e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176479 Jul 01 10:27:38.462963 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 277/556] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:38.470237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:38.472266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:38.493958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:38.495857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:38.496881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:38.497519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:38.593026 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d17daf5b-ba91-409c-89b8-feef073f7bc4 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1620 microversion: 2.1 time: 1.389288 Jul 01 10:27:38.603210 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 280/557] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:37 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1620 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:38.631251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e171ba23-f526-4031-afd3-7e3489bdb4b0 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:38.632195 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e171ba23-f526-4031-afd3-7e3489bdb4b0 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:38.652782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e171ba23-f526-4031-afd3-7e3489bdb4b0 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:38.670877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e171ba23-f526-4031-afd3-7e3489bdb4b0 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:38.680059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e171ba23-f526-4031-afd3-7e3489bdb4b0 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:38.680515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e171ba23-f526-4031-afd3-7e3489bdb4b0 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:40.666794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:40.675466 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0be730f9-e516-47fa-8cd4-fe43039ba268 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1475 microversion: 2.1 time: 2.211163 Jul 01 10:27:40.686203 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 278/558] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:38 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1475 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:40.691379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa639364-c5c0-42f6-9394-4bf2278004c8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f9237ca60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:40.774656 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa639364-c5c0-42f6-9394-4bf2278004c8 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.086991 Jul 01 10:27:40.782766 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 279/559] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:40 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:41.200564 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e171ba23-f526-4031-afd3-7e3489bdb4b0 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 200 len: 1620 microversion: 2.1 time: 2.576413 Jul 01 10:27:41.207830 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 281/560] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:38 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 1620 bytes in 2587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:41.237655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c365ad25-0fce-49ac-b6ee-81f50c7454b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: .version_select at 0x7f6f9237c670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2048815516", "policies": ["anti-affinity"]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:41.345571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c365ad25-0fce-49ac-b6ee-81f50c7454b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:41.354645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c365ad25-0fce-49ac-b6ee-81f50c7454b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:41.387042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a4303b42-2999-4019-af6a-107d5711dfca req-edd362a3-0fc1-4383-bc36-0c4f6d368dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0327eb-9856-41c6-a66c-3833fb79f56c", "tag": "66607fcc-6805-4701-81e1-1a67c103b4d0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:41.401728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a4303b42-2999-4019-af6a-107d5711dfca req-edd362a3-0fc1-4383-bc36-0c4f6d368dfa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:41.402333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a4303b42-2999-4019-af6a-107d5711dfca req-edd362a3-0fc1-4383-bc36-0c4f6d368dfa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:41.449053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a4303b42-2999-4019-af6a-107d5711dfca req-edd362a3-0fc1-4383-bc36-0c4f6d368dfa service nova] Creating event network-changed:66607fcc-6805-4701-81e1-1a67c103b4d0 for instance 0a0327eb-9856-41c6-a66c-3833fb79f56c on n-h1-master-1 Jul 01 10:27:41.506809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-a4303b42-2999-4019-af6a-107d5711dfca req-edd362a3-0fc1-4383-bc36-0c4f6d368dfa service nova] Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:27:41.562466 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a4303b42-2999-4019-af6a-107d5711dfca req-edd362a3-0fc1-4383-bc36-0c4f6d368dfa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178791 Jul 01 10:27:41.574084 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 282/561] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:27:41.687648 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=82,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:41.699841 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:41.706059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:41.747105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:41.747790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:41.750438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:41.753234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:41.769844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c365ad25-0fce-49ac-b6ee-81f50c7454b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:41.794922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c365ad25-0fce-49ac-b6ee-81f50c7454b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:41.865159 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c365ad25-0fce-49ac-b6ee-81f50c7454b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.628667 Jul 01 10:27:41.867900 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 280/562] 10.222.0.23 () {60 vars in 1173 bytes} [Fri Jul 1 10:27:41 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:41.903791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c67104c-e46a-49df-87d4-e5305e5f1b2a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f925c68b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:42.000070 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:42.086825 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c67104c-e46a-49df-87d4-e5305e5f1b2a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1422 microversion: 2.1 time: 0.214569 Jul 01 10:27:42.087157 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 281/563] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:41 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1422 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:42.229488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:42.230392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:42.256533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:42.261097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:42.269599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:42.270753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:42.816774 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:43.354656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:43.367404 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78a0afce-5b96-406a-8a95-d015b6e0090f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1475 microversion: 2.1 time: 1.671836 Jul 01 10:27:43.372537 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 283/564] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:41 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1475 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:27:43.391823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ae9ea8f1-f26d-4837-b459-a83860ffa28d req-78f17295-7c6a-4e06-87c3-840c9dcae727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de87ae39-30f0-4c4d-8396-ed1f999f302e", "tag": "e20185bf-09da-41f5-99ac-f8a4268d19f5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:43.441092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ae9ea8f1-f26d-4837-b459-a83860ffa28d req-78f17295-7c6a-4e06-87c3-840c9dcae727 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:43.445096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ae9ea8f1-f26d-4837-b459-a83860ffa28d req-78f17295-7c6a-4e06-87c3-840c9dcae727 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:43.481463 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:43.484015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ae9ea8f1-f26d-4837-b459-a83860ffa28d req-78f17295-7c6a-4e06-87c3-840c9dcae727 service nova] Creating event network-changed:e20185bf-09da-41f5-99ac-f8a4268d19f5 for instance de87ae39-30f0-4c4d-8396-ed1f999f302e on n-h2-master-1 Jul 01 10:27:43.499698 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ae9ea8f1-f26d-4837-b459-a83860ffa28d req-78f17295-7c6a-4e06-87c3-840c9dcae727 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125706 Jul 01 10:27:43.515922 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 284/565] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:43.521986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1960982740", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "750a6b88-a7c4-4942-a364-68545aa27ab0"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:43.732234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:43.751933 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38296eee-fa71-42b5-b2b9-6dc8a15efc07 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1589 microversion: 2.1 time: 1.520607 Jul 01 10:27:43.768118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 282/566] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:42 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1589 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:43.780698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3962d4c-fdec-44c9-a185-19c998c528ab tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923fea60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:51.839834 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:53.554245 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=56 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:53.737326 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:54.015073 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:54.173679 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:27:58.548166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:27:58.562094 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3962d4c-fdec-44c9-a185-19c998c528ab tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1431 microversion: 2.1 time: 14.792814 Jul 01 10:27:58.563815 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 283/567] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:27:43 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1431 bytes in 14795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:58.584162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:58.585795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:27:58.608480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:58.609591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:58.611032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:58.611687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:58.999738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:27:59.013131 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f5637a34-b4b2-48ad-908f-37abb7b18139 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1470 microversion: 2.1 time: 0.445938 Jul 01 10:27:59.014092 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 284/568] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:27:58 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:27:59.258000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Calling method '.version_select at 0x7f6f923c2c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:27:59.258881 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:27:59.258881 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:27:59.260040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:59.260491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:59.311955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:59.314075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:59.342317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:59.342778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:59.360836 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a63a3529-b6e5-4f10-8741-4f0be205261a tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.345332 Jul 01 10:27:59.361685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 285/569] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:27:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:27:59.458543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1064989199", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ad82b036-ac12-4a66-b1a2-50d8586e1b40"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:27:59.516579 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:27:59.517624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:27:59.518222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:27:59.518772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:27:59.519366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:27:59.539756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] validate_networks() for [('ad82b036-ac12-4a66-b1a2-50d8586e1b40', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:27:59.552102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:59.553762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:59.560820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:27:59.561636 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:27:59.619857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:59.646936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:27:59.682410 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Going to run 2 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:27:59.685848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:27:59.839600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:27:59.858984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:00.004754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:00.019340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:00.074048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=774df999-dc4f-43aa-afe6-237771e977e4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:28:00.308238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:00.324986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:00.343509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:28:00.343937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:28:00.344383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:28:00.344787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:28:00.345199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:28:00.363374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.371958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.380027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.381771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.419820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Getting quotas for project 83905704e34a425887ccad7606e3c792. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:00.424535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Getting quotas for user 408ec811b27c4e908c45d946f555a75c and project 83905704e34a425887ccad7606e3c792. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:00.465314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:28:00.474527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:28:00.477414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:00.489778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:00.594763 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c478e5b-52ef-4880-8ee2-de7be046dec4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 17.077126 Jul 01 10:28:00.596991 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 285/570] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 17081 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:28:00.607330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3ac9347e-8c01-4f9e-b94f-92588cc44b18 req-6f33dbf6-2085-408e-932f-8a41fb91aaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0327eb-9856-41c6-a66c-3833fb79f56c", "name": "network-vif-plugged", "status": "completed", "tag": "66607fcc-6805-4701-81e1-1a67c103b4d0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:00.630153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ac9347e-8c01-4f9e-b94f-92588cc44b18 req-6f33dbf6-2085-408e-932f-8a41fb91aaf1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.630838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ac9347e-8c01-4f9e-b94f-92588cc44b18 req-6f33dbf6-2085-408e-932f-8a41fb91aaf1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.657897 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3ac9347e-8c01-4f9e-b94f-92588cc44b18 req-6f33dbf6-2085-408e-932f-8a41fb91aaf1 service nova] Creating event network-vif-plugged:66607fcc-6805-4701-81e1-1a67c103b4d0 for instance 0a0327eb-9856-41c6-a66c-3833fb79f56c on n-h1-master-1 Jul 01 10:28:00.672718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-3ac9347e-8c01-4f9e-b94f-92588cc44b18 req-6f33dbf6-2085-408e-932f-8a41fb91aaf1 service nova] Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:28:00.689135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eefaac98-d4df-4407-9185-2e695bf2ba17 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326601 Jul 01 10:28:00.695594 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 286/571] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:27:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:28:00.701116 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3ac9347e-8c01-4f9e-b94f-92588cc44b18 req-6f33dbf6-2085-408e-932f-8a41fb91aaf1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101134 Jul 01 10:28:00.702083 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 286/572] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:00.703190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc9631c5-cf90-437d-bda4-a5350a283b14 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92426f70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:00.721486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7cc771be-a53a-4f2c-96c4-f152f6cdf7af tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:00.726351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7cc771be-a53a-4f2c-96c4-f152f6cdf7af tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:00.743644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cc771be-a53a-4f2c-96c4-f152f6cdf7af tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.744097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cc771be-a53a-4f2c-96c4-f152f6cdf7af tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.744881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cc771be-a53a-4f2c-96c4-f152f6cdf7af tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.745357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cc771be-a53a-4f2c-96c4-f152f6cdf7af tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.815759 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc9631c5-cf90-437d-bda4-a5350a283b14 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 200 len: 1431 microversion: 2.1 time: 0.117689 Jul 01 10:28:00.816337 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 287/573] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:00 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 1431 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:00.825412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Calling method '.version_select at 0x7f6f923fe9d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:00.837940 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:00.837940 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:28:00.839652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.843465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.893568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.897577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.948377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:00.949608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:00.975792 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b706fc7-fa30-4c20-82ad-ac834f4b6844 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.157613 Jul 01 10:28:00.976503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 288/574] 10.222.0.23 () {58 vars in 1211 bytes} [Fri Jul 1 10:28:00 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers => generated 275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:00.997800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:01.008232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:01.011098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Searching by: {'deleted': False, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:28:01.054872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.058481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.061017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.062874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.099021 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7cc771be-a53a-4f2c-96c4-f152f6cdf7af tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c/action" status: 204 len: 0 microversion: 2.1 time: 0.393140 Jul 01 10:28:01.111797 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 287/575] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:28:00 2022] POST /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c/action => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:28:01.112789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:28:01.114632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4bf97f50-f0b2-412d-8979-c36c5586dcda tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:01.115723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4bf97f50-f0b2-412d-8979-c36c5586dcda tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:01.150524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62c8934c-7089-4d8e-9f37-c5d91e69d569 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.162193 Jul 01 10:28:01.157344 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 289/576] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:28:00 2022] GET /compute/v2.1/servers => generated 1666 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:01.197515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:01.200382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:01.232243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.233275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.243769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.243769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.325326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4bf97f50-f0b2-412d-8979-c36c5586dcda tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:01.340677 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4bf97f50-f0b2-412d-8979-c36c5586dcda tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1224 microversion: 2.1 time: 0.234415 Jul 01 10:28:01.341635 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 288/577] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:01 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:01.370342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Calling method '.version_select at 0x7f6f9273bdc0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:01.371291 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:01.371291 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:28:01.372673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.376179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.474137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.475065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.529560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.531417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.548076 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-85de7e39-f84a-4047-b200-92a8b34d6bf6 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.200722 Jul 01 10:28:01.553782 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 289/578] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:28:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:01.560227 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:01.561373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:01.576767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.576767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.577734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:01.578163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:01.958464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:01.968677 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-91868cfa-0fd7-4096-839f-0387c26b58fb tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1464 microversion: 2.1 time: 0.808910 Jul 01 10:28:02.005182 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 290/579] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:01 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1464 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:02.011671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9e651c31-ff76-4251-9e30-1a4027b33c1d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:02.012286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9e651c31-ff76-4251-9e30-1a4027b33c1d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:02.017595 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:02.036924 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-843c6760-3b09-44ab-840a-5a59f78ab323 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1470 microversion: 2.1 time: 0.481824 Jul 01 10:28:02.052730 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 290/580] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:01 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:02.064142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d385b56c-ddd0-4114-924c-db321af7c204 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Calling method '.version_select at 0x7f6f923cf280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:02.065411 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:02.065411 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:28:02.068921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d385b56c-ddd0-4114-924c-db321af7c204 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:02.068921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d385b56c-ddd0-4114-924c-db321af7c204 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:02.094379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d385b56c-ddd0-4114-924c-db321af7c204 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:02.098029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d385b56c-ddd0-4114-924c-db321af7c204 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:02.111004 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d385b56c-ddd0-4114-924c-db321af7c204 tempest-HypervisorAdminUnderV252Test-1964404702 tempest-HypervisorAdminUnderV252Test-1964404702-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.054914 Jul 01 10:28:02.112646 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 291/581] 10.222.0.23 () {58 vars in 1208 bytes} [Fri Jul 1 10:28:02 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 104 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:02.142805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1bfd55e3-286b-4282-8286-c63abc329653 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923cf4c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:02.237213 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1bfd55e3-286b-4282-8286-c63abc329653 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f784d1ed-9670-424c-abfe-e98e973ecb0e" status: 200 len: 784 microversion: 2.1 time: 0.123230 Jul 01 10:28:02.238292 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 292/582] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:02 2022] GET /compute/v2.1/images/f784d1ed-9670-424c-abfe-e98e973ecb0e => generated 784 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:02.250638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-80d643d2-d342-4456-ac28-2fce78d85125 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:02.275105 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-80d643d2-d342-4456-ac28-2fce78d85125 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028370 Jul 01 10:28:02.275693 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 293/583] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:28:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:28:02.276391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9e651c31-ff76-4251-9e30-1a4027b33c1d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:02.283552 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9e651c31-ff76-4251-9e30-1a4027b33c1d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1219 microversion: 2.1 time: 0.276909 Jul 01 10:28:02.295372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd99cba6-6f85-4c11-8377-bd10b002236d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923904c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:02.296984 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 291/584] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:02 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1219 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:02.357722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1560d1df-6fd6-4506-aa46-85a912644b84 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:02.358332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1560d1df-6fd6-4506-aa46-85a912644b84 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:02.622258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1560d1df-6fd6-4506-aa46-85a912644b84 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:02.635607 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1560d1df-6fd6-4506-aa46-85a912644b84 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1224 microversion: 2.1 time: 0.276747 Jul 01 10:28:02.645108 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 292/585] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:02 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1224 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:28:03.058139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:03.063492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:03.077315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:03.077972 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:03.080295 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:03.080975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:03.961723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:03.973350 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6d58da8-8f2e-4b4e-bb0c-60848f03159d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1470 microversion: 2.1 time: 0.919381 Jul 01 10:28:03.973932 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 293/586] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:03 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1470 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:28:03.984003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:03.984003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:04.010191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:04.011041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:04.013207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:04.016016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:04.151137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:04.159929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-69ff3275-a40f-43c0-8baf-d488976f175b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1223 microversion: 2.1 time: 0.184942 Jul 01 10:28:04.161798 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 294/587] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:03 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1223 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:04.177876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:04.193810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:04.200083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:04.200524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:04.201326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:04.201950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:04.327260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:04.345977 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-66a8532a-f65f-41a5-bbd9-e6f7fcf6bd3a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1276 microversion: 2.1 time: 0.171778 Jul 01 10:28:04.356289 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 295/588] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:04 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:04.361020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-017dde9d-4484-4e30-b986-ec5a5a390ace req-71104ff3-7043-41a3-833d-3180cea932d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c34990-434f-4eba-8949-58aef875f13e", "name": "network-vif-unplugged", "status": "completed", "tag": "4c664d29-f533-4d28-9279-920175ff5640"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:04.376745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-017dde9d-4484-4e30-b986-ec5a5a390ace req-71104ff3-7043-41a3-833d-3180cea932d2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:04.377485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-017dde9d-4484-4e30-b986-ec5a5a390ace req-71104ff3-7043-41a3-833d-3180cea932d2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:04.399981 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-017dde9d-4484-4e30-b986-ec5a5a390ace req-71104ff3-7043-41a3-833d-3180cea932d2 service nova] Creating event network-vif-unplugged:4c664d29-f533-4d28-9279-920175ff5640 for instance 13c34990-434f-4eba-8949-58aef875f13e on n-h1-master-1 Jul 01 10:28:04.407098 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-017dde9d-4484-4e30-b986-ec5a5a390ace req-71104ff3-7043-41a3-833d-3180cea932d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049425 Jul 01 10:28:04.408741 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 296/589] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:04.636988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd99cba6-6f85-4c11-8377-bd10b002236d tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "DELETE /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 204 len: 0 microversion: 2.1 time: 2.350543 Jul 01 10:28:04.649272 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 294/590] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:02 2022] DELETE /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 0 bytes in 2353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:28:04.652524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa998a01-8df6-479f-b75f-d82ff2113d42 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f9238a790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:04.689305 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-aa998a01-8df6-479f-b75f-d82ff2113d42 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] HTTP exception thrown: Image not found. Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa998a01-8df6-479f-b75f-d82ff2113d42 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Request method failure captured: Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 HTTP/1.1 Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvy_wzXyOmeaJh7Z-f7y9TLdu18Ya7ezbyeSxI7t5uEPNbPcqXkoltjnbqoMtaGaeeD1aM5y_P4Kcg7tc5_wBJoHJ3oW7E-PE0pPz31oqXoxAEGbYAngdV7FYJ330fjD6Q80beJF6M0ToU5CAgJs2RW6oz2JeZFc7puhTYhASeep0g Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 0312d8a40c804b1b9f413780b01253c0 Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:28:04.744618 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0312d8a40c804b1b9f413780b01253c0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 0312d8a40c804b1b9f413780b01253c0 Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesOneServerTestJSON-299521334-project Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 4fdab3d8f0b143cd97b918b91429e73a Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesOneServerTestJSON-299521334-project Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81'} Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:04.745978 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 Jul 01 10:28:04.746827 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:28:04.747877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 could not be found. Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:28:04.757537 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa998a01-8df6-479f-b75f-d82ff2113d42 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:04.758958 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa998a01-8df6-479f-b75f-d82ff2113d42 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 404 len: 62 microversion: 2.1 time: 0.100226 Jul 01 10:28:04.760250 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 297/591] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:04 2022] GET /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:28:04.767457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad43723d-bf4e-49ba-ae48-e1f2cff2ad50 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1608404983"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:04.769498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad43723d-bf4e-49ba-ae48-e1f2cff2ad50 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:04.787737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad43723d-bf4e-49ba-ae48-e1f2cff2ad50 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:04.791672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad43723d-bf4e-49ba-ae48-e1f2cff2ad50 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:04.792698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad43723d-bf4e-49ba-ae48-e1f2cff2ad50 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:04.798140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad43723d-bf4e-49ba-ae48-e1f2cff2ad50 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:05.001999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:05.003320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:05.024296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:05.024296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:05.027757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:05.027757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:05.680260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:05.689519 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af98201a-6cc5-4d9c-bf70-afed9757cfcc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1470 microversion: 2.1 time: 0.700882 Jul 01 10:28:05.690497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 298/592] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:04 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1470 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:05.703123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:05.703819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:05.710466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:05.710904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:05.711671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:05.712271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:05.818504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:05.835472 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1258af6-1c08-4bfe-8d93-fc9b0ba94a34 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1271 microversion: 2.1 time: 0.135626 Jul 01 10:28:05.835472 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 299/593] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:05 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:05.837369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:05.838133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:05.844394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:05.844829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:05.845849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:05.846273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:05.947528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:05.970376 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae73f8fa-db9c-4c7e-8412-f7f786f54915 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1294 microversion: 2.1 time: 0.137172 Jul 01 10:28:05.971134 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 300/594] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:05 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:06.261313 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad43723d-bf4e-49ba-ae48-e1f2cff2ad50 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "POST /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e/action" status: 202 len: 0 microversion: 2.1 time: 1.496411 Jul 01 10:28:06.265677 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 295/595] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:28:04 2022] POST /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e/action => generated 0 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:28:06.273386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53ab6f4f-5c86-4431-9e55-e54373da3930 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f9234faf0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:06.368335 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53ab6f4f-5c86-4431-9e55-e54373da3930 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.099619 Jul 01 10:28:06.374505 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 301/596] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:06 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:06.708400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:06.708400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:06.715092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:06.715532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:06.716543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:06.716719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:06.850924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:06.851484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:06.860312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:06.863109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:06.864144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:06.867620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:07.214041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:07.226439 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc036661-413d-4151-baee-de2a30faa1a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1277 microversion: 2.1 time: 0.379505 Jul 01 10:28:07.239530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 302/597] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:06 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1277 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:28:07.246993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:07.247827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:07.257059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:07.257803 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:07.260628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:07.261274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:07.552401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:07.566201 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-30e7534b-3041-4ed6-9470-acdaadd6247e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1462 microversion: 2.1 time: 0.862957 Jul 01 10:28:07.567046 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 296/598] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:06 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1462 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:07.572292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0cc2bb36-d30b-4950-8638-520c1d16e5ca tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923cf160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:07.634250 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0cc2bb36-d30b-4950-8638-520c1d16e5ca tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.065901 Jul 01 10:28:07.634831 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 297/599] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:07 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:07.639205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e254f239-ef2a-4533-8c54-0ac8537729d3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:07.639814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e254f239-ef2a-4533-8c54-0ac8537729d3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:07.647750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e254f239-ef2a-4533-8c54-0ac8537729d3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:07.648193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e254f239-ef2a-4533-8c54-0ac8537729d3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:07.649183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e254f239-ef2a-4533-8c54-0ac8537729d3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:07.649769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e254f239-ef2a-4533-8c54-0ac8537729d3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:07.815608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:07.824782 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b0c2c767-3355-4614-a091-876bfbed1ea4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 0.583120 Jul 01 10:28:07.825423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 303/600] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:07 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:08.075942 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e254f239-ef2a-4533-8c54-0ac8537729d3 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1613 microversion: 2.1 time: 0.440048 Jul 01 10:28:08.076528 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 298/601] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:07 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1613 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:08.097806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa9d38e1-7b14-47e0-90fa-ce3ef591b780 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '.version_select at 0x7f6f92390700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:08.100347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa9d38e1-7b14-47e0-90fa-ce3ef591b780 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:08.104822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa9d38e1-7b14-47e0-90fa-ce3ef591b780 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:08.127974 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa9d38e1-7b14-47e0-90fa-ce3ef591b780 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.031816 Jul 01 10:28:08.129478 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 299/602] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:28:08 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:08.166745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dcc32430-56a8-41e8-a168-c97337dcbc43 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Action: 'create', calling method: .version_select at 0x7f6f92426670>, body: {"keypair": {"name": "tempest-keypair-284357970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoCR3QRvz6WXSx4O49F8fx/c7QIWU/NbpUaRjJw/A8UxpxnG8m/EeEbivS33sLhVsKrV1qTxIk3GZaGEwxfD3laBpQTJIHb+jMaF+7dAbmsAq/ldRp7UUgH3Rg9IA0UrA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:08.211336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-857bdffa-c8dd-48d3-b648-3795d0dad176 req-47cd8083-e0c6-4f75-8433-1776a39d0dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c7abe7-c029-4079-a717-487c2b56573a", "tag": "311e0c88-1777-4643-834e-e3e9e94477c9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:08.231619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-857bdffa-c8dd-48d3-b648-3795d0dad176 req-47cd8083-e0c6-4f75-8433-1776a39d0dba service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:08.232330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-dcc32430-56a8-41e8-a168-c97337dcbc43 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Getting quotas for project 78e8ee98253b4773b72e3443d0ba2cb4. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:08.241638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-857bdffa-c8dd-48d3-b648-3795d0dad176 req-47cd8083-e0c6-4f75-8433-1776a39d0dba service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:08.243321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-dcc32430-56a8-41e8-a168-c97337dcbc43 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Getting quotas for user 9d17628c74f54f0e8a7d24ae2db32a17 and project 78e8ee98253b4773b72e3443d0ba2cb4. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:08.283296 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-857bdffa-c8dd-48d3-b648-3795d0dad176 req-47cd8083-e0c6-4f75-8433-1776a39d0dba service nova] Creating event network-changed:311e0c88-1777-4643-834e-e3e9e94477c9 for instance e7c7abe7-c029-4079-a717-487c2b56573a on n-h2-master-1 Jul 01 10:28:08.300866 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-857bdffa-c8dd-48d3-b648-3795d0dad176 req-47cd8083-e0c6-4f75-8433-1776a39d0dba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100355 Jul 01 10:28:08.310630 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 300/603] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:28:08.322347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:08.322347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:08.347148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:08.347800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:08.354252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:08.354252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:08.416564 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dcc32430-56a8-41e8-a168-c97337dcbc43 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.589763 Jul 01 10:28:08.417106 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 304/604] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:28:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:08.422712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1999335222", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:08.510957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:28:08.708238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:08.716822 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3e34d426-906f-4a80-9cab-b2bb5c26440c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1277 microversion: 2.1 time: 0.404998 Jul 01 10:28:08.717432 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 301/605] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:08 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1277 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:08.732206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-845b0093-7355-403b-801a-ea02f707969b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92390f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:08.791235 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-845b0093-7355-403b-801a-ea02f707969b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.063359 Jul 01 10:28:08.792737 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 302/606] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:08 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:08.842374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:08.843138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:08.852549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:08.853007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:08.854476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:08.854914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:09.368286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:09.375810 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-30b4e563-cf93-4a10-a625-176844b7b5fa tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 0.538237 Jul 01 10:28:09.376412 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 303/607] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:08 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:09.427521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:28:09.427993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:28:09.428473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:28:09.428877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:28:09.429341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:28:09.439855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:09.440299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:09.441302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:09.444162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:09.459869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:09.463973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for user 0dcb8296a8934a8cbc89d6df73d4a526 and project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:09.477785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:28:09.480213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:28:09.603052 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a166f2da-db49-4247-8e9f-44e9c47ba3f0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182294 Jul 01 10:28:09.606547 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 305/608] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:28:09.619808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd5a996b-5ff1-4730-9786-6e27769143fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:09.619808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd5a996b-5ff1-4730-9786-6e27769143fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:09.620715 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:09.623809 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:09.735150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:09.735904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:09.749992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:09.750543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:09.757296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:09.757296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:09.884642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd5a996b-5ff1-4730-9786-6e27769143fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:09.900257 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd5a996b-5ff1-4730-9786-6e27769143fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1213 microversion: 2.1 time: 0.282473 Jul 01 10:28:09.900257 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 304/609] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:09 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1213 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:09.908001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47aa83b5-084d-450c-850b-56dad7c50531 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92346e50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:10.003631 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47aa83b5-084d-450c-850b-56dad7c50531 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.097946 Jul 01 10:28:10.013464 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 305/610] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:09 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:10.318308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:10.329068 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11bee719-7368-49c4-833c-e5e86681a0dd tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.597655 Jul 01 10:28:10.330295 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 306/611] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:09 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:10.392818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:10.393776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:10.402924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:10.403650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:10.405831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:10.405831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:10.920203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:10.923504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:10.949025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:10.951373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:10.957742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:10.960211 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.213113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:11.227879 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:11.238135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a19614e9-2d31-4bcd-bfb7-f89e3f20274d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1217 microversion: 2.1 time: 0.329729 Jul 01 10:28:11.247892 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 307/612] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:10 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1217 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:11.250979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbe1826f-1bed-4bf0-865a-d5c0f27e02b1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92358700>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:11.322978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fbe1826f-1bed-4bf0-865a-d5c0f27e02b1 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.082343 Jul 01 10:28:11.327140 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 308/613] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:11 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:11.348341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:11.350182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:11.361021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.361739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.362800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.364062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.387695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:11.401771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1584867c-e249-4698-b1b4-517448993bc8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 1.011514 Jul 01 10:28:11.406517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 306/614] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:10 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:11.637073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Calling method '.version_select at 0x7f6f9273bf70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:11.638009 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:11.638009 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:28:11.640079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.640734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.660407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.663162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.675888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.676638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.684964 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ac7621c8-8ade-4034-b019-40ac17ef3019 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.225455 Jul 01 10:28:11.686308 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 307/615] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:28:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:11.832210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a096b8a-bb4c-4c88-b84a-7602cf2ca2c5 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Calling method '.version_select at 0x7f6f92390b80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:11.833921 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:11.833921 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:28:11.837845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a096b8a-bb4c-4c88-b84a-7602cf2ca2c5 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '5750d7e23daa40b5ae9502f664848b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98931763ef2a4a23a7c2f600286e3588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:11.839372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a096b8a-bb4c-4c88-b84a-7602cf2ca2c5 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Request method failure captured: Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hypervisors/n-h2-master-1/search HTTP/1.1 Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsw6g6VkUtuz7Z5G0vF__kn5pXpmA8mhH9QJjx5HhbTVXYEkMNG-GVAlADfHW98tkdvfvu81ZT5073tlwWkDZ93tMKM1H7sQVeQbI882PLIqOvNJa1oukLFad5lBSoK1-ByTkdj7FCBuTHdWo5imeR-vgjaSs-JI5TaJzkvv172KfOc Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 98931763ef2a4a23a7c2f600286e3588 Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-566714532 Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:28:11.840218 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98931763ef2a4a23a7c2f600286e3588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/98931763ef2a4a23a7c2f600286e3588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_98931763ef2a4a23a7c2f600286e3588", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98931763ef2a4a23a7c2f600286e3588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-566714532 Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 98931763ef2a4a23a7c2f600286e3588 Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-566714532 Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-566714532-project Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5750d7e23daa40b5ae9502f664848b7d Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-566714532-project Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 01 10:28:11.841493 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'n-h2-master-1'} Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:28:11.842192 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 01 10:28:11.843383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:11.845897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a096b8a-bb4c-4c88-b84a-7602cf2ca2c5 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:11.848648 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a096b8a-bb4c-4c88-b84a-7602cf2ca2c5 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.155244 Jul 01 10:28:11.852614 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1ae35697-19e8-4dbd-b464-a789e0c3cef1 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.509040 Jul 01 10:28:11.852764 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 308/616] 10.222.0.23 () {58 vars in 1208 bytes} [Fri Jul 1 10:28:11 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 117 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:11.853296 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 309/617] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:11 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:28:11.871234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3e1f9dc7-5d6f-442d-95b2-67db47c77dd4 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Calling method '.version_select at 0x7f6f92356700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:11.885405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e1f9dc7-5d6f-442d-95b2-67db47c77dd4 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.888445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e1f9dc7-5d6f-442d-95b2-67db47c77dd4 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.918916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-3e1f9dc7-5d6f-442d-95b2-67db47c77dd4 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3e1f9dc7-5d6f-442d-95b2-67db47c77dd4 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Request method failure captured: Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsw7LM8jDG1bj--NenLQsJEgqrwOAswWqFO1l0f6UGn1goSgDYpZFXHVhk-SpY4Mec1xW7NCh6BTvpnhpcjZzMrLRla44MaxFhlyy8dJVyaFb91ca3bvWazuaSIytsVLPlJCLSovPSfLajRUK3UHjhmb140b6g7T_pR81RPl5FCX2n0 Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3e5661860eb84845a8763b40486a796d Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-383299830 Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:28:11.920835 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5661860eb84845a8763b40486a796d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5661860eb84845a8763b40486a796d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5661860eb84845a8763b40486a796d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5661860eb84845a8763b40486a796d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-383299830 Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3e5661860eb84845a8763b40486a796d Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-383299830 Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5003262b64b044b8bf476cd7d87a3147 Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 01 10:28:11.928417 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:11.929191 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3e1f9dc7-5d6f-442d-95b2-67db47c77dd4 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3e1f9dc7-5d6f-442d-95b2-67db47c77dd4 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.060321 Jul 01 10:28:11.930379 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 309/618] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:28:11 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:11.932884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Calling method '.version_select at 0x7f6f9238aa60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:11.933806 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:11.933806 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:28:11.934960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.935398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.965641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d2a7bdda-bf01-4bcb-8265-a01855e024a0 req-2c0adfab-c911-4e9a-b650-01dd318faa42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "774df999-dc4f-43aa-afe6-237771e977e4", "tag": "45a3f3f1-e9c2-46d4-91c8-cb08b665d656"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:11.976310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.985330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d2a7bdda-bf01-4bcb-8265-a01855e024a0 req-2c0adfab-c911-4e9a-b650-01dd318faa42 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:11.986016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d2a7bdda-bf01-4bcb-8265-a01855e024a0 req-2c0adfab-c911-4e9a-b650-01dd318faa42 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:11.986153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.000929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.001866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.011496 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b841fb9f-4fc2-4b0b-98b0-6eecd96ba291 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.082381 Jul 01 10:28:12.012687 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 310/619] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:28:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:12.013626 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d2a7bdda-bf01-4bcb-8265-a01855e024a0 req-2c0adfab-c911-4e9a-b650-01dd318faa42 service nova] Creating event network-changed:45a3f3f1-e9c2-46d4-91c8-cb08b665d656 for instance 774df999-dc4f-43aa-afe6-237771e977e4 on n-h2-master-1 Jul 01 10:28:12.023168 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d2a7bdda-bf01-4bcb-8265-a01855e024a0 req-2c0adfab-c911-4e9a-b650-01dd318faa42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061288 Jul 01 10:28:12.024257 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 310/620] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:12.027655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5be57be2-fd83-43ca-83f4-f97954a76f10 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Calling method '.version_select at 0x7f6f9238aee0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:12.028503 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:12.028503 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:28:12.029880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5be57be2-fd83-43ca-83f4-f97954a76f10 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '5750d7e23daa40b5ae9502f664848b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98931763ef2a4a23a7c2f600286e3588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5be57be2-fd83-43ca-83f4-f97954a76f10 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Request method failure captured: Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsw6g6VkUtuz7Z5G0vF__kn5pXpmA8mhH9QJjx5HhbTVXYEkMNG-GVAlADfHW98tkdvfvu81ZT5073tlwWkDZ93tMKM1H7sQVeQbI882PLIqOvNJa1oukLFad5lBSoK1-ByTkdj7FCBuTHdWo5imeR-vgjaSs-JI5TaJzkvv172KfOc Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 98931763ef2a4a23a7c2f600286e3588 Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-566714532 Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:28:12.032435 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98931763ef2a4a23a7c2f600286e3588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/98931763ef2a4a23a7c2f600286e3588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_98931763ef2a4a23a7c2f600286e3588", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98931763ef2a4a23a7c2f600286e3588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-566714532 Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 98931763ef2a4a23a7c2f600286e3588 Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-566714532 Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-566714532-project Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 5750d7e23daa40b5ae9502f664848b7d Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-566714532-project Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '1'} Jul 01 10:28:12.034012 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:28:12.034948 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 01 10:28:12.036425 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:12.043307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5be57be2-fd83-43ca-83f4-f97954a76f10 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:12.044398 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5be57be2-fd83-43ca-83f4-f97954a76f10 tempest-HypervisorAdminNegativeUnderV252Test-566714532 tempest-HypervisorAdminNegativeUnderV252Test-566714532-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.024778 Jul 01 10:28:12.050261 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 311/621] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:28:12 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:12.056780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f298ebf-e69f-46d7-9564-5bc04ad13532 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Calling method '.version_select at 0x7f6f92390e50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:12.057805 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:12.057805 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:28:12.059321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f298ebf-e69f-46d7-9564-5bc04ad13532 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.060020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f298ebf-e69f-46d7-9564-5bc04ad13532 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.066890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0f298ebf-e69f-46d7-9564-5bc04ad13532 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] HTTP exception thrown: No hypervisor matching 'c925e3bd-5914-40da-acd0-a864f54652f9' could be found. Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f298ebf-e69f-46d7-9564-5bc04ad13532 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Request method failure captured: Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-hypervisors/c925e3bd-5914-40da-acd0-a864f54652f9/servers HTTP/1.1 Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsw7LM8jDG1bj--NenLQsJEgqrwOAswWqFO1l0f6UGn1goSgDYpZFXHVhk-SpY4Mec1xW7NCh6BTvpnhpcjZzMrLRla44MaxFhlyy8dJVyaFb91ca3bvWazuaSIytsVLPlJCLSovPSfLajRUK3UHjhmb140b6g7T_pR81RPl5FCX2n0 Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3e5661860eb84845a8763b40486a796d Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-383299830 Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:28:12.068696 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5661860eb84845a8763b40486a796d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5661860eb84845a8763b40486a796d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5661860eb84845a8763b40486a796d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5661860eb84845a8763b40486a796d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-383299830 Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3e5661860eb84845a8763b40486a796d Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-383299830 Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5003262b64b044b8bf476cd7d87a3147 Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: exception: No hypervisor matching 'c925e3bd-5914-40da-acd0-a864f54652f9' could be found. Jul 01 10:28:12.070226 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c925e3bd-5914-40da-acd0-a864f54652f9'} Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'c925e3bd-5914-40da-acd0-a864f54652f9' could be found. Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:12.070917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:12.071981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:12.071981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:12.071981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:12.071981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:12.071981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'c925e3bd-5914-40da-acd0-a864f54652f9' could be found. Jul 01 10:28:12.071981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:12.073390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f298ebf-e69f-46d7-9564-5bc04ad13532 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] Returning 404 to user: No hypervisor matching 'c925e3bd-5914-40da-acd0-a864f54652f9' could be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:12.074283 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f298ebf-e69f-46d7-9564-5bc04ad13532 tempest-HypervisorAdminNegativeUnderV252Test-383299830 tempest-HypervisorAdminNegativeUnderV252Test-383299830-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/c925e3bd-5914-40da-acd0-a864f54652f9/servers" status: 404 len: 123 microversion: 2.1 time: 0.022199 Jul 01 10:28:12.074823 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 311/622] 10.222.0.23 () {58 vars in 1280 bytes} [Fri Jul 1 10:28:12 2022] GET /compute/v2.1/os-hypervisors/c925e3bd-5914-40da-acd0-a864f54652f9/servers => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:28:12.261492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:12.262178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:12.274999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.276386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.277910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.278303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.385461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7640e712-18d0-4997-8aff-a2c03c429d4b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92356f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:12.385713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:12.391647 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9fcd889b-fc5d-46f1-9b40-92cbea3ad60c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1265 microversion: 2.1 time: 0.139701 Jul 01 10:28:12.392180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7640e712-18d0-4997-8aff-a2c03c429d4b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.059549 Jul 01 10:28:12.392750 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 312/623] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:12 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:12.398337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 312/624] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:12 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:28:12.422002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:12.422774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:12.439777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.440617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.441659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.442308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.812837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:12.821245 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10e16ce8-85a4-4b8e-b06a-c94ba0a5e923 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 0.403670 Jul 01 10:28:12.821817 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 313/625] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:12 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:12.873204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:12.874493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:12.882027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.886366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:12.886366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:12.886366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:13.098524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1592981834", "imageRef": "0759d110-2e7e-4937-b5d7-1998a708990c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "05c623a8-1a8d-4f12-8dc8-72455464d757"}], "security_groups": [{"name": "tempest-securitygroup--375989247"}], "key_name": "tempest-keypair-284357970", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:13.110366 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:13.327252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:13.329900 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:13.341892 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a206121b-ec48-4ae5-aeeb-9e0bcc8faab5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.474788 Jul 01 10:28:13.342473 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 313/626] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:12 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:13.399637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] validate_networks() for [('05c623a8-1a8d-4f12-8dc8-72455464d757', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:28:13.404633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ecf133ff-bcba-4d3d-9fbd-2cbd15351787 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923cf700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:13.493087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ecf133ff-bcba-4d3d-9fbd-2cbd15351787 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.092156 Jul 01 10:28:13.498625 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 314/627] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:13 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:28:13.503524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:13.507354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:13.516393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:13.516833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:13.522501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:13.525497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:14.007005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:14.019446 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3dfd454b-dfcd-4153-9dc2-1dfb20d7fffe tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1271 microversion: 2.1 time: 0.522960 Jul 01 10:28:14.032063 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 315/628] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:13 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1271 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:14.048499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:14.053378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:14.067518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:14.071286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:14.077683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:14.077683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:14.666038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:14.678581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31ef7368-773e-4590-af92-a6e23e59c91e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 0.642176 Jul 01 10:28:14.680064 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 316/629] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:14 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:14.689902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-fd159970-4929-4477-a16a-da3613e3cf54 req-8d4d51cd-bee3-4521-8172-d9933bc15ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c34990-434f-4eba-8949-58aef875f13e", "name": "network-vif-plugged", "status": "completed", "tag": "4c664d29-f533-4d28-9279-920175ff5640"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:14.704608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fd159970-4929-4477-a16a-da3613e3cf54 req-8d4d51cd-bee3-4521-8172-d9933bc15ac8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:14.705391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fd159970-4929-4477-a16a-da3613e3cf54 req-8d4d51cd-bee3-4521-8172-d9933bc15ac8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:14.728436 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-fd159970-4929-4477-a16a-da3613e3cf54 req-8d4d51cd-bee3-4521-8172-d9933bc15ac8 service nova] Creating event network-vif-plugged:4c664d29-f533-4d28-9279-920175ff5640 for instance 13c34990-434f-4eba-8949-58aef875f13e on n-h1-master-1 Jul 01 10:28:14.743067 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-fd159970-4929-4477-a16a-da3613e3cf54 req-8d4d51cd-bee3-4521-8172-d9933bc15ac8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056552 Jul 01 10:28:14.747854 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 317/630] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:14.757767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ee7265a8-4ab7-4eba-ab36-92a6202f8159 req-aa9db05f-292b-41cb-aec1-5b0267f1c3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385", "tag": "c0a2d02f-7766-4b8f-86ce-5053e678dbd2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:14.779368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ee7265a8-4ab7-4eba-ab36-92a6202f8159 req-aa9db05f-292b-41cb-aec1-5b0267f1c3f6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:14.783389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ee7265a8-4ab7-4eba-ab36-92a6202f8159 req-aa9db05f-292b-41cb-aec1-5b0267f1c3f6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:14.807308 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ee7265a8-4ab7-4eba-ab36-92a6202f8159 req-aa9db05f-292b-41cb-aec1-5b0267f1c3f6 service nova] Creating event network-changed:c0a2d02f-7766-4b8f-86ce-5053e678dbd2 for instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 on n-h1-master-1 Jul 01 10:28:14.820342 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ee7265a8-4ab7-4eba-ab36-92a6202f8159 req-aa9db05f-292b-41cb-aec1-5b0267f1c3f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070732 Jul 01 10:28:14.821057 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 318/631] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:14.828686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:14.838206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:14.852935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:14.856085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:14.856085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:14.856755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:15.493588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:15.504916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e5ca934-4ae7-4af1-a1ae-05dfafbdb8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.680098 Jul 01 10:28:15.505123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 319/632] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:14 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:15.512655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df3d0743-c7b9-4918-b2e3-03940f728ac3 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92390310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:15.566112 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-df3d0743-c7b9-4918-b2e3-03940f728ac3 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.056950 Jul 01 10:28:15.567261 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 320/633] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:15 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:15.573564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:15.574403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:15.581067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:15.581986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:15.583374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:15.584063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:15.764141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:15.781330 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-632410f0-791f-4e6f-8c49-a8e9fad95cbd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1271 microversion: 2.1 time: 0.208834 Jul 01 10:28:15.781330 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 321/634] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:15 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:15.798428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:15.800742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:15.811071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:15.811859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:15.813049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:15.814146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:15.831797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:28:15.834565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:28:15.835050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:28:15.835456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:28:15.835860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:28:15.855620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:15.857804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:15.860057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:15.860810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:15.887139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Getting quotas for project 78e8ee98253b4773b72e3443d0ba2cb4. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:15.892897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Getting quotas for user 9d17628c74f54f0e8a7d24ae2db32a17 and project 78e8ee98253b4773b72e3443d0ba2cb4. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:15.906057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:28:15.908721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0759d110-2e7e-4937-b5d7-1998a708990c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:28:16.051560 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-67e28063-f6f2-40f3-9ee8-b33635cde543 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.956716 Jul 01 10:28:16.074568 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 314/635] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:28:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:28:16.124071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70f5de75-c62b-4449-86e6-db4a5cc5ea93 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:16.127582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-70f5de75-c62b-4449-86e6-db4a5cc5ea93 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:16.329345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:16.353050 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5ac627b1-6887-4f7b-8706-bd7bff67e9fb tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 0.555138 Jul 01 10:28:16.353050 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 322/636] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:15 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:16.370535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-70f5de75-c62b-4449-86e6-db4a5cc5ea93 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:16.388856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-70f5de75-c62b-4449-86e6-db4a5cc5ea93 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1245 microversion: 2.1 time: 0.312246 Jul 01 10:28:16.402965 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 315/637] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:16 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1245 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:16.529716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:16.529716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:16.529961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:16.534715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:16.538730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:16.543301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:16.544466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:16.546945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:16.547675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:16.547800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:16.555007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:16.555764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:16.617514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:28:16.777043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:16.790354 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b91b4796-d1d0-4ed1-bc7c-beedc483d233 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.271264 Jul 01 10:28:16.791352 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 323/638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:16 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:16.796612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-138f882b-240a-490e-85bd-66e48abdc087 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923465e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:16.870493 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-138f882b-240a-490e-85bd-66e48abdc087 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.077758 Jul 01 10:28:16.871258 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 324/639] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:16 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:16.886807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-74ea1a64-a3ec-42c3-8cb9-c0fefc71233b req-25ca27c0-6cd2-48ce-a3ce-c8e7d0d064dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c7abe7-c029-4079-a717-487c2b56573a", "name": "network-vif-plugged", "status": "completed", "tag": "311e0c88-1777-4643-834e-e3e9e94477c9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:16.908137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-74ea1a64-a3ec-42c3-8cb9-c0fefc71233b req-25ca27c0-6cd2-48ce-a3ce-c8e7d0d064dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:16.908764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-74ea1a64-a3ec-42c3-8cb9-c0fefc71233b req-25ca27c0-6cd2-48ce-a3ce-c8e7d0d064dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:16.922627 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-74ea1a64-a3ec-42c3-8cb9-c0fefc71233b req-25ca27c0-6cd2-48ce-a3ce-c8e7d0d064dc service nova] Creating event network-vif-plugged:311e0c88-1777-4643-834e-e3e9e94477c9 for instance e7c7abe7-c029-4079-a717-487c2b56573a on n-h2-master-1 Jul 01 10:28:16.930638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-74ea1a64-a3ec-42c3-8cb9-c0fefc71233b req-25ca27c0-6cd2-48ce-a3ce-c8e7d0d064dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057935 Jul 01 10:28:16.932272 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 325/640] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:16.938959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:16.939974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:16.947443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:16.948148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:16.949101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:16.949717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:16.977736 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a256ade-7bd0-4b71-be91-035140191228 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 204 len: 0 microversion: 2.1 time: 0.454516 Jul 01 10:28:16.982615 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 316/641] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:28:16 2022] DELETE /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:28:16.989272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:16.993392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:17.002850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:17.007068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:17.008155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:17.009669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:17.242628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:17.251508 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9b4bb143-ddc3-47de-ba11-03c034cadb25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1313 microversion: 2.1 time: 0.317621 Jul 01 10:28:17.255486 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 326/642] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:16 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:17.300889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:17.314090 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7b61adb-524c-4add-8d6a-bfdffd51a2a4 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1714 microversion: 2.1 time: 0.329880 Jul 01 10:28:17.314693 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 317/643] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:16 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1714 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:17.366619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:17.367405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:17.385610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:17.386194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:17.387014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:17.389322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:17.409135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa8109a3-1292-4621-bfb5-b68417035c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:17.409346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa8109a3-1292-4621-bfb5-b68417035c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:17.732252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa8109a3-1292-4621-bfb5-b68417035c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:17.751567 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa8109a3-1292-4621-bfb5-b68417035c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1245 microversion: 2.1 time: 0.347200 Jul 01 10:28:17.765674 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 318/644] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:17 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1245 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:17.808589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:17.809464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:17.826121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:17.826982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:17.829421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:17.830397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:17.962162 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:17.972245 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7fd79171-c031-43c3-8338-ab19f7697e75 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 0.611549 Jul 01 10:28:17.985232 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 327/645] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:17 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:17.990362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-537fd642-0dfb-4ae0-bebd-effe5ed5fa9b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92356790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:18.077759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-537fd642-0dfb-4ae0-bebd-effe5ed5fa9b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.091071 Jul 01 10:28:18.078834 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 328/646] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:17 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:18.272765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:18.273740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:18.285317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:18.286072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:18.287092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:18.290884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:18.467624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:18.513297 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8307e651-40f6-4c82-9b75-47eedb59a7b9 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.688042 Jul 01 10:28:18.513297 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 319/647] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:17 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:18.515773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:18.516525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:18.525837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:18.526615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:18.527973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:18.528789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.012490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:19.020276 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b473c0b-3843-450d-804b-cd2202a2ea92 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1313 microversion: 2.1 time: 0.752199 Jul 01 10:28:19.020849 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 329/648] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:18 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1313 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:19.045287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:19.046297 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:19.061923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:19.061923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.061923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:19.061923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.091435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:19.103436 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0aba0442-8462-4395-a619-7f3eb74a18c2 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1714 microversion: 2.1 time: 0.604548 Jul 01 10:28:19.104235 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 320/649] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:18 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1714 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:19.115102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:19.115102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:19.161080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:19.164897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.166725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:19.176487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.213209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:19.242015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f2c3bf94-50f0-48a7-b504-7be559c3c35f tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1249 microversion: 2.1 time: 0.219587 Jul 01 10:28:19.243466 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 330/650] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:19 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1249 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:19.261369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fac77c77-534f-4ff2-9a76-26eec9612e01 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92356dc0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:19.373586 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fac77c77-534f-4ff2-9a76-26eec9612e01 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.128299 Jul 01 10:28:19.375362 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 331/651] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:19 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:19.384544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-44785e9a-f241-4670-b643-9e84f944c182 req-1c318308-5bfd-49bf-83cc-40ab35889a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774df999-dc4f-43aa-afe6-237771e977e4", "name": "network-vif-plugged", "status": "completed", "tag": "45a3f3f1-e9c2-46d4-91c8-cb08b665d656"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:19.406393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-44785e9a-f241-4670-b643-9e84f944c182 req-1c318308-5bfd-49bf-83cc-40ab35889a00 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:19.407153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-44785e9a-f241-4670-b643-9e84f944c182 req-1c318308-5bfd-49bf-83cc-40ab35889a00 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.429401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-44785e9a-f241-4670-b643-9e84f944c182 req-1c318308-5bfd-49bf-83cc-40ab35889a00 service nova] Creating event network-vif-plugged:45a3f3f1-e9c2-46d4-91c8-cb08b665d656 for instance 774df999-dc4f-43aa-afe6-237771e977e4 on n-h2-master-1 Jul 01 10:28:19.440432 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-44785e9a-f241-4670-b643-9e84f944c182 req-1c318308-5bfd-49bf-83cc-40ab35889a00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063344 Jul 01 10:28:19.442924 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 332/652] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:19.515829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:19.517052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:19.547992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:19.547992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.551044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:19.553763 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:19.751065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:19.760108 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e89858c2-64bd-42ec-b7c9-476ea8c66d56 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1324 microversion: 2.1 time: 0.653521 Jul 01 10:28:19.760699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 321/653] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:19 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1324 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:19.893131 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=26 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:19.924291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:19.932417 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-23efda0b-daf6-4c67-b29e-3c73cf4fbd4f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.421906 Jul 01 10:28:19.936310 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 333/654] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:19 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:19.997661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c001f8f-685c-4d2b-9590-19ef808c9f75 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Calling method '.version_select at 0x7f6f923d1c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:20.037598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:20.039827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:20.051229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.053821 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:20.054904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.055580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:20.118891 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3c001f8f-685c-4d2b-9590-19ef808c9f75 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed" status: 200 len: 371 microversion: 2.1 time: 0.357072 Jul 01 10:28:20.123123 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 322/655] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:28:19 2022] GET /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed => generated 371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:20.130328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:20.132658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:20.145641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.149893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:20.151042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.155772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:20.505176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:20.516898 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ff4ca2b9-4531-41d8-b551-e05704115a80 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1646 microversion: 2.1 time: 0.392342 Jul 01 10:28:20.517503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 323/656] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:20 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1646 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:20.535096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58c5cc9d-4075-4d16-adaf-0170d6d3dbca tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Action: 'update', calling method: .version_select at 0x7f6f9246b700>, body: {"quota_set": {"ram": "5120"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:20.691676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58c5cc9d-4075-4d16-adaf-0170d6d3dbca tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.692973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58c5cc9d-4075-4d16-adaf-0170d6d3dbca tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:20.695147 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58c5cc9d-4075-4d16-adaf-0170d6d3dbca tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.695593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58c5cc9d-4075-4d16-adaf-0170d6d3dbca tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:20.875772 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58c5cc9d-4075-4d16-adaf-0170d6d3dbca tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed" status: 200 len: 328 microversion: 2.1 time: 0.348039 Jul 01 10:28:20.876412 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 324/657] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:28:20 2022] PUT /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed => generated 328 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:20.890798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:20.891442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:20.908727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.912782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:20.913853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:20.914308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:21.033792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:21.043845 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62e959e3-ecf9-43a5-bc98-f351feff2a17 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1313 microversion: 2.1 time: 1.009860 Jul 01 10:28:21.051765 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 334/658] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:20 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1313 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:21.056977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e1e3e287-767e-4688-b91b-1d3a7912939c req-e39f382c-bc3f-4828-a87b-cf9a743439aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802599b4-c743-4f1b-8677-94390fac1ecb", "tag": "8340628d-90db-44e1-9112-2951c74f2772"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:21.086150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e1e3e287-767e-4688-b91b-1d3a7912939c req-e39f382c-bc3f-4828-a87b-cf9a743439aa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:21.086815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e1e3e287-767e-4688-b91b-1d3a7912939c req-e39f382c-bc3f-4828-a87b-cf9a743439aa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:21.105232 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e1e3e287-767e-4688-b91b-1d3a7912939c req-e39f382c-bc3f-4828-a87b-cf9a743439aa service nova] Creating event network-changed:8340628d-90db-44e1-9112-2951c74f2772 for instance 802599b4-c743-4f1b-8677-94390fac1ecb on n-h1-master-1 Jul 01 10:28:21.123966 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e1e3e287-767e-4688-b91b-1d3a7912939c req-e39f382c-bc3f-4828-a87b-cf9a743439aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070606 Jul 01 10:28:21.128733 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 335/659] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:21.141321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8dac94a7-9315-4a96-82b3-a82604bdea10 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f92356940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:21.232199 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8dac94a7-9315-4a96-82b3-a82604bdea10 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1427 microversion: 2.1 time: 0.101731 Jul 01 10:28:21.232880 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 336/660] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:21 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:21.242016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:21.255225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:21.262928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:21.263746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:21.264799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:21.265474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:21.282613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:21.294734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d6c72f5f-8b8f-46e9-9382-ecea71fe7b4a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1305 microversion: 2.1 time: 0.409804 Jul 01 10:28:21.301034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 325/661] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:20 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1305 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:21.310448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b81fd7cc-b368-426e-bf8f-2db39615a63e tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:21.464681 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b81fd7cc-b368-426e-bf8f-2db39615a63e tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed" status: 202 len: 0 microversion: 2.1 time: 0.162328 Jul 01 10:28:21.465200 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 326/662] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:28:21 2022] DELETE /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:28:21.470463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:21.476597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:21.485068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:21.485791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:21.488469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:21.489356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:21.774362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:21.786502 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8b7585a-3e3e-46d1-8cf7-688ca05eeb09 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1521 microversion: 2.1 time: 0.552225 Jul 01 10:28:21.793772 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 337/663] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:21 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:21.798710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c6dbd62e-6e41-42ac-a95c-a7f001ef3f20 req-5080b6a9-616a-4f5d-9537-39ea6bc41a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de87ae39-30f0-4c4d-8396-ed1f999f302e", "name": "network-vif-deleted", "tag": "e20185bf-09da-41f5-99ac-f8a4268d19f5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:21.841225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c6dbd62e-6e41-42ac-a95c-a7f001ef3f20 req-5080b6a9-616a-4f5d-9537-39ea6bc41a9d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:21.841927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c6dbd62e-6e41-42ac-a95c-a7f001ef3f20 req-5080b6a9-616a-4f5d-9537-39ea6bc41a9d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:21.871975 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c6dbd62e-6e41-42ac-a95c-a7f001ef3f20 req-5080b6a9-616a-4f5d-9537-39ea6bc41a9d service nova] Creating event network-vif-deleted:e20185bf-09da-41f5-99ac-f8a4268d19f5 for instance de87ae39-30f0-4c4d-8396-ed1f999f302e on n-h2-master-1 Jul 01 10:28:21.898615 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c6dbd62e-6e41-42ac-a95c-a7f001ef3f20 req-5080b6a9-616a-4f5d-9537-39ea6bc41a9d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103265 Jul 01 10:28:21.899230 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 338/664] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:21.925990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57444fba-bca7-4999-b575-9688f2fb09ed tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Calling method '.version_select at 0x7f6f92390820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:22.096467 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-57444fba-bca7-4999-b575-9688f2fb09ed tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed" status: 200 len: 371 microversion: 2.1 time: 0.194805 Jul 01 10:28:22.098643 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 339/665] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:28:21 2022] GET /compute/v2.1/os-quota-sets/405eb0c5b566406aa93f2f0dcd4e2aed => generated 371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:22.115646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:22.116674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:22.129406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:22.130242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:22.131276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:22.137840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:22.174246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:22.189139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dcc0999e-bd42-4e22-9b86-a75af4c8ccff tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.721712 Jul 01 10:28:22.193229 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 327/666] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:21 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:22.206290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d8c50df8-601a-4d57-a34e-a46547563ea3 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'create', calling method: .version_select at 0x7f6f922cd700>, body: {"pool": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:22.234968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:22.234968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:22.234968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lazy-loading 'fault' on Instance uuid de87ae39-30f0-4c4d-8396-ed1f999f302e {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:28:22.356477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00b392abf154820b4e5bce216b7e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e215073c20cc458983a0912389cb4e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:22.368032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-89bd2419-2191-465e-aff9-98d6690d2169 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 200 len: 1353 microversion: 2.1 time: 0.267566 Jul 01 10:28:22.371194 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 340/667] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:22 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 1353 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:22.387021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:22.393574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:22.420091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:22.420837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:22.421642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:22.422267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:22.475937 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:22.971554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:22.983873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d498b398-59a0-453c-98af-428a1841e7b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1313 microversion: 2.1 time: 0.609045 Jul 01 10:28:22.995015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 341/668] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:22 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:22.999875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-54a8ead0-9918-4560-a163-fa7e9edc7bf4 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923908b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:27.157599 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d8c50df8-601a-4d57-a34e-a46547563ea3 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.962987 Jul 01 10:28:27.158178 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 328/669] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:28:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:27.185566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:27.186984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:27.202116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:27.202866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:27.205307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:27.207291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:27.473457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:27.481817 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec6de52a-ed72-4131-ae4c-f7a847925b08 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 0.303906 Jul 01 10:28:27.490719 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 329/670] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:27 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:27.495920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd76f536-a306-47dc-beb6-04e226d9aa71 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Calling method '.version_select at 0x7f6f923d13a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:27.759673 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd76f536-a306-47dc-beb6-04e226d9aa71 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.267927 Jul 01 10:28:27.760549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 330/671] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:28:27 2022] GET /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6/defaults => generated 371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:27.767104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-97e37ac8-5900-4f52-9a13-7fb2e3139f7f req-77819499-32d2-4558-96cb-e95fbb14d52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385", "name": "network-vif-plugged", "status": "completed", "tag": "c0a2d02f-7766-4b8f-86ce-5053e678dbd2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:27.778476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-97e37ac8-5900-4f52-9a13-7fb2e3139f7f req-77819499-32d2-4558-96cb-e95fbb14d52d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:27.779335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-97e37ac8-5900-4f52-9a13-7fb2e3139f7f req-77819499-32d2-4558-96cb-e95fbb14d52d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:27.799046 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-97e37ac8-5900-4f52-9a13-7fb2e3139f7f req-77819499-32d2-4558-96cb-e95fbb14d52d service nova] Creating event network-vif-plugged:c0a2d02f-7766-4b8f-86ce-5053e678dbd2 for instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 on n-h1-master-1 Jul 01 10:28:27.806760 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-97e37ac8-5900-4f52-9a13-7fb2e3139f7f req-77819499-32d2-4558-96cb-e95fbb14d52d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043829 Jul 01 10:28:27.807606 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 331/672] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:27.814884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:27.815935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:27.824408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:27.825189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:27.826264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:27.826865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:28.274713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:28.278887 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:28.295242 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7bcb6e93-4332-40c0-9203-d43729b61dd3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1319 microversion: 2.1 time: 0.485207 Jul 01 10:28:28.295899 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 332/673] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:27 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:28.317274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:28.318178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:28.345113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:28.345999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:28.346964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:28.347630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:28.383838 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] HTTP exception thrown: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Request method failure captured: Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e HTTP/1.1 Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsutD9EAcdU1ZMUFkziWhNHFeUsv9EnGbylTj6Pfj-3kuUv6xmWkOBwwJRQX5uqLTWdAntPwSBb28oSToQQu8-Ob_WHZtiDMzykRnk87JnHFDogHH8IL7dvF77BVkbbICUBrdA2Rp-8gr6UhUdwDkJJEiaUp5SPNRKGvBUiY9ZCmCk0 Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:28:28.385656 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e215073c20cc458983a0912389cb4e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e215073c20cc458983a0912389cb4e44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: d00b392abf154820b4e5bce216b7e406 Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: exception: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:28.387277 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'de87ae39-30f0-4c4d-8396-ed1f999f302e'} Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:28.388371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:28.391245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:28.394728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Returning 404 to user: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:28.400104 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3439191-a0ab-49dc-a2f0-d4995c5c5ac0 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 404 len: 111 microversion: 2.1 time: 0.098665 Jul 01 10:28:28.403725 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 333/674] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:28 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:28.408485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:28.410268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:28.430296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:28.430296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:28.430296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:28.431040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:28.673670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:28.688464 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ca01759f-df91-4292-b4cd-aaf293a2b6ae tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1313 microversion: 2.1 time: 0.284983 Jul 01 10:28:28.689774 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 334/675] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:28 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:28.695250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ae19379e-49d1-401c-a0c8-41d3a7126fa8 req-0c0a380f-8de5-4ce5-a437-e13e6dcb47ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b75a0d-c563-4a81-ad59-be51d81abb3e", "tag": "95cbf043-1522-4cbc-b2ba-b4848f245f5a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:28.706736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ae19379e-49d1-401c-a0c8-41d3a7126fa8 req-0c0a380f-8de5-4ce5-a437-e13e6dcb47ee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:28.707873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ae19379e-49d1-401c-a0c8-41d3a7126fa8 req-0c0a380f-8de5-4ce5-a437-e13e6dcb47ee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:28.722239 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ae19379e-49d1-401c-a0c8-41d3a7126fa8 req-0c0a380f-8de5-4ce5-a437-e13e6dcb47ee service nova] Creating event network-changed:95cbf043-1522-4cbc-b2ba-b4848f245f5a for instance 44b75a0d-c563-4a81-ad59-be51d81abb3e on n-h2-master-1 Jul 01 10:28:28.731193 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ae19379e-49d1-401c-a0c8-41d3a7126fa8 req-0c0a380f-8de5-4ce5-a437-e13e6dcb47ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039199 Jul 01 10:28:28.733258 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 335/676] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:28.744477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1666576036", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ad82b036-ac12-4a66-b1a2-50d8586e1b40"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:30.707527 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:30.869350 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=40 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:32.082830 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:32.419699 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=60 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:32.571941 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-54a8ead0-9918-4560-a163-fa7e9edc7bf4 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1436 microversion: 2.1 time: 9.575710 Jul 01 10:28:32.574136 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 342/677] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:22 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1436 bytes in 9578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:32.583438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] validate_networks() for [('ad82b036-ac12-4a66-b1a2-50d8586e1b40', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:28:32.589105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fba5dea1-fb36-4d1f-a4d8-c5bf0fc77bae tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Action: 'update', calling method: .version_select at 0x7f6f9273b4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:32.902126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba5dea1-fb36-4d1f-a4d8-c5bf0fc77bae tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:32.902710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba5dea1-fb36-4d1f-a4d8-c5bf0fc77bae tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:32.903367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba5dea1-fb36-4d1f-a4d8-c5bf0fc77bae tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:32.903796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba5dea1-fb36-4d1f-a4d8-c5bf0fc77bae tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.266029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:28:33.266378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:28:33.267333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:28:33.267753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:28:33.268160 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:28:33.299918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.299918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.299918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.299918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.312245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Getting quotas for project 83905704e34a425887ccad7606e3c792. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:33.316836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Getting quotas for user 408ec811b27c4e908c45d946f555a75c and project 83905704e34a425887ccad7606e3c792. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:33.331342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:28:33.334842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:28:33.403834 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fba5dea1-fb36-4d1f-a4d8-c5bf0fc77bae tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658" status: 200 len: 328 microversion: 2.1 time: 0.828250 Jul 01 10:28:33.413627 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 343/678] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:28:32 2022] PUT /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658 => generated 328 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:33.421029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:33.421029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:33.425760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.426411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.427364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.428039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.449216 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] HTTP exception thrown: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Request method failure captured: Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc HTTP/1.1 Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsutD9EAcdU1ZMUFkziWhNHFeUsv9EnGbylTj6Pfj-3kuUv6xmWkOBwwJRQX5uqLTWdAntPwSBb28oSToQQu8-Ob_WHZtiDMzykRnk87JnHFDogHH8IL7dvF77BVkbbICUBrdA2Rp-8gr6UhUdwDkJJEiaUp5SPNRKGvBUiY9ZCmCk0 Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:28:33.461479 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e215073c20cc458983a0912389cb4e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e215073c20cc458983a0912389cb4e44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d00b392abf154820b4e5bce216b7e406 Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:33.468333 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '671d0a80-8e15-49a6-8f16-eb2e010d24cc'} Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:33.469341 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:33.470984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:33.472177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Returning 404 to user: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:33.481517 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cdb968fc-851b-4a72-9f84-a278f4e2ad01 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 404 len: 111 microversion: 2.1 time: 0.048608 Jul 01 10:28:33.483578 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 344/679] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:28:33 2022] DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:33.494880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:33.495971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:33.529377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.539732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.544099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.546711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.559140 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cdd9e05d-6ea5-43ea-b845-0b7ce679b9c8 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.823850 Jul 01 10:28:33.565069 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 336/680] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:28:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:28:33.579256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:33.582261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:33.614652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.631729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:33.633111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:33.635070 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.112997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:34.130128 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d70ef5e-f365-4526-aff2-8763ab3271b2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 0.640104 Jul 01 10:28:34.130128 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 345/681] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:33 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:34.157448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:34.159170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:34.182239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.183938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.184986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.185999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.197853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:34.206624 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81e3606e-f53f-4e09-82f1-9a28838848be tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1469 microversion: 2.1 time: 0.639698 Jul 01 10:28:34.220154 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 337/682] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:33 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1469 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:34.226204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f7edea1b-a357-4d7c-a040-64ff5bf388d3 req-b02d719c-0ed4-4af7-8d78-62362f0398a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802599b4-c743-4f1b-8677-94390fac1ecb", "name": "network-vif-plugged", "status": "completed", "tag": "8340628d-90db-44e1-9112-2951c74f2772"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:34.230391 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:34.237070 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f7edea1b-a357-4d7c-a040-64ff5bf388d3 req-b02d719c-0ed4-4af7-8d78-62362f0398a9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.237845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f7edea1b-a357-4d7c-a040-64ff5bf388d3 req-b02d719c-0ed4-4af7-8d78-62362f0398a9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.260391 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f7edea1b-a357-4d7c-a040-64ff5bf388d3 req-b02d719c-0ed4-4af7-8d78-62362f0398a9 service nova] Creating event network-vif-plugged:8340628d-90db-44e1-9112-2951c74f2772 for instance 802599b4-c743-4f1b-8677-94390fac1ecb on n-h1-master-1 Jul 01 10:28:34.266210 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f7edea1b-a357-4d7c-a040-64ff5bf388d3 req-b02d719c-0ed4-4af7-8d78-62362f0398a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044242 Jul 01 10:28:34.266907 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 338/683] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:34.284176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1e014da9-69db-43b8-bfbf-b377ef8f12a4 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f923c2e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:34.384274 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1e014da9-69db-43b8-bfbf-b377ef8f12a4 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 200 len: 1436 microversion: 2.1 time: 0.105637 Jul 01 10:28:34.385404 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 339/684] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:28:34 2022] GET /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 1436 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:34.395015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb8d9d9d-ed81-4339-ba0d-69727f24adc2 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Calling method '.version_select at 0x7f6f9234f790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:34.503959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:34.513024 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c9a656f-25b2-4564-b7e9-da9ff9c33df7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1313 microversion: 2.1 time: 0.383366 Jul 01 10:28:34.513924 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 346/685] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:34 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:34.527429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:34.528514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:34.535613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.536367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.538098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.538826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.566994 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] HTTP exception thrown: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Request method failure captured: Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc HTTP/1.1 Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsutD9EAcdU1ZMUFkziWhNHFeUsv9EnGbylTj6Pfj-3kuUv6xmWkOBwwJRQX5uqLTWdAntPwSBb28oSToQQu8-Ob_WHZtiDMzykRnk87JnHFDogHH8IL7dvF77BVkbbICUBrdA2Rp-8gr6UhUdwDkJJEiaUp5SPNRKGvBUiY9ZCmCk0 Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:28:34.570132 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e215073c20cc458983a0912389cb4e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e215073c20cc458983a0912389cb4e44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d00b392abf154820b4e5bce216b7e406 Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:34.571433 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '671d0a80-8e15-49a6-8f16-eb2e010d24cc'} Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:34.572452 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:34.580589 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:34.581875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Returning 404 to user: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:34.581875 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7dd987c8-4ef1-4cda-a907-6fa9c0467e8b tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 404 len: 111 microversion: 2.1 time: 0.061115 Jul 01 10:28:34.582897 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 347/686] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:34 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:34.595208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-44c0e035-a7cb-49b8-9e79-e298c647e521 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:34.596649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-44c0e035-a7cb-49b8-9e79-e298c647e521 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:34.667354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-44c0e035-a7cb-49b8-9e79-e298c647e521 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:34.686232 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-44c0e035-a7cb-49b8-9e79-e298c647e521 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1224 microversion: 2.1 time: 0.100701 Jul 01 10:28:34.702968 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 348/687] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:34 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:34.729327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:34.730540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:34.741107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.746761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.746761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.746761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.798830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb8d9d9d-ed81-4339-ba0d-69727f24adc2 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.799371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb8d9d9d-ed81-4339-ba0d-69727f24adc2 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.804488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb8d9d9d-ed81-4339-ba0d-69727f24adc2 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.804488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb8d9d9d-ed81-4339-ba0d-69727f24adc2 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.857393 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb8d9d9d-ed81-4339-ba0d-69727f24adc2 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658/detail" status: 200 len: 916 microversion: 2.1 time: 0.470678 Jul 01 10:28:34.858328 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 340/688] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:28:34 2022] GET /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658/detail => generated 916 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:34.863451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:34.864386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:34.893423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.896908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.901225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:34.903171 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:34.988452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:34.999746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-33fa8030-42ee-4a6a-a1ca-d634df9a44ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4" status: 200 len: 1469 microversion: 2.1 time: 0.294625 Jul 01 10:28:35.007967 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 349/689] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:34 2022] GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:35.008804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-85b189d3-80c6-4e35-a526-7c1857a83193 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '.version_select at 0x7f6f922bdee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:35.180599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:35.201838 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-85b189d3-80c6-4e35-a526-7c1857a83193 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880502020" status: 202 len: 0 microversion: 2.1 time: 0.182395 Jul 01 10:28:35.201838 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 350/690] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880502020 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:28:35.202604 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68ebdbf6-abfe-4292-8a40-4913f8c6a09a tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1464 microversion: 2.1 time: 0.333503 Jul 01 10:28:35.202604 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 341/691] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:34 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:35.202934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:35.214785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:35.215922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Searching by: {'reservation_id': 'r-nhv0q3t9', 'deleted': False, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:28:35.216160 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:35.216767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:35.226099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:35.226763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:35.227720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:35.228467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:35.235583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:35.244971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:35.248769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:35.253438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:35.481693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:28:35.500248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:35.510053 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d1288173-51b1-45bc-9fe1-d617e693ef86 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 0.298049 Jul 01 10:28:35.510922 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 342/692] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:35 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:35.516253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8c576de-3e44-453c-af5e-1596438eccfa tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f922cddc0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:35.704613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:35.720381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:35.727579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:36.282442 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52034d01-b829-4361-919a-5457fd4d28ab tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-nhv0q3t9" status: 200 len: 2931 microversion: 2.1 time: 1.091984 Jul 01 10:28:36.283930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 351/693] 10.222.0.23 () {58 vars in 1196 bytes} [Fri Jul 1 10:28:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-nhv0q3t9 => generated 2931 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:36.302223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Action: 'update', calling method: .version_select at 0x7f6f928b0670>, body: {"quota_set": {"ram": "2048"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:36.442877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:36.443359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:36.451758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:36.452218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:36.547561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:36.551407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:36.553299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:36.555371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:36.772594 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-abbbf822-2a96-41d1-82e1-93323ed17070 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658?user_id=aecfee16a1d14a4d96d95d208d92b5e0" status: 200 len: 328 microversion: 2.1 time: 0.474127 Jul 01 10:28:36.773607 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 352/694] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:28:36 2022] PUT /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658?user_id=aecfee16a1d14a4d96d95d208d92b5e0 => generated 328 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:36.778207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:36.793184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:36.802731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:36.807274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:36.807274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:36.807274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:38.201759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:38.228247 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52b8f0ae-10b6-4e1b-b7af-95c66a2927cc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1462 microversion: 2.1 time: 1.450464 Jul 01 10:28:38.234389 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 353/695] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:36 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1462 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:38.264323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:38.264323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:38.306662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:38.307926 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:38.309121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:38.309765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:38.477779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:38.489243 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2abfefe-a54e-487b-b388-394e3a91c3ad tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1282 microversion: 2.1 time: 0.253486 Jul 01 10:28:38.496893 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 354/696] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:38 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1282 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:38.502167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6723fb1-d3a1-4de7-97d8-894520776787 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:38.519106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.compute.server_groups [None req-c6723fb1-d3a1-4de7-97d8-894520776787 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Querying cell dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) for 2 instances {{(pid=119765) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 01 10:28:38.520070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6723fb1-d3a1-4de7-97d8-894520776787 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:38.520615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6723fb1-d3a1-4de7-97d8-894520776787 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:38.551384 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6723fb1-d3a1-4de7-97d8-894520776787 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/750a6b88-a7c4-4942-a364-68545aa27ab0" status: 200 len: 271 microversion: 2.1 time: 0.053167 Jul 01 10:28:38.552069 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 355/697] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:28:38 2022] GET /compute/v2.1/os-server-groups/750a6b88-a7c4-4942-a364-68545aa27ab0 => generated 271 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:38.558596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:38.559297 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:38.565858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:38.566613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:38.567690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:38.568523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:38.888015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:38.888015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a1baa704-8825-4e26-91ce-d3af5bc5ddc6 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 0.326107 Jul 01 10:28:38.888015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 356/698] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:38 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:38.889033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-29a7b39b-0402-4095-8590-9eefe1cfbaa6 req-81ed7c0a-1c8a-4d6b-8c17-1f9cb96092f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c34990-434f-4eba-8949-58aef875f13e", "name": "network-vif-unplugged", "status": "completed", "tag": "4c664d29-f533-4d28-9279-920175ff5640"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:38.902476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-29a7b39b-0402-4095-8590-9eefe1cfbaa6 req-81ed7c0a-1c8a-4d6b-8c17-1f9cb96092f9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:38.902916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-29a7b39b-0402-4095-8590-9eefe1cfbaa6 req-81ed7c0a-1c8a-4d6b-8c17-1f9cb96092f9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:38.947450 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-29a7b39b-0402-4095-8590-9eefe1cfbaa6 req-81ed7c0a-1c8a-4d6b-8c17-1f9cb96092f9 service nova] Creating event network-vif-unplugged:4c664d29-f533-4d28-9279-920175ff5640 for instance 13c34990-434f-4eba-8949-58aef875f13e on n-h1-master-1 Jul 01 10:28:38.956130 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-29a7b39b-0402-4095-8590-9eefe1cfbaa6 req-81ed7c0a-1c8a-4d6b-8c17-1f9cb96092f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073514 Jul 01 10:28:38.957251 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 357/699] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:38.963525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a04236be-2932-42dc-9f9f-f321d9504937 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Calling method '.version_select at 0x7f6f923905e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:39.075470 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a04236be-2932-42dc-9f9f-f321d9504937 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658?user_id=aecfee16a1d14a4d96d95d208d92b5e0" status: 200 len: 370 microversion: 2.1 time: 0.116971 Jul 01 10:28:39.076817 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 358/700] 10.222.0.23 () {58 vars in 1322 bytes} [Fri Jul 1 10:28:38 2022] GET /compute/v2.1/os-quota-sets/1b4b88187e4442d5bfbfdba128436658?user_id=aecfee16a1d14a4d96d95d208d92b5e0 => generated 370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:39.092927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:39.094400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:39.102971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:39.103556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:39.104670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:39.105339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:39.262735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:39.270495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Old instance type m1.heat2, new instance type m1.heat {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 10:28:39.284136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:28:39.284864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:28:39.285552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:28:39.288078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:28:39.288078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:28:39.430866 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8c576de-3e44-453c-af5e-1596438eccfa tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "DELETE /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1" status: 204 len: 0 microversion: 2.1 time: 3.918608 Jul 01 10:28:39.434813 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 343/701] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:35 2022] DELETE /compute/v2.1/images/f3021f1d-48a9-4866-aa49-9a78b63eaaa1 => generated 0 bytes in 3920 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:28:39.438438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d97df79-5ed7-4496-9b1b-95215a621720 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:39.438889 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:39.438889 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:28:39.597608 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d97df79-5ed7-4496-9b1b-95215a621720 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1498493286" status: 202 len: 0 microversion: 2.1 time: 0.164183 Jul 01 10:28:39.598184 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 344/702] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:28:39 2022] DELETE /compute/v2.1/flavors/1498493286 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:28:39.603250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e0ecfc3-4642-4973-a000-cc54adc14cef tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:39.604155 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e0ecfc3-4642-4973-a000-cc54adc14cef tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:39.625229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e0ecfc3-4642-4973-a000-cc54adc14cef tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:39.630704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e0ecfc3-4642-4973-a000-cc54adc14cef tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:39.632401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e0ecfc3-4642-4973-a000-cc54adc14cef tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:39.633051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e0ecfc3-4642-4973-a000-cc54adc14cef tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.223867 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51f31e02-9a9c-4282-ba31-5ac7874aab60 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb/action" status: 202 len: 0 microversion: 2.1 time: 1.144812 Jul 01 10:28:40.226214 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 359/703] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:28:39 2022] POST /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb/action => generated 0 bytes in 1148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:28:40.240998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18fc0755-1a31-4342-ba52-560c5b1cf93b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '.version_select at 0x7f6f9259ab80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:40.340041 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-18fc0755-1a31-4342-ba52-560c5b1cf93b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] HTTP exception thrown: Image not found. Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18fc0755-1a31-4342-ba52-560c5b1cf93b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Request method failure captured: Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 HTTP/1.1 Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvy_wzXyOmeaJh7Z-f7y9TLdu18Ya7ezbyeSxI7t5uEPNbPcqXkoltjnbqoMtaGaeeD1aM5y_P4Kcg7tc5_wBJoHJ3oW7E-PE0pPz31oqXoxAEGbYAngdV7FYJ330fjD6Q80beJF6M0ToU5CAgJs2RW6oz2JeZFc7puhTYhASeep0g Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0312d8a40c804b1b9f413780b01253c0 Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:28:40.352876 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0312d8a40c804b1b9f413780b01253c0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0312d8a40c804b1b9f413780b01253c0 Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerTestJSON-299521334-project Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 4fdab3d8f0b143cd97b918b91429e73a Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerTestJSON-299521334-project Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81'} Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:40.361837 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 to delete Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:40.362910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 could not be found. Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:40.364436 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18fc0755-1a31-4342-ba52-560c5b1cf93b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-18fc0755-1a31-4342-ba52-560c5b1cf93b tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "DELETE /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81" status: 404 len: 62 microversion: 2.1 time: 0.127747 Jul 01 10:28:40.366566 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 360/704] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:40 2022] DELETE /compute/v2.1/images/f0e6f02b-4e3e-4784-bbb6-dd2ac85d2e81 => generated 62 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:28:40.369398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:40.369889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:40.377334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.378216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.379488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.380122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.413509 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e0ecfc3-4642-4973-a000-cc54adc14cef tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1620 microversion: 2.1 time: 0.813912 Jul 01 10:28:40.416083 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 345/705] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:39 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1620 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:40.426846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d0b4cc6f-9f42-4fa7-a13d-3303529841b2 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:40.461721 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d0b4cc6f-9f42-4fa7-a13d-3303529841b2 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.043917 Jul 01 10:28:40.463767 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 346/706] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:28:40 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:40.473252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:40.473252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:40.477707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.478596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.479384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.479994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.480688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:40.491787 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4b38143-1fde-44a7-b508-f13ee7384035 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1282 microversion: 2.1 time: 0.133898 Jul 01 10:28:40.492962 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 361/707] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:40 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:40.499079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:40.500469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:40.508447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.509174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.510109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.510749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.835260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:40.860583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4cbda85-401d-41f2-b4b9-5242bc5a3a07 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 0.394791 Jul 01 10:28:40.863524 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 347/708] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:40 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:40.878105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4ee9baf-52b9-4216-871a-fd3bb5a928f5 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Calling method '.version_select at 0x7f6f92419f70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:40.880210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:40.893870 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fcaa0b6f-f91a-4778-bcf0-b921e3c39d72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1471 microversion: 2.1 time: 0.394239 Jul 01 10:28:40.904859 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 362/709] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:40 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:40.914812 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:40.916184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:40.930262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.939289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.943576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:40.944851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:40.985035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:28:40.995265 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:41.238882 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4ee9baf-52b9-4216-871a-fd3bb5a928f5 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.371160 Jul 01 10:28:41.239871 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 348/710] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:28:40 2022] GET /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6/defaults => generated 371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:41.245536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2aec0fe3-6c8f-4ecc-a926-9485cd09887e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:41.246485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2aec0fe3-6c8f-4ecc-a926-9485cd09887e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:41.254966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2aec0fe3-6c8f-4ecc-a926-9485cd09887e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:41.255714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2aec0fe3-6c8f-4ecc-a926-9485cd09887e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:41.256710 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2aec0fe3-6c8f-4ecc-a926-9485cd09887e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:41.258941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2aec0fe3-6c8f-4ecc-a926-9485cd09887e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:41.453120 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2116597-dd2c-4f50-a25d-268b0c2fe4fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 204 len: 0 microversion: 2.1 time: 0.546601 Jul 01 10:28:41.454936 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 363/711] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:28:40 2022] DELETE /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:28:41.461060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-248da5fc-d991-4090-a4ed-2baae67037f5 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:41.461978 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:28:41.461978 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:28:41.482878 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:41.545757 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-248da5fc-d991-4090-a4ed-2baae67037f5 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1716007003" status: 202 len: 0 microversion: 2.1 time: 0.089353 Jul 01 10:28:41.546659 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 364/712] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:28:41 2022] DELETE /compute/v2.1/flavors/1716007003 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:28:41.551574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cbb41000-c2ab-4134-91d1-3d7e6a1725b1 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Action: 'update', calling method: .version_select at 0x7f6f923cfca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:41.611726 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2aec0fe3-6c8f-4ecc-a926-9485cd09887e tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4" status: 200 len: 1620 microversion: 2.1 time: 0.370496 Jul 01 10:28:41.612302 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 349/713] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:41 2022] GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4 => generated 1620 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:41.626678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:41.627293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:41.644829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:41.645373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:41.652850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:41.652850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:41.681555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbb41000-c2ab-4134-91d1-3d7e6a1725b1 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:41.682990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbb41000-c2ab-4134-91d1-3d7e6a1725b1 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:41.682990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbb41000-c2ab-4134-91d1-3d7e6a1725b1 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:41.683210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbb41000-c2ab-4134-91d1-3d7e6a1725b1 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:42.028020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:42.044812 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53725f02-b540-45e0-9549-119b82a371ff tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1470 microversion: 2.1 time: 0.427612 Jul 01 10:28:42.045762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 350/714] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:41 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:42.053786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:42.056879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:42.066551 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:42.067647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:42.068687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:42.069778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:42.372719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:42.382177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6bd77bbb-3c29-4bc9-b032-387ce8c70d6d tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1324 microversion: 2.1 time: 0.335160 Jul 01 10:28:42.382844 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 351/715] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:42 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:42.387122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4551b28f-834a-4344-90b2-dbf91d111936 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:42.407916 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4551b28f-834a-4344-90b2-dbf91d111936 tempest-ServersWithSpecificFlavorTestJSON-187616445 tempest-ServersWithSpecificFlavorTestJSON-187616445-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023873 Jul 01 10:28:42.408488 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 352/716] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:28:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:42.414055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1224943321", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "25b54469-ddac-4b10-a1b4-61a4c7be16d9"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:42.489755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:28:42.978807 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cbb41000-c2ab-4134-91d1-3d7e6a1725b1 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6" status: 200 len: 329 microversion: 2.1 time: 1.430407 Jul 01 10:28:42.980771 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 365/717] 10.222.0.23 () {60 vars in 1262 bytes} [Fri Jul 1 10:28:41 2022] PUT /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6 => generated 329 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:42.990598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:42.991737 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:42.998173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:42.998621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:42.999457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:42.999890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:43.045177 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:28:43.046208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:28:43.046841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:28:43.047523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:28:43.048153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:28:43.061626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:43.062573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:43.063541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:43.067688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:43.088395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:43.093882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:43.110415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:28:43.113121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:28:43.260846 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9aaa2c1a-454b-4f3b-80a8-6d3ee66e6f86 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851231 Jul 01 10:28:43.266884 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 353/718] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:28:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:28:43.286746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:43.288188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:43.305668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:43.305668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:43.305668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:43.305668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:43.882916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:43.907255 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c0ed0b36-ee4f-4d73-b782-f817163bad76 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 0.924981 Jul 01 10:28:43.908840 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 366/719] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:42 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:43.914498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:43.915278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:43.921852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:43.922592 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:43.923575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:43.924207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:43.949598 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] HTTP exception thrown: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Request method failure captured: Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e HTTP/1.1 Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsutD9EAcdU1ZMUFkziWhNHFeUsv9EnGbylTj6Pfj-3kuUv6xmWkOBwwJRQX5uqLTWdAntPwSBb28oSToQQu8-Ob_WHZtiDMzykRnk87JnHFDogHH8IL7dvF77BVkbbICUBrdA2Rp-8gr6UhUdwDkJJEiaUp5SPNRKGvBUiY9ZCmCk0 Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:28:43.951965 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e215073c20cc458983a0912389cb4e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e215073c20cc458983a0912389cb4e44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d00b392abf154820b4e5bce216b7e406 Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: exception: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:43.953357 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'de87ae39-30f0-4c4d-8396-ed1f999f302e'} Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:43.961343 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:43.962740 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:43.964303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Returning 404 to user: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:43.964303 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61c37319-18c2-4e5e-ba9e-3ee664984d23 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 404 len: 111 microversion: 2.1 time: 0.045356 Jul 01 10:28:43.964303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 367/720] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:28:43 2022] DELETE /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:43.965328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eeec0df9-d2d1-461c-b389-8e536132e493 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Action: 'update', calling method: .version_select at 0x7f6f9273b8b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:44.060944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeec0df9-d2d1-461c-b389-8e536132e493 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.063239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeec0df9-d2d1-461c-b389-8e536132e493 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.063239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeec0df9-d2d1-461c-b389-8e536132e493 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.063239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeec0df9-d2d1-461c-b389-8e536132e493 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.472901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:44.481138 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-49c07c6e-ab01-4149-a4d1-e570c4dd8459 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1471 microversion: 2.1 time: 1.212327 Jul 01 10:28:44.481687 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 354/721] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:43 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1471 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:44.486021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:44.486616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:44.493074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.493568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.494319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.494744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.759911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:44.767505 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60e090fc-9957-47c3-b41c-2805821d26fe tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1470 microversion: 2.1 time: 0.284834 Jul 01 10:28:44.768289 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 355/722] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:44 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:44.773783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-77d7bf5f-f1be-4bbf-9a5c-40d886e3363e req-5ecb9722-789a-4b5a-bee0-259d1868644f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f70d5be-11e7-4a30-be3e-ee8374833175", "tag": "d2ffd7a6-066f-4ed2-ab25-3a654d2aac61"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:44.783075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-77d7bf5f-f1be-4bbf-9a5c-40d886e3363e req-5ecb9722-789a-4b5a-bee0-259d1868644f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.783507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-77d7bf5f-f1be-4bbf-9a5c-40d886e3363e req-5ecb9722-789a-4b5a-bee0-259d1868644f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.796033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-77d7bf5f-f1be-4bbf-9a5c-40d886e3363e req-5ecb9722-789a-4b5a-bee0-259d1868644f service nova] Creating event network-changed:d2ffd7a6-066f-4ed2-ab25-3a654d2aac61 for instance 2f70d5be-11e7-4a30-be3e-ee8374833175 on n-h1-master-1 Jul 01 10:28:44.801703 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-77d7bf5f-f1be-4bbf-9a5c-40d886e3363e req-5ecb9722-789a-4b5a-bee0-259d1868644f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032216 Jul 01 10:28:44.802359 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 356/723] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:44.807650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:44.808348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:44.815319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.815319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.816033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.816499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.923019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:44.932583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-799cabf1-0f62-4690-bb74-f3677dd80e83 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1221 microversion: 2.1 time: 0.129042 Jul 01 10:28:44.933236 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 357/724] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:44 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:44.939288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:44.939890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:44.946843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.947280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:44.948079 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:44.948529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:45.246865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:45.255267 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a436fc3a-30de-48c9-9d12-dc4fab4f42f2 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1324 microversion: 2.1 time: 0.319634 Jul 01 10:28:45.265456 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 358/725] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:44 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:45.270614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:45.271920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: de87ae39-30f0-4c4d-8396-ed1f999f302e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:45.278169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:45.278608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:45.279365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:45.279964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:45.311901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] HTTP exception thrown: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Request method failure captured: Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e HTTP/1.1 Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsutD9EAcdU1ZMUFkziWhNHFeUsv9EnGbylTj6Pfj-3kuUv6xmWkOBwwJRQX5uqLTWdAntPwSBb28oSToQQu8-Ob_WHZtiDMzykRnk87JnHFDogHH8IL7dvF77BVkbbICUBrdA2Rp-8gr6UhUdwDkJJEiaUp5SPNRKGvBUiY9ZCmCk0 Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:28:45.313572 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e215073c20cc458983a0912389cb4e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e215073c20cc458983a0912389cb4e44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: d00b392abf154820b4e5bce216b7e406 Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: exception: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:45.315307 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'de87ae39-30f0-4c4d-8396-ed1f999f302e'} Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:45.316152 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. Jul 01 10:28:45.317586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:45.319753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Returning 404 to user: Instance de87ae39-30f0-4c4d-8396-ed1f999f302e could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:45.319753 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d6d98736-76ed-44c0-8583-f76756625106 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e" status: 404 len: 111 microversion: 2.1 time: 0.048172 Jul 01 10:28:45.319753 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 359/726] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:45 2022] GET /compute/v2.1/servers/de87ae39-30f0-4c4d-8396-ed1f999f302e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:45.328237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:45.335604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:45.336338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:45.336788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:45.337589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:45.338196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:45.687999 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=26,nova_api:UPDATE=11 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:45.942235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:45.950786 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:45.981171 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5441f31a-ff19-42d7-b01d-3f9d20acaf68 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 0.659652 Jul 01 10:28:45.992781 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 360/727] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:45 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:46.016140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:46.017252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:46.035470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.036035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.038628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.039825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.076824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] HTTP exception thrown: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Request method failure captured: Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc HTTP/1.1 Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsutD9EAcdU1ZMUFkziWhNHFeUsv9EnGbylTj6Pfj-3kuUv6xmWkOBwwJRQX5uqLTWdAntPwSBb28oSToQQu8-Ob_WHZtiDMzykRnk87JnHFDogHH8IL7dvF77BVkbbICUBrdA2Rp-8gr6UhUdwDkJJEiaUp5SPNRKGvBUiY9ZCmCk0 Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:28:46.079535 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e215073c20cc458983a0912389cb4e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e215073c20cc458983a0912389cb4e44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: d00b392abf154820b4e5bce216b7e406 Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.080793 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '671d0a80-8e15-49a6-8f16-eb2e010d24cc'} Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:46.084382 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.085996 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.087193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Returning 404 to user: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:46.089354 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f41d799-17d0-4c7c-a0ca-eb590ed95b00 tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 404 len: 111 microversion: 2.1 time: 0.103942 Jul 01 10:28:46.090151 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 361/728] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:28:45 2022] DELETE /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:46.096457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-830261ad-4d81-46d0-bfb5-595daff92789 req-58c7afe4-017b-4b55-8d8e-dc532b332314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b75a0d-c563-4a81-ad59-be51d81abb3e", "name": "network-vif-plugged", "status": "completed", "tag": "95cbf043-1522-4cbc-b2ba-b4848f245f5a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:46.106354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-830261ad-4d81-46d0-bfb5-595daff92789 req-58c7afe4-017b-4b55-8d8e-dc532b332314 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.107139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-830261ad-4d81-46d0-bfb5-595daff92789 req-58c7afe4-017b-4b55-8d8e-dc532b332314 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.121362 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-830261ad-4d81-46d0-bfb5-595daff92789 req-58c7afe4-017b-4b55-8d8e-dc532b332314 service nova] Creating event network-vif-plugged:95cbf043-1522-4cbc-b2ba-b4848f245f5a for instance 44b75a0d-c563-4a81-ad59-be51d81abb3e on n-h2-master-1 Jul 01 10:28:46.127656 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-830261ad-4d81-46d0-bfb5-595daff92789 req-58c7afe4-017b-4b55-8d8e-dc532b332314 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035803 Jul 01 10:28:46.129602 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 362/729] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:46.151205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:46.154067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:46.157869 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eeec0df9-d2d1-461c-b389-8e536132e493 tempest-QuotasAdminTestJSON-1953155254 tempest-QuotasAdminTestJSON-1953155254-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6" status: 200 len: 329 microversion: 2.1 time: 2.200480 Jul 01 10:28:46.158432 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 368/730] 10.222.0.23 () {60 vars in 1262 bytes} [Fri Jul 1 10:28:43 2022] PUT /compute/v2.1/os-quota-sets/b602b4ea19be48d8a73332e3f880f0b6 => generated 329 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:46.179191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:46.179770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.180201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:46.181588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.182160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.182648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.195256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.195973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.197328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.197931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.275737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.276528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.277113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lazy-loading 'fault' on Instance uuid 13c34990-434f-4eba-8949-58aef875f13e {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:28:46.485561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdab3d8f0b143cd97b918b91429e73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0312d8a40c804b1b9f413780b01253c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:46.497097 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f414116-152f-4f79-b876-f3c915386c68 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 200 len: 1305 microversion: 2.1 time: 0.331491 Jul 01 10:28:46.498395 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 369/731] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:46 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 1305 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:46.504787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:46.505940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:46.515819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.516631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.517702 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.518593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.727799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:46.750448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:46.759171 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e40046f-d2f8-4584-b463-b4d76412a219 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1269 microversion: 2.1 time: 0.259272 Jul 01 10:28:46.765975 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 370/732] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:46 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:46.768544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b917c25e-d2ad-45b8-b880-868a6da2354d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1471 microversion: 2.1 time: 0.635443 Jul 01 10:28:46.769350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 363/733] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:46 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1471 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:46.792285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:46.795215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] [instance: 671d0a80-8e15-49a6-8f16-eb2e010d24cc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:46.796507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:46.797900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:46.826798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.826798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.826798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.827181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.827289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.827461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.829867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.832585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.891585 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] HTTP exception thrown: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Request method failure captured: Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc HTTP/1.1 Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsutD9EAcdU1ZMUFkziWhNHFeUsv9EnGbylTj6Pfj-3kuUv6xmWkOBwwJRQX5uqLTWdAntPwSBb28oSToQQu8-Ob_WHZtiDMzykRnk87JnHFDogHH8IL7dvF77BVkbbICUBrdA2Rp-8gr6UhUdwDkJJEiaUp5SPNRKGvBUiY9ZCmCk0 Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:28:46.896344 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e215073c20cc458983a0912389cb4e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e215073c20cc458983a0912389cb4e44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e215073c20cc458983a0912389cb4e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e215073c20cc458983a0912389cb4e44 Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505 Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d00b392abf154820b4e5bce216b7e406 Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1971059505-project Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.897985 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '671d0a80-8e15-49a6-8f16-eb2e010d24cc'} Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:46.898699 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. Jul 01 10:28:46.899886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:46.912488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] Returning 404 to user: Instance 671d0a80-8e15-49a6-8f16-eb2e010d24cc could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:46.913895 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73b4252c-744f-4782-9c26-dbde6a10116d tempest-ServersWithSpecificFlavorTestJSON-1971059505 tempest-ServersWithSpecificFlavorTestJSON-1971059505-project] 10.222.0.23 "GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc" status: 404 len: 111 microversion: 2.1 time: 0.145614 Jul 01 10:28:46.923772 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 371/734] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:46 2022] GET /compute/v2.1/servers/671d0a80-8e15-49a6-8f16-eb2e010d24cc => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:46.928253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-388732f7-86ea-43f1-a9e8-d0f38e4309d5 req-34ecf24a-ce4b-4d88-ba04-05d5f22ce805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c34990-434f-4eba-8949-58aef875f13e", "name": "network-vif-deleted", "tag": "4c664d29-f533-4d28-9279-920175ff5640"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:46.955015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-388732f7-86ea-43f1-a9e8-d0f38e4309d5 req-34ecf24a-ce4b-4d88-ba04-05d5f22ce805 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:46.958328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-388732f7-86ea-43f1-a9e8-d0f38e4309d5 req-34ecf24a-ce4b-4d88-ba04-05d5f22ce805 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:46.981111 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-388732f7-86ea-43f1-a9e8-d0f38e4309d5 req-34ecf24a-ce4b-4d88-ba04-05d5f22ce805 service nova] Creating event network-vif-deleted:4c664d29-f533-4d28-9279-920175ff5640 for instance 13c34990-434f-4eba-8949-58aef875f13e on n-h1-master-1 Jul 01 10:28:46.996646 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-388732f7-86ea-43f1-a9e8-d0f38e4309d5 req-34ecf24a-ce4b-4d88-ba04-05d5f22ce805 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077152 Jul 01 10:28:47.003264 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 372/735] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:47.012154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:47.016212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:47.030779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:47.031558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:47.032542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:47.033716 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:47.943200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:47.951928 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-89237529-d9b2-41bd-8aa6-5935ae973010 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1324 microversion: 2.1 time: 1.179979 Jul 01 10:28:47.952520 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 364/736] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:46 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1324 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:48.146092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-810073089", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "510d1e57-c4e3-47f6-a81f-66e48831c93c"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:48.213080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:48.244092 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a3a7c652-8961-4ce3-90f4-6ac14bff466d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1370 microversion: 2.1 time: 1.236729 Jul 01 10:28:48.248813 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 373/737] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:47 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1370 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:48.262867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:48.269712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] [instance: 13c34990-434f-4eba-8949-58aef875f13e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:48.288614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] validate_networks() for [('510d1e57-c4e3-47f6-a81f-66e48831c93c', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:28:48.295861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:48.296565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:48.297531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:48.298234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:48.314085 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] HTTP exception thrown: Instance 13c34990-434f-4eba-8949-58aef875f13e could not be found. Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Request method failure captured: Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e HTTP/1.1 Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvy_wzXyOmeaJh7Z-f7y9TLdu18Ya7ezbyeSxI7t5uEPNbPcqXkoltjnbqoMtaGaeeD1aM5y_P4Kcg7tc5_wBJoHJ3oW7E-PE0pPz31oqXoxAEGbYAngdV7FYJ330fjD6Q80beJF6M0ToU5CAgJs2RW6oz2JeZFc7puhTYhASeep0g Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0312d8a40c804b1b9f413780b01253c0 Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:28:48.316051 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0312d8a40c804b1b9f413780b01253c0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0312d8a40c804b1b9f413780b01253c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0312d8a40c804b1b9f413780b01253c0 Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-299521334 Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerTestJSON-299521334-project Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 4fdab3d8f0b143cd97b918b91429e73a Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerTestJSON-299521334-project Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 13c34990-434f-4eba-8949-58aef875f13e could not be found. Jul 01 10:28:48.317631 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '13c34990-434f-4eba-8949-58aef875f13e'} Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c34990-434f-4eba-8949-58aef875f13e could not be found. Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:28:48.319055 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c34990-434f-4eba-8949-58aef875f13e could not be found. Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c34990-434f-4eba-8949-58aef875f13e could not be found. Jul 01 10:28:48.320463 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:28:48.322638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] Returning 404 to user: Instance 13c34990-434f-4eba-8949-58aef875f13e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:28:48.323713 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3bb3c37d-7be5-49d5-9489-0f1df3cd1047 tempest-ImagesOneServerTestJSON-299521334 tempest-ImagesOneServerTestJSON-299521334-project] 10.222.0.23 "GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e" status: 404 len: 111 microversion: 2.1 time: 0.073909 Jul 01 10:28:48.324743 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 374/738] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:48 2022] GET /compute/v2.1/servers/13c34990-434f-4eba-8949-58aef875f13e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:28:48.330171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:48.331052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:48.339161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:48.339815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:48.340893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:48.341585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:48.603006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:48.611882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8fa64a8-db1e-491a-830d-5a0c3db9c9bc tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1275 microversion: 2.1 time: 0.285884 Jul 01 10:28:48.617490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 375/739] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:48 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:48.623782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:48.634233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:48.641235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:48.641912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:48.642851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:48.647280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:49.285607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:49.301272 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-373f394f-2dbd-49f0-b00c-68615d664b00 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1471 microversion: 2.1 time: 0.682387 Jul 01 10:28:49.312785 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 376/740] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:48 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1471 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:49.329832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-886c201c-ffd4-4d88-b15a-65a29f4bb4b8 req-e11a7dad-15ab-44cc-94fc-68a12c3c3b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f70d5be-11e7-4a30-be3e-ee8374833175", "name": "network-vif-plugged", "status": "completed", "tag": "d2ffd7a6-066f-4ed2-ab25-3a654d2aac61"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:49.358322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-886c201c-ffd4-4d88-b15a-65a29f4bb4b8 req-e11a7dad-15ab-44cc-94fc-68a12c3c3b36 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:49.358790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-886c201c-ffd4-4d88-b15a-65a29f4bb4b8 req-e11a7dad-15ab-44cc-94fc-68a12c3c3b36 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:49.396879 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-886c201c-ffd4-4d88-b15a-65a29f4bb4b8 req-e11a7dad-15ab-44cc-94fc-68a12c3c3b36 service nova] Creating event network-vif-plugged:d2ffd7a6-066f-4ed2-ab25-3a654d2aac61 for instance 2f70d5be-11e7-4a30-be3e-ee8374833175 on n-h1-master-1 Jul 01 10:28:49.408738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-886c201c-ffd4-4d88-b15a-65a29f4bb4b8 req-e11a7dad-15ab-44cc-94fc-68a12c3c3b36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086673 Jul 01 10:28:49.411890 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 377/741] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:49.424779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:49.426491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:49.441794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:49.446510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:49.447441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:49.447886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:49.896902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:28:49.897485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:28:49.898352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:28:49.899474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:28:49.900579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:28:49.914929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:49.915738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:49.916874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:49.918038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:49.947219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:28:49.954595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for user cd7034799f014e95bbe8ed18fdc424a6 and project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:28:49.968667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:28:49.971905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:28:50.017195 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:50.030842 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d8d45ee-65fd-43fd-91dd-46e36196175a tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1324 microversion: 2.1 time: 0.617385 Jul 01 10:28:50.031441 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 378/742] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:49 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1324 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:50.036288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:50.039220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:50.051771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.054437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.054437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.054437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.165482 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fe30a6ad-13cb-41a2-9301-855d6c916438 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.208048 Jul 01 10:28:50.172321 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 365/743] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:28:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2215 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:28:50.178367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:50.179443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:50.194503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.195125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.197287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.198316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.341654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:50.351198 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2041581e-6d06-46ca-ae37-229a20cc33de tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1275 microversion: 2.1 time: 0.177470 Jul 01 10:28:50.351782 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 366/744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:50 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:50.366201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a810bfc7-2b35-42dc-9a2e-93853acc75df tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:50.366811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a810bfc7-2b35-42dc-9a2e-93853acc75df tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:50.445424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:50.455223 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2c80937-0b37-4ec3-a6f1-a7d75e3f1d7d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1557 microversion: 2.1 time: 0.422487 Jul 01 10:28:50.459355 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 379/745] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:50 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1557 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:50.473389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:50.477030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:50.486833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.490805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.492566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.504195 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.533542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a810bfc7-2b35-42dc-9a2e-93853acc75df tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:50.543923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a810bfc7-2b35-42dc-9a2e-93853acc75df tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:50.548090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a810bfc7-2b35-42dc-9a2e-93853acc75df tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:50.551430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a810bfc7-2b35-42dc-9a2e-93853acc75df tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1261 microversion: 2.25 time: 0.191537 Jul 01 10:28:50.566567 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 367/746] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:28:50 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:28:50.577582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-02a53082-43dd-422e-8781-adb8b19ec904 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:50.580382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-02a53082-43dd-422e-8781-adb8b19ec904 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:50.591018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02a53082-43dd-422e-8781-adb8b19ec904 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.598300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02a53082-43dd-422e-8781-adb8b19ec904 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.604194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02a53082-43dd-422e-8781-adb8b19ec904 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:50.604762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02a53082-43dd-422e-8781-adb8b19ec904 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:50.854228 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-02a53082-43dd-422e-8781-adb8b19ec904 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.281008 Jul 01 10:28:50.857197 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 368/747] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:28:50 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:50.892464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:50.900557 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc8040c7-38f5-48d4-8228-2eb3901e5e1e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.438918 Jul 01 10:28:50.911334 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 380/748] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:50 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:51.052769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:51.067271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:51.098094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:51.099879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:51.102762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:51.105061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:51.369297 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:51.369912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:51.388374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:51.389138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:51.390701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:51.394271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:52.012290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:52.022100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ef2ce05-53f4-40e1-8f7d-a0242dbc178b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1324 microversion: 2.1 time: 0.977536 Jul 01 10:28:52.033842 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 369/749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:51 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1324 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:52.044872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:52.048958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:52.054991 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:52.069841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:52.071813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:52.071813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:52.072118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:52.238735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:52.251806 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9ddd8b7e-fb52-4f98-8e5c-936e68a174c4 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1317 microversion: 2.1 time: 0.887749 Jul 01 10:28:52.252394 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 381/750] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:51 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:52.258791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:52.262704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:52.270600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:52.272051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:52.272633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:52.273085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:52.294786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:52.317571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:52.323319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:52.329472 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-484f7274-c353-4d0d-a9db-f893c7d36ce4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1265 microversion: 2.25 time: 0.293303 Jul 01 10:28:52.331292 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 370/751] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:28:52 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:28:52.783274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:52.798062 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e38fc6a2-e6cf-429e-841a-f9578dae8f46 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.544436 Jul 01 10:28:52.799478 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 382/752] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:52 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:53.044506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:53.045801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:53.055563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.061737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.061737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.062525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.269776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:53.279358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:53.280141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.280833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.281852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.297212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.551327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:53.559583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db825f85-e03b-41f4-b55c-3c34ac56ea19 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 200 len: 1520 microversion: 2.1 time: 0.522675 Jul 01 10:28:53.560409 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 371/753] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:53 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:53.565514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:53.566354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:53.574324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.575102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.576071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.576660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.719608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:53.733012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:53.734590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:53.735728 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7995a333-2d34-4b14-a86e-9abf4669cf8f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1331 microversion: 2.25 time: 0.174252 Jul 01 10:28:53.736287 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 372/754] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:28:53 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1331 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:28:53.756497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'action', calling method: .version_select at 0x7f6f94a4a820>, body: {"addFloatingIp": {"address": "172.35.6.97"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:53.757719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:53.776150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.782770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.782770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:53.782770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:53.923294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Acquired lock "refresh_cache-e7c7abe7-c029-4079-a717-487c2b56573a" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:28:54.022051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:54.031792 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-846563d6-b4b3-4c98-9fc7-acdb4362f67c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1317 microversion: 2.1 time: 0.766134 Jul 01 10:28:54.041681 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 383/755] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:53 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:54.041681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:54.041681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:54.047443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:54.048328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:54.049322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:54.050529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:54.055387 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:54.088829 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=13 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:54.839555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:54.862549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31a50665-dd2a-43c6-819b-f135f154c2fb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.828667 Jul 01 10:28:54.866788 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 384/756] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:54 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:55.251239 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21deeb29-a529-40dd-a9fc-40e75da1e5d0 tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] Action: 'create', calling method: .version_select at 0x7f6f92a8fee0>, body: {"security_group": {"name": "tempest-securitygroup-494601034", "description": "tempest-description-1423567910"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:56.145344 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=96 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:28:57.020700 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21deeb29-a529-40dd-a9fc-40e75da1e5d0 tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.152730 Jul 01 10:28:57.024735 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 385/757] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:28:54 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:57.039245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:57.042997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:57.049482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:57.050185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:57.051297 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:57.052621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:57.396368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:57.405271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:57.411051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:57.417166 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47f34bec-0e94-4586-bf82-a2b469a87e0f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1361 microversion: 2.25 time: 0.391057 Jul 01 10:28:57.417770 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 386/758] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:28:57 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:28:57.434039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ebaced6b-45eb-4cb0-8f55-cd446ad88d59 req-ed5bb5ef-9b68-4470-9446-296a043e4dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b75a0d-c563-4a81-ad59-be51d81abb3e", "tag": "95cbf043-1522-4cbc-b2ba-b4848f245f5a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:57.446765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ebaced6b-45eb-4cb0-8f55-cd446ad88d59 req-ed5bb5ef-9b68-4470-9446-296a043e4dff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:57.449478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ebaced6b-45eb-4cb0-8f55-cd446ad88d59 req-ed5bb5ef-9b68-4470-9446-296a043e4dff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:57.469354 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ebaced6b-45eb-4cb0-8f55-cd446ad88d59 req-ed5bb5ef-9b68-4470-9446-296a043e4dff service nova] Creating event network-changed:95cbf043-1522-4cbc-b2ba-b4848f245f5a for instance 44b75a0d-c563-4a81-ad59-be51d81abb3e on n-h2-master-1 Jul 01 10:28:57.476291 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ebaced6b-45eb-4cb0-8f55-cd446ad88d59 req-ed5bb5ef-9b68-4470-9446-296a043e4dff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046973 Jul 01 10:28:57.477131 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 387/759] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:57.492139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:57.493053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:57.501445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:57.502580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:57.504591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:57.506419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:57.732576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Building network info cache for instance {{(pid=119764) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:28:57.955737 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:57.963470 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd068956-3fed-443e-92b3-a3e7465c05ce tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1317 microversion: 2.1 time: 0.484717 Jul 01 10:28:57.966041 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 388/760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:57 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:57.978276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:57.979146 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:57.986346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:57.987320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:57.988322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:57.988945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:58.302469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:58.312796 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6683a358-d571-4f16-aa8e-2284abf82bce tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.345645 Jul 01 10:28:58.314498 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 389/761] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:57 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:58.320380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-83e42621-2f1f-4b9d-aa0d-66e4d80b24ac req-49b7e84b-5888-4e3a-9253-478739df0d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5569f4-0626-402c-a3c4-ed62cb8af25c", "tag": "dfca3548-598e-4e5d-abba-a6283102320c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:58.337086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-83e42621-2f1f-4b9d-aa0d-66e4d80b24ac req-49b7e84b-5888-4e3a-9253-478739df0d6a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:58.337614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-83e42621-2f1f-4b9d-aa0d-66e4d80b24ac req-49b7e84b-5888-4e3a-9253-478739df0d6a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:58.354069 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-83e42621-2f1f-4b9d-aa0d-66e4d80b24ac req-49b7e84b-5888-4e3a-9253-478739df0d6a service nova] Creating event network-changed:dfca3548-598e-4e5d-abba-a6283102320c for instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c on n-h2-master-1 Jul 01 10:28:58.359666 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-83e42621-2f1f-4b9d-aa0d-66e4d80b24ac req-49b7e84b-5888-4e3a-9253-478739df0d6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043535 Jul 01 10:28:58.361104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 390/762] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:58.369610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-488485ec-4237-46ce-8265-21686cbeb1ce tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] Action: 'create', calling method: .version_select at 0x7f6f92a8b700>, body: {"security_group": {"name": "tempest-securitygroup-1607717286", "description": "tempest-description-447748064"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:59.220738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Updating instance_info_cache with network_info: [{"id": "311e0c88-1777-4643-834e-e3e9e94477c9", "address": "fa:16:3e:36:4e:10", "network": {"id": "ad82b036-ac12-4a66-b1a2-50d8586e1b40", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1993181966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "83905704e34a425887ccad7606e3c792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap311e0c88-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119764) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:28:59.235813 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-488485ec-4237-46ce-8265-21686cbeb1ce tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.867532 Jul 01 10:28:59.235813 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 391/763] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:28:58 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:28:59.241550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:59.242482 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:59.255251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:59.256246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:59.257348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:59.258325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:59.335513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Releasing lock "refresh_cache-e7c7abe7-c029-4079-a717-487c2b56573a" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:28:59.338064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef855c83-61a8-4675-9af9-6620073f3e5c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action" status: 202 len: 0 microversion: 2.1 time: 5.600702 Jul 01 10:28:59.339376 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 373/764] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:28:53 2022] POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action => generated 0 bytes in 5602 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:28:59.346255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:59.347587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:59.359418 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:59.363997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:59.363997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:59.363997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:59.640443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:59.663301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:59.669343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc41c222-1c35-4b98-bee1-cef6816ca8e3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1317 microversion: 2.1 time: 0.328127 Jul 01 10:28:59.674068 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 374/765] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:59 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:28:59.687220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:59.697413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:28:59.699559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-820b9a40-f552-4444-9f53-6feff82acf57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1361 microversion: 2.25 time: 0.461841 Jul 01 10:28:59.702370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 392/766] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:28:59 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1361 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:28:59.708754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:28:59.714261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:28:59.727755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:59.729727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:59.731482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:28:59.733062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:28:59.800091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9e99f27-2c75-42dd-8616-0a58be6239ef tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Action: 'create', calling method: .version_select at 0x7f6f923fea60>, body: {"security_group": {"name": "tempest-securitygroup-1545930025", "description": "tempest-description-1942904912"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:28:59.936700 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:00.057242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:00.073105 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d9c727c-d980-409a-ab2f-e8ff84a4607c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.369390 Jul 01 10:29:00.088125 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 393/767] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:28:59 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:00.093084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'action', calling method: .version_select at 0x7f6f94a4a820>, body: {"addFloatingIp": {"address": "172.35.6.97"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:00.094464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:00.102732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:00.113733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:00.115055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:00.115698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:00.274601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Acquired lock "refresh_cache-2f70d5be-11e7-4a30-be3e-ee8374833175" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:29:00.541021 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=22 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:01.207805 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9e99f27-2c75-42dd-8616-0a58be6239ef tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.531592 Jul 01 10:29:01.209039 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 375/768] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:28:59 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:01.218309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-79ca4b12-c47f-46a6-b0fd-7a5a9bc4e3fa req-d812c569-029c-4807-93a5-6d4bf8a62a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c18b634-6ae0-4b52-bc86-c6ed5fe457e4", "tag": "52256dd9-2818-4894-88d8-479cc1283487"}, {"name": "network-changed", "server_uuid": "e7c7abe7-c029-4079-a717-487c2b56573a", "tag": "311e0c88-1777-4643-834e-e3e9e94477c9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:01.237736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-79ca4b12-c47f-46a6-b0fd-7a5a9bc4e3fa req-d812c569-029c-4807-93a5-6d4bf8a62a57 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:01.238186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-79ca4b12-c47f-46a6-b0fd-7a5a9bc4e3fa req-d812c569-029c-4807-93a5-6d4bf8a62a57 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:01.271561 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-79ca4b12-c47f-46a6-b0fd-7a5a9bc4e3fa req-d812c569-029c-4807-93a5-6d4bf8a62a57 service nova] Creating event network-changed:52256dd9-2818-4894-88d8-479cc1283487 for instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 on n-h1-master-1 Jul 01 10:29:01.272083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-79ca4b12-c47f-46a6-b0fd-7a5a9bc4e3fa req-d812c569-029c-4807-93a5-6d4bf8a62a57 service nova] Creating event network-changed:311e0c88-1777-4643-834e-e3e9e94477c9 for instance e7c7abe7-c029-4079-a717-487c2b56573a on n-h2-master-1 Jul 01 10:29:01.284961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-79ca4b12-c47f-46a6-b0fd-7a5a9bc4e3fa req-d812c569-029c-4807-93a5-6d4bf8a62a57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070190 Jul 01 10:29:01.286732 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 376/769] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:01.293636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:01.294336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:01.302870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:01.303571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:01.304516 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:01.305097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:01.846137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:01.858089 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f4ddd84-ea77-4c86-8594-72052ff6cb8c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1317 microversion: 2.1 time: 0.568487 Jul 01 10:29:01.859129 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 377/770] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:01 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:01.865434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:01.866045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:01.882287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:01.885853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:01.886683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:01.887124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:02.319311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:02.337695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:02.339420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:02.340823 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e66756c-9b4a-4e07-9b81-4cb4b2af8240 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1361 microversion: 2.25 time: 0.480019 Jul 01 10:29:02.354005 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 378/771] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:01 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:02.359782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6c68a731-eddb-4d8e-93d9-1e85b21b3447 req-6cbac834-7be4-4065-b2e9-0834e5a2c8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c18b634-6ae0-4b52-bc86-c6ed5fe457e4", "name": "network-vif-plugged", "status": "completed", "tag": "52256dd9-2818-4894-88d8-479cc1283487"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:02.370303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6c68a731-eddb-4d8e-93d9-1e85b21b3447 req-6cbac834-7be4-4065-b2e9-0834e5a2c8ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:02.370958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6c68a731-eddb-4d8e-93d9-1e85b21b3447 req-6cbac834-7be4-4065-b2e9-0834e5a2c8ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:02.390248 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6c68a731-eddb-4d8e-93d9-1e85b21b3447 req-6cbac834-7be4-4065-b2e9-0834e5a2c8ca service nova] Creating event network-vif-plugged:52256dd9-2818-4894-88d8-479cc1283487 for instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 on n-h1-master-1 Jul 01 10:29:02.400924 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6c68a731-eddb-4d8e-93d9-1e85b21b3447 req-6cbac834-7be4-4065-b2e9-0834e5a2c8ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045145 Jul 01 10:29:02.402583 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 379/772] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:02.410161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:02.411809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:02.419193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:02.419744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:02.420751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:02.421281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:03.294424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:03.303057 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3595a98f-2af1-4164-8990-f39b8825829e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.898935 Jul 01 10:29:03.307959 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 380/773] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:02 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:03.311630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eeea9e7e-e60b-4018-b52e-53d172360f65 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Action: 'create', calling method: .version_select at 0x7f6f9223cee0>, body: {"security_group": {"name": "tempest-securitygroup-996518718", "description": "tempest-description-814552280"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:03.918957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eeea9e7e-e60b-4018-b52e-53d172360f65 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.612235 Jul 01 10:29:03.922139 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 381/774] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:29:03 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:03.936613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:03.937445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:03.950703 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:03.951163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:03.951944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:03.952380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:04.233246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:04.242481 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8e5ce4a-4d75-49f1-a59e-2b39d4c7904d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1317 microversion: 2.1 time: 0.319260 Jul 01 10:29:04.245017 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 382/775] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:03 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:04.336985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-926174092", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "14a0a945-9224-4c59-b797-2941c9320d9a"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:04.402480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] validate_networks() for [('14a0a945-9224-4c59-b797-2941c9320d9a', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:04.656613 n-d-master-1 devstack@n-api.service[119765]: INFO nova.network.neutron [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] re-assign floating IP 172.35.6.97 from instance e7c7abe7-c029-4079-a717-487c2b56573a Jul 01 10:29:04.762722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Building network info cache for instance {{(pid=119765) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:29:05.187668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:05.188086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:05.188703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:05.189444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:05.189854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:05.199689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:05.199904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:05.202349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:05.203014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:05.225806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:05.229871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for user 877a848749ec4975beaf9ec07bc3b2e6 and project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:05.242316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:05.244650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:05.407536 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17c4663a-20b2-4029-b79b-e4b4df62ab90 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150592 Jul 01 10:29:05.408528 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 383/776] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:05.444384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:05.445945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:05.499862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:05.500326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:05.506341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:05.506797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:05.522396 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:05.714215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Updating instance_info_cache with network_info: [{"id": "311e0c88-1777-4643-834e-e3e9e94477c9", "address": "fa:16:3e:36:4e:10", "network": {"id": "ad82b036-ac12-4a66-b1a2-50d8586e1b40", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1993181966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "83905704e34a425887ccad7606e3c792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap311e0c88-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119765) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:29:05.789632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:05.790676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Building network info cache for instance {{(pid=119765) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:29:05.810009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:05.813307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:05.817196 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c68f6aa3-dae4-4023-9b2a-e0afba5f5cb4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1361 microversion: 2.25 time: 0.407454 Jul 01 10:29:05.818532 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 384/777] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:05 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1361 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:05.830152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Calling method '.version_select at 0x7f6f922e30d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:06.757261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Updating instance_info_cache with network_info: [{"id": "d2ffd7a6-066f-4ed2-ab25-3a654d2aac61", "address": "fa:16:3e:7d:06:cd", "network": {"id": "ad82b036-ac12-4a66-b1a2-50d8586e1b40", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1993181966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "83905704e34a425887ccad7606e3c792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ffd7a6-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119765) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:29:06.858184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Releasing lock "refresh_cache-2f70d5be-11e7-4a30-be3e-ee8374833175" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:29:06.859080 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-69ad6961-43c5-4568-aca6-d8a203cc9e32 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175/action" status: 202 len: 0 microversion: 2.1 time: 6.770019 Jul 01 10:29:06.863453 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 394/778] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:00 2022] POST /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175/action => generated 0 bytes in 6771 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:29:06.865202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:06.865827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:06.872218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:06.872664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:06.873477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:06.873911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:07.132373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:07.146004 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d28735d4-0a6b-4ed8-a15c-fe018da9b5e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.285141 Jul 01 10:29:07.157716 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 395/779] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:06 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:07.164866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7d569ab8-067a-4b86-8f6e-3e974dc55332 req-d10993bf-e6cc-46b8-8470-772575951c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5569f4-0626-402c-a3c4-ed62cb8af25c", "name": "network-vif-plugged", "status": "completed", "tag": "dfca3548-598e-4e5d-abba-a6283102320c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:07.177844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7d569ab8-067a-4b86-8f6e-3e974dc55332 req-d10993bf-e6cc-46b8-8470-772575951c42 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:07.178791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7d569ab8-067a-4b86-8f6e-3e974dc55332 req-d10993bf-e6cc-46b8-8470-772575951c42 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:07.200364 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7d569ab8-067a-4b86-8f6e-3e974dc55332 req-d10993bf-e6cc-46b8-8470-772575951c42 service nova] Creating event network-vif-plugged:dfca3548-598e-4e5d-abba-a6283102320c for instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c on n-h2-master-1 Jul 01 10:29:07.219729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7d569ab8-067a-4b86-8f6e-3e974dc55332 req-d10993bf-e6cc-46b8-8470-772575951c42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060053 Jul 01 10:29:07.219892 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40436f6b-94a2-4dda-ae12-f6416c862c1d does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:29:07.220548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Neutron security group 40436f6b-94a2-4dda-ae12-f6416c862c1d not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:29:07.220657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 396/780] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:07.220829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.security_groups [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Security Group ID 40436f6b-94a2-4dda-ae12-f6416c862c1d does not exist {{(pid=119764) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 01 10:29:07.228199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7a7dcc91-d883-499a-94ac-52e6fece22f9 req-c9be7b99-d75d-4784-b012-f8ef38b85c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c7abe7-c029-4079-a717-487c2b56573a", "tag": "311e0c88-1777-4643-834e-e3e9e94477c9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:07.238925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7a7dcc91-d883-499a-94ac-52e6fece22f9 req-c9be7b99-d75d-4784-b012-f8ef38b85c0b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:07.244673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7a7dcc91-d883-499a-94ac-52e6fece22f9 req-c9be7b99-d75d-4784-b012-f8ef38b85c0b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:07.248089 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40436f6b-94a2-4dda-ae12-f6416c862c1d does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:29:07.248864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Neutron security group 40436f6b-94a2-4dda-ae12-f6416c862c1d not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:29:07.249503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.security_groups [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Security Group ID 40436f6b-94a2-4dda-ae12-f6416c862c1d does not exist {{(pid=119764) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 01 10:29:07.260202 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7a7dcc91-d883-499a-94ac-52e6fece22f9 req-c9be7b99-d75d-4784-b012-f8ef38b85c0b service nova] Creating event network-changed:311e0c88-1777-4643-834e-e3e9e94477c9 for instance e7c7abe7-c029-4079-a717-487c2b56573a on n-h2-master-1 Jul 01 10:29:07.267504 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7a7dcc91-d883-499a-94ac-52e6fece22f9 req-c9be7b99-d75d-4784-b012-f8ef38b85c0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044815 Jul 01 10:29:07.268767 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 397/781] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:07.293759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:07.294484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:07.311029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:07.316888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:07.316888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:07.316888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:07.946120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:07.953753 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a736b7a1-fe6a-4a6b-81fb-a18303693563 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1466 microversion: 2.1 time: 0.683566 Jul 01 10:29:07.973113 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 398/782] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:07 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1466 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:07.978512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:07.979107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:07.999527 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:07.999972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:08.000735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:08.001197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:08.081855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:08.089450 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d25a7ff8-5000-45ec-9335-3b4e66aeda05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1276 microversion: 2.1 time: 0.114601 Jul 01 10:29:08.090019 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 399/783] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:07 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:08.094555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:08.095318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:08.101546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:08.102021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:08.102748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:08.103171 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:08.292411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:08.300754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:08.303232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:08.304642 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-12e917f7-a4d5-48ce-8660-c7cf90c6afeb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1361 microversion: 2.25 time: 0.213544 Jul 01 10:29:08.305619 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 400/784] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:08 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:08.310778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'action', calling method: .version_select at 0x7f6f94a4a8b0>, body: {"removeFloatingIp": {"address": "172.35.6.97"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:08.484946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:08.497357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:08.497797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:08.498631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:08.499132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:08.665775 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b41d5f4f-fa07-4c9a-903b-4394b271c379 does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:29:08.667759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Neutron security group b41d5f4f-fa07-4c9a-903b-4394b271c379 not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:29:08.668202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.security_groups [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Security Group ID b41d5f4f-fa07-4c9a-903b-4394b271c379 does not exist {{(pid=119764) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 01 10:29:08.727139 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b41d5f4f-fa07-4c9a-903b-4394b271c379 does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:29:08.728824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Neutron security group b41d5f4f-fa07-4c9a-903b-4394b271c379 not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:29:08.729637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.security_groups [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Security Group ID b41d5f4f-fa07-4c9a-903b-4394b271c379 does not exist {{(pid=119764) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 01 10:29:08.786588 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] HTTP exception thrown: Floating IP 172.35.6.97 is not associated with instance e7c7abe7-c029-4079-a717-487c2b56573a. Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Request method failure captured: Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action HTTP/1.1 Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 48 Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivswow4_61NXx1-QJCJIx5xYc9Q8R3IP0lF9TipswMKLCnUPQH8edlS0PORApZ3tI8Xz5dccG_Xw0QjdJZSrQJPtFqlP6t9r6G5Msk2pberhcBFbhvaDM1D8aw-oUKDxkzA3JuIaao8ON6SscXNdT5ryFI7vPdWtMvXwy9VoxAMV5sSQ Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:29:08.794319 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83905704e34a425887ccad7606e3c792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83905704e34a425887ccad7606e3c792", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 408ec811b27c4e908c45d946f555a75c Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: {"removeFloatingIp": {"address": "172.35.6.97"}} Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:29:08.795978 n-d-master-1 devstack@n-api.service[119765]: exception: Floating IP 172.35.6.97 is not associated with instance e7c7abe7-c029-4079-a717-487c2b56573a. Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e7c7abe7-c029-4079-a717-487c2b56573a', 'body': {'removeFloatingIp': {'address': '172.35.6.97'}}} Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.6.97 is not associated with instance e7c7abe7-c029-4079-a717-487c2b56573a. Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:08.796967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:08.798547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:08.798547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:08.798547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:08.798547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:08.798547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.6.97 is not associated with instance e7c7abe7-c029-4079-a717-487c2b56573a. Jul 01 10:29:08.798547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:08.800305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Returning 409 to user: Floating IP 172.35.6.97 is not associated with instance e7c7abe7-c029-4079-a717-487c2b56573a. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:08.802116 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-535c2bce-d35d-43eb-96ef-a62574674d39 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action" status: 409 len: 145 microversion: 2.1 time: 0.494138 Jul 01 10:29:08.806036 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 401/785] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:08 2022] POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action => generated 145 bytes in 497 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:29:08.807697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87c885cd-54ca-4226-a59e-62895ff63a04 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:08.808302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87c885cd-54ca-4226-a59e-62895ff63a04 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:08.836995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c885cd-54ca-4226-a59e-62895ff63a04 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:08.840479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c885cd-54ca-4226-a59e-62895ff63a04 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:08.841327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c885cd-54ca-4226-a59e-62895ff63a04 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:08.841765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c885cd-54ca-4226-a59e-62895ff63a04 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:09.131011 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87c885cd-54ca-4226-a59e-62895ff63a04 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1617 microversion: 2.1 time: 0.323703 Jul 01 10:29:09.132336 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 402/786] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:08 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1617 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:09.143546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:09.143986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:09.175292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:09.175748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:09.180546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:09.181606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:09.215893 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:09.402377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:09.419484 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eedf4911-f9b6-487f-ada5-492af6ab1e8e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.284177 Jul 01 10:29:09.420069 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 403/787] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:09 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:09.426043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.97"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:09.609802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:09.612280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e3dacb4-d576-46d0-8538-a9696ca32671 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12080 microversion: 2.1 time: 3.792469 Jul 01 10:29:09.612924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 385/788] 10.222.0.23 () {58 vars in 1190 bytes} [Fri Jul 1 10:29:05 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12080 bytes in 3794 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:29:09.617842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:09.618412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:09.618838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:09.619115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:09.620089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:09.620891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:09.634585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:09.635030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:09.635861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:09.636493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:09.735165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:09.752071 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1587398e-ff3f-4e77-8720-9fe924401466 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1282 microversion: 2.1 time: 0.137749 Jul 01 10:29:09.752660 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 386/789] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:09 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:09.762590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-917431038", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["25b54469-ddac-4b10-a1b4-61a4c7be16d9"]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:09.851827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:09.937277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Acquired lock "refresh_cache-2f70d5be-11e7-4a30-be3e-ee8374833175" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:29:10.343152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:10.343152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:10.343152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:10.343152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:10.343152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:10.351978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:10.352649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:10.353491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:10.353925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:10.372707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:10.376706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:10.388951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:10.391190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:10.611191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8af1b6d4-98b6-4aa3-99e0-85342f0e7262 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857237 Jul 01 10:29:10.612528 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 387/790] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:10.618246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:10.618995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:10.626138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:10.626667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:10.627671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:10.630725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:10.857729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:10.866717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:10.868129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:10.869502 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b38592c-b3c7-45a3-a001-8c718e93c30c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1558 microversion: 2.25 time: 0.255764 Jul 01 10:29:10.874047 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 388/791] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:10 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:10.886368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-84bc274b-2c1b-4f3d-a461-1c8a8ba92ee4 req-a6f489c0-07e9-43d8-8e17-16feea6b3635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f70d5be-11e7-4a30-be3e-ee8374833175", "tag": "d2ffd7a6-066f-4ed2-ab25-3a654d2aac61"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:10.894794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-84bc274b-2c1b-4f3d-a461-1c8a8ba92ee4 req-a6f489c0-07e9-43d8-8e17-16feea6b3635 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:10.895288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-84bc274b-2c1b-4f3d-a461-1c8a8ba92ee4 req-a6f489c0-07e9-43d8-8e17-16feea6b3635 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:10.919797 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-84bc274b-2c1b-4f3d-a461-1c8a8ba92ee4 req-a6f489c0-07e9-43d8-8e17-16feea6b3635 service nova] Creating event network-changed:d2ffd7a6-066f-4ed2-ab25-3a654d2aac61 for instance 2f70d5be-11e7-4a30-be3e-ee8374833175 on n-h1-master-1 Jul 01 10:29:10.931449 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-84bc274b-2c1b-4f3d-a461-1c8a8ba92ee4 req-a6f489c0-07e9-43d8-8e17-16feea6b3635 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048267 Jul 01 10:29:10.941238 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 389/792] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:10.945701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-337ec053-79f5-40aa-8151-c12c45b11b42 tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] Calling method '.version_select at 0x7f6f922911f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:11.076511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Building network info cache for instance {{(pid=119765) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:29:11.327331 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-337ec053-79f5-40aa-8151-c12c45b11b42 tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.389836 Jul 01 10:29:11.328019 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 390/793] 10.222.0.23 () {58 vars in 1190 bytes} [Fri Jul 1 10:29:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:11.485740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3add329-830c-4e11-bc5d-ce3b2648e93e tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1832262602", "id": 212763920, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:11.487476 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:29:11.487476 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:29:11.575623 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3add329-830c-4e11-bc5d-ce3b2648e93e tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.245714 Jul 01 10:29:11.577060 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 391/794] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:29:11 2022] POST /compute/v2.1/flavors => generated 465 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:29:11.583625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:11.585809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:11.596729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:11.597562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:11.599234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:11.599824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:11.912083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:11.920244 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8a5a0c4-0be9-453b-b4ea-1c440a60411e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1476 microversion: 2.1 time: 0.341902 Jul 01 10:29:11.921062 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 392/795] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:11 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:11.927392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:11.928227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:11.938858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:11.941203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:11.941203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:11.941567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:12.046991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:12.057531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7399e9d-13e8-4036-a064-7a0e3bb3b470 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1220 microversion: 2.1 time: 0.134381 Jul 01 10:29:12.065733 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 393/796] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:11 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:12.072223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:12.072830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:12.078937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:12.079378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:12.080696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:12.081133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:12.541062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Updating instance_info_cache with network_info: [{"id": "d2ffd7a6-066f-4ed2-ab25-3a654d2aac61", "address": "fa:16:3e:7d:06:cd", "network": {"id": "ad82b036-ac12-4a66-b1a2-50d8586e1b40", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1993181966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "83905704e34a425887ccad7606e3c792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ffd7a6-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119765) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:29:12.599564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:12.607531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-036ff573-a895-4034-b0bf-9c829e33d4ef tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1324 microversion: 2.1 time: 0.540728 Jul 01 10:29:12.608101 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 394/797] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:12 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1324 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:12.634948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Releasing lock "refresh_cache-2f70d5be-11e7-4a30-be3e-ee8374833175" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:29:12.635899 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdb356ea-ba16-4be5-81ea-8c61df9c19f4 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175/action" status: 202 len: 0 microversion: 2.1 time: 3.213509 Jul 01 10:29:12.636430 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 404/798] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:09 2022] POST /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175/action => generated 0 bytes in 3214 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:29:12.642875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ed113993-d58b-409b-9118-c30692ee09ea req-4ac8a719-2e01-460d-b553-555dc4842db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3168707-cb17-4267-a005-2e7307e2a168", "tag": "91243b24-22ec-4412-9749-7b98ca290584"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:12.655826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ed113993-d58b-409b-9118-c30692ee09ea req-4ac8a719-2e01-460d-b553-555dc4842db1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:12.656273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ed113993-d58b-409b-9118-c30692ee09ea req-4ac8a719-2e01-460d-b553-555dc4842db1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:12.674178 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ed113993-d58b-409b-9118-c30692ee09ea req-4ac8a719-2e01-460d-b553-555dc4842db1 service nova] Creating event network-changed:91243b24-22ec-4412-9749-7b98ca290584 for instance c3168707-cb17-4267-a005-2e7307e2a168 on n-h2-master-1 Jul 01 10:29:12.679951 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ed113993-d58b-409b-9118-c30692ee09ea req-4ac8a719-2e01-460d-b553-555dc4842db1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042408 Jul 01 10:29:12.680750 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 405/799] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:12.687340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2787ab6-51e3-4b04-af36-15dfa7614682 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Calling method '.version_select at 0x7f6f920918b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:12.750632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:12.751675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:12.759368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:12.759814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:12.760585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:12.761049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.021383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 4d5569f4-0626-402c-a3c4-ed62cb8af25c {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:13.081545 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65dc3577-09e8-45e1-a0d5-cc2671d4f391 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 2050 microversion: 2.25 time: 0.472018 Jul 01 10:29:13.082322 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 395/800] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:12 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 2050 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:13.148634 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2787ab6-51e3-4b04-af36-15dfa7614682 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0e7e1f2e-a485-4faa-93a8-fe29fb67bca0" status: 202 len: 0 microversion: 2.1 time: 0.466183 Jul 01 10:29:13.149365 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 406/801] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:29:12 2022] DELETE /compute/v2.1/os-security-groups/0e7e1f2e-a485-4faa-93a8-fe29fb67bca0 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:29:13.160298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:13.161582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:13.191020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.193566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.194415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.194850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.238596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:29:13.286637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-349de8aa-d4f0-4e70-992f-c010866027ad tempest-FlavorsV261TestJSON-1449721241 tempest-FlavorsV261TestJSON-1449721241-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:13.298134 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-349de8aa-d4f0-4e70-992f-c010866027ad tempest-FlavorsV261TestJSON-1449721241 tempest-FlavorsV261TestJSON-1449721241-project] 10.222.0.23 "GET /compute/v2.1/flavors/212763920" status: 200 len: 465 microversion: 2.61 time: 0.213081 Jul 01 10:29:13.298683 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 396/802] 10.222.0.23 () {60 vars in 1195 bytes} [Fri Jul 1 10:29:13 2022] GET /compute/v2.1/flavors/212763920 => generated 465 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:29:13.303351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:13.304139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:13.310744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.311188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.311975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.313104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.515644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:13.524144 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8fb88262-aa08-4a50-b63b-7095b2b48037 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1475 microversion: 2.1 time: 0.224277 Jul 01 10:29:13.524644 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 397/803] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:13 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1475 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:13.529676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-69d9616b-f260-45b1-9710-ab3c09929842 req-77ce780d-eafb-43cc-ac46-29d84ec35c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f70d5be-11e7-4a30-be3e-ee8374833175", "tag": "d2ffd7a6-066f-4ed2-ab25-3a654d2aac61"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:13.539525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-69d9616b-f260-45b1-9710-ab3c09929842 req-77ce780d-eafb-43cc-ac46-29d84ec35c7c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.542896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-69d9616b-f260-45b1-9710-ab3c09929842 req-77ce780d-eafb-43cc-ac46-29d84ec35c7c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.552022 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-69d9616b-f260-45b1-9710-ab3c09929842 req-77ce780d-eafb-43cc-ac46-29d84ec35c7c service nova] Creating event network-changed:d2ffd7a6-066f-4ed2-ab25-3a654d2aac61 for instance 2f70d5be-11e7-4a30-be3e-ee8374833175 on n-h1-master-1 Jul 01 10:29:13.555843 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e06504bb-ab92-4991-b362-197912e0ed30 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 204 len: 0 microversion: 2.1 time: 0.400955 Jul 01 10:29:13.557104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 407/804] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:29:13 2022] DELETE /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:13.558246 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-69d9616b-f260-45b1-9710-ab3c09929842 req-77ce780d-eafb-43cc-ac46-29d84ec35c7c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032048 Jul 01 10:29:13.558832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 398/805] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:13.569893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:13.570425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:13.570592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:13.571588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:13.577047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.577521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.578112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.578281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.578707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.578822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.579691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.580222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.656781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:13.665769 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9ecdfc89-1ea7-40ed-a538-758f8d7aa2af tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1274 microversion: 2.1 time: 0.107165 Jul 01 10:29:13.666735 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 408/806] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:13 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:13.675123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35ef2a30-99c6-4e6c-ba51-447bdfa9c0f4 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] Calling method '.version_select at 0x7f6f928b7280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:13.769352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 4d5569f4-0626-402c-a3c4-ed62cb8af25c {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:13.783651 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28fec465-c2b9-4246-b016-bf195996cb19 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 2050 microversion: 2.25 time: 0.221296 Jul 01 10:29:13.789090 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 399/807] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:13 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 2050 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:13.789749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbfbd9f6-dac1-43d4-98da-a6ace3366519 tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] Action: 'update', calling method: .version_select at 0x7f6f94c0ba60>, body: {"flavor": {"description": "new"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:13.802647 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:29:13.802647 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:29:13.884166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fbfbd9f6-dac1-43d4-98da-a6ace3366519 tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/212763920" status: 200 len: 466 microversion: 2.61 time: 0.098955 Jul 01 10:29:13.884832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 400/808] 10.222.0.23 () {62 vars in 1215 bytes} [Fri Jul 1 10:29:13 2022] PUT /compute/v2.1/flavors/212763920 => generated 466 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:29:13.889484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.97"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:13.891082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:13.896926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.897934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.898311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.898745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.925504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Acquired lock "refresh_cache-e7c7abe7-c029-4079-a717-487c2b56573a" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:29:13.939913 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35ef2a30-99c6-4e6c-ba51-447bdfa9c0f4 tempest-SecurityGroupsTestAdminJSON-1818797903 tempest-SecurityGroupsTestAdminJSON-1818797903-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c0ed67cc-f360-4722-a9ad-52a9dd7e3473" status: 202 len: 0 microversion: 2.1 time: 0.271526 Jul 01 10:29:13.940883 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 409/809] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:29:13 2022] DELETE /compute/v2.1/os-security-groups/c0ed67cc-f360-4722-a9ad-52a9dd7e3473 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:29:13.949333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:13.949934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:13.956214 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.956650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:13.957434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:13.958463 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:14.324507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:14.332886 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1081eac9-2d6b-46bd-a64a-212a11b1b3ea tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1324 microversion: 2.1 time: 0.387268 Jul 01 10:29:14.333496 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 410/810] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:13 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:14.338312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00e320aa-4663-4fc5-89bd-5dc4c7b5ccfa tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:14.339686 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:29:14.339686 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:29:14.340891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e320aa-4663-4fc5-89bd-5dc4c7b5ccfa tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:14.341378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e320aa-4663-4fc5-89bd-5dc4c7b5ccfa tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:14.342455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e320aa-4663-4fc5-89bd-5dc4c7b5ccfa tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:14.342878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e320aa-4663-4fc5-89bd-5dc4c7b5ccfa tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:14.355252 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:14.371302 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00e320aa-4663-4fc5-89bd-5dc4c7b5ccfa tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036770 Jul 01 10:29:14.372164 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 411/811] 10.222.0.23 () {60 vars in 1216 bytes} [Fri Jul 1 10:29:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:29:14.377012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f2746548-2f5c-4984-9412-20e6e00c9fcb tempest-FlavorsV261TestJSON-1449721241 tempest-FlavorsV261TestJSON-1449721241-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:14.414505 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f2746548-2f5c-4984-9412-20e6e00c9fcb tempest-FlavorsV261TestJSON-1449721241 tempest-FlavorsV261TestJSON-1449721241-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.027081 Jul 01 10:29:14.414505 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 412/812] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:29:14 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:14.414505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdf96efa-8364-4517-8ee9-5f40e659fa8a tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] Calling method '.version_select at 0x7f6f923cf4c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:15.203098 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdf96efa-8364-4517-8ee9-5f40e659fa8a tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f8b4cdaf-89cf-407f-953c-1c95374f43ca" status: 202 len: 0 microversion: 2.1 time: 0.800397 Jul 01 10:29:15.205545 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 413/813] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:29:14 2022] DELETE /compute/v2.1/os-security-groups/f8b4cdaf-89cf-407f-953c-1c95374f43ca => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:29:15.212209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:15.214632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:15.225356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:15.226124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:15.227178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:15.227851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:15.372461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'flavor' on Instance uuid 4d5569f4-0626-402c-a3c4-ed62cb8af25c {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:15.424088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Going to try to live migrate instance to n-h1-master-1 {{(pid=119765) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:29:16.862805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Building network info cache for instance {{(pid=119764) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:29:17.924301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Updating instance_info_cache with network_info: [{"id": "311e0c88-1777-4643-834e-e3e9e94477c9", "address": "fa:16:3e:36:4e:10", "network": {"id": "ad82b036-ac12-4a66-b1a2-50d8586e1b40", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1993181966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "83905704e34a425887ccad7606e3c792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap311e0c88-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119764) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:29:18.030404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Releasing lock "refresh_cache-e7c7abe7-c029-4079-a717-487c2b56573a" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:29:18.031660 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fd6aa633-2642-42e6-840a-a315a9e31112 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action" status: 202 len: 0 microversion: 2.1 time: 4.145879 Jul 01 10:29:18.033096 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 401/814] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:13 2022] POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action => generated 0 bytes in 4148 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:29:18.041621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-914e40e0-4cde-47f5-b538-696a8509e3df tempest-FlavorsV261TestJSON-1449721241 tempest-FlavorsV261TestJSON-1449721241-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:18.080220 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-914e40e0-4cde-47f5-b538-696a8509e3df tempest-FlavorsV261TestJSON-1449721241 tempest-FlavorsV261TestJSON-1449721241-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.045798 Jul 01 10:29:18.081479 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 402/815] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Jul 1 10:29:18 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:18.106994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:18.107619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:18.117048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:18.117647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:18.118509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:18.119187 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:18.407789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:18.418982 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae20c26d-f2fb-4045-8266-b70407ecc13d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1470 microversion: 2.1 time: 0.336272 Jul 01 10:29:18.419890 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 403/816] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:18 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:18.432582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:18.433225 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:18.439949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:18.440916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:18.442226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:18.442676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:18.542201 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c69cf2c4-57ff-47c9-81b3-bc0356080d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c/action" status: 202 len: 0 microversion: 2.25 time: 3.334925 Jul 01 10:29:18.542895 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 414/817] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:29:15 2022] POST /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c/action => generated 0 bytes in 3337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:18.547835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9cdb49cf-3484-462e-80e9-bd09751ce29e req-35a69105-6d7a-430b-a97a-9979360483ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802599b4-c743-4f1b-8677-94390fac1ecb", "name": "network-vif-unplugged", "status": "completed", "tag": "8340628d-90db-44e1-9112-2951c74f2772"}, {"name": "network-changed", "server_uuid": "802599b4-c743-4f1b-8677-94390fac1ecb", "tag": "8340628d-90db-44e1-9112-2951c74f2772"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:18.558660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9cdb49cf-3484-462e-80e9-bd09751ce29e req-35a69105-6d7a-430b-a97a-9979360483ee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:18.559161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9cdb49cf-3484-462e-80e9-bd09751ce29e req-35a69105-6d7a-430b-a97a-9979360483ee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:18.571088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9cdb49cf-3484-462e-80e9-bd09751ce29e req-35a69105-6d7a-430b-a97a-9979360483ee service nova] Creating event network-vif-unplugged:8340628d-90db-44e1-9112-2951c74f2772 for instance 802599b4-c743-4f1b-8677-94390fac1ecb on n-h2-master-1 Jul 01 10:29:18.571690 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9cdb49cf-3484-462e-80e9-bd09751ce29e req-35a69105-6d7a-430b-a97a-9979360483ee service nova] Creating event network-changed:8340628d-90db-44e1-9112-2951c74f2772 for instance 802599b4-c743-4f1b-8677-94390fac1ecb on n-h2-master-1 Jul 01 10:29:18.582075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-9cdb49cf-3484-462e-80e9-bd09751ce29e req-35a69105-6d7a-430b-a97a-9979360483ee service nova] Instance 802599b4-c743-4f1b-8677-94390fac1ecb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:29:18.593588 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9cdb49cf-3484-462e-80e9-bd09751ce29e req-35a69105-6d7a-430b-a97a-9979360483ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.049464 Jul 01 10:29:18.597306 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 415/818] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:18.614321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-604b3484-1c61-496b-b834-2c13a2a05e6d tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] Calling method '.version_select at 0x7f6f920644c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:18.681955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:18.689910 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-108c9fc3-ce01-46a5-a1df-00d732117dd8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1316 microversion: 2.1 time: 0.268983 Jul 01 10:29:18.690490 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 404/819] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:18 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:18.695811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:18.696387 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:18.702414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:18.703090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:18.704030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:18.704642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:18.988131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:18.996927 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c9549c76-2b80-4543-85d8-6010bce1d437 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1324 microversion: 2.1 time: 0.305251 Jul 01 10:29:19.006700 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 405/820] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:18 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:19.006700 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-298f49e0-bc99-4972-81b3-b7a091501f9f req-380a6eac-b7c8-475b-b687-053a84dab306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c7abe7-c029-4079-a717-487c2b56573a", "tag": "311e0c88-1777-4643-834e-e3e9e94477c9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:19.010549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-298f49e0-bc99-4972-81b3-b7a091501f9f req-380a6eac-b7c8-475b-b687-053a84dab306 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.010991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-298f49e0-bc99-4972-81b3-b7a091501f9f req-380a6eac-b7c8-475b-b687-053a84dab306 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.022689 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-298f49e0-bc99-4972-81b3-b7a091501f9f req-380a6eac-b7c8-475b-b687-053a84dab306 service nova] Creating event network-changed:311e0c88-1777-4643-834e-e3e9e94477c9 for instance e7c7abe7-c029-4079-a717-487c2b56573a on n-h2-master-1 Jul 01 10:29:19.027783 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-298f49e0-bc99-4972-81b3-b7a091501f9f req-380a6eac-b7c8-475b-b687-053a84dab306 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029126 Jul 01 10:29:19.028623 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 406/821] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:19.033490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1459b1a1-12f4-4940-9892-c20fb3583adf req-25169921-458d-4484-8b03-78cb788a4bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3168707-cb17-4267-a005-2e7307e2a168", "name": "network-vif-plugged", "status": "completed", "tag": "91243b24-22ec-4412-9749-7b98ca290584"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:19.037741 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:19.044151 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1459b1a1-12f4-4940-9892-c20fb3583adf req-25169921-458d-4484-8b03-78cb788a4bc5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.044595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1459b1a1-12f4-4940-9892-c20fb3583adf req-25169921-458d-4484-8b03-78cb788a4bc5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.057048 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1459b1a1-12f4-4940-9892-c20fb3583adf req-25169921-458d-4484-8b03-78cb788a4bc5 service nova] Creating event network-vif-plugged:91243b24-22ec-4412-9749-7b98ca290584 for instance c3168707-cb17-4267-a005-2e7307e2a168 on n-h2-master-1 Jul 01 10:29:19.062269 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1459b1a1-12f4-4940-9892-c20fb3583adf req-25169921-458d-4484-8b03-78cb788a4bc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032513 Jul 01 10:29:19.062869 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 407/822] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:19.068052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9f85991-d6b4-49d4-9b21-c518d1f4bad1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '.version_select at 0x7f6f922e3f70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:19.171786 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-604b3484-1c61-496b-b834-2c13a2a05e6d tempest-SecurityGroupsTestAdminJSON-887660213 tempest-SecurityGroupsTestAdminJSON-887660213-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/8e355089-a498-4da4-8117-a8e3faa1ab6b" status: 202 len: 0 microversion: 2.1 time: 0.569370 Jul 01 10:29:19.172370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 416/823] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:29:18 2022] DELETE /compute/v2.1/os-security-groups/8e355089-a498-4da4-8117-a8e3faa1ab6b => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:29:19.186701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-662960f9-85e6-4da9-ab1d-c20fd90e71cd tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:19.187720 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:29:19.187720 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:29:19.277577 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-662960f9-85e6-4da9-ab1d-c20fd90e71cd tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/212763920" status: 202 len: 0 microversion: 2.61 time: 0.103688 Jul 01 10:29:19.278533 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 417/824] 10.222.0.23 () {60 vars in 1198 bytes} [Fri Jul 1 10:29:19 2022] DELETE /compute/v2.1/flavors/212763920 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:19.288490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-84024fbe-00f4-4588-8783-3dd33e62b17f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:19.291452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-84024fbe-00f4-4588-8783-3dd33e62b17f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:19.308572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84024fbe-00f4-4588-8783-3dd33e62b17f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.310308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84024fbe-00f4-4588-8783-3dd33e62b17f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.311168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84024fbe-00f4-4588-8783-3dd33e62b17f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.312087 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84024fbe-00f4-4588-8783-3dd33e62b17f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.352259 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9f85991-d6b4-49d4-9b21-c518d1f4bad1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/ce5c47f4-e1e0-4a2e-8575-ada13b3af409" status: 200 len: 184 microversion: 2.1 time: 0.288110 Jul 01 10:29:19.353241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 408/825] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:29:19 2022] GET /compute/v2.1/os-floating-ips/ce5c47f4-e1e0-4a2e-8575-ada13b3af409 => generated 184 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:19.358010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:19.358717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:19.366899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.367729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.368503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.369108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.392525 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:19.498113 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-84024fbe-00f4-4588-8783-3dd33e62b17f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb/action" status: 204 len: 0 microversion: 2.1 time: 0.217204 Jul 01 10:29:19.499024 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 418/826] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:19 2022] POST /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb/action => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:19.505593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba34fcd0-d2fb-4105-b051-c5eb7ef06407 tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:19.528638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba34fcd0-d2fb-4105-b051-c5eb7ef06407 tempest-FlavorsV261TestJSON-446199056 tempest-FlavorsV261TestJSON-446199056-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.028015 Jul 01 10:29:19.529238 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 419/827] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:29:19 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:19.533758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.97"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:19.553165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:19.569003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:19.570575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:19.574329 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ee76fcb-13e3-4314-8928-57a947e64781 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.220017 Jul 01 10:29:19.574895 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 409/828] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:19 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:19.590451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:19.591298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:19.597854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.598331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.599091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.601361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.746369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:19.754016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.754828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.755608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.756038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.865767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:19.876085 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8115e106-ec10-4153-8108-565b56597c4e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1470 microversion: 2.1 time: 0.289690 Jul 01 10:29:19.889045 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 410/829] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:19 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:19.890035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:19.890659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:19.897260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.897707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:19.898477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:19.898908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:20.361960 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:20.385495 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:20.733773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:20.742035 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bf01ebd9-b386-4311-b8fd-1472e726a025 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1316 microversion: 2.1 time: 0.863726 Jul 01 10:29:20.742700 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 411/830] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:19 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1316 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:20.747628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:20.748320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:20.754157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:20.758154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:20.758154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:20.758154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:20.771048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Acquired lock "refresh_cache-e7c7abe7-c029-4079-a717-487c2b56573a" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:29:21.262679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:21.270278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e70c730c-a071-4835-9672-3f7930741422 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1324 microversion: 2.1 time: 0.526443 Jul 01 10:29:21.271832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 412/831] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:20 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:21.289628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:21.293889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:21.298437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:21.298854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:21.299618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:21.300045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:21.721880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:21.734211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:21.737331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:21.739410 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1eea4088-d099-4335-be5c-e242f8610f9a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.466643 Jul 01 10:29:21.740486 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 413/832] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:21 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:21.747783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:21.748902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:21.760384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:21.760825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:21.761727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:21.762165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:22.428286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:22.442430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99fc041d-4a79-41a6-8551-190de0fd6f31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1470 microversion: 2.1 time: 0.699179 Jul 01 10:29:22.443508 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 414/833] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:21 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1470 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:22.451453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7c80ae11-9907-47a4-b7b4-70947ff9eb0c req-1d35b75b-c918-4bee-a158-cc4a4c414c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f70d5be-11e7-4a30-be3e-ee8374833175", "name": "network-vif-deleted", "tag": "d2ffd7a6-066f-4ed2-ab25-3a654d2aac61"}, {"name": "network-changed", "server_uuid": "60eb37ae-c715-4b54-ac72-b0dbb5f163fb", "tag": "5a9a9ecb-d754-4e58-9a9b-f4b3e0c3807d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:22.469577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c80ae11-9907-47a4-b7b4-70947ff9eb0c req-1d35b75b-c918-4bee-a158-cc4a4c414c48 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:22.471574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c80ae11-9907-47a4-b7b4-70947ff9eb0c req-1d35b75b-c918-4bee-a158-cc4a4c414c48 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:22.511521 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7c80ae11-9907-47a4-b7b4-70947ff9eb0c req-1d35b75b-c918-4bee-a158-cc4a4c414c48 service nova] Creating event network-vif-deleted:d2ffd7a6-066f-4ed2-ab25-3a654d2aac61 for instance 2f70d5be-11e7-4a30-be3e-ee8374833175 on n-h1-master-1 Jul 01 10:29:22.512331 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7c80ae11-9907-47a4-b7b4-70947ff9eb0c req-1d35b75b-c918-4bee-a158-cc4a4c414c48 service nova] Creating event network-changed:5a9a9ecb-d754-4e58-9a9b-f4b3e0c3807d for instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb on n-h1-master-1 Jul 01 10:29:22.520535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7c80ae11-9907-47a4-b7b4-70947ff9eb0c req-1d35b75b-c918-4bee-a158-cc4a4c414c48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.074480 Jul 01 10:29:22.521886 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 415/834] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:22.529643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ee5fec5a-8208-44ec-8221-4651d9c953fa req-af73b821-783e-4370-917c-48e8c794a76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802599b4-c743-4f1b-8677-94390fac1ecb", "name": "network-vif-plugged", "status": "completed", "tag": "8340628d-90db-44e1-9112-2951c74f2772"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:22.538989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ee5fec5a-8208-44ec-8221-4651d9c953fa req-af73b821-783e-4370-917c-48e8c794a76e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:22.539741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ee5fec5a-8208-44ec-8221-4651d9c953fa req-af73b821-783e-4370-917c-48e8c794a76e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:22.561332 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ee5fec5a-8208-44ec-8221-4651d9c953fa req-af73b821-783e-4370-917c-48e8c794a76e service nova] Creating event network-vif-plugged:8340628d-90db-44e1-9112-2951c74f2772 for instance 802599b4-c743-4f1b-8677-94390fac1ecb on n-h2-master-1 Jul 01 10:29:22.580033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-ee5fec5a-8208-44ec-8221-4651d9c953fa req-af73b821-783e-4370-917c-48e8c794a76e service nova] Instance 802599b4-c743-4f1b-8677-94390fac1ecb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:29:22.591425 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ee5fec5a-8208-44ec-8221-4651d9c953fa req-af73b821-783e-4370-917c-48e8c794a76e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067943 Jul 01 10:29:22.592036 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 416/835] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:22.597574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:22.598305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:22.607036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:22.607724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:22.608675 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:22.609321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:23.101292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:23.118207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-827f5337-0901-4ef7-805c-6e09539a636a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1316 microversion: 2.1 time: 0.524755 Jul 01 10:29:23.118799 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 417/836] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:22 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:23.123567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:23.124178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:23.135717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Building network info cache for instance {{(pid=119765) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:29:23.138739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:23.139191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:23.139970 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:23.140402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:23.933087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:23.942232 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-808cfab0-1cea-4b21-b4a1-68eefdffc60b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.822276 Jul 01 10:29:23.956040 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 418/837] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:23 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:23.962363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:23.964175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:23.971855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:23.972603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:23.974192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:23.974851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:24.348378 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:24.377057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:24.389026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:24.389026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:24.389026 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-27b55c92-4bb1-45d3-bc62-7827ae008fd3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.430723 Jul 01 10:29:24.397527 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 419/838] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:23 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:24.404206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:24.405179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:24.412246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:24.413000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:24.414180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:24.414594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:24.760702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Updating instance_info_cache with network_info: [{"id": "311e0c88-1777-4643-834e-e3e9e94477c9", "address": "fa:16:3e:36:4e:10", "network": {"id": "ad82b036-ac12-4a66-b1a2-50d8586e1b40", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1993181966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "83905704e34a425887ccad7606e3c792", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap311e0c88-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119765) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:29:24.804263 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:24.812188 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f14d17e2-8dc2-45ed-81cd-01b55c1886e0 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1470 microversion: 2.1 time: 0.413606 Jul 01 10:29:24.812762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 420/839] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:24 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1470 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:24.817174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:24.817778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:24.823519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:24.823964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:24.824730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:24.825189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:24.833226 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Releasing lock "refresh_cache-e7c7abe7-c029-4079-a717-487c2b56573a" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:29:24.834237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3625ded0-cf62-4eac-9736-8a21afcc1bae tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action" status: 202 len: 0 microversion: 2.1 time: 5.303975 Jul 01 10:29:24.838400 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 420/840] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:19 2022] POST /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a/action => generated 0 bytes in 5305 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:29:24.842806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:24.843872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:24.850940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:24.851387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:24.852383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:24.852806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:25.401944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:25.409620 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-36fdd53e-436d-42c2-b4e1-dadb5fca5b05 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.595789 Jul 01 10:29:25.415055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:25.422423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 421/841] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:24 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:25.425857 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af7f0bee-9cd4-4d8d-9387-566ee4bfd8e2 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1316 microversion: 2.1 time: 0.589423 Jul 01 10:29:25.426643 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 421/842] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:24 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:25.433053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-432594f5-1ae9-478c-82ad-06990183401a req-72308983-340f-492e-97b5-e8fc5c4c192e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c7abe7-c029-4079-a717-487c2b56573a", "tag": "311e0c88-1777-4643-834e-e3e9e94477c9"}, {"server_uuid": "4d5569f4-0626-402c-a3c4-ed62cb8af25c", "name": "network-vif-unplugged", "status": "completed", "tag": "dfca3548-598e-4e5d-abba-a6283102320c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:25.444857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-432594f5-1ae9-478c-82ad-06990183401a req-72308983-340f-492e-97b5-e8fc5c4c192e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:25.445665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-432594f5-1ae9-478c-82ad-06990183401a req-72308983-340f-492e-97b5-e8fc5c4c192e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:25.458830 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-432594f5-1ae9-478c-82ad-06990183401a req-72308983-340f-492e-97b5-e8fc5c4c192e service nova] Creating event network-changed:311e0c88-1777-4643-834e-e3e9e94477c9 for instance e7c7abe7-c029-4079-a717-487c2b56573a on n-h2-master-1 Jul 01 10:29:25.459321 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-432594f5-1ae9-478c-82ad-06990183401a req-72308983-340f-492e-97b5-e8fc5c4c192e service nova] Creating event network-vif-unplugged:dfca3548-598e-4e5d-abba-a6283102320c for instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c on n-h2-master-1 Jul 01 10:29:25.465739 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-432594f5-1ae9-478c-82ad-06990183401a req-72308983-340f-492e-97b5-e8fc5c4c192e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.036446 Jul 01 10:29:25.466336 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 422/843] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:25.475191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f90a2647-6d32-4d5d-a3cf-59d52fe7ede5 req-0412339c-b06e-4cc7-b743-e0d446d07c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60eb37ae-c715-4b54-ac72-b0dbb5f163fb", "name": "network-vif-plugged", "status": "completed", "tag": "5a9a9ecb-d754-4e58-9a9b-f4b3e0c3807d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:25.483529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f90a2647-6d32-4d5d-a3cf-59d52fe7ede5 req-0412339c-b06e-4cc7-b743-e0d446d07c92 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:25.484202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f90a2647-6d32-4d5d-a3cf-59d52fe7ede5 req-0412339c-b06e-4cc7-b743-e0d446d07c92 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:25.488420 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=6,nova_cell1:RELEASE=2,nova_cell1:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:25.495888 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f90a2647-6d32-4d5d-a3cf-59d52fe7ede5 req-0412339c-b06e-4cc7-b743-e0d446d07c92 service nova] Creating event network-vif-plugged:5a9a9ecb-d754-4e58-9a9b-f4b3e0c3807d for instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb on n-h1-master-1 Jul 01 10:29:25.500801 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f90a2647-6d32-4d5d-a3cf-59d52fe7ede5 req-0412339c-b06e-4cc7-b743-e0d446d07c92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029960 Jul 01 10:29:25.501754 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 423/844] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:25.645680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2087083600", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:25.663234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1300091845", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:25.729294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:25.739729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:26.062962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:26.063413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:26.063883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:26.064288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:26.064701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:26.073992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.074438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.075230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.075661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.079065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:26.079606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:26.080791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:26.081224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:26.081634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:26.090574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.091020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.094758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.095037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Getting quotas for project 1ca92b2cafba4257b5f4931764621897. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:26.095145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.096057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Getting quotas for user 832898660e1d480e8c85a12c9cfd5c02 and project 1ca92b2cafba4257b5f4931764621897. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:26.107550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:26.109861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:26.110016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Getting quotas for project 06fc685846434344b8b938ccb1dae960. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:26.114531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Getting quotas for user 315591357d264b42938cf6eab54a699a and project 06fc685846434344b8b938ccb1dae960. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:26.125864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:26.128293 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:26.201727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96f36a8b-0f1d-4c13-b6f4-44c1162207f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778116 Jul 01 10:29:26.202343 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 422/845] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:26.206754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:26.207753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:26.214325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.215158 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.215604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.216019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.245336 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] HTTP exception thrown: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Request method failure captured: Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 HTTP/1.1 Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswow4_61NXx1-QJCJIx5xYc9Q8R3IP0lF9TipswMKLCnUPQH8edlS0PORApZ3tI8Xz5dccG_Xw0QjdJZSrQJPtFqlP6t9r6G5Msk2pberhcBFbhvaDM1D8aw-oUKDxkzA3JuIaao8ON6SscXNdT5ryFI7vPdWtMvXwy9VoxAMV5sSQ Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:29:26.247196 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83905704e34a425887ccad7606e3c792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83905704e34a425887ccad7606e3c792", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 408ec811b27c4e908c45d946f555a75c Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.248480 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '2f70d5be-11e7-4a30-be3e-ee8374833175'} Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:26.249220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.254464 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.257102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Returning 404 to user: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:26.257102 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bef591cb-da46-492a-bc76-1edd2d2fc9bc tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 404 len: 111 microversion: 2.1 time: 0.046831 Jul 01 10:29:26.257102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 423/846] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:29:26 2022] DELETE /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:29:26.257592 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dde8dba5-676a-47a3-8a46-7b7913a6d1e1 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751293 Jul 01 10:29:26.257592 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 424/847] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:26.257896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:26.257896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:26.266382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.267056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.268049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.268674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.272830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c3b8ce72-ca92-4a51-ac08-e41ec6255296 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-969081396", "metadata": {"": ""}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c3b8ce72-ca92-4a51-ac08-e41ec6255296 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action HTTP/1.1 Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 106 Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:29:26.288818 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-969081396", "metadata": {"": ""}}} Jul 01 10:29:26.290176 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c3168707-cb17-4267-a005-2e7307e2a168', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-969081396', 'metadata': {'': ''}}}} Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'': ''} Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:26.291842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.293072 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c3b8ce72-ca92-4a51-ac08-e41ec6255296 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c3b8ce72-ca92-4a51-ac08-e41ec6255296 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action" status: 400 len: 170 microversion: 2.1 time: 0.019197 Jul 01 10:29:26.294232 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 425/848] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Jul 1 10:29:26 2022] POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action => generated 170 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:29:26.296055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:26.296660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:26.309041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.309519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.310293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.310728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.554661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:26.558926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:26.563230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:26.564737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:26.566000 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b3b2d99-1581-4c42-97fb-7f3429b6083b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.313641 Jul 01 10:29:26.567090 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 424/849] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:26 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:26.567257 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-be2a444f-053f-44f2-98e1-a1febde31ccc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1462 microversion: 2.1 time: 0.276516 Jul 01 10:29:26.567695 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 426/850] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:26 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1462 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:26.571761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:26.572364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: 2f70d5be-11e7-4a30-be3e-ee8374833175] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:26.578692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.579290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.579941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.580373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.585786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f435137-3e52-4949-a186-bd45d116dadc tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:26.586439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1f435137-3e52-4949-a186-bd45d116dadc tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:26.595963 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] HTTP exception thrown: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Request method failure captured: Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 HTTP/1.1 Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivswow4_61NXx1-QJCJIx5xYc9Q8R3IP0lF9TipswMKLCnUPQH8edlS0PORApZ3tI8Xz5dccG_Xw0QjdJZSrQJPtFqlP6t9r6G5Msk2pberhcBFbhvaDM1D8aw-oUKDxkzA3JuIaao8ON6SscXNdT5ryFI7vPdWtMvXwy9VoxAMV5sSQ Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:29:26.597593 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83905704e34a425887ccad7606e3c792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83905704e34a425887ccad7606e3c792", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 408ec811b27c4e908c45d946f555a75c Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.599109 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '2f70d5be-11e7-4a30-be3e-ee8374833175'} Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:26.599966 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. Jul 01 10:29:26.601581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:26.603503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Returning 404 to user: Instance 2f70d5be-11e7-4a30-be3e-ee8374833175 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:26.604344 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ba46ee6-6bac-4b96-a39f-71dcb696401c tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175" status: 404 len: 111 microversion: 2.1 time: 0.036050 Jul 01 10:29:26.604901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 425/851] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:26 2022] GET /compute/v2.1/servers/2f70d5be-11e7-4a30-be3e-ee8374833175 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:29:26.609462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2076613458", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:26.653291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1f435137-3e52-4949-a186-bd45d116dadc tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:26.661228 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f435137-3e52-4949-a186-bd45d116dadc tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1219 microversion: 2.1 time: 0.092221 Jul 01 10:29:26.661941 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 427/852] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:26 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:26.666893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:26.667521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:26.669896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:26.674607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.675055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.676381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.676996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.904648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:26.913492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-207c0135-fd17-41c9-ad11-a1da62290d8d tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.250191 Jul 01 10:29:26.914063 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 428/853] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:26 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:26.918554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:26.919199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:26.927588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.931532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.931532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.931532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.938759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:26.950769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:26.951305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:26.951793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:26.952286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:26.970173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.972175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:26.975264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:26.976044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:27.009782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Getting quotas for project 1ca92b2cafba4257b5f4931764621897. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:27.014623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Getting quotas for user 832898660e1d480e8c85a12c9cfd5c02 and project 1ca92b2cafba4257b5f4931764621897. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:27.027843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:27.030272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:27.077550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:27.086209 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-edba7711-3ea8-4195-8375-c9852844ab97 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1316 microversion: 2.1 time: 0.171128 Jul 01 10:29:27.086775 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 429/854] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:26 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:27.100245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:27.105746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:27.107168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:27.107777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:27.109614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:27.110067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:27.173479 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec6e4dff-0616-4bc2-a859-038e4302f9c9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567417 Jul 01 10:29:27.174283 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 426/855] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:27.179420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc5b38de-9cb5-4740-8349-aa31c4ee0f1b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '.version_select at 0x7f6f92291d30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:27.326778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:27.334634 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ffd4beb2-53dc-45d2-b2b6-e92472f9079c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1462 microversion: 2.1 time: 0.246547 Jul 01 10:29:27.335282 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 430/856] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:27 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1462 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:27.353126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:27.353781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:27.360399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:27.360838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:27.362847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:27.362847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:27.621388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:27.631546 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b7f8cf9e-0541-44f0-b89b-c3d2ca008dd0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.295008 Jul 01 10:29:27.632322 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 431/857] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:27 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:27.638613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ac842805-f203-46ce-aeb7-45e212a9b9c3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:27.640078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ac842805-f203-46ce-aeb7-45e212a9b9c3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:27.738353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ac842805-f203-46ce-aeb7-45e212a9b9c3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:27.745543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ac842805-f203-46ce-aeb7-45e212a9b9c3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1214 microversion: 2.1 time: 0.111664 Jul 01 10:29:27.746548 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 432/858] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:27 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:27.757385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d183994-8a42-4698-84af-6816223afb22 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'create', calling method: .version_select at 0x7f6f92091280>, body: {"keypair": {"name": "tempest-keypair-756475534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw887MGaEnSA5iT5fSCjrVqVpyAMfPFJtwdG9+fQqlIq/tbq6FaX450B2O3okLxoIJWeD9oSteEiMkFnfLiqEW4OHMA/+l2hbaJm3n8PO0SBp9uVEMMKB7dwur+Ashdzg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:27.777638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4d183994-8a42-4698-84af-6816223afb22 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:27.783225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4d183994-8a42-4698-84af-6816223afb22 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for user 0dcb8296a8934a8cbc89d6df73d4a526 and project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:27.929495 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d183994-8a42-4698-84af-6816223afb22 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181748 Jul 01 10:29:27.930446 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 433/859] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:29:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:27.936288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-839714bc-cc8f-4345-88e1-bbb9a2dd78ae req-68aa2bc1-1e77-4a9e-98a9-5844b86a9490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5569f4-0626-402c-a3c4-ed62cb8af25c", "tag": "dfca3548-598e-4e5d-abba-a6283102320c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:27.944491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-839714bc-cc8f-4345-88e1-bbb9a2dd78ae req-68aa2bc1-1e77-4a9e-98a9-5844b86a9490 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:27.945095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-839714bc-cc8f-4345-88e1-bbb9a2dd78ae req-68aa2bc1-1e77-4a9e-98a9-5844b86a9490 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:27.957252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-839714bc-cc8f-4345-88e1-bbb9a2dd78ae req-68aa2bc1-1e77-4a9e-98a9-5844b86a9490 service nova] Creating event network-changed:dfca3548-598e-4e5d-abba-a6283102320c for instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c on n-h2-master-1 Jul 01 10:29:27.963313 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-839714bc-cc8f-4345-88e1-bbb9a2dd78ae req-68aa2bc1-1e77-4a9e-98a9-5844b86a9490 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031563 Jul 01 10:29:27.964218 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 434/860] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:27.969554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:27.970240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:27.979129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:27.979667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:27.981011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:27.982659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.152162 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:28.164409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:28.166721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:28.167595 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e1dc311-8869-469d-bfb1-021363d9b9d5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.202260 Jul 01 10:29:28.168412 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 435/861] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:27 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:28.206375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e05463b2-b386-4fa0-8d68-3dfe6f203ab1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1313361527", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e05463b2-b386-4fa0-8d68-3dfe6f203ab1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action HTTP/1.1 Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 619 Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:29:28.211160 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:28.212505 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:29:28.213102 n-d-master-1 devstack@n-api.service[119765]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1313361527", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 01 10:29:28.213102 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:29:28.213102 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c3168707-cb17-4267-a005-2e7307e2a168', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1313361527', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 01 10:29:28.213358 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:28.214019 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:28.215012 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:28.215754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:28.215754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:28.215754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:29:28.215754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:29:28.215754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 10:29:28.215754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:28.219010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e05463b2-b386-4fa0-8d68-3dfe6f203ab1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:28.219882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e05463b2-b386-4fa0-8d68-3dfe6f203ab1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action" status: 400 len: 938 microversion: 2.1 time: 0.022143 Jul 01 10:29:28.220470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 436/862] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Jul 1 10:29:28 2022] POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action => generated 938 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:29:28.225951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:28.226854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:28.233792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.234286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.235059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.235483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.282859 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc5b38de-9cb5-4740-8349-aa31c4ee0f1b tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/ce5c47f4-e1e0-4a2e-8575-ada13b3af409" status: 202 len: 0 microversion: 2.1 time: 1.107166 Jul 01 10:29:28.283760 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 427/863] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:29:27 2022] DELETE /compute/v2.1/os-floating-ips/ce5c47f4-e1e0-4a2e-8575-ada13b3af409 => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:29:28.291086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:28.294670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:28.304570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.305026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.306823 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.307269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.321929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:28.331703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-713a3145-cc21-4aca-bc5b-a9f97b2cf9dd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1271 microversion: 2.1 time: 0.110121 Jul 01 10:29:28.332891 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 437/864] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:28 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:28.338153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:28.338741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:28.344947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.345429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.346194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.346618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.532835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:28.537743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:28.542074 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-521d0047-ad27-438c-a08b-1a31fcd6f704 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1466 microversion: 2.1 time: 0.256923 Jul 01 10:29:28.542796 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 428/865] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:28 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1466 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:28.548028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:28.554512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:28.554847 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6dfce199-3551-4c7e-8556-927460210093 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.214763 Jul 01 10:29:28.554847 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 438/866] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:28 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:28.557553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.558001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.558819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.559253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.566212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-89093e4e-046e-4672-877d-681b8f5b0244 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:28.567839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-89093e4e-046e-4672-877d-681b8f5b0244 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:28.578612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89093e4e-046e-4672-877d-681b8f5b0244 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.579113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89093e4e-046e-4672-877d-681b8f5b0244 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.579902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89093e4e-046e-4672-877d-681b8f5b0244 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.590987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89093e4e-046e-4672-877d-681b8f5b0244 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.591881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:29:28.638123 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:28.826703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-89093e4e-046e-4672-877d-681b8f5b0244 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1617 microversion: 2.1 time: 0.265146 Jul 01 10:29:28.828270 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 439/867] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:28 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1617 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:28.833732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:28.834457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:28.841523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.842257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.843047 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.843645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.887488 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20fc96f6-7aea-43d5-9f7c-dd983eda1ab1 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 204 len: 0 microversion: 2.1 time: 0.342926 Jul 01 10:29:28.891342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 429/868] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:29:28 2022] DELETE /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:28.893838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:28.899636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:28.908634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.910914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:28.912561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:28.913503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.046471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:29.050121 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db1d5a2b-fea1-42fc-93b8-e0a12ea89041 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1218 microversion: 2.1 time: 0.160790 Jul 01 10:29:29.050917 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 430/869] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:28 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:29.064351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:29.064943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:29.072842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.073443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.074282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.074816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.088515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:29.100846 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00ed6389-8a36-42b4-be86-2cf876fdee11 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.269705 Jul 01 10:29:29.100846 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 440/870] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:28 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:29.105052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1024510138", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "25b54469-ddac-4b10-a1b4-61a4c7be16d9"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:29.159121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:29.343450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:29.352144 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d1ac5f0-232e-491f-9157-e74f90c10231 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1527 microversion: 2.1 time: 0.291407 Jul 01 10:29:29.352643 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 431/871] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:29 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1527 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:29.357806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f573a954-e367-4a29-9557-58ccc6a8df1e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f573a954-e367-4a29-9557-58ccc6a8df1e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action HTTP/1.1 Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 285 Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:29:29.360501 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:29:29.361928 n-d-master-1 devstack@n-api.service[119764]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c3168707-cb17-4267-a005-2e7307e2a168', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:29:29.362727 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:29:29.363410 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:29:29.364899 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:29:29.365832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:29:29.365832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:29.366744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f573a954-e367-4a29-9557-58ccc6a8df1e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:29.367749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f573a954-e367-4a29-9557-58ccc6a8df1e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action" status: 400 len: 619 microversion: 2.1 time: 0.013997 Jul 01 10:29:29.371525 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 432/872] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Jul 1 10:29:29 2022] POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:29:29.377583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:29.380697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:29.385820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.386266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.387023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.387452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.649046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:29.650181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:29.652428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:29.653070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:29.655345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:29.672419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.672928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.673753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.674202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.694747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:29.698876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Getting quotas for user a41a6d17bc1b420f90bb2e3b0c0be2d5 and project e8388729edb84de9823cde8a7a3dba2c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:29.711111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:29.711336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:29.714135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:29.724532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:29.726112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:29.727304 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:29.735435 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06915a5f-a1a1-4891-83b9-9d08214ca415 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.357153 Jul 01 10:29:29.735435 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 433/873] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:29 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:29.750210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:29.750833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:29.759104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.759975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.761113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.761767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.835322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:29.843115 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-35e43bbc-0934-4c88-bea8-ef94375d00c3 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1289 microversion: 2.1 time: 0.110973 Jul 01 10:29:29.843670 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 434/874] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:29 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:29.848697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:29.849321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:29.855188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.855572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.856325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:29.856924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:29.901265 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a84e9873-f4cd-4e84-9627-c02511860810 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799978 Jul 01 10:29:29.903369 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 441/875] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:29.921117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad210762-3127-4298-9aa7-3cc47c805657 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:29.924493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad210762-3127-4298-9aa7-3cc47c805657 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:30.126389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad210762-3127-4298-9aa7-3cc47c805657 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:30.134471 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad210762-3127-4298-9aa7-3cc47c805657 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1217 microversion: 2.1 time: 0.222460 Jul 01 10:29:30.135543 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 442/876] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:29 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:30.140131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:30.140970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:30.157256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.157953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.158472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.158941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.222405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:30.232045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29de5dfb-7bc6-442f-8c70-8ca70ad3ecd7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.387173 Jul 01 10:29:30.233403 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 435/877] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:29 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:30.252456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:30.253707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:30.260708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.261546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.267587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.268360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.281738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:30.292402 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-09ca0b7f-be16-4b58-aea6-3747647031c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1266 microversion: 2.1 time: 0.155639 Jul 01 10:29:30.293782 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 443/878] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:30 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:30.370361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:30.375326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:30.384533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.387078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.388153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.388764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.666143 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:30.678988 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc6bf796-1e3c-41dc-92c7-a807a563fb3f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 0.428494 Jul 01 10:29:30.688439 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 436/879] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:30 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:29:30.717712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0b9b030-b60b-40a9-92a3-49481647b46f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-94256473"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:30.717712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f0b9b030-b60b-40a9-92a3-49481647b46f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:30.730560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b9b030-b60b-40a9-92a3-49481647b46f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.731004 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b9b030-b60b-40a9-92a3-49481647b46f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.731761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b9b030-b60b-40a9-92a3-49481647b46f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.733674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b9b030-b60b-40a9-92a3-49481647b46f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.881083 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:30.899789 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-59b63b0f-3826-452f-9e43-e24be443a10e tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1527 microversion: 2.1 time: 0.534359 Jul 01 10:29:30.909519 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 444/880] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:30 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1527 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:30.915010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:30.915693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:30.942082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.942839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:30.943822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:30.944438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:31.535021 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0b9b030-b60b-40a9-92a3-49481647b46f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action" status: 202 len: 0 microversion: 2.1 time: 0.844893 Jul 01 10:29:31.536414 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 437/881] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:30 2022] POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:29:31.556667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:31.559334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:31.572098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:31.572920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:31.574269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:31.574912 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:31.831867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:31.841114 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38dac3ce-70de-4bc1-9a19-b25021cff1d7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1277 microversion: 2.1 time: 0.297227 Jul 01 10:29:31.842052 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 438/882] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:31 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1277 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:31.846818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:31.847476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:31.873990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:31.874460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:31.875244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:31.875667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:31.877264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:31.885853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:31.887545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:31.888836 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72766db1-30d7-4572-a610-943b5e16bf5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.977574 Jul 01 10:29:31.889423 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 445/883] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:30 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:31.894102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:31.895499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:31.905331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:31.906066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:31.907103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:31.907543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:31.999013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:32.010474 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81350bd4-193a-4dce-af09-352293bb79e8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1213 microversion: 2.1 time: 0.167214 Jul 01 10:29:32.011062 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 439/884] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:31 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:32.016434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2046962555"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:32.017434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:32.024612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.025284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.025402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:32.026066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.026495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.038356 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-189eebee-d1b4-43d5-ac7d-c73999828ec7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1272 microversion: 2.1 time: 0.147436 Jul 01 10:29:32.039020 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 446/885] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:31 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:32.057170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e617b6b9-0ce5-4b67-8c8f-5f8eb33151e5 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '.version_select at 0x7f6f92390040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:32.060168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e617b6b9-0ce5-4b67-8c8f-5f8eb33151e5 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.061069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e617b6b9-0ce5-4b67-8c8f-5f8eb33151e5 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.077763 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e617b6b9-0ce5-4b67-8c8f-5f8eb33151e5 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1184 microversion: 2.1 time: 0.037264 Jul 01 10:29:32.079741 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 447/886] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:29:32 2022] GET /compute/v2.1/os-migrations => generated 1184 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:32.086504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ee18f3ab-6ce7-483e-ad3d-8012edf8d411 req-316fb70c-af53-4a86-b30c-8daf0d022ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c7abe7-c029-4079-a717-487c2b56573a", "name": "network-vif-deleted", "tag": "311e0c88-1777-4643-834e-e3e9e94477c9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:32.096965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ee18f3ab-6ce7-483e-ad3d-8012edf8d411 req-316fb70c-af53-4a86-b30c-8daf0d022ace service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.097961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ee18f3ab-6ce7-483e-ad3d-8012edf8d411 req-316fb70c-af53-4a86-b30c-8daf0d022ace service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.099233 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Cannot 'createImage' instance c3168707-cb17-4267-a005-2e7307e2a168 while it is in task_state image_snapshot Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action HTTP/1.1 Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 85 Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:29:32.104996 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2046962555"}} Jul 01 10:29:32.108629 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: exception: Cannot 'createImage' instance c3168707-cb17-4267-a005-2e7307e2a168 while it is in task_state image_snapshot Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c3168707-cb17-4267-a005-2e7307e2a168', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2046962555'}}} Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3168707-cb17-4267-a005-2e7307e2a168 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:32.109431 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c3168707-cb17-4267-a005-2e7307e2a168 while it is in task_state image_snapshot Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c3168707-cb17-4267-a005-2e7307e2a168 while it is in task_state image_snapshot Jul 01 10:29:32.111356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:32.114391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 409 to user: Cannot 'createImage' instance c3168707-cb17-4267-a005-2e7307e2a168 while it is in task_state image_snapshot {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:32.114391 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c3202104-1113-4bf8-a824-e91b5b8f3b7f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action" status: 409 len: 159 microversion: 2.1 time: 0.096309 Jul 01 10:29:32.114391 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 440/887] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:32 2022] POST /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168/action => generated 159 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:29:32.123176 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ee18f3ab-6ce7-483e-ad3d-8012edf8d411 req-316fb70c-af53-4a86-b30c-8daf0d022ace service nova] Creating event network-vif-deleted:311e0c88-1777-4643-834e-e3e9e94477c9 for instance e7c7abe7-c029-4079-a717-487c2b56573a on n-h2-master-1 Jul 01 10:29:32.127538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:32.130226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:32.131136 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ee18f3ab-6ce7-483e-ad3d-8012edf8d411 req-316fb70c-af53-4a86-b30c-8daf0d022ace service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049696 Jul 01 10:29:32.133615 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 448/888] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:32.141628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-072118f7-2851-456f-9d38-4bdaa0b6e130 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:32.143057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.145565 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.146480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.148527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.152066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-072118f7-2851-456f-9d38-4bdaa0b6e130 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016935 Jul 01 10:29:32.158479 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 449/889] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:29:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:32.164938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de33db55-f910-429d-b469-dc1b02de5707 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '.version_select at 0x7f6f921e5280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:32.345501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408ec811b27c4e908c45d946f555a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83905704e34a425887ccad7606e3c792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:32.353743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-248b6f2e-9937-4281-bfc7-77ebd68283c5 tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 200 len: 1309 microversion: 2.1 time: 0.241711 Jul 01 10:29:32.354315 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 441/890] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:32 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 1309 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:32.358565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad51dd10-0deb-42bf-9350-f7fd4411a418 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-11681065", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:32.360399 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:29:32.360399 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:29:32.442369 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:32.446928 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad51dd10-0deb-42bf-9350-f7fd4411a418 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.091650 Jul 01 10:29:32.447599 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 442/891] 10.222.0.23 () {60 vars in 1145 bytes} [Fri Jul 1 10:29:32 2022] POST /compute/v2.1/flavors => generated 497 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:32.452708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20b4fdeb-8f1c-4c97-a047-52eecc403888 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8f46eed-bf4e-4853-af98-07e466bda7f8"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:32.453841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20b4fdeb-8f1c-4c97-a047-52eecc403888 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:32.459528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20b4fdeb-8f1c-4c97-a047-52eecc403888 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.459951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20b4fdeb-8f1c-4c97-a047-52eecc403888 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.460699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20b4fdeb-8f1c-4c97-a047-52eecc403888 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.461127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20b4fdeb-8f1c-4c97-a047-52eecc403888 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.522602 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de33db55-f910-429d-b469-dc1b02de5707 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/images/6183c22d-9144-4126-813d-66fb7a80a54d" status: 204 len: 0 microversion: 2.1 time: 0.362389 Jul 01 10:29:32.523261 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 450/892] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:32 2022] DELETE /compute/v2.1/images/6183c22d-9144-4126-813d-66fb7a80a54d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:32.531690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ab9aa4a-8bfd-459e-a53e-90d562f00b32 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:32.541483 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ab9aa4a-8bfd-459e-a53e-90d562f00b32 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016473 Jul 01 10:29:32.553477 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 451/893] 10.222.0.23 () {58 vars in 1181 bytes} [Fri Jul 1 10:29:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:29:32.560334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:32.561903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:32.574663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.575577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.576766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:32.577588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:32.899347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:32.901732 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:32.908164 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-05c3a0e0-a47e-4264-bd2f-5728b48ddbb1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1534 microversion: 2.1 time: 0.353570 Jul 01 10:29:32.908729 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 452/894] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:32 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1534 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:32.914009 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1623439991", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "5a3d5174-dbad-4e84-b4b0-cd0f8c868564"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:32.997255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:33.646414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:33.648534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:33.648984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:33.649432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:33.649838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:33.667920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:33.667920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:33.667920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:33.667920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:33.685603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:33.689761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for user 0dcb8296a8934a8cbc89d6df73d4a526 and project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:33.701619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:33.703918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:33.714049 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20b4fdeb-8f1c-4c97-a047-52eecc403888 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "POST /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.264947 Jul 01 10:29:33.720394 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 443/895] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:29:32 2022] POST /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments => generated 194 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:33.739170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-62b07555-f50c-4637-adfe-da9e40a5acb2 req-6ce5a947-7939-46cd-9548-416ad3f35bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5569f4-0626-402c-a3c4-ed62cb8af25c", "name": "network-vif-unplugged", "status": "completed", "tag": "dfca3548-598e-4e5d-abba-a6283102320c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:33.750762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-62b07555-f50c-4637-adfe-da9e40a5acb2 req-6ce5a947-7939-46cd-9548-416ad3f35bb5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:33.751546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-62b07555-f50c-4637-adfe-da9e40a5acb2 req-6ce5a947-7939-46cd-9548-416ad3f35bb5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:33.769763 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-62b07555-f50c-4637-adfe-da9e40a5acb2 req-6ce5a947-7939-46cd-9548-416ad3f35bb5 service nova] Creating event network-vif-unplugged:dfca3548-598e-4e5d-abba-a6283102320c for instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c on n-h2-master-1 Jul 01 10:29:33.776280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-62b07555-f50c-4637-adfe-da9e40a5acb2 req-6ce5a947-7939-46cd-9548-416ad3f35bb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049249 Jul 01 10:29:33.777131 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 444/896] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:33.783362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:33.784130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:33.792499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:33.793350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:33.794981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:33.795649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:33.907280 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4672fad8-ca31-4404-a23f-ad9373b6b40d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997079 Jul 01 10:29:33.908217 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 453/897] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:33.919493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:33.920808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:33.929893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:33.931385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:33.932558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:33.933208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.309306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:34.312797 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:34.319618 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5438e5df-b35d-4645-b31e-c1acf588b146 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.541089 Jul 01 10:29:34.320207 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 445/898] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:33 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:34.333836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:34.334541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:34.340531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.341272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.342269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.342918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.366496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:34.379697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:34.381517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:34.382871 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc15a58e-3828-469f-962d-e0b8e5e0171c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1568 microversion: 2.25 time: 0.467734 Jul 01 10:29:34.383905 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 454/899] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:33 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1568 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:34.389366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:34.390163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:34.398861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.400145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.401202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.401850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.542721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:34.552430 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72f0c33c-dbb0-44bf-bb48-4e5b8ef4e32e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1272 microversion: 2.1 time: 0.167179 Jul 01 10:29:34.553676 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 455/900] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:34 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:34.560430 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:34.561443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] [instance: e7c7abe7-c029-4079-a717-487c2b56573a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:34.568736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.569521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.570755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.571399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.590790 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] HTTP exception thrown: Instance e7c7abe7-c029-4079-a717-487c2b56573a could not be found. Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Request method failure captured: Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a HTTP/1.1 Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivswow4_61NXx1-QJCJIx5xYc9Q8R3IP0lF9TipswMKLCnUPQH8edlS0PORApZ3tI8Xz5dccG_Xw0QjdJZSrQJPtFqlP6t9r6G5Msk2pberhcBFbhvaDM1D8aw-oUKDxkzA3JuIaao8ON6SscXNdT5ryFI7vPdWtMvXwy9VoxAMV5sSQ Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:29:34.593903 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83905704e34a425887ccad7606e3c792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83905704e34a425887ccad7606e3c792", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83905704e34a425887ccad7606e3c792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 83905704e34a425887ccad7606e3c792 Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1238764489 Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 408ec811b27c4e908c45d946f555a75c Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1238764489-project Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e7c7abe7-c029-4079-a717-487c2b56573a could not be found. Jul 01 10:29:34.595199 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e7c7abe7-c029-4079-a717-487c2b56573a'} Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c7abe7-c029-4079-a717-487c2b56573a could not be found. Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:34.595895 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c7abe7-c029-4079-a717-487c2b56573a could not be found. Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c7abe7-c029-4079-a717-487c2b56573a could not be found. Jul 01 10:29:34.597032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:34.599720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] Returning 404 to user: Instance e7c7abe7-c029-4079-a717-487c2b56573a could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:34.600939 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-09d757b2-1004-499c-98eb-f9cd1f374e9f tempest-FloatingIPsAssociationTestJSON-1238764489 tempest-FloatingIPsAssociationTestJSON-1238764489-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a" status: 404 len: 111 microversion: 2.1 time: 0.045810 Jul 01 10:29:34.606704 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 456/901] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:34 2022] GET /compute/v2.1/servers/e7c7abe7-c029-4079-a717-487c2b56573a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:29:34.610190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:34.612393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc1b1c58-568b-4c8d-804c-4a5594105a57 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:34.614183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cc1b1c58-568b-4c8d-804c-4a5594105a57 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:34.624452 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-120277ac-e34d-4f1d-aabf-b0eb0f21f682 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1275 microversion: 2.1 time: 0.302125 Jul 01 10:29:34.625437 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 446/902] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:34 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:34.630840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:34.637989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:34.650779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.651459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.652446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:34.656929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:34.880089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cc1b1c58-568b-4c8d-804c-4a5594105a57 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:34.887745 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cc1b1c58-568b-4c8d-804c-4a5594105a57 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1279 microversion: 2.1 time: 0.279318 Jul 01 10:29:34.896713 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 457/903] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:34 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:35.337709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:35.339407 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:35.351661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:35.355724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:35.357609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:35.361921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:35.553918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:35.562159 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0da94ef4-14aa-4545-80b4-6a9425412fb9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1540 microversion: 2.1 time: 0.935481 Jul 01 10:29:35.567138 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 447/904] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:34 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1540 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:35.575938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:35.586099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:35.596654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:35.597102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:35.597973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:35.598408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.136902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:36.149534 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8504528-9fd7-442e-be29-a24377601131 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.815810 Jul 01 10:29:36.150867 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 458/905] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:35 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:36.174788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:36.176305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:36.182938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.183634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.184597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.185373 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.216530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:36.241908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:36.244695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:36.246762 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09c58ba1-bc92-4ffc-8132-976f0449241b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1558 microversion: 2.25 time: 0.674459 Jul 01 10:29:36.248126 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 448/906] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:35 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1558 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:36.279043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:36.281476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:36.302537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.304491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.304491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.304928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.551858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:36.561204 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b13892d-a523-4497-8dad-dcbb64292a07 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1275 microversion: 2.1 time: 0.311478 Jul 01 10:29:36.566829 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 449/907] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:36 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:36.567829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:36.568655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:36.574784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.575601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.576560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.577225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.801563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:36.813514 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-19417e4f-8930-4dd3-a480-445dc6eefa14 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1331 microversion: 2.1 time: 0.249820 Jul 01 10:29:36.817081 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 450/908] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:36 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1331 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:36.826771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-71217ff0-fe27-4099-9542-368b7727f6af tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '.version_select at 0x7f6f920e0ee0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:36.838202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71217ff0-fe27-4099-9542-368b7727f6af tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.840161 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71217ff0-fe27-4099-9542-368b7727f6af tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.877580 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-71217ff0-fe27-4099-9542-368b7727f6af tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.059029 Jul 01 10:29:36.880094 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 451/909] 10.222.0.23 () {60 vars in 1183 bytes} [Fri Jul 1 10:29:36 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:36.888059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:36.899594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:36.916455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.919777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.919777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:36.919777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:36.946911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:36.978196 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6b4f31a4-1c2d-4414-8960-5eb9a4d66208 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.825984 Jul 01 10:29:36.985400 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 459/910] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:36 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:36.994718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:36.996017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:37.010643 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:37.013546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:37.016066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:37.018236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:37.018932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:37.022491 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:37.845466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 4d5569f4-0626-402c-a3c4-ed62cb8af25c {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:37.894892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:37.909234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7175c086-f427-4747-8d7e-2513871f1117 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1522 microversion: 2.1 time: 1.027873 Jul 01 10:29:37.912778 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 452/911] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:36 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1522 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:37.923404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:37.924097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:37.955611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:37.956056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:37.962378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:37.963069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:37.969538 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20f72856-e3e7-4ca2-bd41-3ac2d95fd9ca tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 2050 microversion: 2.25 time: 0.982734 Jul 01 10:29:37.977919 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 460/912] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:36 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 2050 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:37.977919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:37.977919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:37.984957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:37.985740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:37.986806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:37.987817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:38.802039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:38.810125 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-92e493d9-bca0-40bb-a8d4-be5a0f9cc8e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.896141 Jul 01 10:29:38.815688 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 453/913] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:37 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:38.815688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:38.817408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:38.824104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:38.824681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:38.825733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:38.826272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:38.879524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:38.888235 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a46f5ce7-9a4a-4a9a-9c96-0541e9871b8d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1317 microversion: 2.1 time: 0.915840 Jul 01 10:29:38.888813 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 461/914] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:37 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1317 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:38.894699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:38.895554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:38.903520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:38.904076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:38.904948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:38.905513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:38.935895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:29:39.006597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:39.020927 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50300085-2f26-4838-910a-2b0cc23f9679 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1337 microversion: 2.1 time: 0.204450 Jul 01 10:29:39.020927 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 454/915] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:38 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1337 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:39.031315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:39.031930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:39.051572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:39.057271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:39.058520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:39.059838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:39.318281 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8871c360-3342-423a-b5df-905f0ca3291b tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 204 len: 0 microversion: 2.1 time: 0.426627 Jul 01 10:29:39.320724 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 462/916] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:29:38 2022] DELETE /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:39.328631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-958523947", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "510d1e57-c4e3-47f6-a81f-66e48831c93c"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:39.418636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] validate_networks() for [('510d1e57-c4e3-47f6-a81f-66e48831c93c', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:39.784840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:39.793016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-111ce020-2794-4069-aa14-44a0047246ce tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.774780 Jul 01 10:29:39.806067 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 455/917] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:39 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:39.811322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4cd11bc9-1754-4b77-aa8e-247b95287f92 req-a352ca6c-7682-4b25-926a-59268902a8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3168707-cb17-4267-a005-2e7307e2a168", "name": "network-vif-plugged", "status": "completed", "tag": "91243b24-22ec-4412-9749-7b98ca290584"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:39.825827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4cd11bc9-1754-4b77-aa8e-247b95287f92 req-a352ca6c-7682-4b25-926a-59268902a8e6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:39.826296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4cd11bc9-1754-4b77-aa8e-247b95287f92 req-a352ca6c-7682-4b25-926a-59268902a8e6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:40.104383 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4cd11bc9-1754-4b77-aa8e-247b95287f92 req-a352ca6c-7682-4b25-926a-59268902a8e6 service nova] Creating event network-vif-plugged:91243b24-22ec-4412-9749-7b98ca290584 for instance c3168707-cb17-4267-a005-2e7307e2a168 on n-h2-master-1 Jul 01 10:29:40.110797 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4cd11bc9-1754-4b77-aa8e-247b95287f92 req-a352ca6c-7682-4b25-926a-59268902a8e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302916 Jul 01 10:29:40.111983 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 456/918] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:40.123235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-55e64124-6fce-4877-b44e-9548e66c9043 req-5a6f5e81-b642-49d5-8bd2-ca831120f30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43b75c0-e10d-4c17-bee5-19bf28959a94", "tag": "db63aca7-c13d-4316-887a-56d63f9aa667"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:40.133086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-55e64124-6fce-4877-b44e-9548e66c9043 req-5a6f5e81-b642-49d5-8bd2-ca831120f30e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:40.134013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-55e64124-6fce-4877-b44e-9548e66c9043 req-5a6f5e81-b642-49d5-8bd2-ca831120f30e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:40.147422 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-55e64124-6fce-4877-b44e-9548e66c9043 req-5a6f5e81-b642-49d5-8bd2-ca831120f30e service nova] Creating event network-changed:db63aca7-c13d-4316-887a-56d63f9aa667 for instance e43b75c0-e10d-4c17-bee5-19bf28959a94 on n-h1-master-1 Jul 01 10:29:40.154024 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-55e64124-6fce-4877-b44e-9548e66c9043 req-5a6f5e81-b642-49d5-8bd2-ca831120f30e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039819 Jul 01 10:29:40.155214 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 457/919] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:40.161624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:40.162333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:40.171419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:40.171878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:40.172650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:40.173083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:40.776146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:40.790918 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-041db7f1-0069-472b-a142-b9556e841b10 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1528 microversion: 2.1 time: 0.634217 Jul 01 10:29:40.799624 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 458/920] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:40 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1528 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:40.807487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:40.808420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:40.820961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:40.824048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:40.831574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:40.831574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:41.808335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:41.809432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:41.814378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:41.814378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:41.814378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:41.823930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:41.824927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:41.826308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:41.827004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:41.851989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:41.856958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for user cd7034799f014e95bbe8ed18fdc424a6 and project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:41.877138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:41.882775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:42.009435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:42.018780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9ab8700-ce34-4364-8b16-a30c0c2fc628 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 1.215210 Jul 01 10:29:42.024244 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 459/921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:40 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:42.030884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:42.032836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:42.040995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.041736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.042683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.043322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.064998 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d7be9d54-52a0-45a5-a184-01638e388d85 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.742481 Jul 01 10:29:42.065634 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 463/922] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:29:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:29:42.086117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:42.087239 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:42.104310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.105121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.110288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.110288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.687612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:42.695593 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-456a0900-603a-40e5-965b-f535534de0f0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1317 microversion: 2.1 time: 0.674036 Jul 01 10:29:42.696386 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 460/923] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:42 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:42.699520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:42.701033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:42.701684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:42.708859 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b016154a-154d-467c-9b85-4a37caaaf57b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1379 microversion: 2.1 time: 0.633106 Jul 01 10:29:42.709062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.710003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.710240 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 464/924] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:42 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1379 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:42.711896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.712733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.714722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-cb87a617-d7a1-47ff-b005-5f3889831d45 req-4a341880-f029-485e-a2d4-d62d2615b1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b33f4f-5006-4385-a6ed-3568077e187d", "tag": "3d39a985-0d0e-4eb6-a0ac-66e646f5e96f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:42.724076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cb87a617-d7a1-47ff-b005-5f3889831d45 req-4a341880-f029-485e-a2d4-d62d2615b1b9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.724899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cb87a617-d7a1-47ff-b005-5f3889831d45 req-4a341880-f029-485e-a2d4-d62d2615b1b9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.738087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-cb87a617-d7a1-47ff-b005-5f3889831d45 req-4a341880-f029-485e-a2d4-d62d2615b1b9 service nova] Creating event network-changed:3d39a985-0d0e-4eb6-a0ac-66e646f5e96f for instance f5b33f4f-5006-4385-a6ed-3568077e187d on n-h2-master-1 Jul 01 10:29:42.743227 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-cb87a617-d7a1-47ff-b005-5f3889831d45 req-4a341880-f029-485e-a2d4-d62d2615b1b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031891 Jul 01 10:29:42.744831 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 465/925] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:42.758204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:42.759298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:42.768820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.770040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:42.770820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:42.771378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.080869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:43.089043 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-090660cb-c4c7-44a7-ae2c-bf9e42fa8303 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.391630 Jul 01 10:29:43.089947 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 461/926] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:42 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:43.094392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:43.095059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:43.101005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.101546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.102302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.102728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.161806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:43.169265 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf208bf8-74e7-4436-87f4-178c9b335c15 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1528 microversion: 2.1 time: 0.422938 Jul 01 10:29:43.169843 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 466/927] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:42 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1528 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:43.175039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3606df0a-4bc2-4d78-8965-2ddd5191a41b req-305db473-5434-4e09-bea4-9b74ed74bb3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3168707-cb17-4267-a005-2e7307e2a168", "name": "network-vif-unplugged", "status": "completed", "tag": "91243b24-22ec-4412-9749-7b98ca290584"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:43.183892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3606df0a-4bc2-4d78-8965-2ddd5191a41b req-305db473-5434-4e09-bea4-9b74ed74bb3e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.184330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3606df0a-4bc2-4d78-8965-2ddd5191a41b req-305db473-5434-4e09-bea4-9b74ed74bb3e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.195591 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3606df0a-4bc2-4d78-8965-2ddd5191a41b req-305db473-5434-4e09-bea4-9b74ed74bb3e service nova] Creating event network-vif-unplugged:91243b24-22ec-4412-9749-7b98ca290584 for instance c3168707-cb17-4267-a005-2e7307e2a168 on n-h2-master-1 Jul 01 10:29:43.200784 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3606df0a-4bc2-4d78-8965-2ddd5191a41b req-305db473-5434-4e09-bea4-9b74ed74bb3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029814 Jul 01 10:29:43.201415 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 467/928] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:43.206495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:43.207963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-30077c5e-ff5f-489d-ac89-df8ee45944c9 req-02d772c6-bf09-4937-8d2d-dfb368a93a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672", "tag": "75426cac-af1d-4dc1-8b63-4c327a9be5a5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:43.216120 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-30077c5e-ff5f-489d-ac89-df8ee45944c9 req-02d772c6-bf09-4937-8d2d-dfb368a93a62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.216564 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-30077c5e-ff5f-489d-ac89-df8ee45944c9 req-02d772c6-bf09-4937-8d2d-dfb368a93a62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.217080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:43.218604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:43.219757 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d2476278-5d63-4d32-8386-77c70ec6a364 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1265 microversion: 2.25 time: 0.128968 Jul 01 10:29:43.220685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 462/929] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:43 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:43.234395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:43.235018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:43.238126 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-30077c5e-ff5f-489d-ac89-df8ee45944c9 req-02d772c6-bf09-4937-8d2d-dfb368a93a62 service nova] Creating event network-changed:75426cac-af1d-4dc1-8b63-4c327a9be5a5 for instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 on n-h1-master-1 Jul 01 10:29:43.242250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.247936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.247936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.248404 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-30077c5e-ff5f-489d-ac89-df8ee45944c9 req-02d772c6-bf09-4937-8d2d-dfb368a93a62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040768 Jul 01 10:29:43.248577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.248673 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 468/930] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:43.715265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:43.716383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:43.733692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.733692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:43.733692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:43.733692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.070238 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.079237 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-afc508e0-9de9-4273-beaa-b0d7397822f2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.856910 Jul 01 10:29:44.080472 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 463/931] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:43 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:44.087242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:44.088816 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:44.095059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.095843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.096735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.098268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.117981 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:44.617092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.628646 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14beef97-5cb3-4c3d-a36a-05693520ab7d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1317 microversion: 2.1 time: 0.919068 Jul 01 10:29:44.629263 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 469/932] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:43 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:44.633971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:44.634583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:44.649220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.653014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.653014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.653014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.686828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.694707 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1f20be17-2a70-41c5-9cc8-cddbf60e052e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1379 microversion: 2.1 time: 0.612154 Jul 01 10:29:44.695287 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 464/933] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:44 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1379 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:44.699808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:44.700421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:44.709593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.717538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.717538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.717538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.758564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.759085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.759602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lazy-loading 'fault' on Instance uuid c3168707-cb17-4267-a005-2e7307e2a168 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:44.840379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.848721 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8e8e0fd-80a8-41c4-8f5f-d77ada9ba314 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1314 microversion: 2.1 time: 0.152459 Jul 01 10:29:44.849543 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 465/934] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:44 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:44.854420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:44.855023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:44.861311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.861760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.862510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.866316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:44.964286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.970475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.973058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.974736 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:44.975624 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3af52638-72b7-432b-af15-2faba25a7b61 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1313 microversion: 2.25 time: 0.125411 Jul 01 10:29:44.980467 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c286f036-7827-4171-8a8d-dc91fad162e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.350176 Jul 01 10:29:44.986784 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 470/935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:44 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:44.986784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-52a6e744-35eb-4b7b-9573-a5ae259e1c5c req-8704db45-dcac-4510-a0a6-838624889008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9245057-43b9-492e-8f86-ac014664d207", "tag": "c0c447ef-8eab-4c35-96c1-29d659a0f21b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:44.991952 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 466/936] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:44 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:44.995606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-52a6e744-35eb-4b7b-9573-a5ae259e1c5c req-8704db45-dcac-4510-a0a6-838624889008 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:44.996046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-52a6e744-35eb-4b7b-9573-a5ae259e1c5c req-8704db45-dcac-4510-a0a6-838624889008 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.007345 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-52a6e744-35eb-4b7b-9573-a5ae259e1c5c req-8704db45-dcac-4510-a0a6-838624889008 service nova] Creating event network-changed:c0c447ef-8eab-4c35-96c1-29d659a0f21b for instance f9245057-43b9-492e-8f86-ac014664d207 on n-h2-master-1 Jul 01 10:29:45.012735 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-52a6e744-35eb-4b7b-9573-a5ae259e1c5c req-8704db45-dcac-4510-a0a6-838624889008 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029823 Jul 01 10:29:45.013364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 471/937] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:45.096358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:45.096968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:45.103848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:45.104290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.105084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:45.105541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.260167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d693ab18-b493-4d12-92dc-affb7e7abbe7 req-1ba952fd-910a-4520-b27b-74c1de395c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbbd6ec-d31e-490a-aed8-42c91588b237", "tag": "a82ff7cb-ace7-47d6-b072-2131b708ad9c"}, {"server_uuid": "c3168707-cb17-4267-a005-2e7307e2a168", "name": "network-vif-deleted", "tag": "91243b24-22ec-4412-9749-7b98ca290584"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:45.261292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:45.268993 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64daf783-cb1b-4439-955d-e708ecf79c12 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.176486 Jul 01 10:29:45.269597 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 467/938] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:45 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:45.269742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d693ab18-b493-4d12-92dc-affb7e7abbe7 req-1ba952fd-910a-4520-b27b-74c1de395c87 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:45.272803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d693ab18-b493-4d12-92dc-affb7e7abbe7 req-1ba952fd-910a-4520-b27b-74c1de395c87 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.291873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d693ab18-b493-4d12-92dc-affb7e7abbe7 req-1ba952fd-910a-4520-b27b-74c1de395c87 service nova] Creating event network-changed:a82ff7cb-ace7-47d6-b072-2131b708ad9c for instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 on n-h1-master-1 Jul 01 10:29:45.292438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d693ab18-b493-4d12-92dc-affb7e7abbe7 req-1ba952fd-910a-4520-b27b-74c1de395c87 service nova] Creating event network-vif-deleted:91243b24-22ec-4412-9749-7b98ca290584 for instance c3168707-cb17-4267-a005-2e7307e2a168 on n-h2-master-1 Jul 01 10:29:45.301433 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d693ab18-b493-4d12-92dc-affb7e7abbe7 req-1ba952fd-910a-4520-b27b-74c1de395c87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044991 Jul 01 10:29:45.302339 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 472/939] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:29:45.648878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:45.649559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:45.657942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:45.658582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.660136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:45.660744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.720625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:45.723709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:45.734761 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:45.736997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:45.741516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.742909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:45.745216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:45.959660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:45.972940 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a63faf87-17f9-44db-8dd1-45639844d13a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1317 microversion: 2.1 time: 0.330218 Jul 01 10:29:45.982571 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 468/940] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:45 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:45.996752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:46.000178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:46.012488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.012946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.015463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.015921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.077945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.078402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.078862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lazy-loading 'fault' on Instance uuid c3168707-cb17-4267-a005-2e7307e2a168 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:46.301661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:46.316970 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fbe0ca3b-e5e7-4c98-a64c-087cac87ce36 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 200 len: 1314 microversion: 2.1 time: 0.331362 Jul 01 10:29:46.321484 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 469/941] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:45 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:46.335031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:46.335827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:46.345114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.345797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.346612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.347627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.449273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:46.451792 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:46.459454 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d614079-190d-4271-9552-6f25169b916e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1379 microversion: 2.1 time: 0.750996 Jul 01 10:29:46.463673 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 473/942] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:45 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1379 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:29:46.476589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:46.482409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:46.483153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:46.491375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.491823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.492606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.493044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.507799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:46.509436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:46.510596 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e90cd6c-8d45-4f63-b7fb-de942ab2635d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1321 microversion: 2.25 time: 0.188101 Jul 01 10:29:46.516550 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 470/943] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:46 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:46.522186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:46.530026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:46.540236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.545311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.545311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:46.545311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:46.870072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:46.882373 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78db6443-9da5-4e57-a7d2-1877f389bd48 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.417431 Jul 01 10:29:46.882975 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 474/944] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:46 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:46.892358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:46.900637 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a76a61cb-1095-40f9-b443-c181d5a50c5e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.382641 Jul 01 10:29:46.911049 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 471/945] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:46 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:46.992071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:46.992839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:47.007790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.008341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.010066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.010606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.334711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:47.342171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:47.342433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:47.343498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.343938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.351606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.352129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.353786 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-441ab010-5bea-402d-b357-c786e186b425 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1317 microversion: 2.1 time: 0.366169 Jul 01 10:29:47.368329 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 475/946] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:46 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:47.387658 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 HTTP/1.1 Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:29:47.387889 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: exception: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:29:47.389573 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c3168707-cb17-4267-a005-2e7307e2a168'} Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:47.390483 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:29:47.391872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:29:47.393947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:47.394968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b35d609-b6eb-416d-ac53-df00dd4f2063 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 404 len: 111 microversion: 2.1 time: 0.064967 Jul 01 10:29:47.395685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 472/947] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:47 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:29:47.411655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cbf2871f-0ac6-47b6-802b-23bbd4f5926a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'create', calling method: .version_select at 0x7f6f91f565e0>, body: {"keypair": {"name": "tempest-keypair-38193025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0zliGZxFWv2JWmzaSp74kgXyjCYvdHGdmBiQf5qAWtSWdL/tQeSYXJRSYx3tNhwAnTA66Z2h2Hwcs7QOlXLpFEnFl0TyVn46fKwzNsm1pf9X+tqCRMjD8G8GyQA914bg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:47.444615 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=37 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:47.449994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-cbf2871f-0ac6-47b6-802b-23bbd4f5926a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:47.455814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-cbf2871f-0ac6-47b6-802b-23bbd4f5926a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for user 877a848749ec4975beaf9ec07bc3b2e6 and project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:47.481373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:47.482611 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:47.496168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.498514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.501232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.501890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.594768 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cbf2871f-0ac6-47b6-802b-23bbd4f5926a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.187614 Jul 01 10:29:47.604751 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 476/948] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:29:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:47.617021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:47.617949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:47.633107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.633868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.634804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.636221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.846079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:47.856472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:47.858928 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:47.860389 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87b98a78-3de5-4d18-85ba-9e39ab1f792f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1319 microversion: 2.25 time: 0.254095 Jul 01 10:29:47.861188 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 477/949] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:47 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:47.906015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:47.908073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:47.920641 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.922012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:47.924426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:47.926482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:48.390760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:48.402283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a6764c0-3dea-4f20-887f-0aaaa3e83d36 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1379 microversion: 2.1 time: 0.925963 Jul 01 10:29:48.403190 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 473/950] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:47 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1379 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:48.408809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:48.414719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:48.420504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:48.421193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:48.422337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:48.423002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:48.663718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:48.671203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d706b6d-71a3-4869-a811-510e534989e5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.774385 Jul 01 10:29:48.671791 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 478/951] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:47 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:48.685189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-79cf5d9a-beeb-46f4-889a-5f03616edb7e req-361459de-9444-491a-b9f5-70bab9240aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b33f4f-5006-4385-a6ed-3568077e187d", "name": "network-vif-plugged", "status": "completed", "tag": "3d39a985-0d0e-4eb6-a0ac-66e646f5e96f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:48.693124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-79cf5d9a-beeb-46f4-889a-5f03616edb7e req-361459de-9444-491a-b9f5-70bab9240aa2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:48.693596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-79cf5d9a-beeb-46f4-889a-5f03616edb7e req-361459de-9444-491a-b9f5-70bab9240aa2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:48.707157 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-79cf5d9a-beeb-46f4-889a-5f03616edb7e req-361459de-9444-491a-b9f5-70bab9240aa2 service nova] Creating event network-vif-plugged:3d39a985-0d0e-4eb6-a0ac-66e646f5e96f for instance f5b33f4f-5006-4385-a6ed-3568077e187d on n-h2-master-1 Jul 01 10:29:48.712667 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-79cf5d9a-beeb-46f4-889a-5f03616edb7e req-361459de-9444-491a-b9f5-70bab9240aa2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031245 Jul 01 10:29:48.713661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 479/952] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:48.719296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:48.720234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:48.728170 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:48.728833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:48.732881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:48.733894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:48.771409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:48.793679 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cbc59da0-0bbc-4efb-8ff6-c3cccb18701f tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.388530 Jul 01 10:29:48.798938 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 474/953] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:48 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:48.881131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:48.881774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:48.892251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:48.892699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:48.893507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:48.900983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.246147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:49.246147 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-25bb886d-13ae-48ef-a7cf-d08dd0b8ebdf tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1317 microversion: 2.1 time: 0.526509 Jul 01 10:29:49.246147 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 480/954] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:48 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:49.260439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:49.274746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:49.281775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:49.283430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-399cf948-b76b-4920-a435-3570aa18679f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.407898 Jul 01 10:29:49.286126 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 475/955] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:48 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:29:49.419939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:49.420679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:49.428967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.428967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.429899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.430645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.467471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec7a108e-ec02-420f-92e2-aaa2b63aa4ad tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:49.473412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec7a108e-ec02-420f-92e2-aaa2b63aa4ad tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:49.503637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec7a108e-ec02-420f-92e2-aaa2b63aa4ad tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.509292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec7a108e-ec02-420f-92e2-aaa2b63aa4ad tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.510497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec7a108e-ec02-420f-92e2-aaa2b63aa4ad tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.512611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec7a108e-ec02-420f-92e2-aaa2b63aa4ad tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.573433 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec7a108e-ec02-420f-92e2-aaa2b63aa4ad tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117695 Jul 01 10:29:49.584286 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 476/956] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:29:49 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:49.584689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:49.585069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:49.591744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.592180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.593297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.593915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.616817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:49.627855 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3c479ac3-0736-439d-a564-24b7f174f9f7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1379 microversion: 2.1 time: 0.211853 Jul 01 10:29:49.629008 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 481/957] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:49 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1379 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:49.689119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:49.691304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:49.727124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.727885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.728871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:49.731924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:49.820598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lazy-loading 'services' on Instance uuid 44b75a0d-c563-4a81-ad59-be51d81abb3e {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:49.984889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:49.994687 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0166ae6d-81c6-4b4b-bfb8-d6fbe39f182c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.310500 Jul 01 10:29:50.006218 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 482/958] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:49 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:50.021393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:50.022300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:50.030104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.030994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.031985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.033070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.234032 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a3d0b6b0-8152-4bfc-91e4-7317ea43c195 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "DELETE /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments/b8f46eed-bf4e-4853-af98-07e466bda7f8" status: 202 len: 0 microversion: 2.1 time: 0.653789 Jul 01 10:29:50.238064 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 477/959] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:29:49 2022] DELETE /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments/b8f46eed-bf4e-4853-af98-07e466bda7f8 => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:29:50.242562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b8926ec2-af1b-4c09-b813-9fa1be2c93d2 req-19c2c47b-8865-4017-84f9-7f8b7dc959b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7ba1c8-0f5a-4f84-9378-d4ab844795e0", "tag": "959de9bf-4dd5-436d-bc7b-c7385ccfdaa0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:50.249647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:50.261719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b8926ec2-af1b-4c09-b813-9fa1be2c93d2 req-19c2c47b-8865-4017-84f9-7f8b7dc959b7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.262160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b8926ec2-af1b-4c09-b813-9fa1be2c93d2 req-19c2c47b-8865-4017-84f9-7f8b7dc959b7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.272658 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-660e1a5d-aa91-498f-8be5-caecf808ad50 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.258210 Jul 01 10:29:50.272658 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 483/960] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:50 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:50.272658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:50.273660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:50.282904 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b8926ec2-af1b-4c09-b813-9fa1be2c93d2 req-19c2c47b-8865-4017-84f9-7f8b7dc959b7 service nova] Creating event network-changed:959de9bf-4dd5-436d-bc7b-c7385ccfdaa0 for instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 on n-h2-master-1 Jul 01 10:29:50.287430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b8926ec2-af1b-4c09-b813-9fa1be2c93d2 req-19c2c47b-8865-4017-84f9-7f8b7dc959b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050823 Jul 01 10:29:50.290196 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 478/961] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:50.293292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.299340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.299340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.299340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.323604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:50.324371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:50.338049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.338419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.339215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.340511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.590938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:50.601933 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c9d7204f-ddd9-45b0-82a0-4396b90afe4e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1317 microversion: 2.1 time: 0.333518 Jul 01 10:29:50.603217 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 484/962] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:50 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:50.615523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:50.623516 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:50.625367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:50.626670 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9788fe27-564f-42e5-bef1-070c7d241a70 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.324683 Jul 01 10:29:50.627591 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 479/963] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:50 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:50.646155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:50.646771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:50.653084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.653550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.654312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.654741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.740901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-25a2fcdb-4036-47a3-aab5-9d26b6d3187b req-f61a41fa-98da-4497-a072-191bb9c95be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43b75c0-e10d-4c17-bee5-19bf28959a94", "name": "network-vif-plugged", "status": "completed", "tag": "db63aca7-c13d-4316-887a-56d63f9aa667"}, {"server_uuid": "f9245057-43b9-492e-8f86-ac014664d207", "name": "network-vif-plugged", "status": "completed", "tag": "c0c447ef-8eab-4c35-96c1-29d659a0f21b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:50.756705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-25a2fcdb-4036-47a3-aab5-9d26b6d3187b req-f61a41fa-98da-4497-a072-191bb9c95be1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:50.757598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-25a2fcdb-4036-47a3-aab5-9d26b6d3187b req-f61a41fa-98da-4497-a072-191bb9c95be1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:50.785200 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-25a2fcdb-4036-47a3-aab5-9d26b6d3187b req-f61a41fa-98da-4497-a072-191bb9c95be1 service nova] Creating event network-vif-plugged:db63aca7-c13d-4316-887a-56d63f9aa667 for instance e43b75c0-e10d-4c17-bee5-19bf28959a94 on n-h1-master-1 Jul 01 10:29:50.786112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-25a2fcdb-4036-47a3-aab5-9d26b6d3187b req-f61a41fa-98da-4497-a072-191bb9c95be1 service nova] Creating event network-vif-plugged:c0c447ef-8eab-4c35-96c1-29d659a0f21b for instance f9245057-43b9-492e-8f86-ac014664d207 on n-h2-master-1 Jul 01 10:29:50.805575 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-25a2fcdb-4036-47a3-aab5-9d26b6d3187b req-f61a41fa-98da-4497-a072-191bb9c95be1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069062 Jul 01 10:29:50.805575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 480/964] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:29:50.819121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:50.827329 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7383d780-dcc2-4677-bdf2-169ff1594e72 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1379 microversion: 2.1 time: 0.185776 Jul 01 10:29:50.829513 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 485/965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:50 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1379 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:51.025716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:51.026553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:51.036165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.038575 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.038575 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.039135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.209392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:51.213434 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:51.218482 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3177fc39-82e8-47e4-a06b-3fbc112af93b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.199776 Jul 01 10:29:51.219295 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 481/966] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:51 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:51.288273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:51.289750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:51.307370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.308073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.309021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.309664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.520085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:51.528255 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6dc25c99-0f7b-4f7b-b6a0-d5e7ecf9fac2 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1319 microversion: 2.1 time: 0.244290 Jul 01 10:29:51.535205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 486/967] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:51 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:51.621586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:51.621586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:51.637553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.638233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.639881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.640731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.645863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:51.653098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:51.658719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.659180 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.660102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.660530 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.838307 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:51.956142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:51.967467 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ffde9e3-c728-44c7-995e-1829d16b96c6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1465 microversion: 2.1 time: 0.351724 Jul 01 10:29:51.969704 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 482/968] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:51 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1465 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:51.971010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:51.976636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:51.977443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:51.983180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:51.985198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.991010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:51.991174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:51.991174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:51.991342 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d04d31c-4316-4143-9342-b7b709a3e6f2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.346010 Jul 01 10:29:51.991420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.001122 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 487/969] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:51 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:52.007812 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1568f021-3e84-4548-a5a4-cea900644c56 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:52.008623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1568f021-3e84-4548-a5a4-cea900644c56 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:52.018230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1568f021-3e84-4548-a5a4-cea900644c56 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.022128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1568f021-3e84-4548-a5a4-cea900644c56 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.022128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1568f021-3e84-4548-a5a4-cea900644c56 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.022128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1568f021-3e84-4548-a5a4-cea900644c56 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.353173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:52.363265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-089b7f67-1349-419c-a496-9db0f36f703f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1379 microversion: 2.1 time: 0.392289 Jul 01 10:29:52.379499 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 483/970] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:51 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1379 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:52.384854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:52.387815 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1568f021-3e84-4548-a5a4-cea900644c56 tempest-ServersOnMultiNodesTest-571885063 tempest-ServersOnMultiNodesTest-571885063-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1616 microversion: 2.1 time: 0.385206 Jul 01 10:29:52.388443 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 488/971] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:52 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1616 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:52.389131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:52.395980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.396485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.397323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.397763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.416517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:52.416517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:52.418269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.418714 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.419488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.420243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.448330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:29:52.711087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:52.720919 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-555ddf16-4dfd-4f68-8cd0-7c378e9174b5 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 204 len: 0 microversion: 2.1 time: 0.319101 Jul 01 10:29:52.725383 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 489/972] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:29:52 2022] DELETE /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:29:52.732017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:52.732735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:52.735383 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eff4bfed-0840-43f9-b53f-27290019c39e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.354454 Jul 01 10:29:52.744231 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 484/973] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:52 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:52.744756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-211879406", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:52.748583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.749587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.751190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:52.751709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:52.770446 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:52.816965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] validate_networks() for [('14a0a945-9224-4c59-b797-2941c9320d9a', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:52.993006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:53.001663 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1c05cd5d-561e-4e19-be62-2a2465ddce47 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1469 microversion: 2.1 time: 0.274655 Jul 01 10:29:53.002662 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 490/974] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:52 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:53.017076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:53.017817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:53.025060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.030623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.030623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.030623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.267972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:53.279496 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0b1ba081-66d4-4c95-9e11-c678b86c1bd6 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1471 microversion: 2.1 time: 0.271545 Jul 01 10:29:53.280292 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 491/975] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:53 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:53.291887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ca7b7183-183a-4724-9a92-5cbeaea1d134 req-774778fa-e70f-49a0-aebb-a0ed651323fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbbd6ec-d31e-490a-aed8-42c91588b237", "name": "network-vif-plugged", "status": "completed", "tag": "a82ff7cb-ace7-47d6-b072-2131b708ad9c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:53.303238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ca7b7183-183a-4724-9a92-5cbeaea1d134 req-774778fa-e70f-49a0-aebb-a0ed651323fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.303884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ca7b7183-183a-4724-9a92-5cbeaea1d134 req-774778fa-e70f-49a0-aebb-a0ed651323fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.325246 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ca7b7183-183a-4724-9a92-5cbeaea1d134 req-774778fa-e70f-49a0-aebb-a0ed651323fb service nova] Creating event network-vif-plugged:a82ff7cb-ace7-47d6-b072-2131b708ad9c for instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 on n-h1-master-1 Jul 01 10:29:53.337874 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ca7b7183-183a-4724-9a92-5cbeaea1d134 req-774778fa-e70f-49a0-aebb-a0ed651323fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049392 Jul 01 10:29:53.339099 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 492/976] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:53.346632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:53.348288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:53.356326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.356968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.357867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.358678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.504989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:53.505914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:53.506496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:53.507103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:53.507723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:53.524662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.536027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.539140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.540103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.576881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:53.581920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for user 877a848749ec4975beaf9ec07bc3b2e6 and project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:53.608863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:53.614653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:53.643664 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:53.700457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:53.712577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:53.714444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:53.716816 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-50e9b459-abe1-49e7-9685-a716e9af961b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.376715 Jul 01 10:29:53.718135 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 493/977] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:53 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:53.787454 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b7c20407-83bc-4396-8694-02d15e42edd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.045781 Jul 01 10:29:53.790468 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 485/978] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:53.801885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:53.805996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:53.819204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.824024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:53.824024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:53.824024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.089013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1490361837", "block_migration": true, "disk_over_commit": false}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:54.091018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:54.105431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.105905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.108208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.108917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.158788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lazy-loading 'flavor' on Instance uuid e43b75c0-e10d-4c17-bee5-19bf28959a94 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:54.176507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:54.185615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Going to try to live migrate instance to tempest-host-1490361837 {{(pid=119765) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:29:54.188099 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b4eb6d4-4941-48f6-9399-d2727338212a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1528 microversion: 2.1 time: 0.396434 Jul 01 10:29:54.190408 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 486/979] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:53 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:54.194107 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] HTTP exception thrown: Compute host tempest-host-1490361837 could not be found. Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Request method failure captured: Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94/action HTTP/1.1 Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 107 Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsyEto0232avyg9mE6Z6ERhw1T9wK_R68sfPVswSYaq-aM3uzWepP1ZerhpPx9sqLd133I1a3QQbww_C0A4vkhQNiiRIRYcKWmASNZkkUsUrkv_M3HeklgIScEnDyK7Y1tQjxI0ogSjo7BXLCjkdrpKFoLIbEWENsqqaVVsmNEsCwi0 Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: f9efb94b84a242e8a0f4862ad537a8f8 Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveMigrationNegativeTest-1655646106 Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:29:54.203729 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9efb94b84a242e8a0f4862ad537a8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9efb94b84a242e8a0f4862ad537a8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9efb94b84a242e8a0f4862ad537a8f8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9efb94b84a242e8a0f4862ad537a8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveMigrationNegativeTest-1655646106 Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: f9efb94b84a242e8a0f4862ad537a8f8 Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1655646106 Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveMigrationNegativeTest-1655646106-project-admin Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 10afca57d51a4d4688ddd2031cad6a14 Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveMigrationNegativeTest-1655646106-project-admin Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: {"os-migrateLive": {"host": "tempest-host-1490361837", "block_migration": true, "disk_over_commit": false}} Jul 01 10:29:54.205663 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: exception: Compute host tempest-host-1490361837 could not be found. Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e43b75c0-e10d-4c17-bee5-19bf28959a94', 'body': {'os-migrateLive': {'host': 'tempest-host-1490361837', 'block_migration': True, 'disk_over_commit': False}}} Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:29:54.206587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1490361837 could not be found. Jul 01 10:29:54.207984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1490361837 could not be found. Jul 01 10:29:54.209352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1490361837 could not be found. Jul 01 10:29:54.210842 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:54.211439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:54.211439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:54.214988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Returning 400 to user: Compute host tempest-host-1490361837 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:54.216442 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d70aa741-a842-4f92-b173-00249db547ac tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94/action" status: 400 len: 100 microversion: 2.1 time: 0.492322 Jul 01 10:29:54.222334 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 494/980] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Jul 1 10:29:53 2022] POST /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94/action => generated 100 bytes in 495 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:29:54.227654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a60fdd1d-10c5-4845-8909-e87ad8774247 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:54.228594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a60fdd1d-10c5-4845-8909-e87ad8774247 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:54.229982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.230512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.232160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.233035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.332331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a60fdd1d-10c5-4845-8909-e87ad8774247 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:54.342436 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a60fdd1d-10c5-4845-8909-e87ad8774247 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1224 microversion: 2.1 time: 0.119620 Jul 01 10:29:54.354848 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 495/981] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:54 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:54.359972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:54.360721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:54.371481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.372155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.373188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.374303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.578345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:54.585318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:54.591754 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc83cb53-1490-4623-b890-2142a2b7b473 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1314 microversion: 2.1 time: 0.398957 Jul 01 10:29:54.595742 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e3f1e87-0f51-4336-9823-5c2467fdab31 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1528 microversion: 2.1 time: 0.239674 Jul 01 10:29:54.598085 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 496/982] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:54 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1528 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:54.608762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 487/983] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:54 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:54.612315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:54.612938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:54.616630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:54.617480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:54.635213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.635666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.636450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.636880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.638884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.640649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.645688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.646418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.878919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:54.890162 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-df946f28-bc20-4cb9-b2c5-db1d6680fb98 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1469 microversion: 2.1 time: 0.286646 Jul 01 10:29:54.890756 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 488/984] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:54 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:54.896031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31806e8b-c7fa-4fd3-b1eb-e4ebef0ab17e tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:54.905625 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:29:54.905625 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:29:54.919689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:54.933543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eb63f270-ec6d-42a4-86ac-7322040edf0e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1471 microversion: 2.1 time: 0.323215 Jul 01 10:29:54.934127 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 497/985] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:54 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:54.962846 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:54.963913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:54.977191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.981270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.982382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:54.986652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:54.996620 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31806e8b-c7fa-4fd3-b1eb-e4ebef0ab17e tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/5a3d5174-dbad-4e84-b4b0-cd0f8c868564" status: 202 len: 0 microversion: 2.1 time: 0.103733 Jul 01 10:29:55.002410 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 489/986] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:29:54 2022] DELETE /compute/v2.1/flavors/5a3d5174-dbad-4e84-b4b0-cd0f8c868564 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:29:55.015462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ef0f6b0-5779-48a2-8972-022a6d203143 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:55.083766 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4ef0f6b0-5779-48a2-8972-022a6d203143 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075652 Jul 01 10:29:55.099103 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 490/987] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:29:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:55.114968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:55.116207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:55.129124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:55.129792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:55.130767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:55.133380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:55.276876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:55.294954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:55.297089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:55.298321 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f4401c12-9a41-4f15-9dfe-205c4ae46806 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.351909 Jul 01 10:29:55.298953 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 498/988] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:54 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:55.317712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-182857211", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:55.332481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:55.345308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Old instance type tempest-test_resize_flavor_-11681065, new instance type m1.heat {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 10:29:55.367545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:55.368549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:55.368741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:55.369374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:55.369731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:55.393742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:29:55.719473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:29:55.725346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:29:55.725346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:29:55.725346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:29:55.725346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:29:55.744851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:55.745665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:55.746959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:55.747606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:55.771053 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9e85cc2-3595-4e7c-8bc3-7a857ec6c41b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207/action" status: 202 len: 0 microversion: 2.1 time: 0.661284 Jul 01 10:29:55.775261 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 491/989] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:29:55 2022] POST /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:29:55.777278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Getting quotas for project 06fc685846434344b8b938ccb1dae960. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:29:55.783242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Getting quotas for user 315591357d264b42938cf6eab54a699a and project 06fc685846434344b8b938ccb1dae960. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:29:55.791045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-069418ae-2cb8-47dd-9012-c87f945d8d4b req-e602ef67-234d-4c61-a9d3-b1c00b9cfa68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672", "name": "network-vif-plugged", "status": "completed", "tag": "75426cac-af1d-4dc1-8b63-4c327a9be5a5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:55.798993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:29:55.803573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:29:55.820802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-069418ae-2cb8-47dd-9012-c87f945d8d4b req-e602ef67-234d-4c61-a9d3-b1c00b9cfa68 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:55.822278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-069418ae-2cb8-47dd-9012-c87f945d8d4b req-e602ef67-234d-4c61-a9d3-b1c00b9cfa68 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:55.837207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-069418ae-2cb8-47dd-9012-c87f945d8d4b req-e602ef67-234d-4c61-a9d3-b1c00b9cfa68 service nova] Creating event network-vif-plugged:75426cac-af1d-4dc1-8b63-4c327a9be5a5 for instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 on n-h1-master-1 Jul 01 10:29:55.844038 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-069418ae-2cb8-47dd-9012-c87f945d8d4b req-e602ef67-234d-4c61-a9d3-b1c00b9cfa68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065228 Jul 01 10:29:55.845699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 492/990] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:55.857289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:55.858465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:55.867829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:55.868449 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:55.869640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:55.870298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.016731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:56.024462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b212ca2-8d20-40a9-98ee-8653885346a8 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710659 Jul 01 10:29:56.031914 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 499/991] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:29:56.033694 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a0915578-c87d-46e2-b102-6c57b4f4b6c9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1220 microversion: 2.1 time: 0.185500 Jul 01 10:29:56.036018 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 493/992] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:55 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1220 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:56.038790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:56.039667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:56.052234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:56.056148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:56.068167 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.068802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.069612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.071204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.083354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.084162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.085268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.090573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.594623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:56.605180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:56.607186 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-be8134be-a2d5-4f5d-ab36-f9348baa6d10 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1464 microversion: 2.1 time: 0.573733 Jul 01 10:29:56.608782 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 500/993] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:56 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1464 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:56.620192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc44264a-2be5-4d5b-aa61-f858f9350a12 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1537 microversion: 2.1 time: 0.576507 Jul 01 10:29:56.620192 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 494/994] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:56 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1537 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:56.631340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:56.638112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:56.651594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-799c021c-1625-4b52-aacb-a5b2937da598 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:56.654111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-799c021c-1625-4b52-aacb-a5b2937da598 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:56.665969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.666759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.670748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.670748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.771619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-799c021c-1625-4b52-aacb-a5b2937da598 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:56.790927 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-799c021c-1625-4b52-aacb-a5b2937da598 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1218 microversion: 2.1 time: 0.156414 Jul 01 10:29:56.793038 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 501/995] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:56 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:56.809263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:56.810292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:56.828573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.830419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.833070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.833569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.869586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:56.879327 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f971ccbe-1773-4cd6-b1e6-e60579f109eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1429 microversion: 2.1 time: 0.263985 Jul 01 10:29:56.887388 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 495/996] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:56 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1429 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:56.904568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:56.909833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:56.920656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.921088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:56.923316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:56.924309 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:57.183731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:57.195539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:57.205416 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1df73f71-5612-40a3-bd9f-f1bd428f01af tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1314 microversion: 2.1 time: 0.316375 Jul 01 10:29:57.206628 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 496/997] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:56 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:57.212052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:57.213584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:57.215577 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6c416a9-23c1-41ab-bbfe-850da6e4c5c4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.420073 Jul 01 10:29:57.216146 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 502/998] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:56 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:57.227046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:57.227046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:57.230144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:57.231872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:57.231872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:57.241951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:57.358504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:57.370904 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b460126-f903-4b76-9f73-a326be457b54 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1294 microversion: 2.1 time: 0.162722 Jul 01 10:29:57.373685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 497/999] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:57 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1294 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:57.561839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-15e25ac3-6313-47bc-b30d-aa342790a9e4 req-bd406a0f-a2a6-4caf-a266-2a58067f462a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b33f4f-5006-4385-a6ed-3568077e187d", "name": "network-vif-deleted", "tag": "3d39a985-0d0e-4eb6-a0ac-66e646f5e96f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:29:57.577329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-15e25ac3-6313-47bc-b30d-aa342790a9e4 req-bd406a0f-a2a6-4caf-a266-2a58067f462a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:57.578748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-15e25ac3-6313-47bc-b30d-aa342790a9e4 req-bd406a0f-a2a6-4caf-a266-2a58067f462a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:57.606481 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-15e25ac3-6313-47bc-b30d-aa342790a9e4 req-bd406a0f-a2a6-4caf-a266-2a58067f462a service nova] Creating event network-vif-deleted:3d39a985-0d0e-4eb6-a0ac-66e646f5e96f for instance f5b33f4f-5006-4385-a6ed-3568077e187d on n-h2-master-1 Jul 01 10:29:57.619258 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-15e25ac3-6313-47bc-b30d-aa342790a9e4 req-bd406a0f-a2a6-4caf-a266-2a58067f462a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060703 Jul 01 10:29:57.623210 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 503/1000] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:29:57.630924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:57.631865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:57.646604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:57.647281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:57.650616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:57.654548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:57.810800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:57.811517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:57.822020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:57.822468 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:57.823254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:57.823689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.027471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.038391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-79fbabec-2fb7-4187-80d6-e1562c5f7f6e tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1222 microversion: 2.1 time: 0.232173 Jul 01 10:29:58.039180 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 504/1001] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:57 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:58.072705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:58.075526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:58.088800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.103402 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae683b59-e71b-4cc1-a7d5-85546441f583 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1537 microversion: 2.1 time: 0.476219 Jul 01 10:29:58.109950 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 498/1002] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:57 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1537 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:58.115938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.115938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.116693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.117133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.174500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-047c5a0c-e144-4855-b32d-aaa76c99032a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:58.175961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-047c5a0c-e144-4855-b32d-aaa76c99032a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:58.188144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-047c5a0c-e144-4855-b32d-aaa76c99032a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.188643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-047c5a0c-e144-4855-b32d-aaa76c99032a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.189562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-047c5a0c-e144-4855-b32d-aaa76c99032a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.190195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-047c5a0c-e144-4855-b32d-aaa76c99032a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.201697 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:58.209055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.211711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.212566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lazy-loading 'fault' on Instance uuid f5b33f4f-5006-4385-a6ed-3568077e187d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:29:58.245857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-047c5a0c-e144-4855-b32d-aaa76c99032a tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075222 Jul 01 10:29:58.247438 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 499/1003] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:29:58 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:29:58.253833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:58.254812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:58.264708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.265919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.267014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.267666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.287126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.295818 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-08bc0e92-745b-4b37-9e43-031560f2fbb3 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 200 len: 1307 microversion: 2.1 time: 0.253443 Jul 01 10:29:58.296399 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 505/1004] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:58 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:58.306007 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:29:58.312345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:58.313459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:58.322015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.322735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.323992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.324603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.495809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.509116 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b43486af-e19c-4f48-85bd-55c7920e6db9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1314 microversion: 2.1 time: 0.259749 Jul 01 10:29:58.509926 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 500/1005] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:58 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:58.531148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:58.531761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:58.561181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.562534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.563293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:58.563723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:58.604547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.618272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.619786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.620905 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e64ea70f-74ca-4303-a6c6-f21e0292a238 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.313381 Jul 01 10:29:58.623885 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 506/1006] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:29:58 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:29:58.668529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:58.679483 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-987a60e4-fd3d-456f-933e-790894f79e8a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1282 microversion: 2.1 time: 0.168420 Jul 01 10:29:58.700180 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 501/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:58 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:59.056941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:59.057633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:59.070200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.071084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.072590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.073214 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.129535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:59.130421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:59.150996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.153253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.158595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.160101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.389794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:59.403320 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00ad3815-1755-43b9-a2fc-9d01cb2d3788 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1270 microversion: 2.1 time: 0.345521 Jul 01 10:29:59.413569 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 507/1008] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:59 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1270 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:59.418587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eede9eea-22f2-490e-b4ba-caaa0faea00e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:59.419645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eede9eea-22f2-490e-b4ba-caaa0faea00e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:59.433898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eede9eea-22f2-490e-b4ba-caaa0faea00e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.434662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eede9eea-22f2-490e-b4ba-caaa0faea00e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.437660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eede9eea-22f2-490e-b4ba-caaa0faea00e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.439591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eede9eea-22f2-490e-b4ba-caaa0faea00e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.513367 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eede9eea-22f2-490e-b4ba-caaa0faea00e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106335 Jul 01 10:29:59.515315 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 508/1009] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:29:59 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:29:59.547762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:59.549122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: f5b33f4f-5006-4385-a6ed-3568077e187d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:59.571307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.571780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.572875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.573021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.608504 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance f5b33f4f-5006-4385-a6ed-3568077e187d could not be found. Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d HTTP/1.1 Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:29:59.613434 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: exception: Instance f5b33f4f-5006-4385-a6ed-3568077e187d could not be found. Jul 01 10:29:59.614982 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'f5b33f4f-5006-4385-a6ed-3568077e187d'} Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b33f4f-5006-4385-a6ed-3568077e187d could not be found. Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:29:59.615914 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b33f4f-5006-4385-a6ed-3568077e187d could not be found. Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b33f4f-5006-4385-a6ed-3568077e187d could not be found. Jul 01 10:29:59.618143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:29:59.622902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance f5b33f4f-5006-4385-a6ed-3568077e187d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:29:59.624703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a6585f2-a201-490d-a440-5c59c5e2e401 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d" status: 404 len: 111 microversion: 2.1 time: 0.108085 Jul 01 10:29:59.629125 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 509/1010] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:59 2022] GET /compute/v2.1/servers/f5b33f4f-5006-4385-a6ed-3568077e187d => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:29:59.635913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:59.651163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:59.651163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.651163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.651163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.652138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.662325 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:59.676866 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-41954bdc-9f31-450a-b101-2d3d9be0c7d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1537 microversion: 2.1 time: 0.553658 Jul 01 10:29:59.687715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 502/1011] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:59 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1537 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:59.692475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:59.693037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:29:59.708235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.708694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.709512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:29:59.709950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:29:59.753595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:29:59.959955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:29:59.981093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e6ca923e-48b6-43f4-932e-737020afed06 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1464 microversion: 2.1 time: 0.350494 Jul 01 10:29:59.982825 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 510/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:29:59 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:29:59.991499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f9564168-164f-4fab-b020-bd1c1aead908 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:29:59.993361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f9564168-164f-4fab-b020-bd1c1aead908 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:00.000100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9564168-164f-4fab-b020-bd1c1aead908 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.000816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9564168-164f-4fab-b020-bd1c1aead908 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.004877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9564168-164f-4fab-b020-bd1c1aead908 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.004877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9564168-164f-4fab-b020-bd1c1aead908 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.009403 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:00.075701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f9564168-164f-4fab-b020-bd1c1aead908 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091501 Jul 01 10:30:00.077858 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 511/1013] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:29:59 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:00.082679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:00.090625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:00.101675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.106345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.110326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.110963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.131711 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-913694ec-e700-44ec-8dee-19540485f26f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 204 len: 0 microversion: 2.1 time: 0.442785 Jul 01 10:30:00.132571 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 503/1014] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:29:59 2022] DELETE /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:00.137871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:00.138791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:00.156975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.157521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.158339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.158774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.531070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:00.551476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:00.552919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:00.553882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fbb5496e-806e-4b13-bfe1-a66eaf2156ab tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.474923 Jul 01 10:30:00.554763 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 512/1015] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:00 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:00.559520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ba0aa630-936d-4905-a9bd-77cc97270f66 req-8f877366-553b-4112-a99a-64a966aeaf2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7ba1c8-0f5a-4f84-9378-d4ab844795e0", "name": "network-vif-plugged", "status": "completed", "tag": "959de9bf-4dd5-436d-bc7b-c7385ccfdaa0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:00.603650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ba0aa630-936d-4905-a9bd-77cc97270f66 req-8f877366-553b-4112-a99a-64a966aeaf2e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.604331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ba0aa630-936d-4905-a9bd-77cc97270f66 req-8f877366-553b-4112-a99a-64a966aeaf2e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.645236 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ba0aa630-936d-4905-a9bd-77cc97270f66 req-8f877366-553b-4112-a99a-64a966aeaf2e service nova] Creating event network-vif-plugged:959de9bf-4dd5-436d-bc7b-c7385ccfdaa0 for instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 on n-h2-master-1 Jul 01 10:30:00.660352 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ba0aa630-936d-4905-a9bd-77cc97270f66 req-8f877366-553b-4112-a99a-64a966aeaf2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104321 Jul 01 10:30:00.661320 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 513/1016] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:00.677869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:00.678594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:00.697443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.697738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.698536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:00.699235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:00.747332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:00.760388 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fddca944-5bd4-49e1-8c59-10bf8e8f2677 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.626375 Jul 01 10:30:00.762564 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 504/1017] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:00 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:00.768067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-687941027", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:00.860997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:30:01.777048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:01.786073 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0140e653-3891-4069-ab60-78eca2ac7965 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1472 microversion: 2.1 time: 1.123546 Jul 01 10:30:01.804364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 514/1018] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:00 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1472 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:01.809877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:01.812065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:01.827680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:01.828353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:01.829349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:01.832383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:01.885757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:01.953820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:30:01.954330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:30:01.954981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:30:01.957211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:30:01.959256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:30:01.977106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:01.977577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:01.978392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:01.978837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.042133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Getting quotas for project 1ca92b2cafba4257b5f4931764621897. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:02.047368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Getting quotas for user 832898660e1d480e8c85a12c9cfd5c02 and project 1ca92b2cafba4257b5f4931764621897. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:02.069745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:30:02.074074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:30:02.258551 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-89b70809-dd1a-4605-a9b5-78b5979211b1 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "DELETE /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 204 len: 0 microversion: 2.1 time: 0.452328 Jul 01 10:30:02.262676 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 515/1019] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:01 2022] DELETE /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:02.269113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:02.270123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:02.280961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-97864f91-7838-41c3-838e-ac0f0a953e5f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.517033 Jul 01 10:30:02.291929 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 505/1020] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:30:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:30:02.294936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.295886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.296915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.299191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.302651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:02.303551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:02.351602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.353139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.370451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.373846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.771168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:02.787372 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-109170be-c0a9-4222-b022-cdcbe0be5d11 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.522806 Jul 01 10:30:02.795435 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 516/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:02 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:02.803959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-42cc2b46-8a26-41c8-8907-bb1a97eeac53 req-3a01d2b6-3838-4a9a-ac54-34cb3873c253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9d6ca9-85e6-4713-ad73-a753e315637f", "tag": "6b4ab1fe-7a60-495f-9cf4-fa56c9c65a20"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:02.821742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-42cc2b46-8a26-41c8-8907-bb1a97eeac53 req-3a01d2b6-3838-4a9a-ac54-34cb3873c253 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.822319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-42cc2b46-8a26-41c8-8907-bb1a97eeac53 req-3a01d2b6-3838-4a9a-ac54-34cb3873c253 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.839226 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-42cc2b46-8a26-41c8-8907-bb1a97eeac53 req-3a01d2b6-3838-4a9a-ac54-34cb3873c253 service nova] Creating event network-changed:6b4ab1fe-7a60-495f-9cf4-fa56c9c65a20 for instance 7b9d6ca9-85e6-4713-ad73-a753e315637f on n-h2-master-1 Jul 01 10:30:02.844444 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-42cc2b46-8a26-41c8-8907-bb1a97eeac53 req-3a01d2b6-3838-4a9a-ac54-34cb3873c253 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047244 Jul 01 10:30:02.845815 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 517/1022] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:02.856833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:02.857800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:02.865681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.866479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.867457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.868086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.876771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:02.897979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-63280ca2-18f3-42b5-b413-196f82a58e05 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1537 microversion: 2.1 time: 0.603973 Jul 01 10:30:02.912375 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 506/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:02 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1537 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:02.920077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:02.922300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:02.934345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.935627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:02.936581 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:02.937903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.245748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:03.254018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:03.255496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:03.256590 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fb1dd3bd-9f15-4841-a1b6-36e1cc6dc701 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1361 microversion: 2.25 time: 0.408906 Jul 01 10:30:03.257049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:03.257521 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 518/1024] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:02 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:03.261969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:03.262713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:03.266455 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d07e0fb1-2ff6-44ea-95b3-b14de86af77a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.351392 Jul 01 10:30:03.270362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.270980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.271973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.272431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.275256 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 507/1025] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:02 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:03.282949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:03.283678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:03.292589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.293053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.293874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.294313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.748280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:03.756134 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-363e4aa0-5d93-4b3f-a642-503817b6ea09 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1217 microversion: 2.1 time: 0.479554 Jul 01 10:30:03.756726 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 508/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:03 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1217 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:03.774051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:03.774925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:03.786311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.786311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.786311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.786311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.950572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:03.964297 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f9e0d61a-cbb8-481f-9c0f-fa94a8e6fa45 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1430 microversion: 2.1 time: 0.193790 Jul 01 10:30:03.966143 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 509/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:03 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1430 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:03.972394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:03.975644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:03.991840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.995505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:03.998819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:03.999341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.064243 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.082899 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-75290fd1-a19d-471b-9f2c-12c2ab841c4d tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1682 microversion: 2.1 time: 0.822133 Jul 01 10:30:04.095257 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 519/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:03 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1682 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:04.110324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-23c0cdc4-119d-4bec-b12b-b8774b5fd33f req-6deaaacf-707d-4452-a1e8-ece46b15d62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60eb37ae-c715-4b54-ac72-b0dbb5f163fb", "name": "network-vif-deleted", "tag": "5a9a9ecb-d754-4e58-9a9b-f4b3e0c3807d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:04.133065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-23c0cdc4-119d-4bec-b12b-b8774b5fd33f req-6deaaacf-707d-4452-a1e8-ece46b15d62b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.134280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-23c0cdc4-119d-4bec-b12b-b8774b5fd33f req-6deaaacf-707d-4452-a1e8-ece46b15d62b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.161190 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-23c0cdc4-119d-4bec-b12b-b8774b5fd33f req-6deaaacf-707d-4452-a1e8-ece46b15d62b service nova] Creating event network-vif-deleted:5a9a9ecb-d754-4e58-9a9b-f4b3e0c3807d for instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb on n-h1-master-1 Jul 01 10:30:04.169434 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-23c0cdc4-119d-4bec-b12b-b8774b5fd33f req-6deaaacf-707d-4452-a1e8-ece46b15d62b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069412 Jul 01 10:30:04.170401 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 520/1029] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:04.176535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:04.177844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:04.185248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.185712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.186485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.197390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.370204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.380035 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c781d2be-ef6b-4982-a669-5930b169d657 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.412447 Jul 01 10:30:04.389923 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 510/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:03 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:04.395075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:04.395949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:04.402366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.402948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.403802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.404335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.469620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.477640 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c4dad7b-6205-4640-85d7-f8558c934ffd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1537 microversion: 2.1 time: 0.305397 Jul 01 10:30:04.478332 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 521/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:04 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:04.482759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:04.483399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:04.489806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.490326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.491082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.491675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.716162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.736247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.736247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.736247 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7150f89c-6b81-41d4-ab17-7ee8cd35cee9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1558 microversion: 2.25 time: 0.337826 Jul 01 10:30:04.736550 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 511/1032] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:04 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1558 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:04.753501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:04.754124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:04.759558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.761575 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.762033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.762813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.763250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.772095 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1da67f19-6dcb-4ed0-b617-3c798a5937cf tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.291996 Jul 01 10:30:04.773687 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 522/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:04 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:04.780446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:04.781355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:04.790280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.791581 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.792630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.793303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.891863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:04.905688 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9626e3a7-2eea-47ce-beba-69da54c3ad3a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1265 microversion: 2.1 time: 0.129608 Jul 01 10:30:04.906275 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 523/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:04 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:04.920517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-658b597f-5a1d-4a8f-898f-01d87e5dae58 req-3af0292f-81b0-4ff2-b238-555b04fc08c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "610b3d47-8df7-4d58-a7fd-aaeff3de4553", "tag": "7275b96c-4d48-4f7c-8112-3a73ee00f6fa"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:04.928879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-658b597f-5a1d-4a8f-898f-01d87e5dae58 req-3af0292f-81b0-4ff2-b238-555b04fc08c2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.929539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-658b597f-5a1d-4a8f-898f-01d87e5dae58 req-3af0292f-81b0-4ff2-b238-555b04fc08c2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.941710 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-658b597f-5a1d-4a8f-898f-01d87e5dae58 req-3af0292f-81b0-4ff2-b238-555b04fc08c2 service nova] Creating event network-changed:7275b96c-4d48-4f7c-8112-3a73ee00f6fa for instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 on n-h2-master-1 Jul 01 10:30:04.947131 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-658b597f-5a1d-4a8f-898f-01d87e5dae58 req-3af0292f-81b0-4ff2-b238-555b04fc08c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030248 Jul 01 10:30:04.947814 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 524/1035] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:04.956717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:04.970180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ddba6990-5282-40d1-84e6-79f31a0d8d9d tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 2050 microversion: 2.25 time: 0.226220 Jul 01 10:30:04.973277 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 512/1036] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:04 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 2050 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:04.983117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:04.984421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:04.991288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.999564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:04.999564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:04.999564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.022327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e171067-2017-47ae-8fd3-621209576e5f tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Calling method '.version_select at 0x7f6f91ecee50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:05.034678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:05.035681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.036400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lazy-loading 'fault' on Instance uuid 60eb37ae-c715-4b54-ac72-b0dbb5f163fb {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:05.126145 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e171067-2017-47ae-8fd3-621209576e5f tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.176866 Jul 01 10:30:05.130727 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 525/1037] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:30:04 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:05.140468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:05.143391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:05.149253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:05.149683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.153525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:05.160953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:05.165237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.170737 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-40b8ed36-c677-4232-98d4-ea32aa102971 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 200 len: 1306 microversion: 2.1 time: 0.192477 Jul 01 10:30:05.172029 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 513/1038] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:04 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:05.177874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:05.178939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:05.188304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:05.194303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.194303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:05.194303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.701968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:05.731224 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3084aa93-cff3-491f-b04f-8c6b338ad095 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 2050 microversion: 2.25 time: 0.598793 Jul 01 10:30:05.732026 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 526/1039] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:05 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 2050 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:05.752621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-955b7310-6569-45d8-af25-84853d2cad15 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Action: 'create', calling method: .version_select at 0x7f6f91ecd430>, body: {"pool": "non_exist_pool"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:05.759504 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:05.764796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:05.774234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43b46a8b-7ae5-4f4f-83d9-0f55f691aca0 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1682 microversion: 2.1 time: 0.599715 Jul 01 10:30:05.774234 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 514/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:05 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1682 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:05.785405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:05.785405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:05.799808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:05.799808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.799808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:05.799808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:05.828941 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:06.005447 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-955b7310-6569-45d8-af25-84853d2cad15 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] HTTP exception thrown: Floating IP pool not found. Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-955b7310-6569-45d8-af25-84853d2cad15 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Request method failure captured: Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 26 Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsysVKdHRVkkFcO2Oy63s7bMn7ICcHbaC2MbwzqkusrP1tSYCI0Ii3j73Tz5Q3cJUUEglwRTMViG28qKsszKiIZmCyR6kgkQJjSK3lIFq6pZjIV0CUgr0r4y3vuLmSTR9PXa-b1ttfH9UcsMSnKsDyzbz8xqssPfnFVrQk_ZGcHsCfI Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0316c71175204236aeb9cffca543be62 Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-218875850 Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:06.025130 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0316c71175204236aeb9cffca543be62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0316c71175204236aeb9cffca543be62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0316c71175204236aeb9cffca543be62", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0316c71175204236aeb9cffca543be62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-218875850 Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0316c71175204236aeb9cffca543be62 Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-218875850 Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FloatingIPsNegativeTestJSON-218875850-project Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: eb519d7bad86407b8e8e9a00843bb1ce Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-218875850-project Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: {"pool": "non_exist_pool"} Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: exception: Floating IP pool not found. Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 01 10:30:06.028031 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:06.029180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-955b7310-6569-45d8-af25-84853d2cad15 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Returning 404 to user: Floating IP pool not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:06.031425 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-955b7310-6569-45d8-af25-84853d2cad15 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.294268 Jul 01 10:30:06.033136 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 527/1041] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:30:05 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 296 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:30:06.040624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:06.042050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:06.055486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.055810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.056880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.057538 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.125976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:06.139540 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fccd0b71-05f7-42ba-a90e-f7347beb9416 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.363678 Jul 01 10:30:06.141546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 515/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:05 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:06.149874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bfb8fc42-1dcc-4f2a-a4c3-3a539d3bad38 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:06.151760 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:06.151760 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:30:06.158075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb8fc42-1dcc-4f2a-a4c3-3a539d3bad38 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.158902 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb8fc42-1dcc-4f2a-a4c3-3a539d3bad38 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.160672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb8fc42-1dcc-4f2a-a4c3-3a539d3bad38 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.161670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb8fc42-1dcc-4f2a-a4c3-3a539d3bad38 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.202252 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bfb8fc42-1dcc-4f2a-a4c3-3a539d3bad38 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.058778 Jul 01 10:30:06.203805 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 516/1043] 10.222.0.23 () {60 vars in 1216 bytes} [Fri Jul 1 10:30:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:30:06.217241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:06.217882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:06.220905 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=90,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:06.229654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.230108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.230904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.231343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.498900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:06.510838 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-18a0da5d-4c2d-401a-8766-8a6f1bf30f33 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.481836 Jul 01 10:30:06.511657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 528/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:06 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:06.528861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:06.530339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:06.556055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:06.557987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.558833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.561012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.561693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.568681 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b39e269-ce71-4d23-9a30-dca68d80e1fd tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.363659 Jul 01 10:30:06.569274 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 517/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:06 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:06.592171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3acf2bc1-db36-4d03-b580-7fbb5903bfd9 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Calling method '.version_select at 0x7f6f9234fd30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:06.674057 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-3acf2bc1-db36-4d03-b580-7fbb5903bfd9 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9b8704b8-34fd-4cfc-b82d-0879d60ad773 could not be found", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:30:06.674057 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3acf2bc1-db36-4d03-b580-7fbb5903bfd9 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] HTTP exception thrown: Floating IP not found for ID 9b8704b8-34fd-4cfc-b82d-0879d60ad773 Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3acf2bc1-db36-4d03-b580-7fbb5903bfd9 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Request method failure captured: Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-floating-ips/9b8704b8-34fd-4cfc-b82d-0879d60ad773 HTTP/1.1 Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsysVKdHRVkkFcO2Oy63s7bMn7ICcHbaC2MbwzqkusrP1tSYCI0Ii3j73Tz5Q3cJUUEglwRTMViG28qKsszKiIZmCyR6kgkQJjSK3lIFq6pZjIV0CUgr0r4y3vuLmSTR9PXa-b1ttfH9UcsMSnKsDyzbz8xqssPfnFVrQk_ZGcHsCfI Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 0316c71175204236aeb9cffca543be62 Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-218875850 Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:06.700474 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0316c71175204236aeb9cffca543be62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0316c71175204236aeb9cffca543be62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0316c71175204236aeb9cffca543be62", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0316c71175204236aeb9cffca543be62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-218875850 Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 0316c71175204236aeb9cffca543be62 Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-218875850 Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsNegativeTestJSON-218875850-project Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: eb519d7bad86407b8e8e9a00843bb1ce Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-218875850-project Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: exception: Floating IP not found for ID 9b8704b8-34fd-4cfc-b82d-0879d60ad773 Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '9b8704b8-34fd-4cfc-b82d-0879d60ad773'} Jul 01 10:30:06.702268 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:30:06.703329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9b8704b8-34fd-4cfc-b82d-0879d60ad773 could not be found Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7941ca29-0a65-4798-a6f4-89276c0e88b2'] Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9b8704b8-34fd-4cfc-b82d-0879d60ad773. Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:06.704943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9b8704b8-34fd-4cfc-b82d-0879d60ad773 Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:06.710153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:06.711785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9b8704b8-34fd-4cfc-b82d-0879d60ad773 Jul 01 10:30:06.711785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.713909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3acf2bc1-db36-4d03-b580-7fbb5903bfd9 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] Returning 404 to user: Floating IP not found for ID 9b8704b8-34fd-4cfc-b82d-0879d60ad773 {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:06.716051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3acf2bc1-db36-4d03-b580-7fbb5903bfd9 tempest-FloatingIPsNegativeTestJSON-218875850 tempest-FloatingIPsNegativeTestJSON-218875850-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/9b8704b8-34fd-4cfc-b82d-0879d60ad773" status: 404 len: 111 microversion: 2.1 time: 0.136886 Jul 01 10:30:06.718643 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 518/1046] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:30:06 2022] DELETE /compute/v2.1/os-floating-ips/9b8704b8-34fd-4cfc-b82d-0879d60ad773 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:06.736727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:06.740327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 60eb37ae-c715-4b54-ac72-b0dbb5f163fb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:06.748468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:06.764102 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6018f1c-18df-4588-a675-938763c77b9b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1271 microversion: 2.1 time: 0.247747 Jul 01 10:30:06.767421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.771361 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 529/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:06 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:06.771768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.777413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.778031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-025e09a9-36ab-4768-b029-dc65af7b4bc3 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:06.778458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.778611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-025e09a9-36ab-4768-b029-dc65af7b4bc3 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:06.788044 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=13 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:06.793394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-025e09a9-36ab-4768-b029-dc65af7b4bc3 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.793394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-025e09a9-36ab-4768-b029-dc65af7b4bc3 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.793394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-025e09a9-36ab-4768-b029-dc65af7b4bc3 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.793755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-025e09a9-36ab-4768-b029-dc65af7b4bc3 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.807506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb could not be found. Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb HTTP/1.1 Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:06.811168 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb could not be found. Jul 01 10:30:06.812831 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '60eb37ae-c715-4b54-ac72-b0dbb5f163fb'} Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb could not be found. Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:06.813909 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb could not be found. Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb could not be found. Jul 01 10:30:06.815523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:06.819328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance 60eb37ae-c715-4b54-ac72-b0dbb5f163fb could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:06.820879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f3faa79-ed2a-400d-acd1-dd5a99331a23 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb" status: 404 len: 111 microversion: 2.1 time: 0.099032 Jul 01 10:30:06.825003 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 519/1048] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:06 2022] GET /compute/v2.1/servers/60eb37ae-c715-4b54-ac72-b0dbb5f163fb => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:06.836583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:06.837287 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:06.841933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:06.915473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.915473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:06.915473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:06.915473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:07.017733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d17628c74f54f0e8a7d24ae2db32a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e8ee98253b4773b72e3443d0ba2cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:07.029828 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56e9ffd2-e533-4e39-bfa5-b0ed97ec18f2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 200 len: 1615 microversion: 2.1 time: 0.203377 Jul 01 10:30:07.032136 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 520/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:06 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 1615 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:07.047234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:07.047738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:07.069687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:07.070410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:07.072459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:07.073096 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:07.137670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:07.247292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-025e09a9-36ab-4768-b029-dc65af7b4bc3 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0/action" status: 202 len: 0 microversion: 2.25 time: 0.471836 Jul 01 10:30:07.259033 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 530/1050] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:30:06 2022] POST /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:07.267721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:07.269709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:07.280193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:07.281080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:07.282605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:07.285091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:07.540990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-213eaa2f-fa52-4f3e-a66c-0b70376a6328 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 204 len: 0 microversion: 2.1 time: 0.503648 Jul 01 10:30:07.541822 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 521/1051] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:07 2022] DELETE /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:07.548852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:07.551356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:07.564572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:07.566280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:07.567334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:07.568577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.115029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:08.126993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:08.130417 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e6b6111c-fe9c-40cf-b55a-cc8d915d8cc2 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 2055 microversion: 2.25 time: 0.586330 Jul 01 10:30:08.134563 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 522/1052] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:07 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 2055 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:08.146013 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8bc9d904-a749-43ff-937a-96852f050125 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.876029 Jul 01 10:30:08.146013 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 531/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:07 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:08.150368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:08.151350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:08.158762 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:08.160832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:08.171337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.174774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.177905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.180126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.180591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.180888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.182275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.190557 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.469756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:08.478535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c164b745-3a65-4f29-8fb2-7c1d521a4460 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.342603 Jul 01 10:30:08.482483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:08.482623 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 523/1054] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:08 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:08.483826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:08.484442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:08.488771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e02fbb73-6d9a-4bdf-ab08-12d8c7ba82a7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1472 microversion: 2.1 time: 0.342278 Jul 01 10:30:08.500204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.500689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.501603 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 532/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:08 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1472 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:08.507847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-140c9160-815b-4746-b051-97b1edd29f9f req-696df488-80ba-4316-9716-4bd4db281080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b75a0d-c563-4a81-ad59-be51d81abb3e", "name": "network-vif-deleted", "tag": "95cbf043-1522-4cbc-b2ba-b4848f245f5a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:08.511225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.516485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.531191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-140c9160-815b-4746-b051-97b1edd29f9f req-696df488-80ba-4316-9716-4bd4db281080 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.531726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-140c9160-815b-4746-b051-97b1edd29f9f req-696df488-80ba-4316-9716-4bd4db281080 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.548329 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-140c9160-815b-4746-b051-97b1edd29f9f req-696df488-80ba-4316-9716-4bd4db281080 service nova] Creating event network-vif-deleted:95cbf043-1522-4cbc-b2ba-b4848f245f5a for instance 44b75a0d-c563-4a81-ad59-be51d81abb3e on n-h2-master-1 Jul 01 10:30:08.555762 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-140c9160-815b-4746-b051-97b1edd29f9f req-696df488-80ba-4316-9716-4bd4db281080 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051499 Jul 01 10:30:08.561288 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 533/1056] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:08.577636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:08.582348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:08.609633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.610518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:08.611420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:08.616024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:09.434201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:09.446623 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4711420d-4944-4b3d-8942-69b4d52b3fa0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.966003 Jul 01 10:30:09.459886 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 524/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:08 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:09.483819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:09.487202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:09.523328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:09.523873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:09.525172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:09.525877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:09.543706 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] HTTP exception thrown: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Request method failure captured: Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e HTTP/1.1 Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsv-4sQGsMdz78P9A-bxlHWqAMaYaHYwW23Qke1dbF7gLl5y4STD_B22gpq6NHWB4QuZdXmxuDj0YICjZ7SsRxmfuFQID3OKlHhwWAU8fzdVXFGoK2T4CNflBr18sJS7vnxuzYslsfVUaMjfcq05_shnpH4Id5Q5ommE8-UsFpYzT7k Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 78e8ee98253b4773b72e3443d0ba2cb4 Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:09.546145 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78e8ee98253b4773b72e3443d0ba2cb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 78e8ee98253b4773b72e3443d0ba2cb4 Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachSCSIVolumeTestJSON-1449403646-project Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9d17628c74f54f0e8a7d24ae2db32a17 Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1449403646-project Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:09.553692 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '44b75a0d-c563-4a81-ad59-be51d81abb3e'} Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:09.554559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:09.555832 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:09.558073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Returning 404 to user: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:09.558073 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6e35545-2413-4376-8743-40b3955fec59 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 404 len: 111 microversion: 2.1 time: 0.086877 Jul 01 10:30:09.558073 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 525/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:09 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:09.560032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:09.565743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:09.569028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:09.579997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:09.580482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:09.586712 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76ac48e3-a0b0-4e31-be95-09c83af60c00 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 1.023793 Jul 01 10:30:09.588047 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 534/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:08 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:09.588638 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:09.589212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:09.600819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:09.605630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:09.620701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:09.621437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:09.622529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:09.623808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.177056 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:10.191550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:10.199306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a328d5a6-fb18-4d6c-854d-e9f6387b4f5b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 2035 microversion: 2.25 time: 0.647404 Jul 01 10:30:10.201687 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 526/1060] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:09 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 2035 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:10.207404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:10.209459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:10.215570 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0e40a88-892a-4473-b2f6-4cb81ac4da45 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.610197 Jul 01 10:30:10.218449 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 535/1061] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:09 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:10.219067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.219991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.220993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.222285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.224052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:10.224662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:10.245736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.246329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.247103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.247539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.642734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:10.663266 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0faff923-ab39-4ec3-9912-80fc2a4c1991 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 200 len: 1472 microversion: 2.1 time: 0.443413 Jul 01 10:30:10.664777 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 536/1062] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:10 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:10.677744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-db64c2f0-5e07-4063-a28a-d75e505d0a0e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '.version_select at 0x7f6f91dd7940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:10.704293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:10.728686 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e457a624-f180-4601-819f-6f0a4fbcd21f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.525097 Jul 01 10:30:10.742937 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 527/1063] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:10 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:10.748478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:10.752396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:10.762123 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-db64c2f0-5e07-4063-a28a-d75e505d0a0e tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284357970" status: 202 len: 0 microversion: 2.1 time: 0.095857 Jul 01 10:30:10.766857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 537/1064] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:30:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284357970 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:30:10.767765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:10.768180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:10.778605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.779304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.780283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.781263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.783481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.784472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:10.793910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:10.793910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:11.033861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'flavor' on Instance uuid 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:11.105911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Going to try to live migrate instance to n-h1-master-1 {{(pid=119764) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:30:11.283773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:11.292290 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-694d1010-dc29-4819-bc0d-1e5c232f8bd6 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.528341 Jul 01 10:30:11.292869 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 538/1065] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:10 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:11.305849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:11.306737 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:11.320373 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:11.329595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:11.331228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:11.331739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:12.008012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:12.042053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-835f85f8-cbb5-41af-ae62-4377a34a1b49 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.737759 Jul 01 10:30:12.044676 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 539/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:11 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:12.055086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ff4a3ad1-60d8-40d0-a3d7-19c51ed61a2d req-ba7bc8ea-5263-4f48-b4cc-9f3a10a64f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c18b634-6ae0-4b52-bc86-c6ed5fe457e4", "name": "network-vif-deleted", "tag": "52256dd9-2818-4894-88d8-479cc1283487"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:12.072111 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:12.073548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ff4a3ad1-60d8-40d0-a3d7-19c51ed61a2d req-ba7bc8ea-5263-4f48-b4cc-9f3a10a64f78 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:12.074263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ff4a3ad1-60d8-40d0-a3d7-19c51ed61a2d req-ba7bc8ea-5263-4f48-b4cc-9f3a10a64f78 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:12.089595 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ff4a3ad1-60d8-40d0-a3d7-19c51ed61a2d req-ba7bc8ea-5263-4f48-b4cc-9f3a10a64f78 service nova] Creating event network-vif-deleted:52256dd9-2818-4894-88d8-479cc1283487 for instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 on n-h1-master-1 Jul 01 10:30:12.098730 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ff4a3ad1-60d8-40d0-a3d7-19c51ed61a2d req-ba7bc8ea-5263-4f48-b4cc-9f3a10a64f78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047221 Jul 01 10:30:12.103853 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 540/1067] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:12.110275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:12.111363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:12.120395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:12.121005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:12.122392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:12.122914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:12.606904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:12.615327 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aaaed970-276f-42d4-9395-369cfc3348df tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.509864 Jul 01 10:30:12.619111 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 541/1068] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:12 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:12.628434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:12.631997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:12.647063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:12.647529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:12.648964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:12.650347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:12.681140 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 could not be found. Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 HTTP/1.1 Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:12.687572 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 could not be found. Jul 01 10:30:12.689259 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '5c18b634-6ae0-4b52-bc86-c6ed5fe457e4'} Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 could not be found. Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:12.690651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 could not be found. Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 could not be found. Jul 01 10:30:12.693459 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:12.702516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance 5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:12.703755 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-95e162ce-ab97-416b-a126-f64ac1a2e9eb tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4" status: 404 len: 111 microversion: 2.1 time: 0.083410 Jul 01 10:30:12.704917 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 542/1069] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:12 2022] GET /compute/v2.1/servers/5c18b634-6ae0-4b52-bc86-c6ed5fe457e4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:12.715973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:12.717104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:12.735055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:12.735551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:12.736359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:12.737736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:13.060693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:13.107613 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8772bc87-c01b-4efe-a7bd-dd23f1f30e8d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.400359 Jul 01 10:30:13.118159 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 543/1070] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:12 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:13.118804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:13.119457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:13.127019 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:13.128064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:13.129032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:13.129707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:13.447683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:13.465279 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c9420746-d3e1-4ae7-974c-dc58c0dd064c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.355410 Jul 01 10:30:13.466747 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 544/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:13 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:13.517374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:13.520140 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:13.546692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:13.547993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:13.551758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:13.552554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:13.598596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:13.940740 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-41eca4ad-5553-4026-acd0-9169e5669eb0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4" status: 204 len: 0 microversion: 2.1 time: 0.471018 Jul 01 10:30:13.943088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 545/1072] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:13 2022] DELETE /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:13.946956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-427c819a-08a8-40b0-b0e1-e84bb5f964c4 req-0f5e97de-8079-4319-b36a-c3cbd77068cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610b3d47-8df7-4d58-a7fd-aaeff3de4553", "name": "network-vif-plugged", "status": "completed", "tag": "7275b96c-4d48-4f7c-8112-3a73ee00f6fa"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:13.955150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-427c819a-08a8-40b0-b0e1-e84bb5f964c4 req-0f5e97de-8079-4319-b36a-c3cbd77068cd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:13.956262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-427c819a-08a8-40b0-b0e1-e84bb5f964c4 req-0f5e97de-8079-4319-b36a-c3cbd77068cd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:13.968879 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-427c819a-08a8-40b0-b0e1-e84bb5f964c4 req-0f5e97de-8079-4319-b36a-c3cbd77068cd service nova] Creating event network-vif-plugged:7275b96c-4d48-4f7c-8112-3a73ee00f6fa for instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 on n-h2-master-1 Jul 01 10:30:13.974026 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-427c819a-08a8-40b0-b0e1-e84bb5f964c4 req-0f5e97de-8079-4319-b36a-c3cbd77068cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031418 Jul 01 10:30:13.974846 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 546/1073] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:13.979943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:13.980647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:13.986983 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:13.987444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:13.988236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:13.988651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.148868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:14.157232 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8ac5037b-6189-416d-93d0-7fe9eef5fe03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.181126 Jul 01 10:30:14.158023 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 547/1074] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:13 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:14.163151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:14.164071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:14.170359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.170797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.171555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.171985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.175701 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:14.319724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:14.327038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f6967c7f-ac28-4bf2-bc41-f8c915b67190 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.167885 Jul 01 10:30:14.327610 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 548/1075] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:14 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:14.332717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:14.333236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:14.339224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.339610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.340413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.340844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.369669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:14.600601 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:14.682789 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa8d748d-cf46-4a90-9a03-d49b10855b2c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 204 len: 0 microversion: 2.1 time: 0.352107 Jul 01 10:30:14.685483 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 549/1076] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:14 2022] DELETE /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:14.693404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:14.694564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:14.700657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.701333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.702109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.702547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.841074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:14.849843 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96a56c8e-f4af-49a7-ba31-33cff1ec2569 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.162915 Jul 01 10:30:14.850430 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 550/1077] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:14 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:14.854757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-30eaf91f-f566-4253-af36-93004a7f8e87 req-6881c194-ff4d-48f6-b73a-2e79082d2360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d8f641-c2b2-4863-af93-3cd4d3cf86bc", "tag": "a0c76a77-6369-46fb-884f-56ed56e3bb83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:14.863257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-30eaf91f-f566-4253-af36-93004a7f8e87 req-6881c194-ff4d-48f6-b73a-2e79082d2360 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.863695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-30eaf91f-f566-4253-af36-93004a7f8e87 req-6881c194-ff4d-48f6-b73a-2e79082d2360 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.874430 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-30eaf91f-f566-4253-af36-93004a7f8e87 req-6881c194-ff4d-48f6-b73a-2e79082d2360 service nova] Creating event network-changed:a0c76a77-6369-46fb-884f-56ed56e3bb83 for instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc on n-h1-master-1 Jul 01 10:30:14.879263 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-30eaf91f-f566-4253-af36-93004a7f8e87 req-6881c194-ff4d-48f6-b73a-2e79082d2360 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027756 Jul 01 10:30:14.879846 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 551/1078] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:14.885851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:14.886540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:14.898559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.898559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:14.898906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:14.899357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.048048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:15.059700 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1a575606-d934-4b0c-9913-7f821940828a tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.178462 Jul 01 10:30:15.060263 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 552/1079] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:14 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:15.065189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:15.065970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:15.072211 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.072656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.073614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.074215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.255722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:15.268375 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ae9a247-197f-4902-988b-ad0644fd71e7 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4" status: 200 len: 1475 microversion: 2.1 time: 0.206532 Jul 01 10:30:15.277815 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 553/1080] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:15 2022] GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4 => generated 1475 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:15.286093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:15.286716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:15.293590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.294224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.295004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.295441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.454569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:15.463001 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dec536a8-b26e-44d0-a64f-133c05f3e87d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.182162 Jul 01 10:30:15.464800 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 554/1081] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:15 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:15.469777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:15.470393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:15.477049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.477549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.478324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.478761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.620142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:15.628495 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b59ddc3-9e26-45e4-8672-b92451e89820 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1318 microversion: 2.1 time: 0.162386 Jul 01 10:30:15.629615 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 555/1082] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:15 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:15.869419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:15.874647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:15.878520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.887760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:15.888855 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:15.891561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:16.148620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:16.159735 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa7cf94f-c63c-48e4-b147-ffae9da8b260 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.294350 Jul 01 10:30:16.160947 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 556/1083] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:15 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:16.167573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d954720f-7817-459b-bd23-1c3cbfc0f6dc req-4c2fbd1f-33ff-4630-b8fe-d57b372443d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9d6ca9-85e6-4713-ad73-a753e315637f", "name": "network-vif-plugged", "status": "completed", "tag": "6b4ab1fe-7a60-495f-9cf4-fa56c9c65a20"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:16.176201 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:16.180218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d954720f-7817-459b-bd23-1c3cbfc0f6dc req-4c2fbd1f-33ff-4630-b8fe-d57b372443d3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:16.180770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d954720f-7817-459b-bd23-1c3cbfc0f6dc req-4c2fbd1f-33ff-4630-b8fe-d57b372443d3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:16.199263 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d954720f-7817-459b-bd23-1c3cbfc0f6dc req-4c2fbd1f-33ff-4630-b8fe-d57b372443d3 service nova] Creating event network-vif-plugged:6b4ab1fe-7a60-495f-9cf4-fa56c9c65a20 for instance 7b9d6ca9-85e6-4713-ad73-a753e315637f on n-h2-master-1 Jul 01 10:30:16.209359 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d954720f-7817-459b-bd23-1c3cbfc0f6dc req-4c2fbd1f-33ff-4630-b8fe-d57b372443d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045041 Jul 01 10:30:16.210568 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 557/1084] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:16.217519 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:16.218640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:16.226064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:16.226952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:16.230953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:16.230953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.079525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:17.120344 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9852b6c7-960f-4a7a-9f83-7afea08e92df tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1324 microversion: 2.1 time: 0.908244 Jul 01 10:30:17.135418 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 558/1085] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:16 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1324 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:17.149197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:17.150812 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:17.166218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.166675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.167469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.167906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.331433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:17.358030 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e5d65c2-e23d-4c70-ae19-e0e8bf9b7d03 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4" status: 200 len: 1433 microversion: 2.1 time: 0.216989 Jul 01 10:30:17.358675 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 559/1086] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:17 2022] GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4 => generated 1433 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:17.370047 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1305b81e-2a8e-4166-96e9-8c7a16af8cee tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0/action" status: 202 len: 0 microversion: 2.25 time: 6.614729 Jul 01 10:30:17.375777 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 528/1087] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:30:10 2022] POST /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0/action => generated 0 bytes in 6627 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:17.378299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:17.380303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:17.381036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:17.382044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:17.394841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.395025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.396693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.396819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.397859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.398795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.399439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.399707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.917018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:17.926993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:17.928735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4fd7143c-f57c-4275-ba9a-c44b8d45f639 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1467 microversion: 2.1 time: 0.556475 Jul 01 10:30:17.933190 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 529/1088] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:17 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1467 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:17.945812 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e26bae41-9659-4413-ac0c-828f7a9c15df tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.581527 Jul 01 10:30:17.946403 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 560/1089] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:17 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:17.961360 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c16d1a48-cf39-41af-bc46-936fff338aed req-3c3710dc-a4a0-4c4a-9b04-5bd79dae654d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774df999-dc4f-43aa-afe6-237771e977e4", "name": "network-vif-deleted", "tag": "45a3f3f1-e9c2-46d4-91c8-cb08b665d656"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:17.973998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c16d1a48-cf39-41af-bc46-936fff338aed req-3c3710dc-a4a0-4c4a-9b04-5bd79dae654d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.974696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c16d1a48-cf39-41af-bc46-936fff338aed req-3c3710dc-a4a0-4c4a-9b04-5bd79dae654d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.975214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:17.975836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:17.984412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.984859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.985832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:17.986086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:17.989543 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c16d1a48-cf39-41af-bc46-936fff338aed req-3c3710dc-a4a0-4c4a-9b04-5bd79dae654d service nova] Creating event network-vif-deleted:45a3f3f1-e9c2-46d4-91c8-cb08b665d656 for instance 774df999-dc4f-43aa-afe6-237771e977e4 on n-h2-master-1 Jul 01 10:30:17.995687 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c16d1a48-cf39-41af-bc46-936fff338aed req-3c3710dc-a4a0-4c4a-9b04-5bd79dae654d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060889 Jul 01 10:30:17.996860 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 530/1090] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:18.007673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:18.011347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:18.024875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:18.027238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:18.030785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:18.031429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:18.088091 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:18.457940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:18.469060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:18.475640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:18.477818 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-abc9a187-26c7-44cd-b701-1f1cfa52a279 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.479615 Jul 01 10:30:18.482288 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 531/1091] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:17 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:18.496477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:18.497329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:18.507961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:18.509333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:18.510142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:18.510583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:18.574805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lazy-loading 'flavor' on Instance uuid 610b3d47-8df7-4d58-a7fd-aaeff3de4553 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:18.641570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:18.649781 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72ca5a33-1801-45ec-9f18-7b9829edd495 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.695793 Jul 01 10:30:18.659266 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 561/1092] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:17 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:18.667917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:18.668529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:18.679875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:18.687581 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:18.687581 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:18.687581 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:18.976273 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4ef8653f-db92-44e5-b7d1-932024170e77 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553/action" status: 202 len: 0 microversion: 2.1 time: 0.492494 Jul 01 10:30:18.979914 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 532/1093] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:18 2022] POST /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:30:18.995852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:18.996821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 774df999-dc4f-43aa-afe6-237771e977e4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:19.010960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.014962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.018648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.026832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.047206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:19.057642 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance 774df999-dc4f-43aa-afe6-237771e977e4 could not be found. Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4 HTTP/1.1 Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:19.059688 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 774df999-dc4f-43aa-afe6-237771e977e4 could not be found. Jul 01 10:30:19.061266 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '774df999-dc4f-43aa-afe6-237771e977e4'} Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 774df999-dc4f-43aa-afe6-237771e977e4 could not be found. Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:19.063700 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 774df999-dc4f-43aa-afe6-237771e977e4 could not be found. Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 774df999-dc4f-43aa-afe6-237771e977e4 could not be found. Jul 01 10:30:19.065840 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:19.067166 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad7bdb43-6ce4-4f78-8a8c-bedaa0c74ab9 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1522 microversion: 2.1 time: 0.408493 Jul 01 10:30:19.067166 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 562/1094] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:18 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:19.068460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance 774df999-dc4f-43aa-afe6-237771e977e4 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:19.070677 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65eeb260-7d01-46cc-b9c3-998cbe54e319 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4" status: 404 len: 111 microversion: 2.1 time: 0.089392 Jul 01 10:30:19.075380 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 533/1095] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:18 2022] GET /compute/v2.1/servers/774df999-dc4f-43aa-afe6-237771e977e4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:19.088412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:19.089390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:19.098951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:19.099805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:19.105409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.108838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.109918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.110520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.116176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.116684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.119405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.121184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.374865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:19.387945 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-356a23b2-263d-4c68-850c-9e12c06a8d62 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1475 microversion: 2.1 time: 0.311051 Jul 01 10:30:19.388813 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 534/1096] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:19 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1475 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:19.393975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:19.394675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:19.398010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:19.402840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.403399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.404244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.404810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.406831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d3441776-1b0e-4f5b-9674-c42b6e217e87 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.342633 Jul 01 10:30:19.407703 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 563/1097] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:19 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:19.412444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:19.413054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:19.420361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.420809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.421806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.422988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.448337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.449118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.449804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lazy-loading 'fault' on Instance uuid c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:19.461637 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:19.537955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:19.550900 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ecf6e1b-0e4e-42cb-8186-ca3ca58e05b8 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 200 len: 1309 microversion: 2.1 time: 0.160843 Jul 01 10:30:19.558113 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 535/1098] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:19 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:19.563573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:19.565125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:19.572582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.573466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.574555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.575296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.818124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:19.841556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-94b7a461-fc31-464a-9ded-945d23d025e5 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1522 microversion: 2.1 time: 0.432398 Jul 01 10:30:19.850286 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 564/1099] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:19 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:19.865404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:19.867726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:19.881946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.890532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:19.891369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:19.891809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.002928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:20.014588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:20.017029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:20.019077 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5386a5e-ba52-4669-9c9f-a1add2af9aa6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.459504 Jul 01 10:30:20.019639 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 536/1100] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:19 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:20.025424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-40f79b26-6e0a-42e4-ada3-a43afc640d22 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1657130597"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:20.026802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-40f79b26-6e0a-42e4-ada3-a43afc640d22 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:20.033397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40f79b26-6e0a-42e4-ada3-a43afc640d22 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.033959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40f79b26-6e0a-42e4-ada3-a43afc640d22 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.034802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40f79b26-6e0a-42e4-ada3-a43afc640d22 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.035392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40f79b26-6e0a-42e4-ada3-a43afc640d22 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.086080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:20.096145 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2bd958cd-e74e-4c94-a93e-c8d77f103c03 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.243828 Jul 01 10:30:20.096723 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 565/1101] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:19 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:20.111021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ebeb4b50-4076-4f4d-9bce-e8abf5752898 req-76969c4f-899e-4fbc-b999-1ae645f7ddbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385", "name": "network-vif-deleted", "tag": "c0a2d02f-7766-4b8f-86ce-5053e678dbd2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:20.123860 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ebeb4b50-4076-4f4d-9bce-e8abf5752898 req-76969c4f-899e-4fbc-b999-1ae645f7ddbb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.124478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ebeb4b50-4076-4f4d-9bce-e8abf5752898 req-76969c4f-899e-4fbc-b999-1ae645f7ddbb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.137687 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ebeb4b50-4076-4f4d-9bce-e8abf5752898 req-76969c4f-899e-4fbc-b999-1ae645f7ddbb service nova] Creating event network-vif-deleted:c0a2d02f-7766-4b8f-86ce-5053e678dbd2 for instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 on n-h1-master-1 Jul 01 10:30:20.144796 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ebeb4b50-4076-4f4d-9bce-e8abf5752898 req-76969c4f-899e-4fbc-b999-1ae645f7ddbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046196 Jul 01 10:30:20.146255 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 566/1102] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:20.406165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:20.407089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:20.422188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.423232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.425247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.427936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.682863 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-40f79b26-6e0a-42e4-ada3-a43afc640d22 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f/action" status: 202 len: 0 microversion: 2.1 time: 0.661824 Jul 01 10:30:20.687269 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 537/1103] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:20 2022] POST /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:30:20.699447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:20.703263 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:20.713780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.715099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.716138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.716828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.790712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:20.805457 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e670e0d-7bd6-40ed-9c7a-0b43785d25e7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1458 microversion: 2.1 time: 0.404094 Jul 01 10:30:20.811226 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 567/1104] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:20 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1458 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:20.821346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:20.822049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:20.835847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.836593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.841873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:20.845550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:20.878055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 could not be found. Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 HTTP/1.1 Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:20.888720 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: exception: Instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 could not be found. Jul 01 10:30:20.890339 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385'} Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 could not be found. Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:20.891083 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 could not be found. Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 could not be found. Jul 01 10:30:20.892292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:20.894849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:20.894849 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-05b651c3-5b15-47b9-9300-d154eae4e0b0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385" status: 404 len: 111 microversion: 2.1 time: 0.075855 Jul 01 10:30:20.894849 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 568/1105] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:20 2022] GET /compute/v2.1/servers/c1d2e5c3-0aa2-4eec-ab40-9e95f5f12385 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:20.899480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0726ced9-072c-4aab-b10e-166289bcf2e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '.version_select at 0x7f6f91e46ee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:21.327793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:21.350633 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fcb97ff2-9f7e-44f3-8e94-cff9d1d0d497 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.656133 Jul 01 10:30:21.351434 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 538/1106] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:20 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:21.351780 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0726ced9-072c-4aab-b10e-166289bcf2e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645" status: 204 len: 0 microversion: 2.1 time: 0.463434 Jul 01 10:30:21.355422 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 569/1107] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:20 2022] DELETE /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:21.365747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-336e588c-b6f4-4336-8a99-e9c2a81f7895 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:21.374178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-535e764c-45f0-47ec-95a8-eafb9fb07790 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:21.375713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-535e764c-45f0-47ec-95a8-eafb9fb07790 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:21.390361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-535e764c-45f0-47ec-95a8-eafb9fb07790 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:21.412994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-535e764c-45f0-47ec-95a8-eafb9fb07790 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:21.414354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-535e764c-45f0-47ec-95a8-eafb9fb07790 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:21.414795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-535e764c-45f0-47ec-95a8-eafb9fb07790 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:21.517401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-336e588c-b6f4-4336-8a99-e9c2a81f7895 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/750a6b88-a7c4-4942-a364-68545aa27ab0" status: 204 len: 0 microversion: 2.1 time: 0.163782 Jul 01 10:30:21.519201 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 570/1108] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:30:21 2022] DELETE /compute/v2.1/os-server-groups/750a6b88-a7c4-4942-a364-68545aa27ab0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:21.525747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:21.527084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:21.547176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:21.547972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:21.550101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:21.550719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:21.603032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] HTTP exception thrown: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Request method failure captured: Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e HTTP/1.1 Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsv-4sQGsMdz78P9A-bxlHWqAMaYaHYwW23Qke1dbF7gLl5y4STD_B22gpq6NHWB4QuZdXmxuDj0YICjZ7SsRxmfuFQID3OKlHhwWAU8fzdVXFGoK2T4CNflBr18sJS7vnxuzYslsfVUaMjfcq05_shnpH4Id5Q5ommE8-UsFpYzT7k Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 78e8ee98253b4773b72e3443d0ba2cb4 Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:21.604648 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78e8ee98253b4773b72e3443d0ba2cb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 78e8ee98253b4773b72e3443d0ba2cb4 Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachSCSIVolumeTestJSON-1449403646-project Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9d17628c74f54f0e8a7d24ae2db32a17 Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1449403646-project Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:21.606189 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '44b75a0d-c563-4a81-ad59-be51d81abb3e'} Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:21.607222 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:21.610858 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:21.614971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Returning 404 to user: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:21.616070 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6b850b2-8b62-48eb-a3e2-56cc168ab0e2 tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "DELETE /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 404 len: 111 microversion: 2.1 time: 0.085800 Jul 01 10:30:21.620180 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 571/1109] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:21 2022] DELETE /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:21.632239 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:21.632502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:21.639766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:21.640461 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:21.641513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:21.644025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.342019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:22.351196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:22.352854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:22.354299 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42b7cd86-d0b6-49e3-b6e2-35ed69325052 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.736201 Jul 01 10:30:22.354933 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 572/1110] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:21 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:22.360019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:22.362530 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:22.369469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.370587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.371380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.375105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.740169 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-535e764c-45f0-47ec-95a8-eafb9fb07790 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1609 microversion: 2.1 time: 1.380646 Jul 01 10:30:22.740169 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 539/1111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:21 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1609 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:22.744802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7026615a-338c-48dd-ad3a-1f1eabf91271 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '.version_select at 0x7f6f920e0e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:22.758455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:22.773602 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58583379-d7e1-406c-a796-a74d42f7b9b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.411428 Jul 01 10:30:22.774107 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7026615a-338c-48dd-ad3a-1f1eabf91271 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Image not found. Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7026615a-338c-48dd-ad3a-1f1eabf91271 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645 HTTP/1.1 Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:22.777425 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '75399712-35db-40b6-9247-434599d2e645'} Jul 01 10:30:22.778820 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:30:22.779659 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 75399712-35db-40b6-9247-434599d2e645 Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:30:22.780834 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 75399712-35db-40b6-9247-434599d2e645 could not be found. Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:30:22.782055 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:30:22.784681 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.786894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 573/1112] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:22 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:22.786894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:22.787343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:22.788526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7026615a-338c-48dd-ad3a-1f1eabf91271 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:22.789538 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7026615a-338c-48dd-ad3a-1f1eabf91271 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645" status: 404 len: 62 microversion: 2.1 time: 0.051798 Jul 01 10:30:22.790824 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 540/1113] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:30:22 2022] GET /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:30:22.794402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.795073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.796697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.797340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.798189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:22.799534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] [instance: 44b75a0d-c563-4a81-ad59-be51d81abb3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:22.809418 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.809933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.810859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.811406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.832415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:22.841296 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] HTTP exception thrown: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Request method failure captured: Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e HTTP/1.1 Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsv-4sQGsMdz78P9A-bxlHWqAMaYaHYwW23Qke1dbF7gLl5y4STD_B22gpq6NHWB4QuZdXmxuDj0YICjZ7SsRxmfuFQID3OKlHhwWAU8fzdVXFGoK2T4CNflBr18sJS7vnxuzYslsfVUaMjfcq05_shnpH4Id5Q5ommE8-UsFpYzT7k Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 78e8ee98253b4773b72e3443d0ba2cb4 Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:22.843585 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78e8ee98253b4773b72e3443d0ba2cb4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78e8ee98253b4773b72e3443d0ba2cb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 78e8ee98253b4773b72e3443d0ba2cb4 Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1449403646 Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachSCSIVolumeTestJSON-1449403646-project Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9d17628c74f54f0e8a7d24ae2db32a17 Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1449403646-project Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:22.845362 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '44b75a0d-c563-4a81-ad59-be51d81abb3e'} Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:22.847164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. Jul 01 10:30:22.848588 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:22.849950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] Returning 404 to user: Instance 44b75a0d-c563-4a81-ad59-be51d81abb3e could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:22.850925 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-877b232e-a678-4f92-8aef-17b9091c8f6c tempest-AttachSCSIVolumeTestJSON-1449403646 tempest-AttachSCSIVolumeTestJSON-1449403646-project] 10.222.0.23 "GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e" status: 404 len: 111 microversion: 2.1 time: 0.059012 Jul 01 10:30:22.851685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 541/1114] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:22 2022] GET /compute/v2.1/servers/44b75a0d-c563-4a81-ad59-be51d81abb3e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:22.858266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-75376378-536c-4c25-8c13-8852ca4a74d9 req-fa4ff199-944e-446d-b04b-b454638329c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d8f641-c2b2-4863-af93-3cd4d3cf86bc", "name": "network-vif-plugged", "status": "completed", "tag": "a0c76a77-6369-46fb-884f-56ed56e3bb83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:22.869711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-75376378-536c-4c25-8c13-8852ca4a74d9 req-fa4ff199-944e-446d-b04b-b454638329c4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.870897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-75376378-536c-4c25-8c13-8852ca4a74d9 req-fa4ff199-944e-446d-b04b-b454638329c4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.884315 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-75376378-536c-4c25-8c13-8852ca4a74d9 req-fa4ff199-944e-446d-b04b-b454638329c4 service nova] Creating event network-vif-plugged:a0c76a77-6369-46fb-884f-56ed56e3bb83 for instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc on n-h1-master-1 Jul 01 10:30:22.891652 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-75376378-536c-4c25-8c13-8852ca4a74d9 req-fa4ff199-944e-446d-b04b-b454638329c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038154 Jul 01 10:30:22.894323 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 542/1115] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:22.901669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9e6097a1-b859-4c54-9572-df20c12b125e req-5194c720-21e7-4c6f-bddf-7a8de939808f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7ba1c8-0f5a-4f84-9378-d4ab844795e0", "name": "network-vif-unplugged", "status": "completed", "tag": "959de9bf-4dd5-436d-bc7b-c7385ccfdaa0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:22.914741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e6097a1-b859-4c54-9572-df20c12b125e req-5194c720-21e7-4c6f-bddf-7a8de939808f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.915489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e6097a1-b859-4c54-9572-df20c12b125e req-5194c720-21e7-4c6f-bddf-7a8de939808f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.933021 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9e6097a1-b859-4c54-9572-df20c12b125e req-5194c720-21e7-4c6f-bddf-7a8de939808f service nova] Creating event network-vif-unplugged:959de9bf-4dd5-436d-bc7b-c7385ccfdaa0 for instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 on n-h2-master-1 Jul 01 10:30:22.939732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9e6097a1-b859-4c54-9572-df20c12b125e req-5194c720-21e7-4c6f-bddf-7a8de939808f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043290 Jul 01 10:30:22.940920 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 543/1116] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:22.952443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:22.952679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:22.992966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.997052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:22.998289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:22.998953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.240609 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-757aee9c-f3e4-412f-8943-f3dc3fc8ac7f tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 204 len: 0 microversion: 2.1 time: 0.457570 Jul 01 10:30:23.241277 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 574/1117] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:22 2022] DELETE /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:23.252540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4b935a9-d4e5-4072-99be-154b8ed93d26 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:23.255471 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:23.255471 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:30:23.257137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b935a9-d4e5-4072-99be-154b8ed93d26 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.258426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b935a9-d4e5-4072-99be-154b8ed93d26 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.259478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b935a9-d4e5-4072-99be-154b8ed93d26 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.260098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4b935a9-d4e5-4072-99be-154b8ed93d26 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.309802 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4b935a9-d4e5-4072-99be-154b8ed93d26 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066891 Jul 01 10:30:23.311194 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 575/1118] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:30:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:23.321452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:23.335775 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-058c6ddc-f279-488f-8b78-cbc56ea21f6c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.393405 Jul 01 10:30:23.336799 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 544/1119] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:22 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:23.339349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:23.339349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:23.349989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:23.350710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:23.353031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.353618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.354374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.354803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.363605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.364056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.366740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.367433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.434664 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:23.707114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:23.715644 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4bd7877-1b50-43ba-b6ad-f76cf3bf456e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1540 microversion: 2.1 time: 0.402188 Jul 01 10:30:23.718508 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 576/1120] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:23 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1540 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:23.723479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:23.724833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:23.744680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.746755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.747783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.749020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.794893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Lazy-loading 'flavor' on Instance uuid 610b3d47-8df7-4d58-a7fd-aaeff3de4553 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:23.811317 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 while it is in vm_state suspended Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Request method failure captured: Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553/action HTTP/1.1 Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 97 Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsyEto0232avyg9mE6Z6ERhw1T9wK_R68sfPVswSYaq-aM3uzWepP1ZerhpPx9sqLd133I1a3QQbww_C0A4vkhQNiiRIRYcKWmASNZkkUsUrkv_M3HeklgIScEnDyK7Y1tQjxI0ogSjo7BXLCjkdrpKFoLIbEWENsqqaVVsmNEsCwi0 Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: f9efb94b84a242e8a0f4862ad537a8f8 Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveMigrationNegativeTest-1655646106 Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:30:23.813457 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9efb94b84a242e8a0f4862ad537a8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9efb94b84a242e8a0f4862ad537a8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9efb94b84a242e8a0f4862ad537a8f8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9efb94b84a242e8a0f4862ad537a8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveMigrationNegativeTest-1655646106 Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: f9efb94b84a242e8a0f4862ad537a8f8 Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1655646106 Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveMigrationNegativeTest-1655646106-project-admin Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 10afca57d51a4d4688ddd2031cad6a14 Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveMigrationNegativeTest-1655646106-project-admin Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} Jul 01 10:30:23.815822 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'os-migrateLive' instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 while it is in vm_state suspended Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '610b3d47-8df7-4d58-a7fd-aaeff3de4553', 'body': {'os-migrateLive': {'host': 'n-h1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 01 10:30:23.817160 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:30:23.818305 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 while it is in vm_state suspended Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 while it is in vm_state suspended Jul 01 10:30:23.819680 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:23.826903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 while it is in vm_state suspended {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:23.827841 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-08e1ea15-fc47-4e2f-8fcc-14a995321050 tempest-LiveMigrationNegativeTest-1655646106 tempest-LiveMigrationNegativeTest-1655646106-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553/action" status: 409 len: 155 microversion: 2.1 time: 0.108152 Jul 01 10:30:23.828412 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 577/1121] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:23 2022] POST /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553/action => generated 155 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:30:23.838531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:23.839152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:23.846951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.847697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.848650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.849410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.852220 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8e20146f-5081-4296-997b-5ee6eed60c53 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 204 len: 0 microversion: 2.1 time: 0.514002 Jul 01 10:30:23.853710 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 545/1122] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:23 2022] DELETE /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:23.859520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:23.860377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:23.877931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.879820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:23.880883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:23.882594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.211182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:24.228648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:24.231020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:24.233612 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8913ffb0-c062-4c0c-acb3-6dbe1b1ec94d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.403717 Jul 01 10:30:24.236056 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 578/1123] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:23 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:24.244320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:24.245106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:24.281278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:24.281910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.286296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.287267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.288425 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:24.291915 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37821190-6a89-4d4c-bf9a-d272af5fe20a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.436695 Jul 01 10:30:24.294077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.296359 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 546/1124] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:23 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:24.304914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:24.310191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:24.320858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.321529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.323011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.324032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.363898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:24.609423 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:24.620109 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37cb22bb-f83b-4ebe-9868-057cfe444171 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1475 microversion: 2.1 time: 0.322566 Jul 01 10:30:24.630218 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 547/1125] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:24 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1475 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:24.645792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:24.646643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:24.660532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.661256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.662878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.663622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.715769 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af7c21ca-0847-4747-929a-ecf757cc3bf4 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "DELETE /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 204 len: 0 microversion: 2.1 time: 0.475615 Jul 01 10:30:24.716484 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 579/1126] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:24 2022] DELETE /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:24.731358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:24.733123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:24.741803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.742598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:24.743569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:24.747017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.053935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.062618 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-021dee0f-418b-4241-a04a-cb9e027908e2 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.431103 Jul 01 10:30:25.065122 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 548/1127] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:24 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:25.072530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:25.074187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:25.082761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.083307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.085502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.086162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.200949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.210543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-94c7c3c2-92c0-4fe5-a9e4-165251e1b997 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1464 microversion: 2.1 time: 0.488449 Jul 01 10:30:25.222340 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 580/1128] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:24 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1464 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:25.229990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-385f80be-8712-4827-96c2-6458a860373f req-5f7d7f2a-0ca3-4af0-851a-ae0cc03435c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7ba1c8-0f5a-4f84-9378-d4ab844795e0", "tag": "959de9bf-4dd5-436d-bc7b-c7385ccfdaa0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:25.242653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-385f80be-8712-4827-96c2-6458a860373f req-5f7d7f2a-0ca3-4af0-851a-ae0cc03435c5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.243360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-385f80be-8712-4827-96c2-6458a860373f req-5f7d7f2a-0ca3-4af0-851a-ae0cc03435c5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.258515 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-385f80be-8712-4827-96c2-6458a860373f req-5f7d7f2a-0ca3-4af0-851a-ae0cc03435c5 service nova] Creating event network-changed:959de9bf-4dd5-436d-bc7b-c7385ccfdaa0 for instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 on n-h2-master-1 Jul 01 10:30:25.264330 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-385f80be-8712-4827-96c2-6458a860373f req-5f7d7f2a-0ca3-4af0-851a-ae0cc03435c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040536 Jul 01 10:30:25.265123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 581/1129] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:25.271312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:25.272108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:25.282994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.282994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.282994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.282994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.343337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.354441 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6671f1fb-3cfa-4192-8e59-45f0f94693b7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1522 microversion: 2.1 time: 0.288165 Jul 01 10:30:25.355139 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 549/1130] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:25 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:25.365367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:25.365367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:25.366464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.367199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.368273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.369089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.635481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.651976 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8052077-33ee-40b5-bc94-40847deef771 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.295707 Jul 01 10:30:25.665726 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 550/1131] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:25 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:25.672534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:25.673249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:25.677394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.682092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.682764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.683706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.684428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.690951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.693777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.697233 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0830e11c-5d41-458d-afc7-1b95f0fea1fb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.428747 Jul 01 10:30:25.699974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 582/1132] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:25 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:25.704935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:25.707999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:25.714675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:25.721751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.725480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.727871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:25.728318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:25.734965 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:25.927409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:25.940378 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1787ea28-ff57-4b27-bae4-9c26ffa9bd56 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1475 microversion: 2.1 time: 0.239330 Jul 01 10:30:25.941996 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 583/1133] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:25 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:26.021082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d39a3ee0-08a0-4174-9bcb-05680a58f09d tempest-FloatingIPDetailsNegativeTestJSON-2090745204 tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project] Calling method '.version_select at 0x7f6f91df60d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:26.077463 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-d39a3ee0-08a0-4174-9bcb-05680a58f09d tempest-FloatingIPDetailsNegativeTestJSON-2090745204 tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ec235477-abfd-4299-aa8a-67c28ca64a54 could not be found", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:30:26.078995 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d39a3ee0-08a0-4174-9bcb-05680a58f09d tempest-FloatingIPDetailsNegativeTestJSON-2090745204 tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project] HTTP exception thrown: Floating IP not found for ID ec235477-abfd-4299-aa8a-67c28ca64a54 Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d39a3ee0-08a0-4174-9bcb-05680a58f09d tempest-FloatingIPDetailsNegativeTestJSON-2090745204 tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project] Request method failure captured: Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-floating-ips/ec235477-abfd-4299-aa8a-67c28ca64a54 HTTP/1.1 Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszBAWF5X1bQXkpFygXVdc4k6ZcsQ-2dqEmHNP1LdUb8xb_K34WQWlGBQpSy1aRJBM2NrarmKDkHpxubgrI9ZOi-8vruJ8VboSnUwaoYHClWJboaX37y5ViuPPDfHc3B3StIz5jrvU5WlUEeL5ntFW5rtRGLH03X1Ky6dJBvjSZr7mA Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: bac48d89b2ce40fd8bee33d00b706cbd Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2090745204 Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:26.087524 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bac48d89b2ce40fd8bee33d00b706cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bac48d89b2ce40fd8bee33d00b706cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bac48d89b2ce40fd8bee33d00b706cbd", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bac48d89b2ce40fd8bee33d00b706cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2090745204 Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: bac48d89b2ce40fd8bee33d00b706cbd Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2090745204 Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 964aada0cb554808ab412627e551b586 Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: exception: Floating IP not found for ID ec235477-abfd-4299-aa8a-67c28ca64a54 Jul 01 10:30:26.089231 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ec235477-abfd-4299-aa8a-67c28ca64a54'} Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:26.090153 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ec235477-abfd-4299-aa8a-67c28ca64a54 could not be found Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1f5fbf0-4a40-4105-aa1c-3a8ac6d67a52'] Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ec235477-abfd-4299-aa8a-67c28ca64a54. Jul 01 10:30:26.091548 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ec235477-abfd-4299-aa8a-67c28ca64a54 Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:26.093051 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:26.094570 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:26.094570 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ec235477-abfd-4299-aa8a-67c28ca64a54 Jul 01 10:30:26.094570 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:26.094570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d39a3ee0-08a0-4174-9bcb-05680a58f09d tempest-FloatingIPDetailsNegativeTestJSON-2090745204 tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project] Returning 404 to user: Floating IP not found for ID ec235477-abfd-4299-aa8a-67c28ca64a54 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:26.094570 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d39a3ee0-08a0-4174-9bcb-05680a58f09d tempest-FloatingIPDetailsNegativeTestJSON-2090745204 tempest-FloatingIPDetailsNegativeTestJSON-2090745204-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/ec235477-abfd-4299-aa8a-67c28ca64a54" status: 404 len: 111 microversion: 2.1 time: 0.142395 Jul 01 10:30:26.094570 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 584/1134] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:30:25 2022] GET /compute/v2.1/os-floating-ips/ec235477-abfd-4299-aa8a-67c28ca64a54 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:26.101190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:26.102048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:26.109547 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7246effa-8598-4fbd-928d-df0e5e02fc71 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 204 len: 0 microversion: 2.1 time: 0.442420 Jul 01 10:30:26.111012 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 551/1135] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:25 2022] DELETE /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:26.120468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:26.121979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:26.147034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.149561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:26.151376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.153638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.154475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:26.155779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:26.156785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.162401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:26.528373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:26.545723 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-28d91886-0b11-468e-a097-13e59718150f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 0.458199 Jul 01 10:30:26.546337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 585/1136] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:26 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:26.552684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:26.553692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:26.564939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:26.567685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.569698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:26.570175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.570954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:26.578668 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6fa81b9b-92f9-4fb4-86b4-82445be0d75e tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1528 microversion: 2.1 time: 0.461866 Jul 01 10:30:26.579832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 552/1137] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:26 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1528 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:26.671552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:26.672838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:26.682533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.683222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:26.685578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:26.690455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:27.344095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:27.362556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-db8594dc-8a5b-4c33-aee8-c7688240bf63 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1464 microversion: 2.1 time: 0.814175 Jul 01 10:30:27.363142 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 586/1138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:26 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1464 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:27.368069 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:27.368873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:27.375602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:27.376388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:27.377459 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:27.378120 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:27.620493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:27.636119 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a55f284-c24c-4516-a7ec-bdd3ab8153c8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 0.968607 Jul 01 10:30:27.636630 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 553/1139] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:26 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:27.667295 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:27.667922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:27.683669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:27.684129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:27.684926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:27.693667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:27.863602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:27.880381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:27.883941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:27.898781 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bfccd349-9666-4b15-a08b-1ccacbe36cef tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.534338 Jul 01 10:30:27.900642 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 587/1140] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:27 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:27.908523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:27.909679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:27.928574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:27.929067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:27.929900 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:27.930341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:28.477957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:28.497451 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1e9e9928-a793-4c22-8fd7-1354d38d34e0 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1475 microversion: 2.1 time: 0.837673 Jul 01 10:30:28.498810 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 554/1141] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:27 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1475 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:28.515123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:28.515746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:28.538412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:28.545966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:28.553998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:28.561350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:28.896178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:28.915480 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7f63bbec-9274-4f78-8862-ea05308936f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1313 microversion: 2.1 time: 1.013328 Jul 01 10:30:28.916865 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 588/1142] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:27 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1313 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:28.927014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e6cfa3b2-061d-4881-975d-9fdd11bd4cb2 req-717592cd-8376-4e25-9250-b1b2cff9632f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56be635-1bd7-40c9-b62e-c6d3710f52c6", "name": "network-vif-unplugged", "status": "completed", "tag": "72946124-356f-475a-8aef-b673fc28b874"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:28.932628 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:28.942121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e6cfa3b2-061d-4881-975d-9fdd11bd4cb2 req-717592cd-8376-4e25-9250-b1b2cff9632f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:28.942572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e6cfa3b2-061d-4881-975d-9fdd11bd4cb2 req-717592cd-8376-4e25-9250-b1b2cff9632f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:28.971802 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e6cfa3b2-061d-4881-975d-9fdd11bd4cb2 req-717592cd-8376-4e25-9250-b1b2cff9632f service nova] Creating event network-vif-unplugged:72946124-356f-475a-8aef-b673fc28b874 for instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 on n-h1-master-1 Jul 01 10:30:28.980020 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e6cfa3b2-061d-4881-975d-9fdd11bd4cb2 req-717592cd-8376-4e25-9250-b1b2cff9632f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057128 Jul 01 10:30:28.985079 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 589/1143] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:28.999586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:29.002644 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:29.014312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:29.016288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:29.017341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:29.018448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:29.254316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:29.280804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-76aed678-c6e4-4d2a-8a9f-3a704c25a2b4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1528 microversion: 2.1 time: 0.780123 Jul 01 10:30:29.282229 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 555/1144] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:28 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1528 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:29.287716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:29.290164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:29.311006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:29.311755 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:29.312664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:29.313400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:29.862632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:29.893652 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef5eeb31-bf46-4c60-b0d6-e9d01e4c3776 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 200 len: 1464 microversion: 2.1 time: 0.904070 Jul 01 10:30:29.894793 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 590/1145] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:28 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 1464 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:29.933491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:29.937746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:29.967043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:29.967539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:29.968345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:29.968779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:30.285430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:30.296755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b994aa31-5c97-4429-af4d-351be52eb9fd tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1542 microversion: 2.1 time: 1.012534 Jul 01 10:30:30.298190 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 556/1146] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:29 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1542 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:30.303439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:30.304312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:30.317104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:30.319662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:30.320681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:30.321478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:31.071892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:31.115403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:31.121604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:31.123178 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba8faf62-2853-4f51-a5c9-52c0df04d9e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 1.224090 Jul 01 10:30:31.124265 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 591/1147] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:29 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:31.140103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:31.141064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:31.173331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:31.176009 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:31.177234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:31.181140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:31.331913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:31.340350 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a99fe4b-c234-4cf5-9f02-e1fe77d8f279 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1475 microversion: 2.1 time: 1.040974 Jul 01 10:30:31.346695 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 557/1148] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:30 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1475 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:31.364876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:31.365639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:31.382395 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:31.384509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:31.385172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:31.386176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:31.386613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:32.697183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:32.714494 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-de0ec187-9d10-4b23-8df2-66a5a00586c4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1528 microversion: 2.1 time: 1.366256 Jul 01 10:30:32.716504 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 558/1149] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:31 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1528 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:32.722662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d33d32ef-4ea1-4bb4-b0d9-6b143b79ea64 req-f64ce517-4f09-4790-bdf4-14d28168ccac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7ba1c8-0f5a-4f84-9378-d4ab844795e0", "name": "network-vif-unplugged", "status": "completed", "tag": "959de9bf-4dd5-436d-bc7b-c7385ccfdaa0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:32.734379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d33d32ef-4ea1-4bb4-b0d9-6b143b79ea64 req-f64ce517-4f09-4790-bdf4-14d28168ccac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:32.736835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d33d32ef-4ea1-4bb4-b0d9-6b143b79ea64 req-f64ce517-4f09-4790-bdf4-14d28168ccac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:32.770412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:32.774352 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d33d32ef-4ea1-4bb4-b0d9-6b143b79ea64 req-f64ce517-4f09-4790-bdf4-14d28168ccac service nova] Creating event network-vif-unplugged:959de9bf-4dd5-436d-bc7b-c7385ccfdaa0 for instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 on n-h2-master-1 Jul 01 10:30:32.789323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d33d32ef-4ea1-4bb4-b0d9-6b143b79ea64 req-f64ce517-4f09-4790-bdf4-14d28168ccac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071801 Jul 01 10:30:32.791235 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 559/1150] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:32.793372 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d5e1cad-961b-463b-a13a-0cea032ed217 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1461 microversion: 2.1 time: 1.666244 Jul 01 10:30:32.794207 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 592/1151] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:31 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1461 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:32.810014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-227b3908-881a-451f-8f06-86b05f28a40b req-f9a438e0-aa65-41f2-a276-57cc1a9916ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1104472d-27ae-4dfc-afaa-fc1f4c6d52a7", "name": "network-vif-unplugged", "status": "completed", "tag": "29d02663-dbc8-4074-aafb-728f803f4182"}, {"server_uuid": "610b3d47-8df7-4d58-a7fd-aaeff3de4553", "name": "network-vif-unplugged", "status": "completed", "tag": "7275b96c-4d48-4f7c-8112-3a73ee00f6fa"}, {"server_uuid": "1b7ba1c8-0f5a-4f84-9378-d4ab844795e0", "name": "network-vif-unplugged", "status": "completed", "tag": "959de9bf-4dd5-436d-bc7b-c7385ccfdaa0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:32.814115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:32.815859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: 610b3d47-8df7-4d58-a7fd-aaeff3de4553] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:32.837892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:32.837892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:32.837892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:32.837892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:32.859433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-227b3908-881a-451f-8f06-86b05f28a40b req-f9a438e0-aa65-41f2-a276-57cc1a9916ff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:32.859887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-227b3908-881a-451f-8f06-86b05f28a40b req-f9a438e0-aa65-41f2-a276-57cc1a9916ff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:32.882453 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] HTTP exception thrown: Instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 could not be found. Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Request method failure captured: Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 HTTP/1.1 Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsyDCdfUoqsGGcsTKC999Y8HsgsgPI3PYEJKtrScZAcHvbNQtBgaYc8np0NBJ5lMN1fxd3kAxBdid6ygeV3JoWxv1slF3N7zZDDpV6Ea7PftPT0b05McM5hFYDVYaeYnYfKIQUGkFhmpWqz_K7P3EEOeVg7HXBv47-_8SQxR4KrVICw Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 06fc685846434344b8b938ccb1dae960 Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-LiveMigrationNegativeTest-1640593553 Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:32.903041 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06fc685846434344b8b938ccb1dae960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/06fc685846434344b8b938ccb1dae960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_06fc685846434344b8b938ccb1dae960", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06fc685846434344b8b938ccb1dae960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-LiveMigrationNegativeTest-1640593553 Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 06fc685846434344b8b938ccb1dae960 Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1640593553 Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-LiveMigrationNegativeTest-1640593553-project Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 315591357d264b42938cf6eab54a699a Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-LiveMigrationNegativeTest-1640593553-project Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 could not be found. Jul 01 10:30:32.905043 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '610b3d47-8df7-4d58-a7fd-aaeff3de4553'} Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 could not be found. Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:32.905998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 could not be found. Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 could not be found. Jul 01 10:30:32.907296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:32.911901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Returning 404 to user: Instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:32.914211 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa200c65-ed72-48c6-8c53-06305fc30b2a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553" status: 404 len: 111 microversion: 2.1 time: 0.120007 Jul 01 10:30:32.923396 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 560/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:32 2022] GET /compute/v2.1/servers/610b3d47-8df7-4d58-a7fd-aaeff3de4553 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:32.933803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:32.934940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:32.947500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:32.957184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:32.957184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:32.957894 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-227b3908-881a-451f-8f06-86b05f28a40b req-f9a438e0-aa65-41f2-a276-57cc1a9916ff service nova] Creating event network-vif-unplugged:29d02663-dbc8-4074-aafb-728f803f4182 for instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 on n-h1-master-1 Jul 01 10:30:32.957998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:32.958165 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-227b3908-881a-451f-8f06-86b05f28a40b req-f9a438e0-aa65-41f2-a276-57cc1a9916ff service nova] Creating event network-vif-unplugged:7275b96c-4d48-4f7c-8112-3a73ee00f6fa for instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 on n-h2-master-1 Jul 01 10:30:32.958165 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-227b3908-881a-451f-8f06-86b05f28a40b req-f9a438e0-aa65-41f2-a276-57cc1a9916ff service nova] Creating event network-vif-unplugged:959de9bf-4dd5-436d-bc7b-c7385ccfdaa0 for instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 on n-h2-master-1 Jul 01 10:30:32.995020 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-227b3908-881a-451f-8f06-86b05f28a40b req-f9a438e0-aa65-41f2-a276-57cc1a9916ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.198333 Jul 01 10:30:32.996152 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 593/1153] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:33.014175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5fbd7c36-14d6-440f-aa90-2a3881c8dc7a req-d67ca821-3180-48fb-81a8-c8ae1cdd1d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56be635-1bd7-40c9-b62e-c6d3710f52c6", "name": "network-vif-deleted", "tag": "72946124-356f-475a-8aef-b673fc28b874"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:33.025098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5fbd7c36-14d6-440f-aa90-2a3881c8dc7a req-d67ca821-3180-48fb-81a8-c8ae1cdd1d67 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:33.026011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5fbd7c36-14d6-440f-aa90-2a3881c8dc7a req-d67ca821-3180-48fb-81a8-c8ae1cdd1d67 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:33.046774 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5fbd7c36-14d6-440f-aa90-2a3881c8dc7a req-d67ca821-3180-48fb-81a8-c8ae1cdd1d67 service nova] Creating event network-vif-deleted:72946124-356f-475a-8aef-b673fc28b874 for instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 on n-h1-master-1 Jul 01 10:30:33.059463 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5fbd7c36-14d6-440f-aa90-2a3881c8dc7a req-d67ca821-3180-48fb-81a8-c8ae1cdd1d67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060627 Jul 01 10:30:33.061216 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 594/1154] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:33.068825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:33.070580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:33.078322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:33.078995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:33.081690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:33.082358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:33.272489 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:33.773491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:33.793049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:33.794639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:33.796913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:33.799152 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-870ff717-282b-4bbc-b41e-744f36308d66 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.735893 Jul 01 10:30:33.801261 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 595/1155] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:33 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:33.806070 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-63e515ca-389e-48f2-89c4-e4311dff2f65 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1541 microversion: 2.1 time: 0.881058 Jul 01 10:30:33.807266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 561/1156] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:32 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1541 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:33.807518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:33.808431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:33.816148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:33.824268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:33.825135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:33.825651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:33.890062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:33.890862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:33.890862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lazy-loading 'fault' on Instance uuid 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:34.046415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-edf016a8-30df-4c34-81a6-456e0353542b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:34.050708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-edf016a8-30df-4c34-81a6-456e0353542b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Searching by: {'deleted': False, 'project_id': '417939a3f8714997b714e68ea07e1e4b'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:34.071859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf016a8-30df-4c34-81a6-456e0353542b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.072312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf016a8-30df-4c34-81a6-456e0353542b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.073114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf016a8-30df-4c34-81a6-456e0353542b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.073777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf016a8-30df-4c34-81a6-456e0353542b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.239624 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-edf016a8-30df-4c34-81a6-456e0353542b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.426675 Jul 01 10:30:34.239624 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 562/1157] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:30:33 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:34.242651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:34.243426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:34.254354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.255077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.256153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.256777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.298663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:34.301976 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:34.556545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:34.562783 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-19c52a81-06b0-42f5-96e4-a8eec8740d9c tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 200 len: 1309 microversion: 2.1 time: 0.760213 Jul 01 10:30:34.563847 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 596/1158] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:33 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 1309 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:34.570944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:34.571864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:34.581657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.582418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.584363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.584363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.610578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-70ccfdfd-303c-4082-bc17-f4df4a5995ca tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 204 len: 0 microversion: 2.1 time: 0.372471 Jul 01 10:30:34.618749 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 563/1159] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:34 2022] DELETE /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:34.621912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:34.628590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Searching by: {'deleted': False} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:34.662374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.663701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.664920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.665908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.710442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:34.718169 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-625b0640-6267-4c7b-8756-42ff0f0c1702 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 200 len: 1486 microversion: 2.1 time: 0.153022 Jul 01 10:30:34.719313 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 597/1160] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:34 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 1486 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:34.738155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:34.750169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:34.764003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.765186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.786404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:34.787332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:34.852077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:30:35.012038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:35.012825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:35.797095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:35.810910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b07ef971-3715-493f-a34e-abc746ad370a tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1475 microversion: 2.1 time: 1.089568 Jul 01 10:30:35.812210 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 598/1161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:34 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1475 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:35.822892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:35.830615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:35.832935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:35.834775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:35.835851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:35.836481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.277361 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d217bf1-f30a-4615-9502-f30ee22ed2bf tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17895 microversion: 2.1 time: 1.643531 Jul 01 10:30:36.277361 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 564/1162] 10.222.0.23 () {58 vars in 1170 bytes} [Fri Jul 1 10:30:34 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17895 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:30:36.290298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:36.293754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:36.307139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.311540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.311540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.313322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.356094 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:36.375815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:36.377711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:36.379153 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-404146fa-7ebc-4880-a7f9-6a702a2588aa tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1568 microversion: 2.25 time: 0.565259 Jul 01 10:30:36.382126 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 599/1163] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:35 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1568 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:36.397358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-74006e0a-40bb-4db5-82d0-b59b3d99d0f2 req-14adc49a-af28-4914-8ace-a40f207f860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610b3d47-8df7-4d58-a7fd-aaeff3de4553", "name": "network-vif-deleted", "tag": "7275b96c-4d48-4f7c-8112-3a73ee00f6fa"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:36.406694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-74006e0a-40bb-4db5-82d0-b59b3d99d0f2 req-14adc49a-af28-4914-8ace-a40f207f860f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.407445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-74006e0a-40bb-4db5-82d0-b59b3d99d0f2 req-14adc49a-af28-4914-8ace-a40f207f860f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.421883 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-74006e0a-40bb-4db5-82d0-b59b3d99d0f2 req-14adc49a-af28-4914-8ace-a40f207f860f service nova] Creating event network-vif-deleted:7275b96c-4d48-4f7c-8112-3a73ee00f6fa for instance 610b3d47-8df7-4d58-a7fd-aaeff3de4553 on n-h2-master-1 Jul 01 10:30:36.434001 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-74006e0a-40bb-4db5-82d0-b59b3d99d0f2 req-14adc49a-af28-4914-8ace-a40f207f860f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047474 Jul 01 10:30:36.434830 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 600/1164] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:36.442113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5ec6ddd9-50ef-448d-a42c-d661e2b6eab4 req-d1953729-5c82-4e3e-a238-e2c96220fe9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9245057-43b9-492e-8f86-ac014664d207", "name": "network-vif-unplugged", "status": "completed", "tag": "c0c447ef-8eab-4c35-96c1-29d659a0f21b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:36.452450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5ec6ddd9-50ef-448d-a42c-d661e2b6eab4 req-d1953729-5c82-4e3e-a238-e2c96220fe9e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.455448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5ec6ddd9-50ef-448d-a42c-d661e2b6eab4 req-d1953729-5c82-4e3e-a238-e2c96220fe9e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.472395 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5ec6ddd9-50ef-448d-a42c-d661e2b6eab4 req-d1953729-5c82-4e3e-a238-e2c96220fe9e service nova] Creating event network-vif-unplugged:c0c447ef-8eab-4c35-96c1-29d659a0f21b for instance f9245057-43b9-492e-8f86-ac014664d207 on n-h2-master-1 Jul 01 10:30:36.484271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-5ec6ddd9-50ef-448d-a42c-d661e2b6eab4 req-d1953729-5c82-4e3e-a238-e2c96220fe9e service nova] Instance f9245057-43b9-492e-8f86-ac014664d207 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:30:36.487264 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5ec6ddd9-50ef-448d-a42c-d661e2b6eab4 req-d1953729-5c82-4e3e-a238-e2c96220fe9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050858 Jul 01 10:30:36.489319 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 601/1165] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:36.494997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-99fec660-c58a-4351-b456-79e6897ff48d req-77b14944-09c2-4fad-a36f-f3910ac25660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1104472d-27ae-4dfc-afaa-fc1f4c6d52a7", "name": "network-vif-deleted", "tag": "29d02663-dbc8-4074-aafb-728f803f4182"}, {"server_uuid": "7b9d6ca9-85e6-4713-ad73-a753e315637f", "name": "network-vif-deleted", "tag": "6b4ab1fe-7a60-495f-9cf4-fa56c9c65a20"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:36.506778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-99fec660-c58a-4351-b456-79e6897ff48d req-77b14944-09c2-4fad-a36f-f3910ac25660 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.507228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-99fec660-c58a-4351-b456-79e6897ff48d req-77b14944-09c2-4fad-a36f-f3910ac25660 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.524744 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-99fec660-c58a-4351-b456-79e6897ff48d req-77b14944-09c2-4fad-a36f-f3910ac25660 service nova] Creating event network-vif-deleted:29d02663-dbc8-4074-aafb-728f803f4182 for instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 on n-h1-master-1 Jul 01 10:30:36.525850 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-99fec660-c58a-4351-b456-79e6897ff48d req-77b14944-09c2-4fad-a36f-f3910ac25660 service nova] Creating event network-vif-deleted:6b4ab1fe-7a60-495f-9cf4-fa56c9c65a20 for instance 7b9d6ca9-85e6-4713-ad73-a753e315637f on n-h2-master-1 Jul 01 10:30:36.536298 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-99fec660-c58a-4351-b456-79e6897ff48d req-77b14944-09c2-4fad-a36f-f3910ac25660 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045324 Jul 01 10:30:36.538264 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 602/1166] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:36.545721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:36.546753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:36.555245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.557371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.558369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.558969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.579912 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 could not be found. Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 HTTP/1.1 Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:36.582622 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 could not be found. Jul 01 10:30:36.584049 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1104472d-27ae-4dfc-afaa-fc1f4c6d52a7'} Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 could not be found. Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:36.584823 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 could not be found. Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 could not be found. Jul 01 10:30:36.586256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.589891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance 1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:36.590982 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a96b047-7fb0-4122-8be6-559fd718bc18 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7" status: 404 len: 111 microversion: 2.1 time: 0.051345 Jul 01 10:30:36.595551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 603/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:36 2022] GET /compute/v2.1/servers/1104472d-27ae-4dfc-afaa-fc1f4c6d52a7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:36.603536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:36.604390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:36.611948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.616682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.616682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.616682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.649378 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f HTTP/1.1 Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:36.651259 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:30:36.652964 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7b9d6ca9-85e6-4713-ad73-a753e315637f'} Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:36.653856 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:30:36.655140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.660551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:36.661838 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a188c521-c705-4dde-9b67-b568a87bc66c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 404 len: 111 microversion: 2.1 time: 0.064910 Jul 01 10:30:36.665527 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 604/1168] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:36 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:36.695839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4dbc7abf-062f-41f2-aa2e-b16d347b19b8 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:36.700668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4dbc7abf-062f-41f2-aa2e-b16d347b19b8 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Searching by: {'deleted': False, 'project_id': '417939a3f8714997b714e68ea07e1e4b'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:36.720613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dbc7abf-062f-41f2-aa2e-b16d347b19b8 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.723590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dbc7abf-062f-41f2-aa2e-b16d347b19b8 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.726009 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dbc7abf-062f-41f2-aa2e-b16d347b19b8 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.728283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dbc7abf-062f-41f2-aa2e-b16d347b19b8 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.837953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:36.860080 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b894539a-97e7-4eda-85e7-7c92eacd5f43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1473 microversion: 2.1 time: 0.580734 Jul 01 10:30:36.866729 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 565/1169] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:36 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1473 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:36.879274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:36.884099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: b56be635-1bd7-40c9-b62e-c6d3710f52c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:36.890994 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4dbc7abf-062f-41f2-aa2e-b16d347b19b8 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=1ca92b2cafba4257b5f4931764621897" status: 200 len: 15 microversion: 2.1 time: 0.221292 Jul 01 10:30:36.894129 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 605/1170] 10.222.0.23 () {58 vars in 1230 bytes} [Fri Jul 1 10:30:36 2022] GET /compute/v2.1/servers/detail?tenant_id=1ca92b2cafba4257b5f4931764621897 => generated 15 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:36.895643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.896339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.897444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.898061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.904494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1627772589", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:36.917719 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 could not be found. Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 HTTP/1.1 Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:36.919654 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: exception: Instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 could not be found. Jul 01 10:30:36.921289 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'b56be635-1bd7-40c9-b62e-c6d3710f52c6'} Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 could not be found. Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:36.922192 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 could not be found. Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 could not be found. Jul 01 10:30:36.924713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:36.930934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance b56be635-1bd7-40c9-b62e-c6d3710f52c6 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:36.932724 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6cd604e-590a-4a7b-acdf-16d9d2ab5f66 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6" status: 404 len: 111 microversion: 2.1 time: 0.064522 Jul 01 10:30:36.934032 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 566/1171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:36 2022] GET /compute/v2.1/servers/b56be635-1bd7-40c9-b62e-c6d3710f52c6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:36.940101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:36.941399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:36.952130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.952588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:36.955290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:36.955917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:37.036658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] validate_networks() for [('14a0a945-9224-4c59-b797-2941c9320d9a', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:30:37.435588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:37.447709 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7262acd0-7a7d-4b50-9bcc-ad60c3a9b4f7 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1475 microversion: 2.1 time: 0.512378 Jul 01 10:30:37.452166 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 567/1172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:36 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1475 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:37.459259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:37.483705 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Searching by: {'tenant_id': '1ca92b2cafba4257b5f4931764621897', 'deleted': False} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:37.497908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:37.503514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:37.503514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:37.503514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:37.587427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:30:37.802436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:37.802931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:38.397115 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b259a825-a01b-4232-a37f-9b92a7c2ca36 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1ca92b2cafba4257b5f4931764621897" status: 200 len: 4825 microversion: 2.1 time: 0.939392 Jul 01 10:30:38.397115 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 568/1173] 10.222.0.23 () {58 vars in 1256 bytes} [Fri Jul 1 10:30:37 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1ca92b2cafba4257b5f4931764621897 => generated 4825 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:38.399043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2038f461-c6e3-4074-8d6a-d9477d609a1a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:38.504287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:30:38.504991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:30:38.505563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:30:38.505971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:30:38.506380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:30:38.535279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:38.535730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:38.536748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:38.537385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:38.552207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2038f461-c6e3-4074-8d6a-d9477d609a1a tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/b77eb36d-a0ec-491e-8dcb-c83920fd1264" status: 204 len: 0 microversion: 2.1 time: 0.156707 Jul 01 10:30:38.553135 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 569/1174] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:30:38 2022] DELETE /compute/v2.1/os-server-groups/b77eb36d-a0ec-491e-8dcb-c83920fd1264 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:38.558949 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:38.562057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:38.562954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:38.575266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:38.578762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:38.578919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:38.581050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:38.581877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:38.583925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Getting quotas for user 877a848749ec4975beaf9ec07bc3b2e6 and project 7c5bd64c68cb4f35b7e894e017bab3f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:38.605565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:30:38.608759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:30:38.804228 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6fa8b34e-1bd4-45ed-832c-b812d9e45823 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.908536 Jul 01 10:30:38.809561 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 606/1175] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:30:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:30:38.818630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:38.818630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:38.832861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:38.837121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:38.838125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:38.839799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:38.952172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:38.973673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:38.978896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:38.981260 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c43e4a27-176f-4d6c-894e-ab23edd0ff57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1543 microversion: 2.25 time: 0.426200 Jul 01 10:30:38.983301 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 570/1176] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:38 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1543 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:38.989942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d8c2e88-8eca-4b4b-a633-a9a3385072ad tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:38.996015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d8c2e88-8eca-4b4b-a633-a9a3385072ad tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Searching by: {'tenant_id': '417939a3f8714997b714e68ea07e1e4b', 'deleted': False} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:39.012738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d8c2e88-8eca-4b4b-a633-a9a3385072ad tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.013304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d8c2e88-8eca-4b4b-a633-a9a3385072ad tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.014116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d8c2e88-8eca-4b4b-a633-a9a3385072ad tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.014717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d8c2e88-8eca-4b4b-a633-a9a3385072ad tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.062321 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d8c2e88-8eca-4b4b-a633-a9a3385072ad tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=417939a3f8714997b714e68ea07e1e4b" status: 200 len: 15 microversion: 2.1 time: 0.076382 Jul 01 10:30:39.062897 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 571/1177] 10.222.0.23 () {58 vars in 1256 bytes} [Fri Jul 1 10:30:38 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=417939a3f8714997b714e68ea07e1e4b => generated 15 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:39.082028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:39.082684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:39.092077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.092788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.094278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.115710 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.290819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315591357d264b42938cf6eab54a699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fc685846434344b8b938ccb1dae960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:39.309775 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c10c4e9f-e1b9-41bb-bbfd-8adf0bbfe6bd tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 200 len: 1304 microversion: 2.1 time: 0.237644 Jul 01 10:30:39.321377 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 572/1178] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:39 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:39.332350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:39.339921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:39.356786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.363241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.364909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.365974 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.402391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:39.406735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:39.415349 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3c968997-423a-4b31-aba3-519eee8f8c86 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1470 microversion: 2.1 time: 0.603789 Jul 01 10:30:39.430361 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 607/1179] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:38 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1470 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:39.439815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7ec41585-0892-48ff-b8ab-aecd16487816 req-1a817af2-1948-4dbf-9b9e-d95068e829a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43b75c0-e10d-4c17-bee5-19bf28959a94", "name": "network-vif-deleted", "tag": "db63aca7-c13d-4316-887a-56d63f9aa667"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:39.492021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7ec41585-0892-48ff-b8ab-aecd16487816 req-1a817af2-1948-4dbf-9b9e-d95068e829a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.494681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7ec41585-0892-48ff-b8ab-aecd16487816 req-1a817af2-1948-4dbf-9b9e-d95068e829a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.544085 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7ec41585-0892-48ff-b8ab-aecd16487816 req-1a817af2-1948-4dbf-9b9e-d95068e829a6 service nova] Creating event network-vif-deleted:db63aca7-c13d-4316-887a-56d63f9aa667 for instance e43b75c0-e10d-4c17-bee5-19bf28959a94 on n-h1-master-1 Jul 01 10:30:39.553629 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7ec41585-0892-48ff-b8ab-aecd16487816 req-1a817af2-1948-4dbf-9b9e-d95068e829a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120976 Jul 01 10:30:39.557684 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 608/1180] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:39.565841 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2fb682ad-b0b3-45c1-9cb9-d37ddcf9f265 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:39.567366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2fb682ad-b0b3-45c1-9cb9-d37ddcf9f265 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:39.695450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2fb682ad-b0b3-45c1-9cb9-d37ddcf9f265 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:39.706142 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2fb682ad-b0b3-45c1-9cb9-d37ddcf9f265 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1225 microversion: 2.1 time: 0.146826 Jul 01 10:30:39.707470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 609/1181] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:39 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1225 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:39.714351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5864c0a9-c84a-4cd5-9fd6-1ec4c6ed46bc tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '.version_select at 0x7f6f91da7040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:39.717057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5864c0a9-c84a-4cd5-9fd6-1ec4c6ed46bc tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.717838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5864c0a9-c84a-4cd5-9fd6-1ec4c6ed46bc tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.731330 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5864c0a9-c84a-4cd5-9fd6-1ec4c6ed46bc tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.022638 Jul 01 10:30:39.733992 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 610/1182] 10.222.0.23 () {60 vars in 1183 bytes} [Fri Jul 1 10:30:39 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:39.737794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46bc6936-47e6-4f79-905d-46859360102e tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:39.742405 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46bc6936-47e6-4f79-905d-46859360102e tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008898 Jul 01 10:30:39.754486 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 611/1183] 10.222.0.23 () {58 vars in 1188 bytes} [Fri Jul 1 10:30:39 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:39.762991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:39.768639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:39.771663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.772112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.773255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.773691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.789824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-75acd523-4c42-408d-a0bc-6374f840c16d tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 204 len: 0 microversion: 2.1 time: 0.466768 Jul 01 10:30:39.792455 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 573/1184] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:39 2022] DELETE /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:39.811359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:39.816766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:39.826510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.827203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.828692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.829906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.857946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.858615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.859907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:39.860511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:39.953559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:39.963347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for user 0dcb8296a8934a8cbc89d6df73d4a526 and project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:40.156564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:40.182702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b75164c7-7159-4201-93c4-64bd197553c0 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 2035 microversion: 2.25 time: 0.386870 Jul 01 10:30:40.183295 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 574/1185] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:39 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 2035 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:40.194644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-344b4b71-2dc3-4179-a328-8ff173700731 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:40.206796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-344b4b71-2dc3-4179-a328-8ff173700731 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:40.217914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b4b71-2dc3-4179-a328-8ff173700731 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.218571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b4b71-2dc3-4179-a328-8ff173700731 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.219523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b4b71-2dc3-4179-a328-8ff173700731 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.220491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b4b71-2dc3-4179-a328-8ff173700731 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.542145 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-344b4b71-2dc3-4179-a328-8ff173700731 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action" status: 202 len: 0 microversion: 2.1 time: 0.357243 Jul 01 10:30:40.545561 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 575/1186] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:40 2022] POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:30:40.547794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:40.549003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:40.559103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.559883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.560874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.561525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.568161 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8358f83-03de-41e0-b558-6265c4a4231a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207/action" status: 202 len: 0 microversion: 2.1 time: 0.811961 Jul 01 10:30:40.571535 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 612/1187] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:39 2022] POST /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:30:40.580630 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:40.582768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ab2d15d3-5cc8-41b4-a266-a3275bc23868 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Action: 'create', calling method: .version_select at 0x7f6f921e5550>, body: {"keypair": {"name": "tempest-keypair-1580804816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeSM+Dw01RTVPwwf34qrgtHSusi1DI7hmaHh3sphYS8cMaDlSYvl96AdiMDI02ACZz5aFWc9Dnnr6KvYKNxy4bjsi7LIE0Jg0ExHWKtNDBn9gK6Nuz4PYsNtuQsxP6NxQ=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:40.620486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ab2d15d3-5cc8-41b4-a266-a3275bc23868 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:40.649023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ab2d15d3-5cc8-41b4-a266-a3275bc23868 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for user cd7034799f014e95bbe8ed18fdc424a6 and project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:40.796573 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ab2d15d3-5cc8-41b4-a266-a3275bc23868 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.223117 Jul 01 10:30:40.797311 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 613/1188] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:30:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 225 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:30:40.803604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:40.804221 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] [instance: e43b75c0-e10d-4c17-bee5-19bf28959a94] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:40.811837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.812511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.813330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.814253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.858574 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] HTTP exception thrown: Instance e43b75c0-e10d-4c17-bee5-19bf28959a94 could not be found. Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Request method failure captured: Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 HTTP/1.1 Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsyDCdfUoqsGGcsTKC999Y8HsgsgPI3PYEJKtrScZAcHvbNQtBgaYc8np0NBJ5lMN1fxd3kAxBdid6ygeV3JoWxv1slF3N7zZDDpV6Ea7PftPT0b05McM5hFYDVYaeYnYfKIQUGkFhmpWqz_K7P3EEOeVg7HXBv47-_8SQxR4KrVICw Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 06fc685846434344b8b938ccb1dae960 Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveMigrationNegativeTest-1640593553 Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:30:40.861916 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06fc685846434344b8b938ccb1dae960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/06fc685846434344b8b938ccb1dae960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_06fc685846434344b8b938ccb1dae960", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06fc685846434344b8b938ccb1dae960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveMigrationNegativeTest-1640593553 Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 06fc685846434344b8b938ccb1dae960 Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1640593553 Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveMigrationNegativeTest-1640593553-project Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 315591357d264b42938cf6eab54a699a Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveMigrationNegativeTest-1640593553-project Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e43b75c0-e10d-4c17-bee5-19bf28959a94 could not be found. Jul 01 10:30:40.863555 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e43b75c0-e10d-4c17-bee5-19bf28959a94'} Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43b75c0-e10d-4c17-bee5-19bf28959a94 could not be found. Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:40.864500 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43b75c0-e10d-4c17-bee5-19bf28959a94 could not be found. Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43b75c0-e10d-4c17-bee5-19bf28959a94 could not be found. Jul 01 10:30:40.866053 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:40.868223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] Returning 404 to user: Instance e43b75c0-e10d-4c17-bee5-19bf28959a94 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:40.869295 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-617abe73-b8d8-4ada-9157-60b29506ad39 tempest-LiveMigrationNegativeTest-1640593553 tempest-LiveMigrationNegativeTest-1640593553-project] 10.222.0.23 "GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94" status: 404 len: 111 microversion: 2.1 time: 0.071108 Jul 01 10:30:40.870303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 614/1189] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:40 2022] GET /compute/v2.1/servers/e43b75c0-e10d-4c17-bee5-19bf28959a94 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:40.878393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-044ec4d2-66b5-484d-8178-b32747e24f35 req-82180f79-e751-4741-846a-025767b54968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9245057-43b9-492e-8f86-ac014664d207", "name": "network-vif-plugged", "status": "completed", "tag": "c0c447ef-8eab-4c35-96c1-29d659a0f21b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:40.888293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-044ec4d2-66b5-484d-8178-b32747e24f35 req-82180f79-e751-4741-846a-025767b54968 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.888961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-044ec4d2-66b5-484d-8178-b32747e24f35 req-82180f79-e751-4741-846a-025767b54968 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.910996 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-044ec4d2-66b5-484d-8178-b32747e24f35 req-82180f79-e751-4741-846a-025767b54968 service nova] Creating event network-vif-plugged:c0c447ef-8eab-4c35-96c1-29d659a0f21b for instance f9245057-43b9-492e-8f86-ac014664d207 on n-h2-master-1 Jul 01 10:30:40.922093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-044ec4d2-66b5-484d-8178-b32747e24f35 req-82180f79-e751-4741-846a-025767b54968 service nova] Instance f9245057-43b9-492e-8f86-ac014664d207 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:30:40.934032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-044ec4d2-66b5-484d-8178-b32747e24f35 req-82180f79-e751-4741-846a-025767b54968 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061846 Jul 01 10:30:40.940386 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 615/1190] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:40.948388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:40.953633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:40.958611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '1ca92b2cafba4257b5f4931764621897'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:40.963863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.964397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:40.965601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:40.966105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:41.083201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:30:41.173828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b9450ee7-8f70-48f2-a96b-612e929d6252 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.230955 Jul 01 10:30:41.175615 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 616/1191] 10.222.0.23 () {58 vars in 1149 bytes} [Fri Jul 1 10:30:40 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:41.181979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:41.192178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:41.192178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:41.192178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:41.192567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:41.193011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:41.397537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:41.416448 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45d37064-3750-4eea-8d02-4cb91d7a7c3b tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1472 microversion: 2.1 time: 0.872061 Jul 01 10:30:41.419122 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 576/1192] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:40 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1472 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:41.426202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:41.428572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:41.443614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:41.443614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:41.444467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:41.449240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:41.736298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:41.757775 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f67211e6-a4ef-4fc7-a57f-39aac6f9f650 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1229 microversion: 2.1 time: 0.336371 Jul 01 10:30:41.760582 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 577/1193] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:41 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1229 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:41.780224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c2161431-0234-4ab4-8b29-8fe95c528abb tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:41.784655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c2161431-0234-4ab4-8b29-8fe95c528abb tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:41.812096 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2161431-0234-4ab4-8b29-8fe95c528abb tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:41.815711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2161431-0234-4ab4-8b29-8fe95c528abb tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:41.817464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2161431-0234-4ab4-8b29-8fe95c528abb tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:41.819816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2161431-0234-4ab4-8b29-8fe95c528abb tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:41.868361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:41.878406 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-666cf89a-3c3f-4b79-8a80-4055c18aeff7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1469 microversion: 2.1 time: 0.701464 Jul 01 10:30:41.890370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 617/1194] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:41 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1469 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:42.216277 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c2161431-0234-4ab4-8b29-8fe95c528abb tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action" status: 202 len: 0 microversion: 2.1 time: 0.452457 Jul 01 10:30:42.217136 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 578/1195] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:41 2022] POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:30:42.234272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-edb1ad72-76a6-40b3-9e7a-0d40eaf45950 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:42.236831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-edb1ad72-76a6-40b3-9e7a-0d40eaf45950 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:42.252140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edb1ad72-76a6-40b3-9e7a-0d40eaf45950 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.253500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edb1ad72-76a6-40b3-9e7a-0d40eaf45950 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.255774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edb1ad72-76a6-40b3-9e7a-0d40eaf45950 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.257916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edb1ad72-76a6-40b3-9e7a-0d40eaf45950 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.436065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09a8b848-5c01-47df-93ff-a65946eaa0fd tempest-AbsoluteLimitsTestJSON-238989344 tempest-AbsoluteLimitsTestJSON-238989344-project] Calling method '.version_select at 0x7f6f91db5790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:42.457038 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:42.473816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a8b848-5c01-47df-93ff-a65946eaa0fd tempest-AbsoluteLimitsTestJSON-238989344 tempest-AbsoluteLimitsTestJSON-238989344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.474580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a8b848-5c01-47df-93ff-a65946eaa0fd tempest-AbsoluteLimitsTestJSON-238989344 tempest-AbsoluteLimitsTestJSON-238989344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.476369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a8b848-5c01-47df-93ff-a65946eaa0fd tempest-AbsoluteLimitsTestJSON-238989344 tempest-AbsoluteLimitsTestJSON-238989344-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.477648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a8b848-5c01-47df-93ff-a65946eaa0fd tempest-AbsoluteLimitsTestJSON-238989344 tempest-AbsoluteLimitsTestJSON-238989344-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.522583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-09a8b848-5c01-47df-93ff-a65946eaa0fd tempest-AbsoluteLimitsTestJSON-238989344 tempest-AbsoluteLimitsTestJSON-238989344-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.640164 Jul 01 10:30:42.523498 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 618/1196] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Jul 1 10:30:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:42.571639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:42.574735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:42.600241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.601829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.607386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.611271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.726084 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-edb1ad72-76a6-40b3-9e7a-0d40eaf45950 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1615 microversion: 2.1 time: 0.500090 Jul 01 10:30:42.729193 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 579/1197] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:42 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1615 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:42.760584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-553cd292-1c0a-4af5-b8da-30dcf09946a6 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:42.763175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-553cd292-1c0a-4af5-b8da-30dcf09946a6 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:42.773396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553cd292-1c0a-4af5-b8da-30dcf09946a6 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.781455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553cd292-1c0a-4af5-b8da-30dcf09946a6 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.781455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553cd292-1c0a-4af5-b8da-30dcf09946a6 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.781455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553cd292-1c0a-4af5-b8da-30dcf09946a6 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.789261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:42.798102 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c1b5056-508b-4c7a-8cac-5bd2170a8831 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1430 microversion: 2.1 time: 0.273011 Jul 01 10:30:42.807970 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 619/1198] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:42 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1430 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:42.812840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:42.813674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:42.830537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.831267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.832204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:42.832778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:42.994971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:43.005559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-80fcfb0c-88df-43f6-b782-a2a4c0f2d630 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1295 microversion: 2.1 time: 0.195873 Jul 01 10:30:43.016353 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 620/1199] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:42 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1295 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:43.022333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:43.028002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:43.034284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.034861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.035629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.036057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.338735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-553cd292-1c0a-4af5-b8da-30dcf09946a6 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1615 microversion: 2.1 time: 0.592214 Jul 01 10:30:43.339301 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 580/1200] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:42 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1615 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:43.344336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4876134c-c795-4a5c-849f-7e0c3fa6de76 req-fdeee7d1-1ddc-4c7c-86de-95fdfffe8573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b54469-ddac-4b10-a1b4-61a4c7be16d9", "name": "network-vif-deleted", "tag": "e7c61238-8bcf-4fa1-86a7-287c7981ba37"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:43.370795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4876134c-c795-4a5c-849f-7e0c3fa6de76 req-fdeee7d1-1ddc-4c7c-86de-95fdfffe8573 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.371242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4876134c-c795-4a5c-849f-7e0c3fa6de76 req-fdeee7d1-1ddc-4c7c-86de-95fdfffe8573 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.417197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:43.426968 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee617fda-1310-4aaf-b99d-936afb71f006 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1469 microversion: 2.1 time: 0.408893 Jul 01 10:30:43.432860 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 621/1201] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:43 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1469 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:43.440750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:43.452026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:43.456051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4876134c-c795-4a5c-849f-7e0c3fa6de76 req-fdeee7d1-1ddc-4c7c-86de-95fdfffe8573 service nova] Creating event network-vif-deleted:e7c61238-8bcf-4fa1-86a7-287c7981ba37 for instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 on n-h2-master-1 Jul 01 10:30:43.470867 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4876134c-c795-4a5c-849f-7e0c3fa6de76 req-fdeee7d1-1ddc-4c7c-86de-95fdfffe8573 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127871 Jul 01 10:30:43.472087 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 581/1202] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:43.472215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.473637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.476719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.478659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.599006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:30:43.664300 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e9710c5-c718-4f03-83a4-3b83b950abab tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 1985 microversion: 2.1 time: 0.232944 Jul 01 10:30:43.665363 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 622/1203] 10.222.0.23 () {58 vars in 1189 bytes} [Fri Jul 1 10:30:43 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 1985 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:43.680909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d41cff19-9bfd-4aa8-8cb0-34093b73a9b1 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:43.692442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d41cff19-9bfd-4aa8-8cb0-34093b73a9b1 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:30:43.704147 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d41cff19-9bfd-4aa8-8cb0-34093b73a9b1 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.707744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d41cff19-9bfd-4aa8-8cb0-34093b73a9b1 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.712793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d41cff19-9bfd-4aa8-8cb0-34093b73a9b1 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.712793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d41cff19-9bfd-4aa8-8cb0-34093b73a9b1 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.824724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:43.825379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:43.839930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.840847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.843590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.844226 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.857634 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d41cff19-9bfd-4aa8-8cb0-34093b73a9b1 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.183492 Jul 01 10:30:43.864332 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 582/1204] 10.222.0.23 () {58 vars in 1195 bytes} [Fri Jul 1 10:30:43 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:43.878398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c226e57a-fab5-4565-84b9-99d279a27d3a tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:43.881495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c226e57a-fab5-4565-84b9-99d279a27d3a tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:43.891139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c226e57a-fab5-4565-84b9-99d279a27d3a tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.894291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c226e57a-fab5-4565-84b9-99d279a27d3a tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.900203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c226e57a-fab5-4565-84b9-99d279a27d3a tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.900663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c226e57a-fab5-4565-84b9-99d279a27d3a tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.923391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:43.924162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:43.924804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lazy-loading 'fault' on Instance uuid 25b54469-ddac-4b10-a1b4-61a4c7be16d9 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:30:44.067942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41a6d17bc1b420f90bb2e3b0c0be2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8388729edb84de9823cde8a7a3dba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:44.077721 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb3f8db0-a6a0-48e1-a1a2-94b9a30b3512 tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 200 len: 1307 microversion: 2.1 time: 0.257790 Jul 01 10:30:44.078305 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 623/1205] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:43 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:30:44.083592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:44.084204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:44.096077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.097851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.099194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.099461 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.289042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:44.302112 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2ef13aed-d9ee-4d96-9794-3d905cb12d47 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1283 microversion: 2.1 time: 0.222476 Jul 01 10:30:44.302705 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 624/1206] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:44 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1283 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:44.362448 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c226e57a-fab5-4565-84b9-99d279a27d3a tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action" status: 202 len: 0 microversion: 2.1 time: 0.488555 Jul 01 10:30:44.363498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 583/1207] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:43 2022] POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:30:44.372406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:44.374453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:44.382074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.382522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.383303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.383912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.411318 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:44.445409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:44.446955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:44.458917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.459691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.461175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.461831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.492709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:30:44.496861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:30:44.496861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:30:44.496861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:30:44.496861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:30:44.763876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:44.772248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.773093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.774199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.783984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.814837 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bd7d656-4341-47f8-b27f-73e0c273e7e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action" status: 202 len: 1068 microversion: 2.1 time: 0.447599 Jul 01 10:30:44.816279 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 625/1208] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:30:44 2022] POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action => generated 1068 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 01 10:30:44.820247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:44.821895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-896415005", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "510d1e57-c4e3-47f6-a81f-66e48831c93c"}], "security_groups": [{"name": "tempest-securitygroup--730935914"}], "key_name": "tempest-keypair-1580804816", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:44.834714 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f23a4cda-0ca9-4faf-afdc-88b17c0f433e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1469 microversion: 2.1 time: 0.393903 Jul 01 10:30:44.836101 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 584/1209] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:44 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:30:44.854889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:44.856260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:44.867539 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.873929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:44.880641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:44.880641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:45.225349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] validate_networks() for [('510d1e57-c4e3-47f6-a81f-66e48831c93c', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:30:45.371924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:45.382527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1687627-13d0-453c-8760-417180bfe297 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.544970 Jul 01 10:30:45.383332 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 585/1210] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:44 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:45.395685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:45.395685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] [instance: 25b54469-ddac-4b10-a1b4-61a4c7be16d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:45.399922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:45.400615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:45.401628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:45.402220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:45.423890 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] HTTP exception thrown: Instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 could not be found. Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Request method failure captured: Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 HTTP/1.1 Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvf_fjTr8sdLkwRBAegHMpM7umtvIzcsf4naQXlneiUG0ce3M9kJCZJ_FUu_pGGgYXB3KPL8XtPzR7Zvhv45felOBh829MZXL42I3-lIN6BV6jh3eipYygKObNdOjdG2IFYid1WSX6LYidhRM2dS5o29kE-iHDEHQT1EGAfDtq8e5s Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:30:45.426176 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8388729edb84de9823cde8a7a3dba2c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8388729edb84de9823cde8a7a3dba2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e8388729edb84de9823cde8a7a3dba2c Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-451899738 Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a41a6d17bc1b420f90bb2e3b0c0be2d5 Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersOnMultiNodesTest-451899738-project Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 could not be found. Jul 01 10:30:45.427947 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '25b54469-ddac-4b10-a1b4-61a4c7be16d9'} Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 could not be found. Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:45.428873 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 could not be found. Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 could not be found. Jul 01 10:30:45.430371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:30:45.432865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] Returning 404 to user: Instance 25b54469-ddac-4b10-a1b4-61a4c7be16d9 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:45.433925 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7373740c-1ba8-4ffb-b437-b7759ad64d7e tempest-ServersOnMultiNodesTest-451899738 tempest-ServersOnMultiNodesTest-451899738-project] 10.222.0.23 "GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9" status: 404 len: 111 microversion: 2.1 time: 0.049352 Jul 01 10:30:45.434833 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 586/1211] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:45 2022] GET /compute/v2.1/servers/25b54469-ddac-4b10-a1b4-61a4c7be16d9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:45.447488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:45.448163 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:45.455653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:45.456179 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:45.457121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:45.457577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:46.027817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:46.039366 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3373463c-24fe-4644-96de-7e5657f5ce0f tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1325 microversion: 2.1 time: 0.599053 Jul 01 10:30:46.040515 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 587/1212] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:45 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1325 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:46.050493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a6b79196-eaee-4b4c-a7e4-5be63f4cc9f1 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f91bfce50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:46.136112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a6b79196-eaee-4b4c-a7e4-5be63f4cc9f1 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74" status: 200 len: 637 microversion: 2.1 time: 0.093695 Jul 01 10:30:46.137784 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 588/1213] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:30:46 2022] GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74 => generated 637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:46.143026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:46.143660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:46.162289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:46.162661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:46.163443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:46.163875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:46.569653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:46.578649 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-161f21d9-53cc-465b-9d5b-0a8b5fddbdb6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1469 microversion: 2.1 time: 0.439801 Jul 01 10:30:46.579260 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 589/1214] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:46 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:46.591815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5929cb97-da68-43a4-bbf0-b6807662af20 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update_all', calling method: .version_select at 0x7f6f91c224c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:47.000166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:30:47.000650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:30:47.001455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:30:47.002015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:30:47.002432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:30:47.033019 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:47.035561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:47.035561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:47.035561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:47.104641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:47.111142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for user cd7034799f014e95bbe8ed18fdc424a6 and project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:47.136949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:30:47.139747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:30:47.221166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5929cb97-da68-43a4-bbf0-b6807662af20 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:47.229251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5929cb97-da68-43a4-bbf0-b6807662af20 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:47.282906 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-49e04ae1-7927-4ebd-bd13-13988ede785b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.463761 Jul 01 10:30:47.289685 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 626/1215] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:30:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:30:47.295859 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:47.300368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:47.305039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:47.305877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:47.307245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:47.307999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:47.705652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:47.714881 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-390a275e-93f3-4939-b06d-15ef9bcaafca tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.423817 Jul 01 10:30:47.715784 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 627/1216] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:47 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:47.721606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:47.722479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:47.730104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:47.730921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:47.732051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:47.732720 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:47.807576 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5929cb97-da68-43a4-bbf0-b6807662af20 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 61 microversion: 2.1 time: 1.222957 Jul 01 10:30:47.808255 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 590/1217] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:30:46 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 61 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:47.816217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b1d83b9-d112-4bae-8db3-6ba3fa417140 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:47.817017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b1d83b9-d112-4bae-8db3-6ba3fa417140 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:47.969204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b1d83b9-d112-4bae-8db3-6ba3fa417140 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:47.978183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b1d83b9-d112-4bae-8db3-6ba3fa417140 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:47.981710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b1d83b9-d112-4bae-8db3-6ba3fa417140 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:47.993277 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b1d83b9-d112-4bae-8db3-6ba3fa417140 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1285 microversion: 2.25 time: 0.171976 Jul 01 10:30:47.993277 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 591/1218] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:47 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:47.994404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-00bbbe32-d9a4-40fe-8527-4c079ceaf707 req-f05b47a0-b354-4426-9dc2-95914ca0a690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9105eb-0cc9-47e1-aefc-80b0e1d295c6", "tag": "0564be7a-919a-4e9a-9f29-c53e9c2ac28d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:48.016225 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:48.018054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-00bbbe32-d9a4-40fe-8527-4c079ceaf707 req-f05b47a0-b354-4426-9dc2-95914ca0a690 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:48.018505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-00bbbe32-d9a4-40fe-8527-4c079ceaf707 req-f05b47a0-b354-4426-9dc2-95914ca0a690 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:48.059678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-00bbbe32-d9a4-40fe-8527-4c079ceaf707 req-f05b47a0-b354-4426-9dc2-95914ca0a690 service nova] Creating event network-changed:0564be7a-919a-4e9a-9f29-c53e9c2ac28d for instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 on n-h2-master-1 Jul 01 10:30:48.065781 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-00bbbe32-d9a4-40fe-8527-4c079ceaf707 req-f05b47a0-b354-4426-9dc2-95914ca0a690 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076571 Jul 01 10:30:48.066960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 592/1219] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:48.073793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:48.075060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:48.082074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:48.082795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:48.083935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:48.084435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:48.209924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:48.233900 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1527c669-b5bd-4e5d-a8a7-81b41372f5b0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1325 microversion: 2.1 time: 0.507399 Jul 01 10:30:48.233900 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 628/1220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:47 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:48.236121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc1e1a2b-42ae-4b01-b331-4fe62497665f tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f91df30d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:48.467413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:48.476377 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-734e3f07-cc2b-4fbe-9278-69406ec6db01 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1535 microversion: 2.1 time: 0.408339 Jul 01 10:30:48.481038 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 593/1221] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:48 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1535 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:48.578683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ae6f1a1c-ac16-4dfc-897b-87a27fd72946 req-c42ecb9c-5815-45cc-ac46-ed95b53c63fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9245057-43b9-492e-8f86-ac014664d207", "name": "network-vif-unplugged", "status": "completed", "tag": "c0c447ef-8eab-4c35-96c1-29d659a0f21b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:48.606622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ae6f1a1c-ac16-4dfc-897b-87a27fd72946 req-c42ecb9c-5815-45cc-ac46-ed95b53c63fc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:48.609200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ae6f1a1c-ac16-4dfc-897b-87a27fd72946 req-c42ecb9c-5815-45cc-ac46-ed95b53c63fc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:48.652516 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ae6f1a1c-ac16-4dfc-897b-87a27fd72946 req-c42ecb9c-5815-45cc-ac46-ed95b53c63fc service nova] Creating event network-vif-unplugged:c0c447ef-8eab-4c35-96c1-29d659a0f21b for instance f9245057-43b9-492e-8f86-ac014664d207 on n-h2-master-1 Jul 01 10:30:48.660277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-ae6f1a1c-ac16-4dfc-897b-87a27fd72946 req-c42ecb9c-5815-45cc-ac46-ed95b53c63fc service nova] Instance f9245057-43b9-492e-8f86-ac014664d207 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:30:48.667869 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ae6f1a1c-ac16-4dfc-897b-87a27fd72946 req-c42ecb9c-5815-45cc-ac46-ed95b53c63fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095287 Jul 01 10:30:48.669124 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 594/1222] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:48.743909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:48.745010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:48.752691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:48.753541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:48.754564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:48.755186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:48.896878 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc1e1a2b-42ae-4b01-b331-4fe62497665f tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "DELETE /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.669906 Jul 01 10:30:48.897629 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 629/1223] 10.222.0.23 () {58 vars in 1295 bytes} [Fri Jul 1 10:30:48 2022] DELETE /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata/os_version => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:30:48.906872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb5ce13d-72be-44bd-9355-178db6098858 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f91ab9280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:48.955395 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb5ce13d-72be-44bd-9355-178db6098858 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 37 microversion: 2.1 time: 0.053524 Jul 01 10:30:48.956669 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 630/1224] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:30:48 2022] GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 37 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:48.969592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-571181b8-5fc9-499a-a179-f4b18ab4170d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update_all', calling method: .version_select at 0x7f6f91db5790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:48.986546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:48.998920 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-89dbfa97-6fed-4657-b156-aee41b2514ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.260228 Jul 01 10:30:48.999653 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 595/1225] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:48 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:49.061971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-571181b8-5fc9-499a-a179-f4b18ab4170d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:49.067937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-571181b8-5fc9-499a-a179-f4b18ab4170d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:49.177039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b05e33e-0113-4a7a-93d1-5fa54da25b3f tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] Calling method '.version_select at 0x7f6f91b5d0d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:49.178187 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:49.178187 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:30:49.193918 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b05e33e-0113-4a7a-93d1-5fa54da25b3f tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.174751 Jul 01 10:30:49.194818 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 596/1226] 10.222.0.23 () {58 vars in 1184 bytes} [Fri Jul 1 10:30:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:49.199858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:49.201375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:49.209588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:49.210253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:49.211133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:49.211688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:49.217933 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:49.303531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:49.313978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:49.315668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:49.317189 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6706b97-bf85-4a33-a006-1b6064642289 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1289 microversion: 2.25 time: 0.121154 Jul 01 10:30:49.318596 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 597/1227] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:49 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:49.324149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f12fc92b-c936-40e8-b5b8-86ad52172b09 tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91b5d280>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:49.342157 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:49.342157 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:30:49.508883 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-571181b8-5fc9-499a-a179-f4b18ab4170d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.546760 Jul 01 10:30:49.512238 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 631/1228] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:30:48 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 61 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 10:30:49.516999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:49.517643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:49.523634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:49.524074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:49.524838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:49.525293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:49.691154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:49.699381 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba62e7bf-9db5-47f6-8965-7d36b0fc3ded tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1325 microversion: 2.1 time: 0.188628 Jul 01 10:30:49.699938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 632/1229] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:49 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1325 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:49.710089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:49.710685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:49.716597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:49.721460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:49.721460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:49.721460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:49.881201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:49.888785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b387de2-960d-4b45-872b-c0368039885f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1535 microversion: 2.1 time: 0.187741 Jul 01 10:30:49.889393 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 633/1230] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:49 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1535 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:49.894432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ee4396c-6b45-4867-be4f-c95d60d287ad tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f91db59d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:49.931975 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ee4396c-6b45-4867-be4f-c95d60d287ad tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.041302 Jul 01 10:30:49.932544 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 634/1231] 10.222.0.23 () {58 vars in 1289 bytes} [Fri Jul 1 10:30:49 2022] GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata/os_distro => generated 33 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:49.942810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f372d2d-8ee4-472b-8120-e70b62d6c706 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update_all', calling method: .version_select at 0x7f6f91c55280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:50.013023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3f372d2d-8ee4-472b-8120-e70b62d6c706 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:50.020408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3f372d2d-8ee4-472b-8120-e70b62d6c706 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:50.319287 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f372d2d-8ee4-472b-8120-e70b62d6c706 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.380201 Jul 01 10:30:50.320085 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 635/1232] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:30:49 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 61 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 10:30:50.328028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:50.329666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:50.336880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:50.337362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:50.338326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:50.338762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:50.651612 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f12fc92b-c936-40e8-b5b8-86ad52172b09 tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.331737 Jul 01 10:30:50.652947 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 598/1233] 10.222.0.23 () {60 vars in 1205 bytes} [Fri Jul 1 10:30:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:50.669120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ce9d0909-669b-44e4-8217-9459074b8d6b tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f91bb7040>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:50.700481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:50.712337 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b84de008-4977-4771-8230-d4b0f7d63f56 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.390756 Jul 01 10:30:50.712829 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 636/1234] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:50 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:50.738306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce9d0909-669b-44e4-8217-9459074b8d6b tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.083237 Jul 01 10:30:50.739781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:50.739913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:50.744285 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 599/1235] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:30:50 2022] GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 61 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:50.755991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4c8cba69-c4c7-432d-82d5-12d829f0a526 tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] Calling method '.version_select at 0x7f6f91b1e700>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:50.758469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:50.759649 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:50.759649 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:30:50.760168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:50.760999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:50.761458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:50.791825 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4c8cba69-c4c7-432d-82d5-12d829f0a526 tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.037250 Jul 01 10:30:50.792390 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 600/1236] 10.222.0.23 () {58 vars in 1184 bytes} [Fri Jul 1 10:30:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:50.866745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:50.887453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:50.890760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:50.892182 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a3a10274-4ea1-44e6-8530-2b6f99d75e56 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1355 microversion: 2.25 time: 0.175526 Jul 01 10:30:50.893346 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 637/1237] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:50 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1355 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:50.898337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:50.901739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:50.913398 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:50.914134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:50.917452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:50.918313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:51.005024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9403207b-8545-4cae-a999-8c7d1290e2a6 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:51.006297 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:51.006297 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:30:51.008802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9403207b-8545-4cae-a999-8c7d1290e2a6 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:51.008802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9403207b-8545-4cae-a999-8c7d1290e2a6 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:51.008802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9403207b-8545-4cae-a999-8c7d1290e2a6 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:51.009242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9403207b-8545-4cae-a999-8c7d1290e2a6 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:51.033738 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9403207b-8545-4cae-a999-8c7d1290e2a6 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.239978 Jul 01 10:30:51.034643 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 601/1238] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:30:50 2022] GET /compute/v2.1/os-services => generated 944 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:51.051738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-359c4341-445d-4fd2-8de5-485020f1f290 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update_all', calling method: .version_select at 0x7f6f91b1e940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:51.109851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-359c4341-445d-4fd2-8de5-485020f1f290 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:51.115874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-359c4341-445d-4fd2-8de5-485020f1f290 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:51.414280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-359c4341-445d-4fd2-8de5-485020f1f290 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.378477 Jul 01 10:30:51.419235 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 602/1239] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:30:51 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 61 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:51.425432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8eeb42ea-eea9-48d6-8d10-d42c13997f12 tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91e26b80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:51.438375 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:51.438375 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:30:51.702780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:51.713401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a8d8b98-8cfc-416d-8143-b1c65ec589d8 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1325 microversion: 2.1 time: 0.818491 Jul 01 10:30:51.714142 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 638/1240] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:50 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1325 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:51.720907 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:51.721766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:51.729755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:51.730275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:51.731049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:51.731491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:51.876635 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=19,nova_api:INSERT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:52.162352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:52.172009 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-db32d94e-954f-464b-bf3b-789b236ca349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1528 microversion: 2.1 time: 0.455288 Jul 01 10:30:52.172599 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 639/1241] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:51 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1528 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:52.177951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b3eb9fd-06bc-4ce2-ad25-a0cc6b9a8e3e tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:52.181802 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:52.181802 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:30:52.183943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3eb9fd-06bc-4ce2-ad25-a0cc6b9a8e3e tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.184898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3eb9fd-06bc-4ce2-ad25-a0cc6b9a8e3e tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:52.186482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3eb9fd-06bc-4ce2-ad25-a0cc6b9a8e3e tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.187168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3eb9fd-06bc-4ce2-ad25-a0cc6b9a8e3e tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:52.216789 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b3eb9fd-06bc-4ce2-ad25-a0cc6b9a8e3e tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.042813 Jul 01 10:30:52.217779 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 640/1242] 10.222.0.23 () {58 vars in 1171 bytes} [Fri Jul 1 10:30:52 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:52.229404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c309eeb2-cdb5-4558-9f7b-e9930b0bc78d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update_all', calling method: .version_select at 0x7f6f91b2b1f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:52.289368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c309eeb2-cdb5-4558-9f7b-e9930b0bc78d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:52.295416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c309eeb2-cdb5-4558-9f7b-e9930b0bc78d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:52.308655 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8eeb42ea-eea9-48d6-8d10-d42c13997f12 tempest-QuotaClassesAdminTestJSON-2075145157 tempest-QuotaClassesAdminTestJSON-2075145157-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.887900 Jul 01 10:30:52.310610 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 603/1243] 10.222.0.23 () {60 vars in 1205 bytes} [Fri Jul 1 10:30:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:52.315881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:52.316828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:52.325997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.325997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:52.325997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.326240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:52.716957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:52.730648 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d063be00-20b7-4e5a-a377-7a833314482d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.418553 Jul 01 10:30:52.732082 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 604/1244] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:52 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:52.747104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:52.749326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:52.756331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.758480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:52.760183 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.761458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:52.846679 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c309eeb2-cdb5-4558-9f7b-e9930b0bc78d tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 64 microversion: 2.1 time: 0.626869 Jul 01 10:30:52.848487 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 641/1245] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:30:52 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 64 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:52.855989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:52.856847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:52.868179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.868846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:52.871677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:52.872357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.349896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:53.361994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:53.364197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:53.366031 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-90d107e8-2770-48f4-8d7b-0e9882e11d50 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.632445 Jul 01 10:30:53.368205 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 605/1246] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:52 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:53.383822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a12854a-d2af-4ea2-8b9c-f7d196b2d0c7 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:53.385218 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:53.385218 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:30:53.391412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a12854a-d2af-4ea2-8b9c-f7d196b2d0c7 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.391412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a12854a-d2af-4ea2-8b9c-f7d196b2d0c7 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.391412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a12854a-d2af-4ea2-8b9c-f7d196b2d0c7 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.391412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a12854a-d2af-4ea2-8b9c-f7d196b2d0c7 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.419523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:53.419939 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a12854a-d2af-4ea2-8b9c-f7d196b2d0c7 tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040183 Jul 01 10:30:53.427964 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 606/1247] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:30:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:53.433187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:53.433841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:53.434672 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5177b0e-609c-4d28-ad0d-0aa19d334f38 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1528 microversion: 2.1 time: 0.584636 Jul 01 10:30:53.435438 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 642/1248] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:52 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1528 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:53.439928 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0dd2671d-6dc9-42af-b605-59e12f70bf6a tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f921e5550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:53.451238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.451692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.452496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.452931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.515401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0dd2671d-6dc9-42af-b605-59e12f70bf6a tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 64 microversion: 2.1 time: 0.079042 Jul 01 10:30:53.516861 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 643/1249] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:30:53 2022] GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 64 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:53.522867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-974d1755-b172-4819-821b-399c0adbd5cd tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:53.525342 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:53.525342 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:30:53.526878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-974d1755-b172-4819-821b-399c0adbd5cd tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.527326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-974d1755-b172-4819-821b-399c0adbd5cd tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.528664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-974d1755-b172-4819-821b-399c0adbd5cd tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.529061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-974d1755-b172-4819-821b-399c0adbd5cd tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.556147 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-974d1755-b172-4819-821b-399c0adbd5cd tempest-ServicesAdminTestJSON-271514701 tempest-ServicesAdminTestJSON-271514701-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037411 Jul 01 10:30:53.557676 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 644/1250] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:30:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:53.562397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7905250a-c6ad-46a4-9dbf-1c8687389a6b tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:53.564542 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:30:53.564542 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:30:53.572353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7905250a-c6ad-46a4-9dbf-1c8687389a6b tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] HTTP exception thrown: Flavor 5a3d5174-dbad-4e84-b4b0-cd0f8c868564 could not be found. Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7905250a-c6ad-46a4-9dbf-1c8687389a6b tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Request method failure captured: Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/flavors/5a3d5174-dbad-4e84-b4b0-cd0f8c868564 HTTP/1.1 Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsviiwvUz4fmp4ZYvYIoI9iK4cZbBagQrz60l_jxq5K4u1OYUZ-AOo8PRDVZAC0wpdBEqgK8-sW8Mij0sNwwnGdivrm46ISsSt_7iaYQolRAHegvZ4JcDb7ZfiieiGIwT5BtlxRPIgfIJ8sWFrkjPv2V2LiJp0xiT_rGmVAPx9dy_mU Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 68d42bbbf8b6456a9206d9702bba80a8 Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MigrationsAdminTest-205391562 Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:30:53.582312 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68d42bbbf8b6456a9206d9702bba80a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/68d42bbbf8b6456a9206d9702bba80a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_68d42bbbf8b6456a9206d9702bba80a8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68d42bbbf8b6456a9206d9702bba80a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MigrationsAdminTest-205391562 Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 68d42bbbf8b6456a9206d9702bba80a8 Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MigrationsAdminTest-205391562 Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MigrationsAdminTest-205391562-project-admin Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: dc93ddc48d9b42e99facdd6a1dc08815 Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MigrationsAdminTest-205391562-project-admin Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: exception: Flavor 5a3d5174-dbad-4e84-b4b0-cd0f8c868564 could not be found. Jul 01 10:30:53.583676 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '5a3d5174-dbad-4e84-b4b0-cd0f8c868564'} Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5a3d5174-dbad-4e84-b4b0-cd0f8c868564 could not be found. Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:53.584495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5a3d5174-dbad-4e84-b4b0-cd0f8c868564 could not be found. Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5a3d5174-dbad-4e84-b4b0-cd0f8c868564 could not be found. Jul 01 10:30:53.586267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:30:53.587374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7905250a-c6ad-46a4-9dbf-1c8687389a6b tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Returning 404 to user: Flavor 5a3d5174-dbad-4e84-b4b0-cd0f8c868564 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:30:53.587374 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7905250a-c6ad-46a4-9dbf-1c8687389a6b tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/5a3d5174-dbad-4e84-b4b0-cd0f8c868564" status: 404 len: 109 microversion: 2.1 time: 0.025382 Jul 01 10:30:53.587374 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 645/1251] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:53 2022] DELETE /compute/v2.1/flavors/5a3d5174-dbad-4e84-b4b0-cd0f8c868564 => generated 109 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:30:53.598355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-036f7ce2-1904-4eb5-a420-dd28ed882669 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update_all', calling method: .version_select at 0x7f6f91df3160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:53.695362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-036f7ce2-1904-4eb5-a420-dd28ed882669 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:53.707911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-036f7ce2-1904-4eb5-a420-dd28ed882669 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:53.715473 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:53.810533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:53.840447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3054200-090e-4418-9beb-86cbda6f7733 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1325 microversion: 2.1 time: 0.417616 Jul 01 10:30:53.841317 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 607/1252] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:53 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:53.849659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:53.850495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:53.856946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.857429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:53.861574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:53.862087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:54.289775 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-036f7ce2-1904-4eb5-a420-dd28ed882669 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.700294 Jul 01 10:30:54.290362 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 646/1253] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:30:53 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 61 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:54.295597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1805651289", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:54.351330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:30:54.579799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:54.597516 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b2ae89e4-19f7-495e-8fa0-97572ad9d255 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.752797 Jul 01 10:30:54.598894 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 608/1254] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:53 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:54.605821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1c9ebbe-7109-4b58-b33b-e71fe72026bd tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update', calling method: .version_select at 0x7f6f91b12040>, body: {"meta": {"os_version": "alt"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:54.674460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-f1c9ebbe-7109-4b58-b33b-e71fe72026bd tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:54.680754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-f1c9ebbe-7109-4b58-b33b-e71fe72026bd tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:54.973616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:30:54.974676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:30:54.975373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:30:54.975896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:30:54.976376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:30:54.992573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:54.993929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:54.995464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:54.998226 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:55.063025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:55.069831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Getting quotas for user 0dcb8296a8934a8cbc89d6df73d4a526 and project 95422d1e22a44786abcef182c9b1a5ca. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:55.087764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:30:55.091488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:30:55.193211 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1c9ebbe-7109-4b58-b33b-e71fe72026bd tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.592723 Jul 01 10:30:55.198533 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 609/1255] 10.222.0.23 () {60 vars in 1312 bytes} [Fri Jul 1 10:30:54 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata/os_version => generated 31 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:55.206186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:55.213350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:55.218851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:55.219336 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:55.221000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:55.221480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:55.294725 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c5a695cd-fbf2-4f2a-93fb-8b54b792faea tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003099 Jul 01 10:30:55.297419 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 647/1256] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:30:55.307971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:55.316525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:55.327573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:55.330374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:55.331446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:55.332080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:55.827445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:55.831896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:55.833749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:55.835269 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-542d8086-5306-4718-b7c8-ee5434f71bd5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.635266 Jul 01 10:30:55.835829 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 610/1257] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:55 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:55.840400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6157737f-476b-4fda-9b9f-a7001309fee7 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f91abaf70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:55.868612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:55.878597 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a2a579c8-ad51-4816-bad9-2108cd4b06c7 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1325 microversion: 2.1 time: 0.577716 Jul 01 10:30:55.880337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 648/1258] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:55 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:55.887027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a155f27-b605-4f69-95f6-68f14f191da6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:55.887637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a155f27-b605-4f69-95f6-68f14f191da6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:55.892551 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6157737f-476b-4fda-9b9f-a7001309fee7 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 58 microversion: 2.1 time: 0.055527 Jul 01 10:30:55.893620 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 611/1259] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:30:55 2022] GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 58 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:55.898683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f355a0a1-8fd1-48a0-b743-56becc30d8e6 req-0a0fd4aa-18a3-4388-b67a-bbb4e5b96c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9105eb-0cc9-47e1-aefc-80b0e1d295c6", "name": "network-vif-plugged", "status": "completed", "tag": "0564be7a-919a-4e9a-9f29-c53e9c2ac28d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:55.912243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f355a0a1-8fd1-48a0-b743-56becc30d8e6 req-0a0fd4aa-18a3-4388-b67a-bbb4e5b96c92 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:55.912243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f355a0a1-8fd1-48a0-b743-56becc30d8e6 req-0a0fd4aa-18a3-4388-b67a-bbb4e5b96c92 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:55.943658 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f355a0a1-8fd1-48a0-b743-56becc30d8e6 req-0a0fd4aa-18a3-4388-b67a-bbb4e5b96c92 service nova] Creating event network-vif-plugged:0564be7a-919a-4e9a-9f29-c53e9c2ac28d for instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 on n-h2-master-1 Jul 01 10:30:55.962453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4a155f27-b605-4f69-95f6-68f14f191da6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:55.965552 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f355a0a1-8fd1-48a0-b743-56becc30d8e6 req-0a0fd4aa-18a3-4388-b67a-bbb4e5b96c92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062149 Jul 01 10:30:55.966282 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 612/1260] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:55.970966 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a155f27-b605-4f69-95f6-68f14f191da6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1213 microversion: 2.1 time: 0.088974 Jul 01 10:30:55.971897 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 649/1261] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:55 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:55.977608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6467406-3a87-4e02-b8b9-be699056a62f tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'update_all', calling method: .version_select at 0x7f6f91b09e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:55.997836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:56.003785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:56.014873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:56.020285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:56.021472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:56.022323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:56.057487 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b6467406-3a87-4e02-b8b9-be699056a62f tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:56.064499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b6467406-3a87-4e02-b8b9-be699056a62f tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:56.495470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:56.511367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-981828df-c752-44a0-9d30-550824564c29 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.540499 Jul 01 10:30:56.512071 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 613/1262] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:55 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:56.519571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-16d0cf3f-1858-4f76-9b78-e844eb629ecf req-a955d2e7-b34f-4c97-834c-ed71ddb572e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730", "tag": "b53fda29-dab0-4898-920d-4dd9caf3daae"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:56.553846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-16d0cf3f-1858-4f76-9b78-e844eb629ecf req-a955d2e7-b34f-4c97-834c-ed71ddb572e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:56.554961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-16d0cf3f-1858-4f76-9b78-e844eb629ecf req-a955d2e7-b34f-4c97-834c-ed71ddb572e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:56.580330 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-16d0cf3f-1858-4f76-9b78-e844eb629ecf req-a955d2e7-b34f-4c97-834c-ed71ddb572e4 service nova] Creating event network-changed:b53fda29-dab0-4898-920d-4dd9caf3daae for instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 on n-h1-master-1 Jul 01 10:30:56.594107 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-16d0cf3f-1858-4f76-9b78-e844eb629ecf req-a955d2e7-b34f-4c97-834c-ed71ddb572e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080538 Jul 01 10:30:56.598172 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 614/1263] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:56.833746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6467406-3a87-4e02-b8b9-be699056a62f tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.860562 Jul 01 10:30:56.834590 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 650/1264] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:30:55 2022] PUT /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 61 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:56.847081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6fc88854-cec3-42a9-a3c1-7d914e6a5f43 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Action: 'create', calling method: .version_select at 0x7f6f920e0e50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:56.858634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:56.859606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:56.878580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:56.879117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:56.881363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:56.882896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:56.941186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-6fc88854-cec3-42a9-a3c1-7d914e6a5f43 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:30:56.954901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-6fc88854-cec3-42a9-a3c1-7d914e6a5f43 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Getting quotas for user 7c443f796a4c4d609eb709de451611e5 and project e97275b17894406090d74623a5eb2e0d. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:30:57.197712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:57.216623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:57.220620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:57.222058 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8b6d85d-36a3-4f03-af94-55e08ae55010 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.369704 Jul 01 10:30:57.224657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 651/1265] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:56 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:30:57.240079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:57.241727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:57.252986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:57.253775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:57.255295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:57.255948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:57.570778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:57.580194 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1cfdeb4c-3299-4f6f-92be-fd6cd9e89173 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1325 microversion: 2.1 time: 0.354205 Jul 01 10:30:57.582213 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 652/1266] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:57 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:57.605751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:57.608284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:57.620216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:57.626395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:57.626395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:57.626395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:57.652999 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6fc88854-cec3-42a9-a3c1-7d914e6a5f43 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "POST /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 85 microversion: 2.1 time: 0.812437 Jul 01 10:30:57.656600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 615/1267] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Jul 1 10:30:56 2022] POST /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 85 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:57.671382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:57.677543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:57.699308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:57.699308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:57.699308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:57.701386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:57.737773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:57.745595 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:30:57.757469 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d38e83e0-d8e8-45e9-89f4-9fc62b333dfb tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1265 microversion: 2.1 time: 0.173827 Jul 01 10:30:57.758399 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 653/1268] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:57 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:57.764534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20259474-f133-4bc8-9db8-bcc1d107d0c0 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] Calling method '.version_select at 0x7f6f91cd7f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:57.833248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20259474-f133-4bc8-9db8-bcc1d107d0c0 tempest-ImagesMetadataTestJSON-1784364917 tempest-ImagesMetadataTestJSON-1784364917-project] 10.222.0.23 "GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata" status: 200 len: 85 microversion: 2.1 time: 0.073084 Jul 01 10:30:57.841135 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 654/1269] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:30:57 2022] GET /compute/v2.1/images/e574104b-5f92-4591-b2e4-d07847336c74/metadata => generated 85 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:30:57.964257 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:57.974204 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d1132a42-a875-48b9-9e77-c0777a406e70 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.315229 Jul 01 10:30:57.974839 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 616/1270] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:57 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:58.018588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0b4b1c75-2452-4187-bc8a-cdddf6f36fd5 req-4be3565b-c0be-43af-8239-e246d3c25f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9245057-43b9-492e-8f86-ac014664d207", "name": "network-vif-plugged", "status": "completed", "tag": "c0c447ef-8eab-4c35-96c1-29d659a0f21b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:30:58.032470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0b4b1c75-2452-4187-bc8a-cdddf6f36fd5 req-4be3565b-c0be-43af-8239-e246d3c25f25 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:58.036016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0b4b1c75-2452-4187-bc8a-cdddf6f36fd5 req-4be3565b-c0be-43af-8239-e246d3c25f25 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:58.059454 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0b4b1c75-2452-4187-bc8a-cdddf6f36fd5 req-4be3565b-c0be-43af-8239-e246d3c25f25 service nova] Creating event network-vif-plugged:c0c447ef-8eab-4c35-96c1-29d659a0f21b for instance f9245057-43b9-492e-8f86-ac014664d207 on n-h2-master-1 Jul 01 10:30:58.066823 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0b4b1c75-2452-4187-bc8a-cdddf6f36fd5 req-4be3565b-c0be-43af-8239-e246d3c25f25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055219 Jul 01 10:30:58.068928 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 655/1271] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:58.246368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:58.247226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:58.274328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:58.274946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:58.275734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:58.276275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:58.628404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:58.633382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:58.649741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:58.650384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:58.652677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:58.654717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:58.678368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:58.687692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:58.701336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:58.703135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc73db61-850b-4c28-a1fd-10681edddb79 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.465124 Jul 01 10:30:58.708152 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 617/1272] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:58 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:30:58.777129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:58.778058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:58.792559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:58.793029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:58.793838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:58.796598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:58.983471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:59.000411 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-57575bc9-413a-4618-b3dc-0b3897c35234 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1283 microversion: 2.1 time: 0.228879 Jul 01 10:30:59.013724 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 618/1273] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:58 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1283 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:59.182489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:59.193568 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87479f13-2ab9-4108-8a23-6a28e704c504 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1522 microversion: 2.1 time: 0.596600 Jul 01 10:30:59.194168 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 656/1274] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:58 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:59.200680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:59.201327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:59.230625 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:59.231084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:59.233265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4e6eac1-7d55-47b9-8edd-b8a2dec9a4a7 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Calling method '.version_select at 0x7f6f91b6eca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:59.235410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:59.243322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:59.742742 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4e6eac1-7d55-47b9-8edd-b8a2dec9a4a7 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 371 microversion: 2.1 time: 0.727391 Jul 01 10:30:59.744151 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 619/1275] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:30:59 2022] GET /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 371 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:30:59.758268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:59.758268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:59.765600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:59.767045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:59.768105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:59.768693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:59.805492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:30:59.857491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:30:59.873049 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b17f545e-606c-40c5-a372-739a8b1edbe8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.677820 Jul 01 10:30:59.874231 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 657/1276] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:30:59 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:30:59.884620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:30:59.884620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:30:59.901019 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:59.901728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:30:59.902712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:30:59.903308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.124954 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d1dd68c-749c-40fa-9414-dd4e64acd40c tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 204 len: 0 microversion: 2.1 time: 0.378766 Jul 01 10:31:00.130278 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 620/1277] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:30:59 2022] DELETE /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:31:00.133123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8fa355d8-38e8-4349-ba9a-b1676285d358 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91acef70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:00.281202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:00.291344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:00.292901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:00.298152 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc2f87e3-698d-4b6e-b817-ffc0deff561c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.422241 Jul 01 10:31:00.299574 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 658/1278] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:30:59 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:31:00.559044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fa355d8-38e8-4349-ba9a-b1676285d358 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.559044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fa355d8-38e8-4349-ba9a-b1676285d358 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.559615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fa355d8-38e8-4349-ba9a-b1676285d358 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.561438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fa355d8-38e8-4349-ba9a-b1676285d358 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.587170 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=15 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:00.698581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-377425b9-09f2-4bec-83b4-334eb212cb84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'create', calling method: .version_select at 0x7f6f91b2b8b0>, body: {"keypair": {"name": "tempest-keypair-1804035014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSVxnPhZvRweYbSAvmxu+gyabRdBKTyc+oFHMcn1j8xh7UdQyFtOErNxfbB0eKALFeF92kaSJ+zZlwyD+zCJmYxvnruqQ3ZXuESM2F5PHwgR5Tsvhh2RxijRPS22RjzQw=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:00.725836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-377425b9-09f2-4bec-83b4-334eb212cb84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for project cb942eeb3788403687ba800c070babd5. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:00.736149 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8fa355d8-38e8-4349-ba9a-b1676285d358 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 328 microversion: 2.1 time: 0.608541 Jul 01 10:31:00.740080 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 621/1279] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:31:00 2022] PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 328 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:00.744897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:00.745444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-377425b9-09f2-4bec-83b4-334eb212cb84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for user adf336817b04429b930e1f80ea25b1f7 and project cb942eeb3788403687ba800c070babd5. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:00.749597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:00.764910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.770662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.771693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.772298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.858664 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-377425b9-09f2-4bec-83b4-334eb212cb84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.552529 Jul 01 10:31:00.864843 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 659/1280] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:31:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:00.865340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:00.871283 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:00.878907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.879361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.880158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.880573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.916092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:00.927631 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b0e02469-b418-4676-b7b0-524382ad564e tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1271 microversion: 2.1 time: 0.186378 Jul 01 10:31:00.929668 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 622/1281] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:00 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:00.947435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:00.953019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:00.964820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.967618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:00.969044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:00.970429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:01.261516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:01.275585 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3317d0ea-7a98-45e1-8cd2-175461bca269 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1528 microversion: 2.1 time: 0.414329 Jul 01 10:31:01.286453 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 660/1282] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:00 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1528 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:01.423439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:01.431099 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a8aa7e11-b8ae-4af8-9612-c52ae93f8b8e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1472 microversion: 2.1 time: 0.499492 Jul 01 10:31:01.442523 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 623/1283] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:00 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1472 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:01.447705 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:01.448313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:01.458542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:01.458542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:01.458542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:01.458542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:01.477046 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:01.735622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1247372335", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:01.820938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:02.051978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:02.062186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:02.064419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:02.065728 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a667d48-7ab3-4c90-971a-18a93582661a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.622170 Jul 01 10:31:02.066358 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 624/1284] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:31:01 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:31:02.313735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1549383910", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:02.380376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:02.560110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:02.560569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:02.563492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:02.563492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:02.563492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:02.586301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:02.587033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:02.588103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:02.588928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:02.655948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Getting quotas for project 0f32681fae984f77bb7992d436e0bd63. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:02.671237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Getting quotas for user 7a3b90a2f8e4402eaa57c7e22f744427 and project 0f32681fae984f77bb7992d436e0bd63. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:02.689008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.utils [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] cores quota exceeded for 0f32681fae984f77bb7992d436e0bd63, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119765) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 01 10:31:02.691011 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Request method failure captured: Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 145 Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszhkv4w3Tp03xIt7ZlmlvDE6R1HDLVgvyoCj5lrfjbclK_TjI7k57EAn-nz_uudsaevdkRXhl_Gf3SKTO1XyBisHZ6TZkkUvsETAwfDr1ezms0SxLBMRSbpXp3ILqe-h5fyPWNWqahwGSX3zoIQI1bQeLuqvh673_4j9TEs2Iwfn7E Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:02.721131 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f32681fae984f77bb7992d436e0bd63", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7a3b90a2f8e4402eaa57c7e22f744427 Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1247372335", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} Jul 01 10:31:02.722703 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1247372335', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452'}}} Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 01 10:31:02.723506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:02.724645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:02.725985 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:02.731573 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:02.731573 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:02.731573 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:02.731573 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:02.731573 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 01 10:31:02.731573 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:02.740739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:02.743793 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2bf157f-09f9-4966-8352-f819bc4497df tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.454602 Jul 01 10:31:02.744991 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 661/1285] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:01 2022] POST /compute/v2.1/servers => generated 111 bytes in 1458 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:02.755897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:02.757777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:02.770684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:02.771074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:02.771874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:02.772315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:03.188179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:03.189280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:03.191178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:03.192203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:03.192644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:03.207290 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=77,nova_cell0:UPDATE=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:03.221754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:03.223635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:03.224075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:03.224476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:03.295336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Getting quotas for project ad9e8deb1e614945bb7e0e9bc65f40d1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:03.310242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Getting quotas for user 7314359d124b4ee5978f99f21ca96375 and project ad9e8deb1e614945bb7e0e9bc65f40d1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:03.325516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:03.338702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa96d78d-45e4-4843-b442-2e58881c3578 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 0.591934 Jul 01 10:31:03.340153 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 662/1286] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:02 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:03.354580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:31:03.357472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:03.358421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:03.362653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:31:03.367138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:03.367924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:03.369136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:03.369856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:03.392560 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=6,nova_api:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:03.546546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad9050c9-919b-4770-bb0f-9a8a55ce8faf tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478626 Jul 01 10:31:03.547541 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 625/1287] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:31:03.558854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:03.560055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:03.575323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877a848749ec4975beaf9ec07bc3b2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bd64c68cb4f35b7e894e017bab3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:03.576765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:03.577249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:03.580821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:03.581603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:03.598688 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e543c159-0950-4015-8b74-ced881eb53c2 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 200 len: 1486 microversion: 2.1 time: 0.245633 Jul 01 10:31:03.599303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 663/1288] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:03 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 1486 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:03.645005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f69c5c7d-6202-4353-b25c-368cc46c695b tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91c1e940>, body: {"quota_set": {"cores": 20}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:04.044160 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:04.053605 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0549adf8-252b-4d87-ac34-5324880fe005 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1478 microversion: 2.1 time: 0.503407 Jul 01 10:31:04.064669 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 626/1289] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:03 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1478 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:04.074287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:04.074907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:04.100201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.101002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.103189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.103655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.160160 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f69c5c7d-6202-4353-b25c-368cc46c695b tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.160809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f69c5c7d-6202-4353-b25c-368cc46c695b tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.163040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f69c5c7d-6202-4353-b25c-368cc46c695b tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.164105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f69c5c7d-6202-4353-b25c-368cc46c695b tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.195109 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=24 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:04.369742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:04.378678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:04.380179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:04.381353 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c017e841-9128-4389-a4ba-fd6925fb65c6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.315597 Jul 01 10:31:04.381908 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 627/1290] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:31:04 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:31:04.386495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c0182abd-98db-4dbd-a075-eedde69d62fd req-33d25082-a4d4-4bac-b471-5df140ac76e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730", "name": "network-vif-plugged", "status": "completed", "tag": "b53fda29-dab0-4898-920d-4dd9caf3daae"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:04.395355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c0182abd-98db-4dbd-a075-eedde69d62fd req-33d25082-a4d4-4bac-b471-5df140ac76e2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.396086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c0182abd-98db-4dbd-a075-eedde69d62fd req-33d25082-a4d4-4bac-b471-5df140ac76e2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.407934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c0182abd-98db-4dbd-a075-eedde69d62fd req-33d25082-a4d4-4bac-b471-5df140ac76e2 service nova] Creating event network-vif-plugged:b53fda29-dab0-4898-920d-4dd9caf3daae for instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 on n-h1-master-1 Jul 01 10:31:04.408874 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f69c5c7d-6202-4353-b25c-368cc46c695b tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 329 microversion: 2.1 time: 0.808512 Jul 01 10:31:04.409580 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 664/1291] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:31:03 2022] PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 329 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:04.413001 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c0182abd-98db-4dbd-a075-eedde69d62fd req-33d25082-a4d4-4bac-b471-5df140ac76e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029884 Jul 01 10:31:04.424363 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 628/1292] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:04.481240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a783949-de95-48b8-8756-7f25407407db tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:04.481899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a783949-de95-48b8-8756-7f25407407db tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:04.621826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-118b43fc-5f77-47e4-8d5c-38b7733efe44 req-70a0a71e-5d40-4d73-b037-8b4e43bc68a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9105eb-0cc9-47e1-aefc-80b0e1d295c6", "name": "network-vif-deleted", "tag": "0564be7a-919a-4e9a-9f29-c53e9c2ac28d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:04.632273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-118b43fc-5f77-47e4-8d5c-38b7733efe44 req-70a0a71e-5d40-4d73-b037-8b4e43bc68a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.632806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-118b43fc-5f77-47e4-8d5c-38b7733efe44 req-70a0a71e-5d40-4d73-b037-8b4e43bc68a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.649135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a783949-de95-48b8-8756-7f25407407db tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:04.666901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a783949-de95-48b8-8756-7f25407407db tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1214 microversion: 2.1 time: 0.242126 Jul 01 10:31:04.668161 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 629/1293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:04 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:04.679154 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-118b43fc-5f77-47e4-8d5c-38b7733efe44 req-70a0a71e-5d40-4d73-b037-8b4e43bc68a4 service nova] Creating event network-vif-deleted:0564be7a-919a-4e9a-9f29-c53e9c2ac28d for instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 on n-h2-master-1 Jul 01 10:31:04.693446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:04.694507 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-118b43fc-5f77-47e4-8d5c-38b7733efe44 req-70a0a71e-5d40-4d73-b037-8b4e43bc68a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280296 Jul 01 10:31:04.695624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:04.695870 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 665/1294] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:04.702323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-248656b9-6201-4d1f-8a99-8668f1d1bc62 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Calling method '.version_select at 0x7f6f91d8c0d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:04.711435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.717388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.717388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.717388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.816780 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-248656b9-6201-4d1f-8a99-8668f1d1bc62 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 371 microversion: 2.1 time: 0.118928 Jul 01 10:31:04.817504 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 666/1295] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:31:04 2022] GET /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:04.826172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:04.832271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:04.834557 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:04.837020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.837747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.838777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.839491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.858555 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 could not be found. Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 HTTP/1.1 Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:04.861234 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 could not be found. Jul 01 10:31:04.862623 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1f9105eb-0cc9-47e1-aefc-80b0e1d295c6'} Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 could not be found. Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:04.863398 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 could not be found. Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 could not be found. Jul 01 10:31:04.864692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:04.865850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Instance 1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:04.865850 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7e6f5839-726b-4aaa-a87b-ad8012c23938 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6" status: 404 len: 111 microversion: 2.1 time: 0.043905 Jul 01 10:31:04.865850 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 667/1296] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:04 2022] GET /compute/v2.1/servers/1f9105eb-0cc9-47e1-aefc-80b0e1d295c6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:04.868629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1160ff25-f3c8-43d4-a6c5-ac580a52971e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91c1e9d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:04.946017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1160ff25-f3c8-43d4-a6c5-ac580a52971e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.946867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1160ff25-f3c8-43d4-a6c5-ac580a52971e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:04.947919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1160ff25-f3c8-43d4-a6c5-ac580a52971e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:04.948664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1160ff25-f3c8-43d4-a6c5-ac580a52971e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.065974 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1160ff25-f3c8-43d4-a6c5-ac580a52971e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 328 microversion: 2.1 time: 0.201524 Jul 01 10:31:05.077875 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 668/1297] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:31:04 2022] PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 328 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:05.098594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13face3a-cf8e-4b07-836b-ce0500ba91c1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '.version_select at 0x7f6f91c1ef70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:05.128184 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-13face3a-cf8e-4b07-836b-ce0500ba91c1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Image not found. Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13face3a-cf8e-4b07-836b-ce0500ba91c1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645 HTTP/1.1 Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:05.135419 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '75399712-35db-40b6-9247-434599d2e645'} Jul 01 10:31:05.136804 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 75399712-35db-40b6-9247-434599d2e645 to delete Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.137662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 75399712-35db-40b6-9247-434599d2e645 could not be found. Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:05.138848 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:31:05.140262 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.144069 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13face3a-cf8e-4b07-836b-ce0500ba91c1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:05.145586 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13face3a-cf8e-4b07-836b-ce0500ba91c1 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645" status: 404 len: 62 microversion: 2.1 time: 0.063766 Jul 01 10:31:05.146567 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 669/1298] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:05 2022] DELETE /compute/v2.1/images/75399712-35db-40b6-9247-434599d2e645 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:31:05.152720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:05.154474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:05.165801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.166631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.167750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.168362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.186152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:05.201972 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a2df812-209f-47df-bfc2-c96ac1bace3c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 0.531857 Jul 01 10:31:05.206785 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 630/1299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:04 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:05.214552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:05.219691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:05.227341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.227789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.228585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.229204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.244834 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f HTTP/1.1 Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:31:05.247467 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.248896 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '7b9d6ca9-85e6-4713-ad73-a753e315637f'} Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:05.249851 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.251800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.254425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:05.258682 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-965d8706-694e-4908-9c13-18344a33b8c0 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 404 len: 111 microversion: 2.1 time: 0.050473 Jul 01 10:31:05.259951 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 631/1300] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:31:05 2022] DELETE /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:05.276822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-12098438", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:05.357390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:05.524116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:05.537202 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b5f791b0-7462-451a-82da-655331a2eb39 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1478 microversion: 2.1 time: 0.388715 Jul 01 10:31:05.538324 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 670/1301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:05 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1478 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:05.545811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:05.546962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: 7b9d6ca9-85e6-4713-ad73-a753e315637f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:05.558465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.559083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.562036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.562719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.579614 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f HTTP/1.1 Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:05.581174 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.582555 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7b9d6ca9-85e6-4713-ad73-a753e315637f'} Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:05.583446 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. Jul 01 10:31:05.584924 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.588403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Instance 7b9d6ca9-85e6-4713-ad73-a753e315637f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:05.588403 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-41999819-b2af-42b8-bbfc-09b72fd6f6ad tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f" status: 404 len: 111 microversion: 2.1 time: 0.043109 Jul 01 10:31:05.588403 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 671/1302] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:05 2022] GET /compute/v2.1/servers/7b9d6ca9-85e6-4713-ad73-a753e315637f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:05.593587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:05.597110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:05.602026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.602464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.603231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.603965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.772481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:05.772943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:05.773377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:05.773997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:05.775958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:05.786918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.788224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.789401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.790436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.813921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Getting quotas for project 0f32681fae984f77bb7992d436e0bd63. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:05.820656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Getting quotas for user 7a3b90a2f8e4402eaa57c7e22f744427 and project 0f32681fae984f77bb7992d436e0bd63. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:05.834501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.utils [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] instances quota exceeded for 0f32681fae984f77bb7992d436e0bd63, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119764) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 01 10:31:05.836003 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Request method failure captured: Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 143 Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivszhkv4w3Tp03xIt7ZlmlvDE6R1HDLVgvyoCj5lrfjbclK_TjI7k57EAn-nz_uudsaevdkRXhl_Gf3SKTO1XyBisHZ6TZkkUvsETAwfDr1ezms0SxLBMRSbpXp3ILqe-h5fyPWNWqahwGSX3zoIQI1bQeLuqvh673_4j9TEs2Iwfn7E Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:31:05.839787 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f32681fae984f77bb7992d436e0bd63", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7a3b90a2f8e4402eaa57c7e22f744427 Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-12098438", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} Jul 01 10:31:05.841261 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-12098438', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452'}}} Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 01 10:31:05.842035 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.843298 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.845239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:05.849011 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-52c5686c-8fb1-4f99-ada6-0fe6a5f9ac49 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.586492 Jul 01 10:31:05.850741 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 632/1303] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:05 2022] POST /compute/v2.1/servers => generated 119 bytes in 590 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:05.855694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b403cbe7-8a47-4a84-90e3-5ea68a727077 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '.version_select at 0x7f6f91ace3a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:05.889171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:05.908918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:05.910582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:05.911737 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7166151e-e072-4dcb-8c6a-e41501b8e379 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1410 microversion: 2.25 time: 0.323624 Jul 01 10:31:05.912304 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 672/1304] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:31:05 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1410 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:31:05.927952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:05.928577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:05.935663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.936111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.936888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:05.937359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:05.983492 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b403cbe7-8a47-4a84-90e3-5ea68a727077 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38193025" status: 202 len: 0 microversion: 2.1 time: 0.131375 Jul 01 10:31:05.984077 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 633/1305] 10.222.0.23 () {58 vars in 1214 bytes} [Fri Jul 1 10:31:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38193025 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:31:05.991013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1006187829", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04eeb7f2-cad2-4f5d-96c5-202b3781e660"}], "security_groups": [{"name": "tempest-securitygroup--1365183834"}], "key_name": "tempest-keypair-1804035014", "user_data": "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:06.009803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:06.019741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0608939-8ad8-4d5b-9df2-15105276a6be tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1210 microversion: 2.1 time: 0.104630 Jul 01 10:31:06.020750 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 673/1306] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:05 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:06.025619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f31a53a-e743-4497-a315-14cfc027201e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91aa8c10>, body: {"quota_set": {"instances": 10}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:06.096341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f31a53a-e743-4497-a315-14cfc027201e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:06.097043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f31a53a-e743-4497-a315-14cfc027201e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:06.098481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f31a53a-e743-4497-a315-14cfc027201e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:06.099142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f31a53a-e743-4497-a315-14cfc027201e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:06.117426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] validate_networks() for [('04eeb7f2-cad2-4f5d-96c5-202b3781e660', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:06.271545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f31a53a-e743-4497-a315-14cfc027201e tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 329 microversion: 2.1 time: 0.249454 Jul 01 10:31:06.278892 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 674/1307] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:31:06 2022] PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 329 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:06.278892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:06.278892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:06.285244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:06.285713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:06.286682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:06.287122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:06.546641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:06.560124 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9bf75e55-4c4e-49d6-9a3c-16b913ce7dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 0.286695 Jul 01 10:31:06.561383 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 675/1308] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:06 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:06.567043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c08cb523-ad5b-472d-a221-2916e1d86cb6 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Calling method '.version_select at 0x7f6f91aa8790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:06.676426 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c08cb523-ad5b-472d-a221-2916e1d86cb6 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 371 microversion: 2.1 time: 0.113715 Jul 01 10:31:06.677013 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 676/1309] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:31:06 2022] GET /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:06.682500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:06.683323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:06.690509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:06.691188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:06.692351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:06.692951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.179446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:07.179916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:07.180391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:07.180799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:07.181556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:07.217476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.218794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.221528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.222227 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.245309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:07.254118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for user adf336817b04429b930e1f80ea25b1f7 and project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:07.269203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:31:07.274434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:31:07.334584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:07.346610 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b3877f1-330a-4b43-b3df-21a60681763b tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1478 microversion: 2.1 time: 0.668052 Jul 01 10:31:07.347106 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 677/1310] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:06 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1478 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:07.352625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a59cabb0-dfb0-4aa0-ac07-166a358e3732 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91b09dc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:07.427522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a59cabb0-dfb0-4aa0-ac07-166a358e3732 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.427967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a59cabb0-dfb0-4aa0-ac07-166a358e3732 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.429788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a59cabb0-dfb0-4aa0-ac07-166a358e3732 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.429788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a59cabb0-dfb0-4aa0-ac07-166a358e3732 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.455181 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=89 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:07.473655 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-34f66082-919c-4880-bfa9-7b0892914190 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.487642 Jul 01 10:31:07.474781 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 634/1311] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:31:07.480190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:07.481717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:07.499566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.503102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.504034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.506320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.608332 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a59cabb0-dfb0-4aa0-ac07-166a358e3732 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 325 microversion: 2.1 time: 0.259231 Jul 01 10:31:07.608980 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 678/1312] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:31:07 2022] PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:07.634676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-932c0b57-3477-40a4-99c5-35b01d2f6f22 req-6092d978-6929-4156-9745-0082656a913c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:07.658803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-932c0b57-3477-40a4-99c5-35b01d2f6f22 req-6092d978-6929-4156-9745-0082656a913c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.659470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-932c0b57-3477-40a4-99c5-35b01d2f6f22 req-6092d978-6929-4156-9745-0082656a913c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.712556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-932c0b57-3477-40a4-99c5-35b01d2f6f22 req-6092d978-6929-4156-9745-0082656a913c service nova] Creating event network-changed:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h2-master-1 Jul 01 10:31:07.726012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-932c0b57-3477-40a4-99c5-35b01d2f6f22 req-6092d978-6929-4156-9745-0082656a913c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113054 Jul 01 10:31:07.727394 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 679/1313] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:07.740354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:07.741126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:07.758468 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.759188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:07.762021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:07.764985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.025964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:08.034803 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d91691b-a7b3-4162-9444-fe753d3a7c7c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1274 microversion: 2.1 time: 0.304219 Jul 01 10:31:08.036041 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 680/1314] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:07 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:08.041108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-66695b01-e01f-406a-919f-58750fba6527 req-ae16df72-2662-4d4c-bf38-90a68cf0df88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672", "name": "network-vif-unplugged", "status": "completed", "tag": "75426cac-af1d-4dc1-8b63-4c327a9be5a5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:08.058037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-66695b01-e01f-406a-919f-58750fba6527 req-ae16df72-2662-4d4c-bf38-90a68cf0df88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:08.058037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-66695b01-e01f-406a-919f-58750fba6527 req-ae16df72-2662-4d4c-bf38-90a68cf0df88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.071402 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-66695b01-e01f-406a-919f-58750fba6527 req-ae16df72-2662-4d4c-bf38-90a68cf0df88 service nova] Creating event network-vif-unplugged:75426cac-af1d-4dc1-8b63-4c327a9be5a5 for instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 on n-h1-master-1 Jul 01 10:31:08.080089 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-66695b01-e01f-406a-919f-58750fba6527 req-ae16df72-2662-4d4c-bf38-90a68cf0df88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042533 Jul 01 10:31:08.083141 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 681/1315] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:08.103684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1a64a09e-90dc-43b3-b27e-3d8b156cce7d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:08.104676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1a64a09e-90dc-43b3-b27e-3d8b156cce7d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:08.147453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:08.157632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:08.161249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:08.161249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68ebb1b1-cbc6-4e12-800a-e0b4f01c99e5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1607 microversion: 2.25 time: 0.684650 Jul 01 10:31:08.161249 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 635/1316] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:31:07 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1607 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:31:08.168603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:08.169367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:08.190160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:08.192903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.194026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:08.194625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.207508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1a64a09e-90dc-43b3-b27e-3d8b156cce7d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:08.216714 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1a64a09e-90dc-43b3-b27e-3d8b156cce7d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1239 microversion: 2.1 time: 0.131760 Jul 01 10:31:08.217653 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 682/1317] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:08 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1239 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:08.225584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-127578422", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:08.303616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:08.776105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:08.809004 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1b3fe15-6631-4e69-9f78-1e8068556706 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 0.642042 Jul 01 10:31:08.822304 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 636/1318] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:08 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:08.840019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cea6626e-4dcf-48f0-8074-399a21256fc9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:08.840525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cea6626e-4dcf-48f0-8074-399a21256fc9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:08.865408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cea6626e-4dcf-48f0-8074-399a21256fc9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:08.865872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cea6626e-4dcf-48f0-8074-399a21256fc9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.866700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cea6626e-4dcf-48f0-8074-399a21256fc9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:08.869438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cea6626e-4dcf-48f0-8074-399a21256fc9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.872137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:08.873222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:08.874331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:08.874929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:08.876216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:08.901290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:08.902055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.903144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:08.903754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:08.949303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Getting quotas for project 0f32681fae984f77bb7992d436e0bd63. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:08.960946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Getting quotas for user 7a3b90a2f8e4402eaa57c7e22f744427 and project 0f32681fae984f77bb7992d436e0bd63. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:08.986768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.utils [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] ram quota exceeded for 0f32681fae984f77bb7992d436e0bd63, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119765) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 01 10:31:08.988827 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Request method failure captured: Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 144 Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszhkv4w3Tp03xIt7ZlmlvDE6R1HDLVgvyoCj5lrfjbclK_TjI7k57EAn-nz_uudsaevdkRXhl_Gf3SKTO1XyBisHZ6TZkkUvsETAwfDr1ezms0SxLBMRSbpXp3ILqe-h5fyPWNWqahwGSX3zoIQI1bQeLuqvh673_4j9TEs2Iwfn7E Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:08.992307 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f32681fae984f77bb7992d436e0bd63", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7a3b90a2f8e4402eaa57c7e22f744427 Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-127578422", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} Jul 01 10:31:08.994099 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-127578422', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452'}}} Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 01 10:31:08.995103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:08.997760 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:08.999580 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.001627 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.001627 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.001627 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:09.001627 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:09.001627 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 01 10:31:09.001627 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.004249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:09.005648 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6ff8735-cb46-4b89-b6bb-5382a3564f08 tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.785990 Jul 01 10:31:09.006258 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 683/1319] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:08 2022] POST /compute/v2.1/servers => generated 110 bytes in 788 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:09.014794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:09.015653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:09.028182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.028808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.029711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.030255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.061730 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:09.088311 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cea6626e-4dcf-48f0-8074-399a21256fc9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.263298 Jul 01 10:31:09.091481 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 637/1320] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Jul 1 10:31:08 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:31:09.097648 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a1a4c52-fd51-484e-a644-06b911b9dd68 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '.version_select at 0x7f6f91a5b310>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:09.133404 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5a1a4c52-fd51-484e-a644-06b911b9dd68 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Image not found. Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a1a4c52-fd51-484e-a644-06b911b9dd68 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/images/6183c22d-9144-4126-813d-66fb7a80a54d HTTP/1.1 Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:31:09.135385 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6183c22d-9144-4126-813d-66fb7a80a54d'} Jul 01 10:31:09.136749 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6183c22d-9144-4126-813d-66fb7a80a54d to delete Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.137763 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6183c22d-9144-4126-813d-66fb7a80a54d could not be found. Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:09.138977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:31:09.140208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.142784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a1a4c52-fd51-484e-a644-06b911b9dd68 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:09.144246 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a1a4c52-fd51-484e-a644-06b911b9dd68 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/images/6183c22d-9144-4126-813d-66fb7a80a54d" status: 404 len: 62 microversion: 2.1 time: 0.051579 Jul 01 10:31:09.153911 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 638/1321] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:09 2022] DELETE /compute/v2.1/images/6183c22d-9144-4126-813d-66fb7a80a54d => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:31:09.174188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-71562358-7ab8-4a21-bc83-731c14c480f2 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91a5b160>, body: {"quota_set": {"ram": 51200}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:09.277625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71562358-7ab8-4a21-bc83-731c14c480f2 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.278901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71562358-7ab8-4a21-bc83-731c14c480f2 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.284963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71562358-7ab8-4a21-bc83-731c14c480f2 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.284963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71562358-7ab8-4a21-bc83-731c14c480f2 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.470015 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-71562358-7ab8-4a21-bc83-731c14c480f2 tempest-QuotasAdminNegativeTest-1124212919 tempest-QuotasAdminNegativeTest-1124212919-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 200 len: 329 microversion: 2.1 time: 0.309164 Jul 01 10:31:09.470597 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 639/1322] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:31:09 2022] PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 329 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:09.481550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:09.485458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:09.495234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.495901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.496873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.497492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.584008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:09.593854 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-244b47df-4fe8-4f30-bbaa-25e2734b8fd3 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1478 microversion: 2.1 time: 0.585063 Jul 01 10:31:09.605292 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 684/1323] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:09 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1478 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:09.614330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:09.631124 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2f716bea-e06e-4019-ace6-8a5bdbee0ae6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1272 microversion: 2.1 time: 0.153223 Jul 01 10:31:09.635526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:09.635526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:09.668114 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 640/1324] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:09 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:09.674803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:09.676947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:09.680445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.685697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.686611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.687289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.694946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.696505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.698924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.700388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.720498 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 HTTP/1.1 Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:09.728875 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: exception: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.732230 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c3168707-cb17-4267-a005-2e7307e2a168'} Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:09.733239 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.734891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.736451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:09.736451 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eb5e8a9f-e201-454a-81b4-9157204d3811 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 404 len: 111 microversion: 2.1 time: 0.123813 Jul 01 10:31:09.740230 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 685/1325] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:31:09 2022] DELETE /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:09.747132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d748f05-ccbe-4e19-9354-6892fe81df1d tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Action: 'update', calling method: .version_select at 0x7f6f91aa84c0>, body: {"quota_set": {"ram": 0}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:09.750180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d748f05-ccbe-4e19-9354-6892fe81df1d tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7a3b90a2f8e4402eaa57c7e22f744427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f32681fae984f77bb7992d436e0bd63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d748f05-ccbe-4e19-9354-6892fe81df1d tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Request method failure captured: Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 HTTP/1.1 Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 25 Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszhkv4w3Tp03xIt7ZlmlvDE6R1HDLVgvyoCj5lrfjbclK_TjI7k57EAn-nz_uudsaevdkRXhl_Gf3SKTO1XyBisHZ6TZkkUvsETAwfDr1ezms0SxLBMRSbpXp3ILqe-h5fyPWNWqahwGSX3zoIQI1bQeLuqvh673_4j9TEs2Iwfn7E Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:09.753090 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f32681fae984f77bb7992d436e0bd63", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f32681fae984f77bb7992d436e0bd63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0f32681fae984f77bb7992d436e0bd63 Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1493256805 Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7a3b90a2f8e4402eaa57c7e22f744427 Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-QuotasAdminNegativeTest-1493256805-project Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: {"quota_set": {"ram": 0}} Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 01 10:31:09.761123 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0f32681fae984f77bb7992d436e0bd63', 'body': {'quota_set': {'ram': 0}}} Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:09.762266 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.763708 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d748f05-ccbe-4e19-9354-6892fe81df1d tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d748f05-ccbe-4e19-9354-6892fe81df1d tempest-QuotasAdminNegativeTest-1493256805 tempest-QuotasAdminNegativeTest-1493256805-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63" status: 403 len: 116 microversion: 2.1 time: 0.014315 Jul 01 10:31:09.765249 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 686/1326] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:31:09 2022] PUT /compute/v2.1/os-quota-sets/0f32681fae984f77bb7992d436e0bd63 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:09.796031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:09.797027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] [instance: c3168707-cb17-4267-a005-2e7307e2a168] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:09.826419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.826419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.826419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.829495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.848685 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] HTTP exception thrown: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Request method failure captured: Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 HTTP/1.1 Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxvSdgALPosQWsdt51LzYDtirvTBkheZPZRMC2_9qROCtACf5j9CHQ67xesb--H6OrOTzlg6uHNqm7L5zUBazTq8qF98_kEy-eCZxlPiFVLMsyP_tyd8E_PS1E82p8Y3htkzNj5kOrU7Z7Bv9m0uMZZ0rdTgPp_ZetwIXcoGF6gS9A Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:09.851196 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c5bd64c68cb4f35b7e894e017bab3f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c5bd64c68cb4f35b7e894e017bab3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 7c5bd64c68cb4f35b7e894e017bab3f9 Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-241369058 Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 877a848749ec4975beaf9ec07bc3b2e6 Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-241369058-project Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: exception: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.862174 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c3168707-cb17-4267-a005-2e7307e2a168'} Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:09.863220 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. Jul 01 10:31:09.865532 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:09.867099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] Returning 404 to user: Instance c3168707-cb17-4267-a005-2e7307e2a168 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:09.867099 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f199f777-dd9f-4d77-ad15-57c132cf15e4 tempest-ImagesOneServerNegativeTestJSON-241369058 tempest-ImagesOneServerNegativeTestJSON-241369058-project] 10.222.0.23 "GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168" status: 404 len: 111 microversion: 2.1 time: 0.096199 Jul 01 10:31:09.867099 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 687/1327] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:09 2022] GET /compute/v2.1/servers/c3168707-cb17-4267-a005-2e7307e2a168 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:09.867099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:09.867099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:09.872478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.873109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:09.873848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:09.874283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:10.160061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:10.168734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2978212f-2f2e-4381-85a5-5bf1df02d032 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1243 microversion: 2.1 time: 0.499423 Jul 01 10:31:10.178479 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 641/1328] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:09 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1243 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:10.612474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:10.613194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:10.662087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:10.662567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:10.663359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:10.667610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:11.044160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:11.056751 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-213ebf55-570b-44ad-80ef-4884cd10e4b3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 1.196874 Jul 01 10:31:11.078929 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 688/1329] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:09 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:11.084733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:11.086036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:11.099997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:11.100965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:11.105775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:11.107067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:11.126450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:11.174323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bf0dccac-3625-4d5c-851f-91ecb5c78b4d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1478 microversion: 2.1 time: 0.553006 Jul 01 10:31:11.182811 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 642/1330] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:10 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1478 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:11.197287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:11.204051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:11.213676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:11.214505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:11.215625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:11.216408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:11.323331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:11.336535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-008df878-980c-469e-abe8-28b6d8de5ed6 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1272 microversion: 2.1 time: 0.261568 Jul 01 10:31:11.337836 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 689/1331] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:11 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:11.410050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:11.418171 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a4e4baed-0c67-41cb-9b9f-71cb148383e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1297 microversion: 2.1 time: 0.233109 Jul 01 10:31:11.420619 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 643/1332] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:11 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1297 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:11.544165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5cc5258b-9582-4d6e-9082-4ee2f2161ed5 req-c355f428-ac16-4bf2-b190-6817488cd5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672", "name": "network-vif-plugged", "status": "completed", "tag": "75426cac-af1d-4dc1-8b63-4c327a9be5a5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:11.576659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5cc5258b-9582-4d6e-9082-4ee2f2161ed5 req-c355f428-ac16-4bf2-b190-6817488cd5be service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:11.577496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5cc5258b-9582-4d6e-9082-4ee2f2161ed5 req-c355f428-ac16-4bf2-b190-6817488cd5be service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:11.608005 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5cc5258b-9582-4d6e-9082-4ee2f2161ed5 req-c355f428-ac16-4bf2-b190-6817488cd5be service nova] Creating event network-vif-plugged:75426cac-af1d-4dc1-8b63-4c327a9be5a5 for instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 on n-h1-master-1 Jul 01 10:31:11.626457 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5cc5258b-9582-4d6e-9082-4ee2f2161ed5 req-c355f428-ac16-4bf2-b190-6817488cd5be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088229 Jul 01 10:31:11.633095 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 690/1333] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:12.080698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:12.081994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:12.110468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:12.112948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:12.112948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:12.112948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:12.184768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:12.190286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:12.200992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:12.201481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:12.202275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:12.202718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:13.029795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:13.040978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4200f934-674f-492f-a307-a95cdd316e10 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 0.969645 Jul 01 10:31:13.042759 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 644/1334] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:12 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:13.048407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:13.049382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:13.058544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:13.061454 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:13.063649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:13.064484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:13.085016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:13.102612 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec57cdfb-f004-4a65-be5b-48a6d3dd6a3f tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1478 microversion: 2.1 time: 0.922205 Jul 01 10:31:13.103530 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 691/1335] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:12 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1478 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:13.118183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:13.119977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:13.134890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:13.138410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:13.148707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:13.156808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:13.319260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:13.333636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d81a4b73-5167-4701-91f9-ff79e8130759 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1297 microversion: 2.1 time: 0.228954 Jul 01 10:31:13.337287 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 692/1336] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:13 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1297 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:13.906584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7742897-7f73-40fc-8f4b-2f55850654bc tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Action: 'create', calling method: .version_select at 0x7f6f91ad2280>, body: {"keypair": {"name": "tempest-keypair-1170409016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnFV3FRDnJ8Z2nRRG5pn42OQFATXeDcOgrwBvOG/OJVnWtDoUU2a0OzMaaskyMF+43Q2ZvzrosdXgdpcMSPufwy5QfoDovkrx/nFza07YRznV9qmd3MdQIGzO9ggj6iZg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:13.914904 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:13.922278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:13.934720 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9eddc4d7-77f0-4f8c-986a-8c55f1b71d1f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.890683 Jul 01 10:31:13.935302 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 645/1337] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:13 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:13.944272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f7742897-7f73-40fc-8f4b-2f55850654bc tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Getting quotas for project 7e6c31c774f94b0cb1cdd78fb57f2916. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:13.954459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7ce70522-bbeb-45c2-a4b6-131b67560ebb req-c5c6c956-080c-42d0-bdb6-1389c6aa66f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730", "tag": "b53fda29-dab0-4898-920d-4dd9caf3daae"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:13.954592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f7742897-7f73-40fc-8f4b-2f55850654bc tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Getting quotas for user ed8ee2f955624a3aa3ccbc8f18516539 and project 7e6c31c774f94b0cb1cdd78fb57f2916. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:13.984690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7ce70522-bbeb-45c2-a4b6-131b67560ebb req-c5c6c956-080c-42d0-bdb6-1389c6aa66f1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:13.988041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7ce70522-bbeb-45c2-a4b6-131b67560ebb req-c5c6c956-080c-42d0-bdb6-1389c6aa66f1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:14.019444 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7ce70522-bbeb-45c2-a4b6-131b67560ebb req-c5c6c956-080c-42d0-bdb6-1389c6aa66f1 service nova] Creating event network-changed:b53fda29-dab0-4898-920d-4dd9caf3daae for instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 on n-h1-master-1 Jul 01 10:31:14.038420 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7ce70522-bbeb-45c2-a4b6-131b67560ebb req-c5c6c956-080c-42d0-bdb6-1389c6aa66f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094776 Jul 01 10:31:14.039589 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 646/1338] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:14.050389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8f1ead5b-66a2-4f50-bd7f-72574b037486 req-01920938-4d09-49f2-b5b9-ed7c96e3f52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "name": "network-vif-plugged", "status": "completed", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:14.071104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8f1ead5b-66a2-4f50-bd7f-72574b037486 req-01920938-4d09-49f2-b5b9-ed7c96e3f52d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:14.071540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8f1ead5b-66a2-4f50-bd7f-72574b037486 req-01920938-4d09-49f2-b5b9-ed7c96e3f52d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:14.091046 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8f1ead5b-66a2-4f50-bd7f-72574b037486 req-01920938-4d09-49f2-b5b9-ed7c96e3f52d service nova] Creating event network-vif-plugged:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h2-master-1 Jul 01 10:31:14.096868 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8f1ead5b-66a2-4f50-bd7f-72574b037486 req-01920938-4d09-49f2-b5b9-ed7c96e3f52d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052999 Jul 01 10:31:14.097831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 647/1339] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:14.103598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:14.104560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:14.113622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:14.113952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:14.115083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:14.115523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:14.116681 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7742897-7f73-40fc-8f4b-2f55850654bc tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.766139 Jul 01 10:31:14.117515 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 693/1340] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:31:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:14.122386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:14.127156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:14.138512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:14.139185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:14.140238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:14.148781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:14.720280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:14.729012 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e326f281-9130-4ccc-b229-c53d4965aa68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 0.629656 Jul 01 10:31:14.730365 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 648/1341] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:14 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:14.736045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:14.736872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:14.743498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:14.747403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:14.747403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:14.749235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:15.344667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:15.355150 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-64caa7ea-cc37-40b5-87f0-41c816ec85be tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1478 microversion: 2.1 time: 1.236107 Jul 01 10:31:15.357492 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 694/1342] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:14 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1478 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:15.367229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:15.368060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:15.375683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:15.376516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:15.377412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:15.378507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:15.814589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:15.818605 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:15.829191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d409aaa-daa6-4f3c-a915-0bf1d9820d09 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 1.096725 Jul 01 10:31:15.829789 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 649/1343] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:14 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:15.844717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:15.845388 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:15.852164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:15.852729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:15.853548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:15.853998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:16.056732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:16.065005 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c0e5176-8ce6-4e11-a10d-717929fbd67f tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.706229 Jul 01 10:31:16.081662 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 695/1344] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:15 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:16.344840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:16.357555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93c969e5-51b0-4fd9-b603-8c2cd0b2db82 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1313 microversion: 2.1 time: 0.526379 Jul 01 10:31:16.363432 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 650/1345] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:15 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:16.377287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:16.379405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:16.397983 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:16.398539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:16.399401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:16.399909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:16.815213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa61674b-5fea-4621-b317-221ca31768c6 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:16.833061 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa61674b-5fea-4621-b317-221ca31768c6 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.362674 Jul 01 10:31:16.834352 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 651/1346] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:16.839274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-28b16127-848d-42e0-bfc4-17bc7018db40 req-ee8b712b-f151-4508-b28f-9562d597a6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a71f77a0-2de2-45c0-aaad-d21568206141", "tag": "ba9b2f43-8c38-48a1-aa13-d95458b0a8d1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:16.865019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-28b16127-848d-42e0-bfc4-17bc7018db40 req-ee8b712b-f151-4508-b28f-9562d597a6a7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:16.870994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-28b16127-848d-42e0-bfc4-17bc7018db40 req-ee8b712b-f151-4508-b28f-9562d597a6a7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:16.879989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-28b16127-848d-42e0-bfc4-17bc7018db40 req-ee8b712b-f151-4508-b28f-9562d597a6a7 service nova] Creating event network-changed:ba9b2f43-8c38-48a1-aa13-d95458b0a8d1 for instance a71f77a0-2de2-45c0-aaad-d21568206141 on n-h2-master-1 Jul 01 10:31:16.888740 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-28b16127-848d-42e0-bfc4-17bc7018db40 req-ee8b712b-f151-4508-b28f-9562d597a6a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052882 Jul 01 10:31:16.889943 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 652/1347] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:16.895996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-82868d9e-fb5e-4d93-9e28-7b3d6600a2a4 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:16.920773 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:16.929282 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-82868d9e-fb5e-4d93-9e28-7b3d6600a2a4 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.037130 Jul 01 10:31:16.930012 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 653/1348] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:31:16 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:16.935268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:16.936117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:16.943380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:16.944099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:16.945526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:16.945648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:17.233344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:17.244212 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6032bd7e-15cc-4e71-8073-9bde15cb6b44 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1464 microversion: 2.1 time: 0.873486 Jul 01 10:31:17.245357 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 696/1349] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:16 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1464 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:17.251529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd00b5c3-1769-470a-a4ba-7be78b872cbd tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:17.268701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd00b5c3-1769-470a-a4ba-7be78b872cbd tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022079 Jul 01 10:31:17.277042 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 697/1350] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:17.283022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:17.283952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:17.295342 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:17.295889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:17.297342 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:17.298132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:17.405949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:17.418035 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f0e11af-6eac-45b8-866d-d30a0f08ebcf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.486831 Jul 01 10:31:17.419151 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 654/1351] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:16 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:17.428091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:17.429497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:17.436046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:17.436544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:17.437643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:17.438176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:17.712275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:17.724234 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e58ddcf-2026-4036-86c4-f3e6c2d237f5 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.445750 Jul 01 10:31:17.736239 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 698/1352] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:17 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:17.746376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-32bcb095-15b1-4ebe-af6a-c2a6227f5d85 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:17.782879 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-32bcb095-15b1-4ebe-af6a-c2a6227f5d85 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043113 Jul 01 10:31:17.784970 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 699/1353] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:17.795696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:17.797493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:17.804482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:17.804962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:17.809672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:17.810355 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.017627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:18.028264 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da898688-353a-44cc-910a-cc6be3fd518a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1464 microversion: 2.1 time: 0.607729 Jul 01 10:31:18.028831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 655/1354] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:17 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1464 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:18.038490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95bebf57-0fba-43df-8159-7591411ae420 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:18.090728 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95bebf57-0fba-43df-8159-7591411ae420 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.055746 Jul 01 10:31:18.092186 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 656/1355] 10.222.0.23 () {58 vars in 1164 bytes} [Fri Jul 1 10:31:18 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:18.097872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:18.100009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:18.107900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.111571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.111571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.111571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.211396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:18.233337 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f31d0448-8a6a-4270-9a0e-4485503d7522 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1462 microversion: 2.1 time: 0.437792 Jul 01 10:31:18.233337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 700/1356] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:17 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1462 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:18.240457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aeb93349-b08f-4d9c-b181-12a86689babf tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:18.259781 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aeb93349-b08f-4d9c-b181-12a86689babf tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028277 Jul 01 10:31:18.261814 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 701/1357] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:18.268080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:18.268806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:18.269655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:18.270281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:18.271063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:18.273873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8fc3226b-3d5d-4559-87c9-a9b5d45a6f16 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:18.274698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8fc3226b-3d5d-4559-87c9-a9b5d45a6f16 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:18.297756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc3226b-3d5d-4559-87c9-a9b5d45a6f16 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.297756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc3226b-3d5d-4559-87c9-a9b5d45a6f16 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.297756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc3226b-3d5d-4559-87c9-a9b5d45a6f16 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.297756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc3226b-3d5d-4559-87c9-a9b5d45a6f16 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.530034 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8fc3226b-3d5d-4559-87c9-a9b5d45a6f16 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1613 microversion: 2.1 time: 0.264479 Jul 01 10:31:18.532252 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 702/1358] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:18 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1613 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:18.538204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d45a29e2-98d7-45ec-852f-bcfde6a5ea97 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:18.576703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d45a29e2-98d7-45ec-852f-bcfde6a5ea97 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.043053 Jul 01 10:31:18.583583 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 703/1359] 10.222.0.23 () {58 vars in 1168 bytes} [Fri Jul 1 10:31:18 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:18.584295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:18.585168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:18.591872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.592764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.594013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.594686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.612886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:18.632095 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.632553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.643462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.643462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.716871 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3e6221b-068f-4d96-8521-3f45d72c9a88 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action" status: 202 len: 1068 microversion: 2.1 time: 0.623312 Jul 01 10:31:18.719191 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 657/1360] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:31:18 2022] POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action => generated 1068 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 01 10:31:18.725752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:18.728467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:18.743929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.744719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.745690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:18.746842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:18.871305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc93ddc48d9b42e99facdd6a1dc08815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d42bbbf8b6456a9206d9702bba80a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:18.871907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] flavor_id is None. Assuming migration. {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 01 10:31:18.874417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 10:31:18.911767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:18.921119 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2f4576cb-16a9-4e75-8305-05fc3d9480aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.340366 Jul 01 10:31:18.921738 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 704/1361] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:18 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:18.938768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6b5b2c03-bb5e-443e-84ab-8a2e339c42fe tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:18.971922 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=9 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:18.976171 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6b5b2c03-bb5e-443e-84ab-8a2e339c42fe tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.041161 Jul 01 10:31:18.981263 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 705/1362] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:31:18 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:18.993439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:18.995097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:19.013595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:19.014808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:19.016610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:19.017777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:19.292220 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=9 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:19.504526 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=27 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:19.787223 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c37693ab-46b7-40c8-b5d4-3128e5f34dad tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65/action" status: 202 len: 0 microversion: 2.1 time: 1.064871 Jul 01 10:31:19.788609 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 658/1363] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:31:18 2022] POST /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65/action => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:31:19.796771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:19.797853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:19.810438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:19.816522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:19.817821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:19.818608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:20.440912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:20.453866 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d3095346-9fcc-4c8c-8b3f-2c99a6cbbab4 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 1.471058 Jul 01 10:31:20.454692 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 706/1364] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:18 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:20.462819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0a56be71-e6be-47e4-a366-4e6b7611f0f8 req-d69ffc8b-6b7f-4131-b9ca-b9c89ce0b019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:20.474610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0a56be71-e6be-47e4-a366-4e6b7611f0f8 req-d69ffc8b-6b7f-4131-b9ca-b9c89ce0b019 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:20.475053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0a56be71-e6be-47e4-a366-4e6b7611f0f8 req-d69ffc8b-6b7f-4131-b9ca-b9c89ce0b019 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:20.489536 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0a56be71-e6be-47e4-a366-4e6b7611f0f8 req-d69ffc8b-6b7f-4131-b9ca-b9c89ce0b019 service nova] Creating event network-changed:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:31:20.496403 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0a56be71-e6be-47e4-a366-4e6b7611f0f8 req-d69ffc8b-6b7f-4131-b9ca-b9c89ce0b019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040175 Jul 01 10:31:20.497285 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 707/1365] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:20.507962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-817a0d96-b9da-45c0-bc40-3dd1269c1e7d tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:20.512854 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-817a0d96-b9da-45c0-bc40-3dd1269c1e7d tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014405 Jul 01 10:31:20.513897 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 708/1366] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:20.519062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:20.519958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:20.526560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:20.527013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:20.528962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:20.529525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:20.565788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:20.574284 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-994136ec-7bd3-46c0-82e4-8b15be0889f4 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.784296 Jul 01 10:31:20.575085 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 659/1367] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:19 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:20.580827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:20.581461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:20.588502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:20.588946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:20.589755 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:20.590277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:20.826890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:20.835106 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d0d8154-5453-435d-a3fa-21781ffca193 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1471 microversion: 2.1 time: 0.320027 Jul 01 10:31:20.835758 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 709/1368] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:20 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:20.866471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:20.875392 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-85d71c89-0a0b-4c31-867f-629fe11bc024 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.298109 Jul 01 10:31:20.876260 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 660/1369] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:20 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:20.881723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1857482e-a530-4bf3-a86f-2d827ceb6b2f tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:20.945569 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1857482e-a530-4bf3-a86f-2d827ceb6b2f tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.067538 Jul 01 10:31:20.946648 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 661/1370] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Jul 1 10:31:20 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:20.962195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50061262-a398-443a-973f-38d05a0be7ad tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:20.976391 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50061262-a398-443a-973f-38d05a0be7ad tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020535 Jul 01 10:31:20.978389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 662/1371] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:31:20.994663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-491f66fe-ff00-4b12-875f-a40c202d0c35 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.011626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-491f66fe-ff00-4b12-875f-a40c202d0c35 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.020481 Jul 01 10:31:21.012382 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 663/1372] 10.222.0.23 () {58 vars in 1143 bytes} [Fri Jul 1 10:31:20 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:21.030279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-091819a4-172b-4a55-98dc-3073b8dc70f6 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.052381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-edfe01cc-d0f4-43b3-a057-42c550c9ec34 tempest-ListImagesTestJSON-781068319 tempest-ListImagesTestJSON-781068319-project] Calling method '.version_select at 0x7f6f91a42b80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.063024 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-091819a4-172b-4a55-98dc-3073b8dc70f6 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036169 Jul 01 10:31:21.063781 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 664/1373] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:31:21.078427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a7e1c899-7f1f-4114-8e54-c040959b88d3 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.102836 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-edfe01cc-d0f4-43b3-a057-42c550c9ec34 tempest-ListImagesTestJSON-781068319 tempest-ListImagesTestJSON-781068319-project] 10.222.0.23 "GET /compute/v2.1/images/f784d1ed-9670-424c-abfe-e98e973ecb0e" status: 200 len: 784 microversion: 2.1 time: 0.264764 Jul 01 10:31:21.103767 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 710/1374] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:31:20 2022] GET /compute/v2.1/images/f784d1ed-9670-424c-abfe-e98e973ecb0e => generated 784 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:21.114426 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a7e1c899-7f1f-4114-8e54-c040959b88d3 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.042744 Jul 01 10:31:21.115280 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 665/1375] 10.222.0.23 () {58 vars in 1147 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:21.118260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-892f09d8-a2bb-4d3c-b94a-8d9a47c71540 tempest-ListImagesTestJSON-781068319 tempest-ListImagesTestJSON-781068319-project] Calling method '.version_select at 0x7f6f91c1eca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.130119 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ed72dfa-6f95-4938-85da-defa7384800f tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.172881 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ed72dfa-6f95-4938-85da-defa7384800f tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.048372 Jul 01 10:31:21.173910 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 666/1376] 10.222.0.23 () {58 vars in 1139 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:21.188559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef8640ff-91f4-4301-b075-64a2061b3ac9 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.203715 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef8640ff-91f4-4301-b075-64a2061b3ac9 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013983 Jul 01 10:31:21.203715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 667/1377] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:21.216523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f512b77f-fcb2-4f90-9777-91ac7b42a1f4 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.229729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-892f09d8-a2bb-4d3c-b94a-8d9a47c71540 tempest-ListImagesTestJSON-781068319 tempest-ListImagesTestJSON-781068319-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.116508 Jul 01 10:31:21.236965 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 711/1378] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/images => generated 445 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:21.241975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff678fe1-fe91-4a11-a2f8-3c22f3d36631 tempest-ListImagesTestJSON-781068319 tempest-ListImagesTestJSON-781068319-project] Calling method '.version_select at 0x7f6f91a42b80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.255023 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f512b77f-fcb2-4f90-9777-91ac7b42a1f4 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.046137 Jul 01 10:31:21.255608 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 668/1379] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:21.267544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56131702-5ad3-4f38-ae38-a368a4282bb6 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.297232 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff678fe1-fe91-4a11-a2f8-3c22f3d36631 tempest-ListImagesTestJSON-781068319 tempest-ListImagesTestJSON-781068319-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.058321 Jul 01 10:31:21.305692 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 712/1380] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:21.305801 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56131702-5ad3-4f38-ae38-a368a4282bb6 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035419 Jul 01 10:31:21.311021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 669/1381] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:21.316471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2d07277-5daa-49a6-9614-97a9e7dc7b27 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.326723 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2d07277-5daa-49a6-9614-97a9e7dc7b27 tempest-FlavorsV2TestJSON-1981375199 tempest-FlavorsV2TestJSON-1981375199-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015581 Jul 01 10:31:21.327230 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 713/1382] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:21.472133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.472746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:21.480602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.481209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:21.482429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.482569 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:21.591397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.592630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:21.599430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.599871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:21.600863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.601379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:21.645591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:21.654709 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-18604be2-1030-448a-832a-1034e6c141ec tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.186440 Jul 01 10:31:21.655600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 670/1383] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:21.765369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:21.774194 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6e8ad61-2d8a-4eaf-8bd4-ee1acb8848fb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.186678 Jul 01 10:31:21.774837 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 714/1384] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:21.853500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.854528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:21.863629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.868688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:21.870335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.871106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:21.893635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:21.895010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:21.902125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.902897 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:21.904049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:21.906082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:22.243467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:22.254235 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9a58f44-d1ca-42f7-986a-7a957bf15872 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1471 microversion: 2.1 time: 0.405516 Jul 01 10:31:22.256112 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 671/1385] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:22.278555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:22.283273 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:22.293814 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-692053b1-1040-4c50-b792-c88cd3bf9ec7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.405709 Jul 01 10:31:22.308198 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 715/1386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:21 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:22.672592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:22.673254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:22.679327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:22.679773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:22.680534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:22.681521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:22.790542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:22.791147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:22.798458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:22.798899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:22.799673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:22.800100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:22.837309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:22.861933 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c12817b3-d63c-4ca3-b115-74464198524a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.193704 Jul 01 10:31:22.869179 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 672/1387] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:22 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:22.987416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:22.995330 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7c64675d-9d8b-43ab-8c08-13d048950368 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.208738 Jul 01 10:31:22.996601 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 716/1388] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:22 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:23.273522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:23.274403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:23.282414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:23.283823 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:23.284768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:23.285400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:23.313660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:23.314282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:23.330002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:23.331063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:23.332635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:23.333499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:23.769969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:23.778156 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:23.788729 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6292b9c7-fce4-4dae-bdb5-71188c4e74aa tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1471 microversion: 2.1 time: 0.519359 Jul 01 10:31:23.789018 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c66d64e-cba1-49da-ad63-30425dd65f86 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.480574 Jul 01 10:31:23.790304 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 717/1389] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:23 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:23.796821 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 673/1390] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:23 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1471 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:23.885463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:23.886364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:23.900237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:23.900237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:23.900237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:23.900237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:23.972945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a84ed224-49cd-4e97-9f58-e10211da1dcb req-94535e0a-5195-46e6-ba47-cc3445ef24b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71f77a0-2de2-45c0-aaad-d21568206141", "name": "network-vif-plugged", "status": "completed", "tag": "ba9b2f43-8c38-48a1-aa13-d95458b0a8d1"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:23.983335 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=17 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:23.987472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a84ed224-49cd-4e97-9f58-e10211da1dcb req-94535e0a-5195-46e6-ba47-cc3445ef24b0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:23.989542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a84ed224-49cd-4e97-9f58-e10211da1dcb req-94535e0a-5195-46e6-ba47-cc3445ef24b0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:24.014718 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a84ed224-49cd-4e97-9f58-e10211da1dcb req-94535e0a-5195-46e6-ba47-cc3445ef24b0 service nova] Creating event network-vif-plugged:ba9b2f43-8c38-48a1-aa13-d95458b0a8d1 for instance a71f77a0-2de2-45c0-aaad-d21568206141 on n-h2-master-1 Jul 01 10:31:24.025272 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a84ed224-49cd-4e97-9f58-e10211da1dcb req-94535e0a-5195-46e6-ba47-cc3445ef24b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231520 Jul 01 10:31:24.028988 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 718/1391] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:24.039476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:24.040760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:24.052909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:24.055129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:24.057675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:24.058409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:24.132067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:24.141524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ee12b684-fe6b-4059-9941-5554193fb601 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.259876 Jul 01 10:31:24.145647 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 674/1392] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:23 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:24.342631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:24.350796 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e860d282-e544-461b-ac5b-d761a8a58871 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.320779 Jul 01 10:31:24.351360 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 719/1393] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:24 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:24.780002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b29cc358-472f-4489-8c46-551ecf11742b tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:24.788458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b29cc358-472f-4489-8c46-551ecf11742b tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.143368 Jul 01 10:31:24.789029 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 675/1394] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:31:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:24.803854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:24.804500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:24.807778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:24.809242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:24.812888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:24.813638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:24.814743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:24.815872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:24.824963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:24.825444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:24.826225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:24.826657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:24.856908 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:25.034451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:25.039215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:25.047341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23668770-170c-4d80-8d58-ef54e6ef64f9 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.244318 Jul 01 10:31:25.048208 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 676/1395] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:24 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:25.059256 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b24fa20d-af01-411f-a342-40c0b7741fb7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1471 microversion: 2.1 time: 0.259276 Jul 01 10:31:25.065002 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 720/1396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:24 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1471 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:25.160949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:25.161819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:25.176023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:25.176928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:25.178078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:25.178706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:25.367909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:25.368570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:25.368712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:25.386333 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-47969718-008c-474b-bb75-e150c537ad03 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.224287 Jul 01 10:31:25.386821 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:25.386911 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 677/1397] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:25 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:25.389915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:25.391406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:25.392277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:25.553991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:25.565093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf7996af-3401-40c4-831f-fdb6129cfd1c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1314 microversion: 2.1 time: 0.200912 Jul 01 10:31:25.576386 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 721/1398] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:25 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:25.936546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c35c08c-db8f-4503-8671-f65ed612da66 tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1066168725", "imageRef": "c54bba2d-1095-4402-8a19-f5522776da75", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:25.989277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-2c35c08c-db8f-4503-8671-f65ed612da66 tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:26.045139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-808110b9-3fdd-4558-8bb2-1fbb85b3c887 req-0be90b95-01ae-473a-a55b-566fc26ab381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-plugged", "status": "completed", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:26.058555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-808110b9-3fdd-4558-8bb2-1fbb85b3c887 req-0be90b95-01ae-473a-a55b-566fc26ab381 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.059059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-808110b9-3fdd-4558-8bb2-1fbb85b3c887 req-0be90b95-01ae-473a-a55b-566fc26ab381 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.081453 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-808110b9-3fdd-4558-8bb2-1fbb85b3c887 req-0be90b95-01ae-473a-a55b-566fc26ab381 service nova] Creating event network-vif-plugged:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:31:26.093092 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-808110b9-3fdd-4558-8bb2-1fbb85b3c887 req-0be90b95-01ae-473a-a55b-566fc26ab381 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051634 Jul 01 10:31:26.098107 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 722/1399] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:31:26.107254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:26.110087 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:26.121902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.123176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.127349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.130383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.295273 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-2c35c08c-db8f-4503-8671-f65ed612da66 tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c35c08c-db8f-4503-8671-f65ed612da66 tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] Request method failure captured: Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 143 Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsz8RyXHwwHlB_CPZ3H1pDbTuaE4squNXk5mZOOhmRHyVLwVwZ6ZNL1AGec5qoUyZ9D8Df_mYycikSYg9IPIZqVO5-zTluZVDUiqg37wpTKOEOKQ6uFB1Tl7O0oNxrKV-7Pdbx6NBcMnYsin9jLO9ArpyLlPjuNnBlmVmGHoBP3N2NI Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: bcaa14e9612e4e1d84964bb9b522def8 Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FlavorsV2NegativeTest-1796246527 Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:31:26.297723 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcaa14e9612e4e1d84964bb9b522def8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcaa14e9612e4e1d84964bb9b522def8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcaa14e9612e4e1d84964bb9b522def8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcaa14e9612e4e1d84964bb9b522def8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FlavorsV2NegativeTest-1796246527 Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: bcaa14e9612e4e1d84964bb9b522def8 Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1796246527 Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FlavorsV2NegativeTest-1796246527-project Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 3439b543d36e42598253bf447946b574 Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FlavorsV2NegativeTest-1796246527-project Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1066168725", "imageRef": "c54bba2d-1095-4402-8a19-f5522776da75", "flavorRef": "452"}} Jul 01 10:31:26.299402 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: exception: Flavor's memory is too small for requested image. Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1066168725', 'imageRef': 'c54bba2d-1095-4402-8a19-f5522776da75', 'flavorRef': '452'}}} Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:26.300389 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:26.301929 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c35c08c-db8f-4503-8671-f65ed612da66 tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c35c08c-db8f-4503-8671-f65ed612da66 tempest-FlavorsV2NegativeTest-1796246527 tempest-FlavorsV2NegativeTest-1796246527-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.366767 Jul 01 10:31:26.303459 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 678/1400] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:25 2022] POST /compute/v2.1/servers => generated 93 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:31:26.304475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:26.305336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:26.312977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.314074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.315141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.315583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.451609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:26.480785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-23d21c15-8e6b-4bc4-b7ed-8ea23cef472c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.380002 Jul 01 10:31:26.496234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 723/1401] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:26 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:26.504358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:26.504908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:26.522472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.523477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.525040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.526199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.588449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:26.607897 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc5a9d4c-5881-40df-88b2-76c1e5459adc tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.305243 Jul 01 10:31:26.608498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 679/1402] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:26 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:26.620707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:26.623430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:26.659313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.659773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.662494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:26.663212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:26.789953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:26.801122 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f803d70c-902f-4813-8bfc-112c4d16cfab tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.313508 Jul 01 10:31:26.813920 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 724/1403] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:26 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:26.877715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:26.887003 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac412b90-9254-4c3d-80ec-fb36ce35c5b0 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1464 microversion: 2.1 time: 0.275449 Jul 01 10:31:26.888180 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 680/1404] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:26 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1464 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:27.035308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5dda4975-aa50-4f8c-a42f-6013ae1ef21e tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Calling method '.version_select at 0x7f6f91aa8ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:27.047266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dda4975-aa50-4f8c-a42f-6013ae1ef21e tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.048418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dda4975-aa50-4f8c-a42f-6013ae1ef21e tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.067223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dda4975-aa50-4f8c-a42f-6013ae1ef21e tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.067664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dda4975-aa50-4f8c-a42f-6013ae1ef21e tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.090317 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5dda4975-aa50-4f8c-a42f-6013ae1ef21e tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/ad9e8deb1e614945bb7e0e9bc65f40d1?start=2022-06-30T10%3A31%3A26.898099&end=2022-07-02T10%3A31%3A26.898099" status: 200 len: 651 microversion: 2.1 time: 0.188426 Jul 01 10:31:27.091187 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 725/1405] 10.222.0.23 () {58 vars in 1411 bytes} [Fri Jul 1 10:31:26 2022] GET /compute/v2.1/os-simple-tenant-usage/ad9e8deb1e614945bb7e0e9bc65f40d1?start=2022-06-30T10%3A31%3A26.898099&end=2022-07-02T10%3A31%3A26.898099 => generated 651 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:31:27.106301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7d8b4d61-00ea-4500-b3b4-3c2ff434f1cb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '.version_select at 0x7f6f91dd0c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:27.126764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d8b4d61-00ea-4500-b3b4-3c2ff434f1cb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.128047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d8b4d61-00ea-4500-b3b4-3c2ff434f1cb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.145665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d8b4d61-00ea-4500-b3b4-3c2ff434f1cb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.146439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d8b4d61-00ea-4500-b3b4-3c2ff434f1cb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.169552 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7d8b4d61-00ea-4500-b3b4-3c2ff434f1cb tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/ad9e8deb1e614945bb7e0e9bc65f40d1?start=2022-06-30T10%3A31%3A26.898099&end=2022-07-02T10%3A31%3A26.898099" status: 200 len: 695 microversion: 2.1 time: 0.067261 Jul 01 10:31:27.170446 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 681/1406] 10.222.0.23 () {58 vars in 1411 bytes} [Fri Jul 1 10:31:27 2022] GET /compute/v2.1/os-simple-tenant-usage/ad9e8deb1e614945bb7e0e9bc65f40d1?start=2022-06-30T10%3A31%3A26.898099&end=2022-07-02T10%3A31%3A26.898099 => generated 695 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:27.184249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-804b2992-10bf-43ef-ba3f-9ff1928f137f tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Calling method '.version_select at 0x7f6f91c55c10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:27.195680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-804b2992-10bf-43ef-ba3f-9ff1928f137f tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.196379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-804b2992-10bf-43ef-ba3f-9ff1928f137f tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.214872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-804b2992-10bf-43ef-ba3f-9ff1928f137f tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.217715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-804b2992-10bf-43ef-ba3f-9ff1928f137f tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.304784 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-804b2992-10bf-43ef-ba3f-9ff1928f137f tempest-TenantUsagesTestJSON-832344573 tempest-TenantUsagesTestJSON-832344573-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-30T10%3A31%3A26.898099&end=2022-07-02T10%3A31%3A26.898099&detailed=1" status: 200 len: 17490 microversion: 2.1 time: 0.124617 Jul 01 10:31:27.305411 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 726/1407] 10.222.0.23 () {58 vars in 1334 bytes} [Fri Jul 1 10:31:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-30T10%3A31%3A26.898099&end=2022-07-02T10%3A31%3A26.898099&detailed=1 => generated 17490 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:31:27.327839 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:27.328337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:27.335432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.336234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.336865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.337509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.369124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:31:27.503979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:27.504886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:27.526955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.526955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.526955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.526955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.788312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:27.805655 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a8bb10fa-c96d-4308-b89c-8872908cb98e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1365 microversion: 2.1 time: 0.304187 Jul 01 10:31:27.805655 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 727/1408] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:27 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:27.816050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:27.817044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:27.827668 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cdfa5069-c953-43af-b8ab-a34f404ed96b tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 204 len: 0 microversion: 2.1 time: 0.503969 Jul 01 10:31:27.828577 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 682/1409] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:31:27 2022] DELETE /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:31:27.837428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:27.845036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:27.851971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.855863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.863795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.867840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.872633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.873106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:27.873941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:27.874388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:28.111882 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:28.129382 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc162728-6b36-4f85-9273-8cfa0a22a6d7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.323764 Jul 01 10:31:28.140217 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 728/1410] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:27 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:28.146829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:28.147699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:28.153945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:28.154672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:28.155452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:28.156082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:28.172891 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:28.186527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e6e02485-2050-4bed-9641-90c4ffbb409d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.356243 Jul 01 10:31:28.194649 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 683/1411] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:27 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:28.353527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:28.365240 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21ef5875-1b5d-4d14-9f2c-03253f8faa3e tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1470 microversion: 2.1 time: 0.222451 Jul 01 10:31:28.366107 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 729/1412] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:28 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:28.825188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:28.828824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:28.836797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:28.837568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:28.838563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:28.839210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.014886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:29.036864 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a01532a-1a40-451c-a81a-d2dbe41761be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1552 microversion: 2.1 time: 0.205629 Jul 01 10:31:29.039224 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 684/1413] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:28 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1552 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:29.055861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-362d0bc0-9835-4055-82fb-be4648fc607d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:29.058275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-362d0bc0-9835-4055-82fb-be4648fc607d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:29.066842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-362d0bc0-9835-4055-82fb-be4648fc607d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.067672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-362d0bc0-9835-4055-82fb-be4648fc607d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.070482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-362d0bc0-9835-4055-82fb-be4648fc607d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.071131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-362d0bc0-9835-4055-82fb-be4648fc607d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.147013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:29.148049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:29.164429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.167385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.168266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.168720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.217365 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-362d0bc0-9835-4055-82fb-be4648fc607d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166355 Jul 01 10:31:29.219355 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 730/1414] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:31:29 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:29.230450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:29.231335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:29.243973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.248557 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.249580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.250271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.858073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:29.879712 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-685106d8-e7bb-49f6-a4a7-4f78557d4d0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.724896 Jul 01 10:31:29.880372 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 685/1415] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:29 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:29.902446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:29.903087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:29.921648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.922352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:29.923319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:29.923936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:30.106175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:30.113914 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f6ff44c1-7baa-4706-920b-a78f8d8644f9 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.887601 Jul 01 10:31:30.114494 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 731/1416] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:29 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:30.318474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:30.331506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4aa280f6-5e58-4417-acc3-d7f137a0cabe tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1470 microversion: 2.1 time: 0.450060 Jul 01 10:31:30.332281 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 686/1417] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:29 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:30.392188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b60e212c-0321-4bb4-9edc-3f8e9c63a573 tempest-ListImageFiltersNegativeTestJSON-679697851 tempest-ListImageFiltersNegativeTestJSON-679697851-project] Calling method '.version_select at 0x7f6f91b09700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:30.432196 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b60e212c-0321-4bb4-9edc-3f8e9c63a573 tempest-ListImageFiltersNegativeTestJSON-679697851 tempest-ListImageFiltersNegativeTestJSON-679697851-project] HTTP exception thrown: Image not found. Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b60e212c-0321-4bb4-9edc-3f8e9c63a573 tempest-ListImageFiltersNegativeTestJSON-679697851 tempest-ListImageFiltersNegativeTestJSON-679697851-project] Request method failure captured: Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/images/50df8841-86fd-4919-876e-020d51626734 HTTP/1.1 Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0CrwDxW2UQQ_N12GSV9hnJQb0jn8R85UEOoBpXposV9ZucqJUMKe06n2sknSbk5nU6N85Lafg1viBiP5J4gixfSydKdURPYcDHvGRmrYXG_44o52sXpNpDmEj1eqJlYW3FODiNLh-GayG4H2nAJml8T_DiWD1KkuIoIWiiLWgI8-0 Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 981a6755dd54408998c33a96aaa56f66 Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-679697851 Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:30.434965 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/981a6755dd54408998c33a96aaa56f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/981a6755dd54408998c33a96aaa56f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_981a6755dd54408998c33a96aaa56f66", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/981a6755dd54408998c33a96aaa56f66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-679697851 Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 981a6755dd54408998c33a96aaa56f66 Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-679697851 Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListImageFiltersNegativeTestJSON-679697851-project Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 79eed457721f4a148dcbadd49b1ae316 Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-679697851-project Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '50df8841-86fd-4919-876e-020d51626734'} Jul 01 10:31:30.436511 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:31:30.437583 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 50df8841-86fd-4919-876e-020d51626734 Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:31:30.438726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50df8841-86fd-4919-876e-020d51626734 could not be found. Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:30.439958 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:30.441106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b60e212c-0321-4bb4-9edc-3f8e9c63a573 tempest-ListImageFiltersNegativeTestJSON-679697851 tempest-ListImageFiltersNegativeTestJSON-679697851-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:30.448884 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b60e212c-0321-4bb4-9edc-3f8e9c63a573 tempest-ListImageFiltersNegativeTestJSON-679697851 tempest-ListImageFiltersNegativeTestJSON-679697851-project] 10.222.0.23 "GET /compute/v2.1/images/50df8841-86fd-4919-876e-020d51626734" status: 404 len: 62 microversion: 2.1 time: 0.256686 Jul 01 10:31:30.448884 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 732/1418] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:31:30 2022] GET /compute/v2.1/images/50df8841-86fd-4919-876e-020d51626734 => generated 62 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:31:30.705742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d4aa677a-2af2-4bc0-826f-fa81543205bf req-aa7f86b7-dd3e-4425-ab28-040966549500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71f77a0-2de2-45c0-aaad-d21568206141", "name": "network-vif-deleted", "tag": "ba9b2f43-8c38-48a1-aa13-d95458b0a8d1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:30.714932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d4aa677a-2af2-4bc0-826f-fa81543205bf req-aa7f86b7-dd3e-4425-ab28-040966549500 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:30.715982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d4aa677a-2af2-4bc0-826f-fa81543205bf req-aa7f86b7-dd3e-4425-ab28-040966549500 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:30.735961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d4aa677a-2af2-4bc0-826f-fa81543205bf req-aa7f86b7-dd3e-4425-ab28-040966549500 service nova] Creating event network-vif-deleted:ba9b2f43-8c38-48a1-aa13-d95458b0a8d1 for instance a71f77a0-2de2-45c0-aaad-d21568206141 on n-h2-master-1 Jul 01 10:31:30.742138 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d4aa677a-2af2-4bc0-826f-fa81543205bf req-aa7f86b7-dd3e-4425-ab28-040966549500 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041195 Jul 01 10:31:30.748009 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 687/1419] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:31:30.898546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:30.900356 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:30.909911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:30.911081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:30.912280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:30.912978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:31.107387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:31.122785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee967a88-d071-4e5b-a299-f3a806449984 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.229708 Jul 01 10:31:31.124010 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 733/1420] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:30 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:31.132455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:31.133790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:31.147287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:31.150396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:31.156920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:31.158347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:31.350754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:31.351370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:31.362038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:31.363799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:31.365635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:31.366295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:31.391289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:31.404270 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d1cbeb9-523f-4882-b6b2-f01a85597246 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.273045 Jul 01 10:31:31.405215 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 688/1421] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:31 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:31.463294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:31.466422 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:31.467174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lazy-loading 'fault' on Instance uuid a71f77a0-2de2-45c0-aaad-d21568206141 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:31:31.563722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7314359d124b4ee5978f99f21ca96375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e8deb1e614945bb7e0e9bc65f40d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:31.582534 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea6cf26e-c09f-4cf8-84ec-36df093b27b8 tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 200 len: 1304 microversion: 2.1 time: 0.235171 Jul 01 10:31:31.590625 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 734/1422] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:31 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:32.139840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:32.141457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:32.158889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:32.161380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:32.161380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:32.161380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:32.242115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-53a9f8d5-4cfc-492d-9869-38d45b52113b req-43bfe137-d14c-4ff0-a1e8-0437f9431d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:32.258053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-53a9f8d5-4cfc-492d-9869-38d45b52113b req-43bfe137-d14c-4ff0-a1e8-0437f9431d57 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:32.263208 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-53a9f8d5-4cfc-492d-9869-38d45b52113b req-43bfe137-d14c-4ff0-a1e8-0437f9431d57 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:32.275303 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-53a9f8d5-4cfc-492d-9869-38d45b52113b req-43bfe137-d14c-4ff0-a1e8-0437f9431d57 service nova] Creating event network-changed:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:31:32.282000 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-53a9f8d5-4cfc-492d-9869-38d45b52113b req-43bfe137-d14c-4ff0-a1e8-0437f9431d57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381508 Jul 01 10:31:32.283281 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 689/1423] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:32.423393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:32.426899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:32.435082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:32.435610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:32.436561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:32.437254 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:33.320331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:33.329707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:33.331551 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-84431d94-fde4-46ec-9543-a6184b450a43 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 1.195616 Jul 01 10:31:33.337403 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-21ecc972-eb18-4ceb-97d1-2fa06b3d03fc tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.919324 Jul 01 10:31:33.341062 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 690/1424] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:32 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:33.346332 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 735/1425] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:32 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:33.348099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:33.348715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] [instance: a71f77a0-2de2-45c0-aaad-d21568206141] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:33.360749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:33.361458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:33.362290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:33.362685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:33.392809 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] HTTP exception thrown: Instance a71f77a0-2de2-45c0-aaad-d21568206141 could not be found. Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Request method failure captured: Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 HTTP/1.1 Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivszjeeh5hUVcwpt6OLwXOQJJ23iHOUxnQuLjV1tDObvmpipCZ6-kwKtiVXqeDsUqflSFnDuTGl5tvVSx06K1Gc3TqkhRmiEn6bxKON2hjFkGe6w-qLzmu7wQHr95iQlwv9tXb3dJgKrz9DbOPka9FOlJcJP2In0LuRLOiTGO6B8HkKY Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: ad9e8deb1e614945bb7e0e9bc65f40d1 Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TenantUsagesTestJSON-1965834597 Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:31:33.394505 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad9e8deb1e614945bb7e0e9bc65f40d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad9e8deb1e614945bb7e0e9bc65f40d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad9e8deb1e614945bb7e0e9bc65f40d1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad9e8deb1e614945bb7e0e9bc65f40d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TenantUsagesTestJSON-1965834597 Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: ad9e8deb1e614945bb7e0e9bc65f40d1 Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1965834597 Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TenantUsagesTestJSON-1965834597-project Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7314359d124b4ee5978f99f21ca96375 Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TenantUsagesTestJSON-1965834597-project Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: exception: Instance a71f77a0-2de2-45c0-aaad-d21568206141 could not be found. Jul 01 10:31:33.396138 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'a71f77a0-2de2-45c0-aaad-d21568206141'} Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71f77a0-2de2-45c0-aaad-d21568206141 could not be found. Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:33.397053 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71f77a0-2de2-45c0-aaad-d21568206141 could not be found. Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71f77a0-2de2-45c0-aaad-d21568206141 could not be found. Jul 01 10:31:33.398551 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:33.400607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] Returning 404 to user: Instance a71f77a0-2de2-45c0-aaad-d21568206141 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:33.401683 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-334b07cc-852d-43c8-af1c-18608f0a168c tempest-TenantUsagesTestJSON-1965834597 tempest-TenantUsagesTestJSON-1965834597-project] 10.222.0.23 "GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141" status: 404 len: 111 microversion: 2.1 time: 0.059477 Jul 01 10:31:33.402401 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 691/1426] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:33 2022] GET /compute/v2.1/servers/a71f77a0-2de2-45c0-aaad-d21568206141 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:34.354739 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:34.355652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:34.368313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:34.368821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:34.369910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:34.370684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:34.548488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dd41f4f0-1c59-4a64-8766-94d6e629aa3c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Calling method '.version_select at 0x7f6f91c55550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:34.571667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd41f4f0-1c59-4a64-8766-94d6e629aa3c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:34.572201 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd41f4f0-1c59-4a64-8766-94d6e629aa3c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:34.574159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd41f4f0-1c59-4a64-8766-94d6e629aa3c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:34.574968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd41f4f0-1c59-4a64-8766-94d6e629aa3c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:34.581636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:34.590987 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9c14ebc-4186-4587-bf5d-907777bfb9c4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.243428 Jul 01 10:31:34.592133 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 692/1427] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:34 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:34.592482 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:34.639519 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dd41f4f0-1c59-4a64-8766-94d6e629aa3c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.533927 Jul 01 10:31:34.715529 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 736/1428] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Jul 1 10:31:34 2022] GET /compute/v2.1/limits => generated 511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:34.715529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:34.715529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:34.715529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:34.715529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:34.716822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:34.716822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:34.717022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7896f3e7-5c29-49a2-b162-f042e9097751 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Calling method '.version_select at 0x7f6f91bb7820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:34.760439 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-7896f3e7-5c29-49a2-b162-f042e9097751 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:31:34.762264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-7896f3e7-5c29-49a2-b162-f042e9097751 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Neutron security group cb995250-263d-4cd8-8187-bdefce02930f not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:31:34.763208 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7896f3e7-5c29-49a2-b162-f042e9097751 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] HTTP exception thrown: Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist Jul 01 10:31:34.763208 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-540913bd-c41e-4136-96ff-5d0e313360df'] Jul 01 10:31:34.862819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:34.870979 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7eae1634-a482-4f98-b7f4-68a44dee47b5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.228509 Jul 01 10:31:34.872637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 737/1429] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:34 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:34.877997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1940743086", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:35.006439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7896f3e7-5c29-49a2-b162-f042e9097751 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Request method failure captured: Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-security-groups/cb995250-263d-4cd8-8187-bdefce02930f HTTP/1.1 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0GYl-USkomjR7ihG9Aw4QYPLb_-EL2EI7h2YwoVVMUmOpyN9riFjvhrxxmsDNdwDGoghlBhlJ9SsXca5lWpA6tPBy5mA0-Vif1YKCkxTZ5q86MxEunbRiYbh1PHRrM4GIk3OxetyRo-MQMxEwMIHAcodMwfZ6ECmzYLXbHk3teyZY Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8d8f1671bb47368aa4dcb5ae4ba58d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1941456f91614447bf09b28ddc116efd Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: exception: Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-540913bd-c41e-4136-96ff-5d0e313360df'] Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'cb995250-263d-4cd8-8187-bdefce02930f'} Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:31:35.007448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-540913bd-c41e-4136-96ff-5d0e313360df'] Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-540913bd-c41e-4136-96ff-5d0e313360df'] Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-540913bd-c41e-4136-96ff-5d0e313360df'] Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-540913bd-c41e-4136-96ff-5d0e313360df'] Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7896f3e7-5c29-49a2-b162-f042e9097751 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Returning 404 to user: Security group cb995250-263d-4cd8-8187-bdefce02930f does not exist Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-540913bd-c41e-4136-96ff-5d0e313360df'] {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7896f3e7-5c29-49a2-b162-f042e9097751 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/cb995250-263d-4cd8-8187-bdefce02930f" status: 404 len: 194 microversion: 2.1 time: 0.392829 Jul 01 10:31:35.016278 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 693/1430] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:31:34 2022] DELETE /compute/v2.1/os-security-groups/cb995250-263d-4cd8-8187-bdefce02930f => generated 194 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:35.032322 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce7c8348-8fa4-4428-b958-f88fc3a365ab tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008601 Jul 01 10:31:35.032322 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 694/1431] 10.222.0.23 () {58 vars in 1163 bytes} [Fri Jul 1 10:31:35 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 10:31:35.036249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5eaa26d1-6859-486c-9584-1e531231531d tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Calling method '.version_select at 0x7f6f9249d550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:35.222053 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:35.227247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Getting quotas for project 61049dd2433d458daee77ec6a2fdbc2e. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:35.233188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Getting quotas for user e82f08e6c3b94811ba9493c33c105f01 and project 61049dd2433d458daee77ec6a2fdbc2e. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:35.247218 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Request method failure captured: Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 1752 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0FuHtJ6uSNgddIq9uKz9AA0Am1I6xrcj2FhubXCd7wLFYSXa3JHfJvENYepa7541q03lYoDZSJfNHCENns1ePyacTpHUTOv8ESxyoX8CqoLel-E3kvioQpU-S6fdtCzM0B2mlv7em7-Akz61Q5daUQsNEy9B7imR-hExvSXXoQ2FY Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 61049dd2433d458daee77ec6a2fdbc2e Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1808850656 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61049dd2433d458daee77ec6a2fdbc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61049dd2433d458daee77ec6a2fdbc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61049dd2433d458daee77ec6a2fdbc2e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61049dd2433d458daee77ec6a2fdbc2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1808850656 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 61049dd2433d458daee77ec6a2fdbc2e Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1808850656 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: e82f08e6c3b94811ba9493c33c105f01 Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1940743086", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:31:35.250081 n-d-master-1 devstack@n-api.service[119765]: exception: Maximum number of metadata items exceeds 128 Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1940743086', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:35.253522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 01 10:31:35.257018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.259997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:35.261207 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-493b4d83-9cf0-4962-a98c-6c93c82e7e9c tempest-AbsoluteLimitsNegativeTestJSON-1808850656 tempest-AbsoluteLimitsNegativeTestJSON-1808850656-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.387403 Jul 01 10:31:35.266995 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 738/1432] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Jul 1 10:31:34 2022] POST /compute/v2.1/servers => generated 87 bytes in 393 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:31:35.303535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5eaa26d1-6859-486c-9584-1e531231531d tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.275221 Jul 01 10:31:35.304055 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 695/1433] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:31:35 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:35.318205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-accdf9bc-6b91-45e0-b60b-7ea7db7e507a tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Calling method '.version_select at 0x7f6f91d970d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:35.435152 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-accdf9bc-6b91-45e0-b60b-7ea7db7e507a tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:31:35.435943 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-accdf9bc-6b91-45e0-b60b-7ea7db7e507a tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 01 10:31:35.435943 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-6d8d4bff-0417-4834-a2bc-d25c2f90f5e1'] Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-accdf9bc-6b91-45e0-b60b-7ea7db7e507a tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Request method failure captured: Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/1bbac1e2-00a9-421b-bd51-2477d82d9ba4 HTTP/1.1 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0GYl-USkomjR7ihG9Aw4QYPLb_-EL2EI7h2YwoVVMUmOpyN9riFjvhrxxmsDNdwDGoghlBhlJ9SsXca5lWpA6tPBy5mA0-Vif1YKCkxTZ5q86MxEunbRiYbh1PHRrM4GIk3OxetyRo-MQMxEwMIHAcodMwfZ6ECmzYLXbHk3teyZY Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8d8f1671bb47368aa4dcb5ae4ba58d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 1941456f91614447bf09b28ddc116efd Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: exception: Insufficient rights for removing default security group. Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-6d8d4bff-0417-4834-a2bc-d25c2f90f5e1'] Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1bbac1e2-00a9-421b-bd51-2477d82d9ba4'} Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:31:35.438978 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d8d4bff-0417-4834-a2bc-d25c2f90f5e1'] Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d8d4bff-0417-4834-a2bc-d25c2f90f5e1'] Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d8d4bff-0417-4834-a2bc-d25c2f90f5e1'] Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d8d4bff-0417-4834-a2bc-d25c2f90f5e1'] Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-accdf9bc-6b91-45e0-b60b-7ea7db7e507a tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-6d8d4bff-0417-4834-a2bc-d25c2f90f5e1'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-accdf9bc-6b91-45e0-b60b-7ea7db7e507a tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1bbac1e2-00a9-421b-bd51-2477d82d9ba4" status: 400 len: 182 microversion: 2.1 time: 0.128311 Jul 01 10:31:35.443159 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 739/1434] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:31:35 2022] DELETE /compute/v2.1/os-security-groups/1bbac1e2-00a9-421b-bd51-2477d82d9ba4 => generated 182 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:31:35.458616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-89eb7276-2bd9-4ee3-a3f7-817251c3a781 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Calling method '.version_select at 0x7f6f91ea5790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:35.480079 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-89eb7276-2bd9-4ee3-a3f7-817251c3a781 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:31:35.480669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-89eb7276-2bd9-4ee3-a3f7-817251c3a781 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Neutron security group c5232980-61d5-47cf-8e92-b6985e597cdf not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:31:35.481222 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-89eb7276-2bd9-4ee3-a3f7-817251c3a781 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] HTTP exception thrown: Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist Jul 01 10:31:35.481222 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-96470b1f-3541-487c-b13e-e76be6946761'] Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-89eb7276-2bd9-4ee3-a3f7-817251c3a781 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Request method failure captured: Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-security-groups/c5232980-61d5-47cf-8e92-b6985e597cdf HTTP/1.1 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0GYl-USkomjR7ihG9Aw4QYPLb_-EL2EI7h2YwoVVMUmOpyN9riFjvhrxxmsDNdwDGoghlBhlJ9SsXca5lWpA6tPBy5mA0-Vif1YKCkxTZ5q86MxEunbRiYbh1PHRrM4GIk3OxetyRo-MQMxEwMIHAcodMwfZ6ECmzYLXbHk3teyZY Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8d8f1671bb47368aa4dcb5ae4ba58d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1941456f91614447bf09b28ddc116efd Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: exception: Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-96470b1f-3541-487c-b13e-e76be6946761'] Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c5232980-61d5-47cf-8e92-b6985e597cdf'} Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:31:35.483028 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96470b1f-3541-487c-b13e-e76be6946761'] Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96470b1f-3541-487c-b13e-e76be6946761'] Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96470b1f-3541-487c-b13e-e76be6946761'] Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96470b1f-3541-487c-b13e-e76be6946761'] Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-89eb7276-2bd9-4ee3-a3f7-817251c3a781 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Returning 404 to user: Security group c5232980-61d5-47cf-8e92-b6985e597cdf does not exist Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-96470b1f-3541-487c-b13e-e76be6946761'] {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-89eb7276-2bd9-4ee3-a3f7-817251c3a781 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/c5232980-61d5-47cf-8e92-b6985e597cdf" status: 404 len: 194 microversion: 2.1 time: 0.032608 Jul 01 10:31:35.487747 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 696/1435] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:31:35 2022] GET /compute/v2.1/os-security-groups/c5232980-61d5-47cf-8e92-b6985e597cdf => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:35.494275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41f4362f-eb01-4928-8b20-95a58bc5da23 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Action: 'update', calling method: .version_select at 0x7f6f91aa8670>, body: {"security_group": {"name": "tempest-sg-1798273966", "description": "tempest-description-1211985062"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:35.517886 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-41f4362f-eb01-4928-8b20-95a58bc5da23 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:31:35.518488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-41f4362f-eb01-4928-8b20-95a58bc5da23 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Neutron security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:31:35.519016 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-41f4362f-eb01-4928-8b20-95a58bc5da23 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] HTTP exception thrown: Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist Jul 01 10:31:35.519016 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-fd0912e8-85a7-4db0-b8d8-946a08060c58'] Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41f4362f-eb01-4928-8b20-95a58bc5da23 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Request method failure captured: Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-security-groups/1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 HTTP/1.1 Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 102 Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0GYl-USkomjR7ihG9Aw4QYPLb_-EL2EI7h2YwoVVMUmOpyN9riFjvhrxxmsDNdwDGoghlBhlJ9SsXca5lWpA6tPBy5mA0-Vif1YKCkxTZ5q86MxEunbRiYbh1PHRrM4GIk3OxetyRo-MQMxEwMIHAcodMwfZ6ECmzYLXbHk3teyZY Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8d8f1671bb47368aa4dcb5ae4ba58d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8d8f1671bb47368aa4dcb5ae4ba58d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5d8d8f1671bb47368aa4dcb5ae4ba58d Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061 Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 1941456f91614447bf09b28ddc116efd Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1079661061-project Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: {"security_group": {"name": "tempest-sg-1798273966", "description": "tempest-description-1211985062"}} Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-fd0912e8-85a7-4db0-b8d8-946a08060c58'] Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1b1f69a7-4db8-4a2f-aa20-a069eaa10a99', 'body': {'security_group': {'name': 'tempest-sg-1798273966', 'description': 'tempest-description-1211985062'}}} Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:31:35.521001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0912e8-85a7-4db0-b8d8-946a08060c58'] Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0912e8-85a7-4db0-b8d8-946a08060c58'] Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0912e8-85a7-4db0-b8d8-946a08060c58'] Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0912e8-85a7-4db0-b8d8-946a08060c58'] Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41f4362f-eb01-4928-8b20-95a58bc5da23 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] Returning 404 to user: Security group 1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 does not exist Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-fd0912e8-85a7-4db0-b8d8-946a08060c58'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-41f4362f-eb01-4928-8b20-95a58bc5da23 tempest-SecurityGroupsNegativeTestJSON-1079661061 tempest-SecurityGroupsNegativeTestJSON-1079661061-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/1b1f69a7-4db8-4a2f-aa20-a069eaa10a99" status: 404 len: 194 microversion: 2.1 time: 0.032028 Jul 01 10:31:35.525490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 740/1436] 10.222.0.23 () {60 vars in 1289 bytes} [Fri Jul 1 10:31:35 2022] PUT /compute/v2.1/os-security-groups/1b1f69a7-4db8-4a2f-aa20-a069eaa10a99 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:31:35.609000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:35.610189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:35.617997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:35.618522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:35.619844 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:35.621833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:35.793706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:35.802334 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d24f57ad-25b4-4896-a8c8-081b2a87084f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.197268 Jul 01 10:31:35.812704 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 697/1437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:35 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:35.895523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:35.898921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:35.909982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:35.910699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:35.912576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:35.913662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:36.277701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:36.294903 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-078c8fd0-9436-407d-87c2-c2f6304551ed tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.407142 Jul 01 10:31:36.298995 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 741/1438] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:35 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:36.819439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:36.819439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:36.830684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:36.831135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:36.832337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:36.833029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:37.126065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:37.138128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-97571518-c48e-4f0d-a6bd-4d06353205ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.323223 Jul 01 10:31:37.139093 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 698/1439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:36 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:37.317515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:37.317515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:37.323227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:37.324137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:37.325300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:37.325906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:37.585038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:37.653631 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5cb686e7-6b3b-4033-9899-1cecac60267c tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.342680 Jul 01 10:31:37.666290 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 742/1440] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:37 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:38.163035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:38.163646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:38.173370 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:38.176894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:38.178864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:38.183519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:38.186744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:38.192235 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:38.412944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:38.427184 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e39cb08-97e4-4e3b-9a4f-5023be213349 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.268177 Jul 01 10:31:38.432777 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 699/1441] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:38 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:38.673178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:38.675638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:38.686997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:38.688334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:38.688684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:38.689335 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:38.918032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:38.934248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2ece3fdc-abfa-4c12-85d6-146a294ce9ba tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.266796 Jul 01 10:31:38.949300 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 743/1442] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:38 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:39.445426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:39.446202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:39.452571 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:39.456098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:39.456649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:39.457587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:39.458102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:39.774756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:39.786786 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-90654fc0-ab31-4511-9ad6-a1fe7feb5375 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.344169 Jul 01 10:31:39.790030 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 700/1443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:39 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:39.956382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:39.957330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:39.964672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:39.965361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:39.966523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:39.967495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:40.599572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:40.646082 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4f49abfd-bcaa-40ee-90d5-f3816592c0ae tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.696783 Jul 01 10:31:40.659030 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 744/1444] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:39 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:40.806752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:40.811411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:40.817044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:40.818069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:40.819321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:40.820182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:41.047030 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:41.054633 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2bca5269-f809-453f-b764-edb7e33d8b16 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.252643 Jul 01 10:31:41.055293 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 701/1445] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:40 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:41.667148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:41.667835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:41.677026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:41.677526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:41.678331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:41.678776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:41.965708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:41.980775 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4b25299-ed5e-4afc-b3d2-8f3503b36d36 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.317555 Jul 01 10:31:41.981406 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 745/1446] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:41 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:42.083367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:42.085884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:42.093587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:42.094785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:42.095760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:42.096383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:42.348118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:42.359622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e4537aa-a983-403c-b0cd-089d9c7ee34d tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.284067 Jul 01 10:31:42.360242 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 702/1447] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:42 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:43.002193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:43.003562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:43.029851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:43.034346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:43.035672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:43.038547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:43.550044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:43.560908 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7a387e3-4739-482a-91a6-d253c8eaf6da tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.562610 Jul 01 10:31:43.567242 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 746/1448] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:42 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:43.695059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef45de3a-a30d-4bc1-a1f6-dc7a193270c7 tempest-AZV2TestJSON-1231697851 tempest-AZV2TestJSON-1231697851-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:43.696977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef45de3a-a30d-4bc1-a1f6-dc7a193270c7 tempest-AZV2TestJSON-1231697851 tempest-AZV2TestJSON-1231697851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:43.697635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef45de3a-a30d-4bc1-a1f6-dc7a193270c7 tempest-AZV2TestJSON-1231697851 tempest-AZV2TestJSON-1231697851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:43.699265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef45de3a-a30d-4bc1-a1f6-dc7a193270c7 tempest-AZV2TestJSON-1231697851 tempest-AZV2TestJSON-1231697851-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:43.700059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef45de3a-a30d-4bc1-a1f6-dc7a193270c7 tempest-AZV2TestJSON-1231697851 tempest-AZV2TestJSON-1231697851-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:43.737404 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef45de3a-a30d-4bc1-a1f6-dc7a193270c7 tempest-AZV2TestJSON-1231697851 tempest-AZV2TestJSON-1231697851-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.166369 Jul 01 10:31:43.737404 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 747/1449] 10.222.0.23 () {58 vars in 1163 bytes} [Fri Jul 1 10:31:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:31:43.769784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:43.773285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:43.781527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:43.782179 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:43.788203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:43.788888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:44.114751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:44.123002 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb79fe74-028c-4af4-9955-91506a979ba4 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.748296 Jul 01 10:31:44.123779 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 703/1450] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:43 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:44.585330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:44.585971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:44.598089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:44.603823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:44.613783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:44.613783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:44.684532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:44.685176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:44.714207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:44.714673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:44.715480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:44.715915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:45.122388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:45.132097 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8fa48b4-a36f-49c5-84da-1868e7b1c2c8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.554359 Jul 01 10:31:45.139268 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 748/1451] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:44 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:45.148711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:45.152171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:45.162858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:45.163172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:45.163946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:45.167787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:45.243644 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:45.386724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:31:45.418972 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-15622ac9-acdd-4ba9-9227-134f85367689 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 2342 microversion: 2.25 time: 0.752596 Jul 01 10:31:45.420118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 704/1452] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:31:44 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 2342 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:31:45.434590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:45.438284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2acf3489-0de3-4d5a-9e1e-98d47f523c1f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:45.439772 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:31:45.439772 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:31:45.440877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2acf3489-0de3-4d5a-9e1e-98d47f523c1f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:45.441401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2acf3489-0de3-4d5a-9e1e-98d47f523c1f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:45.449107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2acf3489-0de3-4d5a-9e1e-98d47f523c1f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:45.450303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2acf3489-0de3-4d5a-9e1e-98d47f523c1f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:45.454517 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-848772ba-00b1-4aea-89b0-7793209a4918 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.314012 Jul 01 10:31:45.457815 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 749/1453] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:45 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:45.490154 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2acf3489-0de3-4d5a-9e1e-98d47f523c1f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055733 Jul 01 10:31:45.494497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 705/1454] 10.222.0.23 () {60 vars in 1216 bytes} [Fri Jul 1 10:31:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:31:46.158341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:46.158952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:46.174645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:46.179218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:46.179218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:46.179218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:46.476340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:46.477740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:46.509008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:46.510225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:46.511101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:46.511601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:47.336017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:47.360003 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3be3d524-6fb6-4108-85db-5eb9856a0e4f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.883278 Jul 01 10:31:47.367807 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 706/1455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:46 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:47.466334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:47.487098 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eedde86b-863b-4ee4-abc0-206b0f6ac178 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 1.333375 Jul 01 10:31:47.487742 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 750/1456] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:46 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:48.385698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:48.387075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:48.417271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:48.417789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:48.420368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:48.423960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:48.504630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:48.506826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:48.524744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:48.528619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:48.529796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:48.533091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:49.033797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:49.049937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f8fff496-4180-4ffc-89a8-c85b7bd9fd6c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.669812 Jul 01 10:31:49.050875 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 707/1457] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:48 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:49.072914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:49.085548 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-161ac713-2928-49f4-9737-60cb173a3a81 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.585418 Jul 01 10:31:49.089392 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 751/1458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:48 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:49.835121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-613ca09e-08bd-46f4-848e-e8448b8990e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a5f5030-fd70-44b5-b844-2e252af6fc7f", "device": "/dev/xvdb"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:49.836706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-613ca09e-08bd-46f4-848e-e8448b8990e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:49.856532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-613ca09e-08bd-46f4-848e-e8448b8990e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:49.864783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-613ca09e-08bd-46f4-848e-e8448b8990e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:49.865968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-613ca09e-08bd-46f4-848e-e8448b8990e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:49.866582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-613ca09e-08bd-46f4-848e-e8448b8990e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:50.067750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:50.069053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:50.084072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:50.085018 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:50.086063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:50.086666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:50.510260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:50.531603 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-90c3b324-ee22-46a2-934d-ca4533d69dc7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.459256 Jul 01 10:31:50.535145 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 752/1459] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:50 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:50.543703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:50.546618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:50.554069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:50.554866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:50.555853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:50.556722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:50.865434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:50.891121 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-06a7305b-b10a-490e-bf18-0dcc390b2070 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1473 microversion: 2.1 time: 0.350108 Jul 01 10:31:50.892124 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 753/1460] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:50 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1473 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:51.207164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-187818496", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "e231d808-d9c2-44eb-8ea8-e48179fbb8a1"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:51.325368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] validate_networks() for [('e231d808-d9c2-44eb-8ea8-e48179fbb8a1', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:52.010535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-613ca09e-08bd-46f4-848e-e8448b8990e8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "POST /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.178745 Jul 01 10:31:52.016417 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 708/1461] 10.222.0.23 () {62 vars in 1363 bytes} [Fri Jul 1 10:31:49 2022] POST /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 194 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:31:52.025485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:52.026402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:52.037080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:52.037767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:52.038609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:52.039046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:52.290326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:52.291538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:52.292284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:52.292924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:52.293373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:52.309704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:52.310511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:52.312088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:52.312804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:52.322912 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=9 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:52.346219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Getting quotas for project 36cd881902f945c2b1253364b13d0823. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:52.352996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Getting quotas for user 6fd895513ff5473dbdf18a7aef8b65af and project 36cd881902f945c2b1253364b13d0823. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:52.368111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:31:52.368618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:52.370925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:31:52.380013 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac0dcf8d-2895-4229-9eee-8bbabe2861ca tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.360128 Jul 01 10:31:52.396243 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 709/1462] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:52 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:52.493294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e7cd02c6-f980-42c4-9d80-c09cc3163020 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f91e1e700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1451625057", "description": "tempest-description-1645061428"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:52.546251 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d03260f-55f4-4641-b9bc-0c2f4406454e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652758 Jul 01 10:31:52.551378 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 754/1463] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:31:52.559479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:52.560419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:52.585996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:52.585996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:52.586496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:52.586938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:52.858217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:52.898588 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e4a9a75-660b-47bf-a56b-8deb2100314a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1479 microversion: 2.1 time: 0.345180 Jul 01 10:31:52.901721 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 755/1464] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:52 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1479 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:52.913737 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef8f0add-d325-48b3-9973-61f91a8179bf tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:52.917184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef8f0add-d325-48b3-9973-61f91a8179bf tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:53.031253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef8f0add-d325-48b3-9973-61f91a8179bf tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:53.039685 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef8f0add-d325-48b3-9973-61f91a8179bf tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1231 microversion: 2.1 time: 0.136576 Jul 01 10:31:53.041643 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 756/1465] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:52 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1231 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:53.073017 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e7cd02c6-f980-42c4-9d80-c09cc3163020 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.675646 Jul 01 10:31:53.077543 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 710/1466] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:31:52 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:53.087692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a94a8e5d-a388-4984-b18e-04783fea4a94 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f91db5c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2072281846", "description": "tempest-description-1818738009"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:53.413537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:53.414145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:53.427477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:53.427936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:53.428739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:53.429194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:53.690815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:53.705227 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1aba9e25-3c9c-4f9b-917c-7e80cbfe66ec tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.295853 Jul 01 10:31:53.706031 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 711/1467] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:53 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:53.723970 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a94a8e5d-a388-4984-b18e-04783fea4a94 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.640107 Jul 01 10:31:53.724895 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 757/1468] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:31:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:53.797520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-874815330", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "93cdd59a-6d6e-4390-8a35-7e503398b9db"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:53.930108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:53.931005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:53.940277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] validate_networks() for [('93cdd59a-6d6e-4390-8a35-7e503398b9db', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:53.974322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:53.974792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:53.987990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:53.988451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:54.978998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:54.992275 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6123af6-628c-41e3-82ef-1fb13b075783 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1479 microversion: 2.1 time: 1.075987 Jul 01 10:31:54.999590 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 758/1469] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:53 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1479 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:55.012213 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:55.012945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:55.034392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:55.038124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:55.048515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:55.050396 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:55.177193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:55.186615 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:55.207904 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-029c777e-e3f0-4c5c-b0d4-d3bab5f69b5e tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1227 microversion: 2.1 time: 0.190917 Jul 01 10:31:55.214168 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 759/1470] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:54 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1227 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:55.230791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:55.238889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:55.268351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:55.268802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:55.270931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:55.275479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:55.459664 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:55.713891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:55.730663 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0eebadc1-edad-4124-9778-fd4c3a1698a8 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.510851 Jul 01 10:31:55.731355 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 760/1471] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:55 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:55.756942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:31:55.757915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:31:55.758580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:31:55.759197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:31:55.759803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:31:55.769578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:55.770277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:55.779008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:55.779479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:55.830236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Getting quotas for project 8771160d78704ad687c0ea474b14d6e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:31:55.849077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Getting quotas for user 275daef9a0aa460aaecb90de5e035c4d and project 8771160d78704ad687c0ea474b14d6e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:31:55.873886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:31:55.879036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:31:56.018153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:56.018772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:56.043955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:56.053304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:56.053304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:56.053304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:56.150934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cad9ba61-26e9-4208-bc42-123e73189e5e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.348291 Jul 01 10:31:56.188799 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 712/1472] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:31:56.205554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0598861b-643d-4504-9b1c-648f449ea2ee tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:56.208702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0598861b-643d-4504-9b1c-648f449ea2ee tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:56.318413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0598861b-643d-4504-9b1c-648f449ea2ee tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:56.331622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0598861b-643d-4504-9b1c-648f449ea2ee tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1215 microversion: 2.1 time: 0.135785 Jul 01 10:31:56.333570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:56.341205 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 713/1473] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:56 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:56.349671 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-11bbc439-f9f7-4401-a415-694c3582bdb8 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1479 microversion: 2.1 time: 0.337765 Jul 01 10:31:56.350594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 761/1474] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:56 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1479 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:56.371165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:56.372062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:56.381079 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:56.383104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:56.396321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:56.396321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:56.556692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:56.559341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-73552af2-99ad-4854-8710-ba6787b151ef tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1283 microversion: 2.1 time: 0.223367 Jul 01 10:31:56.562529 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 714/1475] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:56 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1283 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:56.748750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:56.749495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:56.762030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:56.762482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:56.763327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:56.763709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:57.059563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:57.075885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a6af3c6-4d90-4be9-b272-7f260777f55b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1476 microversion: 2.1 time: 0.330288 Jul 01 10:31:57.076757 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 762/1476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:56 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:57.274632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3252eca6-87f5-44c9-9535-270360ab52e8 req-8d8f3a90-7d2f-4fa6-941e-85968aeff9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672", "name": "network-vif-unplugged", "status": "completed", "tag": "75426cac-af1d-4dc1-8b63-4c327a9be5a5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:57.291903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3252eca6-87f5-44c9-9535-270360ab52e8 req-8d8f3a90-7d2f-4fa6-941e-85968aeff9e1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:57.292280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3252eca6-87f5-44c9-9535-270360ab52e8 req-8d8f3a90-7d2f-4fa6-941e-85968aeff9e1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:57.323500 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3252eca6-87f5-44c9-9535-270360ab52e8 req-8d8f3a90-7d2f-4fa6-941e-85968aeff9e1 service nova] Creating event network-vif-unplugged:75426cac-af1d-4dc1-8b63-4c327a9be5a5 for instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 on n-h1-master-1 Jul 01 10:31:57.338707 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3252eca6-87f5-44c9-9535-270360ab52e8 req-8d8f3a90-7d2f-4fa6-941e-85968aeff9e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068669 Jul 01 10:31:57.340882 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 715/1477] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:31:57.351852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e6ccae6-4ff2-403d-8c8c-d822beb2c618 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:57.358563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e6ccae6-4ff2-403d-8c8c-d822beb2c618 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:57.368111 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:57.369253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:57.376361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:57.377114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:57.378195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:57.378806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:57.442562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e6ccae6-4ff2-403d-8c8c-d822beb2c618 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:57.451634 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e6ccae6-4ff2-403d-8c8c-d822beb2c618 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1215 microversion: 2.1 time: 0.103716 Jul 01 10:31:57.453055 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 763/1478] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:57 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:57.585529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:57.596465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:57.602220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:57.605340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:57.609754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:57.610802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:57.956362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:57.965133 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-557daf61-5997-4b2f-9684-747002bb86ad tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1479 microversion: 2.1 time: 0.601812 Jul 01 10:31:57.969300 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 716/1479] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:57 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1479 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:57.975599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:57.984476 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c5599f0-28a8-4961-83a4-815096b10e5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1291 microversion: 2.1 time: 0.403125 Jul 01 10:31:57.985351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 764/1480] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:57 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1291 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:58.094656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:58.095755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:58.121453 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:58.122535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:58.126394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:58.130140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:58.518328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:58.519677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:58.554324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:58.559944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:58.568483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:58.569684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:58.581820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:58.593198 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20ab8c35-ecda-484b-a39e-a5b4056ea31a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1475 microversion: 2.1 time: 0.502453 Jul 01 10:31:58.607353 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 717/1481] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:58 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1475 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:58.817603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:58.859862 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46e32d78-57fc-40d1-9f04-72fd25769035 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1219 microversion: 2.1 time: 0.391107 Jul 01 10:31:58.872658 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 765/1482] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:58 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1219 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:31:58.987276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:58.988628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:59.003708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:59.005817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:59.005984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:59.006450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:59.011477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:59.012460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:59.027963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:59.030792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:59.031891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:59.040316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:59.138326 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:31:59.246347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:59.259463 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31587ce2-992c-4b5e-9709-86f17ac37051 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1289 microversion: 2.1 time: 0.257967 Jul 01 10:31:59.274321 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 766/1483] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:59 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1289 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:59.416092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-71092958", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "3825514f-dbbb-4c14-b03b-f6703a9c3e3d"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:31:59.524319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] validate_networks() for [('3825514f-dbbb-4c14-b03b-f6703a9c3e3d', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:31:59.836366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:31:59.845759 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-816b63a2-077d-4132-8aec-fa0aea8ef9f5 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1479 microversion: 2.1 time: 0.863513 Jul 01 10:31:59.860255 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 718/1484] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:58 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1479 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:31:59.865984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:31:59.867067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:31:59.874873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:59.875964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:31:59.877136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:31:59.877821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:00.667730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:00.678749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65b4c167-11c1-4d65-a0c7-ed4e2593ac25 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1475 microversion: 2.1 time: 0.816972 Jul 01 10:32:00.679430 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 719/1485] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:31:59 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1475 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:00.696509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:00.697262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:00.704432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:00.706326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:00.707317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:00.707953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:00.884947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:00.908787 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62102d21-f7e6-46d0-a5ee-dfbdcbe763bd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1285 microversion: 2.1 time: 0.215540 Jul 01 10:32:00.908787 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 720/1486] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:00 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:00.908787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:00.908787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:00.924078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:00.924887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:00.925940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:00.926631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:01.039742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:01.054458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab8bfc15-2c19-4d74-8ac8-ac38f43c220c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1289 microversion: 2.1 time: 0.154544 Jul 01 10:32:01.055811 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 721/1487] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:00 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:01.062106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f75523de-6b72-4328-8b8a-bf5a2aced855 req-bf699ae8-382d-4c98-a04b-52b68635e7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "name": "network-vif-unplugged", "status": "completed", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:01.070842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f75523de-6b72-4328-8b8a-bf5a2aced855 req-bf699ae8-382d-4c98-a04b-52b68635e7d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:01.071286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f75523de-6b72-4328-8b8a-bf5a2aced855 req-bf699ae8-382d-4c98-a04b-52b68635e7d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:01.088531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f75523de-6b72-4328-8b8a-bf5a2aced855 req-bf699ae8-382d-4c98-a04b-52b68635e7d4 service nova] Creating event network-vif-unplugged:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h1-master-1 Jul 01 10:32:01.093787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:32:01.094507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:32:01.095313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:32:01.095874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-f75523de-6b72-4328-8b8a-bf5a2aced855 req-bf699ae8-382d-4c98-a04b-52b68635e7d4 service nova] Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:32:01.096432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:32:01.096923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:32:01.112009 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f75523de-6b72-4328-8b8a-bf5a2aced855 req-bf699ae8-382d-4c98-a04b-52b68635e7d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054411 Jul 01 10:32:01.113194 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 722/1488] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:01.114879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:01.118778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:01.119962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:01.120347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:01.121504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:01.122540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:01.148249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:01.148880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:01.150761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:01.151319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:01.173629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Getting quotas for project 721b3c5bc89d41dd9e93e1c33c7c7d1c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:32:01.202803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Getting quotas for user 052154793cc042f3b4c84ac992b8b179 and project 721b3c5bc89d41dd9e93e1c33c7c7d1c. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:32:01.252873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:32:01.255424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:32:01.424650 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7647c549-d4df-45dc-b12a-ce7194e54e07 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.147693 Jul 01 10:32:01.429354 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 767/1489] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:32:01.437477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abd43b22-1f2d-4d33-8cc5-278bf5a5a9ed tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:01.438157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-abd43b22-1f2d-4d33-8cc5-278bf5a5a9ed tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:02.539465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-abd43b22-1f2d-4d33-8cc5-278bf5a5a9ed tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:02.549746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-abd43b22-1f2d-4d33-8cc5-278bf5a5a9ed tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1215 microversion: 2.1 time: 1.113047 Jul 01 10:32:02.564699 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 768/1490] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:01 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1215 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:02.565205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:02.565963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:02.591730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:02.594845 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:02.596166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:02.602544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.036888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:03.054473 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0fe0d999-25d6-4afb-bedf-75b72436ca6a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1479 microversion: 2.1 time: 1.935422 Jul 01 10:32:03.074204 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 723/1491] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:01 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1479 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:03.080842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:03.081491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:03.100848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.101594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.102586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.103197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.463922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:03.481278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab69c725-f457-4bcd-9358-41f5a050dd4a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1273 microversion: 2.1 time: 0.398620 Jul 01 10:32:03.482035 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 724/1492] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:03 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:03.508511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:03.509322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:03.530182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.530182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.530182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.531569 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.620813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:03.651303 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c0de6a54-a5c9-450b-8641-5c2bfe4908ad tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1475 microversion: 2.1 time: 1.095241 Jul 01 10:32:03.666032 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 769/1493] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:02 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1475 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:03.666032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-398e4067-ac5c-48ec-a2c5-226af5ed82e2 req-fd9866b5-3d11-4d8c-96f1-ed218f6d52e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672", "name": "network-vif-plugged", "status": "completed", "tag": "75426cac-af1d-4dc1-8b63-4c327a9be5a5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:03.672479 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:03.675474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-398e4067-ac5c-48ec-a2c5-226af5ed82e2 req-fd9866b5-3d11-4d8c-96f1-ed218f6d52e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.676462 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-398e4067-ac5c-48ec-a2c5-226af5ed82e2 req-fd9866b5-3d11-4d8c-96f1-ed218f6d52e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.689596 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-398e4067-ac5c-48ec-a2c5-226af5ed82e2 req-fd9866b5-3d11-4d8c-96f1-ed218f6d52e9 service nova] Creating event network-vif-plugged:75426cac-af1d-4dc1-8b63-4c327a9be5a5 for instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 on n-h1-master-1 Jul 01 10:32:03.695079 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-398e4067-ac5c-48ec-a2c5-226af5ed82e2 req-fd9866b5-3d11-4d8c-96f1-ed218f6d52e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041112 Jul 01 10:32:03.695937 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 770/1494] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:03.702621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ab8ab56b-671c-49fd-b331-004fca86a1f5 req-b7a3b652-993b-407c-be5c-388593b1b925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:03.710824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ab8ab56b-671c-49fd-b331-004fca86a1f5 req-b7a3b652-993b-407c-be5c-388593b1b925 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.711493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ab8ab56b-671c-49fd-b331-004fca86a1f5 req-b7a3b652-993b-407c-be5c-388593b1b925 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.724087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ab8ab56b-671c-49fd-b331-004fca86a1f5 req-b7a3b652-993b-407c-be5c-388593b1b925 service nova] Creating event network-changed:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h1-master-1 Jul 01 10:32:03.730212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-ab8ab56b-671c-49fd-b331-004fca86a1f5 req-b7a3b652-993b-407c-be5c-388593b1b925 service nova] Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:32:03.757437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ab8ab56b-671c-49fd-b331-004fca86a1f5 req-b7a3b652-993b-407c-be5c-388593b1b925 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058890 Jul 01 10:32:03.759068 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 771/1495] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:03.779921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:03.780982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:03.790564 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.791362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.792397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:03.793084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:03.999758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:04.015812 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66f70d9e-7c3b-4c30-acd9-8e9a76264823 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1211 microversion: 2.1 time: 0.249022 Jul 01 10:32:04.015812 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 772/1496] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:03 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1211 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:04.074881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:04.075979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:04.086317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:04.087046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:04.088153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:04.088909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:04.099049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:04.116873 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb62b0b7-a9e9-4e9d-96ac-4544501baa5a tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1331 microversion: 2.1 time: 0.622702 Jul 01 10:32:04.117489 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 725/1497] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:03 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1331 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:04.241629 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1068088379", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2ac4790e-ac72-469e-b390-7b9250d58af9"}], "security_groups": [{"name": "tempest-securitygroup--1892999251"}], "key_name": "tempest-keypair-1170409016", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "02a5b83a-23c3-44e0-8535-3823c4727a69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:04.857344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:04.867695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] validate_networks() for [('2ac4790e-ac72-469e-b390-7b9250d58af9', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:32:04.875794 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb1eeea5-b1e5-4d5f-9156-e1753760eba1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1479 microversion: 2.1 time: 0.801124 Jul 01 10:32:04.878059 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 773/1498] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:04 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1479 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:04.885030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:04.886066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:04.896141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:04.896595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:04.897458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:04.904280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:05.133182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:05.142076 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-44d56d5c-f988-4fc7-876d-ddffcae3db76 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1273 microversion: 2.1 time: 0.262495 Jul 01 10:32:05.143091 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 774/1499] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:04 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:05.150159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:05.150894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:05.162109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:05.162905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:05.164881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:05.165929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:05.786423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:05.803703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-92831e5b-dfb9-4b68-810e-15bcb5089891 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1475 microversion: 2.1 time: 0.658940 Jul 01 10:32:05.805013 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 775/1500] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:05 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1475 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:05.839793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:05.841764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:05.866081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:05.867375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:05.874481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:05.875183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:05.916758 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:06.327648 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:06.866307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:06.876852 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c6ea26c-271e-439c-9a79-421514846a7d tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 1.070611 Jul 01 10:32:06.877654 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 776/1501] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:05 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:06.885686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:06.891699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:06.912265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:06.918427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:06.919622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:06.920851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.200202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Getting quotas for project 7e6c31c774f94b0cb1cdd78fb57f2916. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:32:07.208799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Getting quotas for user ed8ee2f955624a3aa3ccbc8f18516539 and project 7e6c31c774f94b0cb1cdd78fb57f2916. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:32:07.224793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:32:07.225621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:32:07.226919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:32:07.227427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:32:07.228101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:32:07.239883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.242889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.242889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.242889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.272440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Getting quotas for project 7e6c31c774f94b0cb1cdd78fb57f2916. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:32:07.279058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Getting quotas for user ed8ee2f955624a3aa3ccbc8f18516539 and project 7e6c31c774f94b0cb1cdd78fb57f2916. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:32:07.348582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:32:07.351022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02a5b83a-23c3-44e0-8535-3823c4727a69',volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:32:07.465055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:07.473284 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-600f8739-8fbe-44df-b281-1f34faae60f3 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1331 microversion: 2.1 time: 0.594359 Jul 01 10:32:07.473861 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 777/1502] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:06 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1331 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:07.487031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:07.488350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:07.493542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.494002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.494787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.495213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.748024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:07.754192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f9c9d65-15dc-4c26-a7de-a097a128c94f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.519135 Jul 01 10:32:07.760912 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 726/1503] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:32:04 2022] POST /compute/v2.1/servers => generated 407 bytes in 3527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:32:07.766255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:07.767097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:07.769683 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b256c858-fffa-4850-b50a-4dd2ebad4e7a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1464 microversion: 2.1 time: 0.283922 Jul 01 10:32:07.773887 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 778/1504] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:07 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:07.774853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.775476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.776430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.777020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.781449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:07.782345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:07.801743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.802535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:07.803296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:07.804472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.201359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:08.209653 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5490d4bf-101e-4a45-a568-8c2d1641a60c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1315 microversion: 2.1 time: 0.447282 Jul 01 10:32:08.210665 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 727/1505] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:07 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:08.215281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:08.215942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:08.222389 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.222834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.223605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.224164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.263762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:08.277618 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4500a93c-f3b3-4d06-b418-402bfd1dab67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1473 microversion: 2.1 time: 0.499317 Jul 01 10:32:08.277618 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 779/1506] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:07 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1473 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:08.277618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-81ad9b80-8336-471a-853d-5afebfcc9145 req-310ec30f-e192-4eb8-ad5b-89744864d2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465b90a8-e2f3-4131-9ea7-bca24fd5b8ed", "tag": "6725c15e-2e2e-4e48-8005-0e7cf0ee9cee"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:08.290653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-81ad9b80-8336-471a-853d-5afebfcc9145 req-310ec30f-e192-4eb8-ad5b-89744864d2b6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.291320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-81ad9b80-8336-471a-853d-5afebfcc9145 req-310ec30f-e192-4eb8-ad5b-89744864d2b6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.295933 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:08.303642 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-81ad9b80-8336-471a-853d-5afebfcc9145 req-310ec30f-e192-4eb8-ad5b-89744864d2b6 service nova] Creating event network-changed:6725c15e-2e2e-4e48-8005-0e7cf0ee9cee for instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed on n-h1-master-1 Jul 01 10:32:08.309744 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-81ad9b80-8336-471a-853d-5afebfcc9145 req-310ec30f-e192-4eb8-ad5b-89744864d2b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035288 Jul 01 10:32:08.312957 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 780/1507] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:08.320076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-71238ddc-dd18-4030-b0ab-dfe7cde6f4e8 req-c963516f-77c5-43e7-969e-c31a0de9c6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8c7fb2f-c8a5-4288-b068-1074ce9da4ba", "tag": "f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:08.332359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-71238ddc-dd18-4030-b0ab-dfe7cde6f4e8 req-c963516f-77c5-43e7-969e-c31a0de9c6e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.332799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-71238ddc-dd18-4030-b0ab-dfe7cde6f4e8 req-c963516f-77c5-43e7-969e-c31a0de9c6e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.345231 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-71238ddc-dd18-4030-b0ab-dfe7cde6f4e8 req-c963516f-77c5-43e7-969e-c31a0de9c6e3 service nova] Creating event network-changed:f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 for instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba on n-h2-master-1 Jul 01 10:32:08.356516 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-71238ddc-dd18-4030-b0ab-dfe7cde6f4e8 req-c963516f-77c5-43e7-969e-c31a0de9c6e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041865 Jul 01 10:32:08.357126 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 781/1508] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:08.363037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67c67501-0c27-450a-81ad-92ec84a68e38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:08.363730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67c67501-0c27-450a-81ad-92ec84a68e38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:08.486591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67c67501-0c27-450a-81ad-92ec84a68e38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:08.493550 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67c67501-0c27-450a-81ad-92ec84a68e38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1122 microversion: 2.1 time: 0.134500 Jul 01 10:32:08.494206 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 782/1509] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:08 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1122 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:08.498915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad23a939-e30f-4f09-ba59-2a5f6aa5f285 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:08.499938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad23a939-e30f-4f09-ba59-2a5f6aa5f285 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:08.506842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad23a939-e30f-4f09-ba59-2a5f6aa5f285 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.507363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad23a939-e30f-4f09-ba59-2a5f6aa5f285 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.508201 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad23a939-e30f-4f09-ba59-2a5f6aa5f285 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.508639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad23a939-e30f-4f09-ba59-2a5f6aa5f285 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.541182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:08.549928 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87a551fc-ca1d-4cc2-bf3a-c5a225c482f8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.338127 Jul 01 10:32:08.550518 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 728/1510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:08 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:08.555149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:08.557445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:08.563420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.564009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.564796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.565266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.810146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:08.818715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad23a939-e30f-4f09-ba59-2a5f6aa5f285 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action" status: 202 len: 0 microversion: 2.1 time: 0.320998 Jul 01 10:32:08.823093 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 783/1511] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:08 2022] POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:08.823230 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-de6a5f0c-f578-4d0a-9886-022a7f39b317 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.270447 Jul 01 10:32:08.823230 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 729/1512] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:08 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:08.828594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:08.829538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:08.836357 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:08.838318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.838971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.840312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.840926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.854135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:08.854135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:08.882921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.886305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:08.886305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:08.886305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.121111 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:09.127772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:09.132271 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bf8ff59c-32c3-4c9a-8932-9c78499f135b tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1331 microversion: 2.1 time: 0.308003 Jul 01 10:32:09.132735 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 730/1513] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:08 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1331 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:09.138825 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8888b7e0-5766-4130-a0e1-3688905085eb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.309980 Jul 01 10:32:09.138825 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 784/1514] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:08 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:09.140366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:09.140988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:09.148923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.149399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.150247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.150868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.153442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:09.156053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:09.159989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.160430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.161343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.161758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.182030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.182514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.182971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lazy-loading 'fault' on Instance uuid 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:32:09.351917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:09.361118 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af614df5-3de1-42dd-82fd-c6ea287354f5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.211588 Jul 01 10:32:09.365898 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 785/1515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:09 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:09.366054 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9bdd2584-2ab1-47a7-8b8c-c42925159ee4 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1598 microversion: 2.1 time: 0.228289 Jul 01 10:32:09.366054 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 731/1516] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:09 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1598 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:09.368082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:09.368998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:09.371145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:09.372001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:09.377544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.377992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.378409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.378764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.378885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.379200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.379597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.380024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.612892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:09.616897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:09.620425 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-082e7768-5552-4b02-8782-27699773b9fa tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1315 microversion: 2.1 time: 0.252942 Jul 01 10:32:09.621042 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 786/1517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:09 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:09.625409 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d822277-4c48-414d-8e34-99419b83a104 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1473 microversion: 2.1 time: 0.261034 Jul 01 10:32:09.625797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd91fd2f-0c88-4835-b974-7df2ca7c9e9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-998993391"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:09.634712 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 732/1518] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:09 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1473 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:09.634933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd91fd2f-0c88-4835-b974-7df2ca7c9e9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:09.635047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04c1b765-57eb-4348-8a6f-d535d0a03f17 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:09.635047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04c1b765-57eb-4348-8a6f-d535d0a03f17 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:09.635234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd91fd2f-0c88-4835-b974-7df2ca7c9e9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.635234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd91fd2f-0c88-4835-b974-7df2ca7c9e9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.635234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd91fd2f-0c88-4835-b974-7df2ca7c9e9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.635234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd91fd2f-0c88-4835-b974-7df2ca7c9e9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.642402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c1b765-57eb-4348-8a6f-d535d0a03f17 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.642946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c1b765-57eb-4348-8a6f-d535d0a03f17 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.643813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c1b765-57eb-4348-8a6f-d535d0a03f17 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.644325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c1b765-57eb-4348-8a6f-d535d0a03f17 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.822317 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:09.957891 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04c1b765-57eb-4348-8a6f-d535d0a03f17 tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action" status: 202 len: 0 microversion: 2.1 time: 0.330504 Jul 01 10:32:09.958810 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 733/1519] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:09 2022] POST /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:09.963730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:09.966862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:09.970447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.970906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:09.971863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:09.972117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.126697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:10.134615 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4bbb49d1-82b0-4efb-ae09-22e4649c58ce tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1172 microversion: 2.1 time: 0.174894 Jul 01 10:32:10.135182 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 734/1520] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:09 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1172 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:10.147559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:10.148573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:10.156025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.156445 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.157405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.157850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.265786 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd91fd2f-0c88-4835-b974-7df2ca7c9e9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.643209 Jul 01 10:32:10.266468 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 787/1521] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:09 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 01 10:32:10.274904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed90c9d9-dd9f-479d-8e53-9de19263112b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:10.275903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed90c9d9-dd9f-479d-8e53-9de19263112b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:10.283398 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed90c9d9-dd9f-479d-8e53-9de19263112b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.284219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed90c9d9-dd9f-479d-8e53-9de19263112b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.285531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed90c9d9-dd9f-479d-8e53-9de19263112b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.286196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed90c9d9-dd9f-479d-8e53-9de19263112b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.825989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:10.832264 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-602170f8-6e41-4e02-a74c-18c7a0c63bde tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.695808 Jul 01 10:32:10.833028 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 735/1522] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:10 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:10.837772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:10.841130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:10.847273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.847799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.848640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.849078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.929396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed90c9d9-dd9f-479d-8e53-9de19263112b tempest-ServersAdminTestJSON-155167482 tempest-ServersAdminTestJSON-155167482-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1615 microversion: 2.1 time: 0.661318 Jul 01 10:32:10.931103 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 788/1523] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:10 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1615 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:10.937360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ff2750fc-77fb-4547-bd4a-449ad439fafd req-f8bc98e5-daec-4587-b081-2ecd4f1d1fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88347916-572c-4ee0-8918-473b01edc6d0", "tag": "8a073947-b214-44c4-80dc-9bf621ffd488"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:10.949797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ff2750fc-77fb-4547-bd4a-449ad439fafd req-f8bc98e5-daec-4587-b081-2ecd4f1d1fe2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.950771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ff2750fc-77fb-4547-bd4a-449ad439fafd req-f8bc98e5-daec-4587-b081-2ecd4f1d1fe2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.964413 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ff2750fc-77fb-4547-bd4a-449ad439fafd req-f8bc98e5-daec-4587-b081-2ecd4f1d1fe2 service nova] Creating event network-changed:8a073947-b214-44c4-80dc-9bf621ffd488 for instance 88347916-572c-4ee0-8918-473b01edc6d0 on n-h2-master-1 Jul 01 10:32:10.969721 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ff2750fc-77fb-4547-bd4a-449ad439fafd req-f8bc98e5-daec-4587-b081-2ecd4f1d1fe2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036467 Jul 01 10:32:10.970648 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 789/1524] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:10.977179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:10.977179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:10.983962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.984346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:10.985251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:10.985692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:11.150670 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:11.469821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:11.490424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bd55a49d-8d11-4f0a-ba0e-f48939ed2a10 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1331 microversion: 2.1 time: 0.656090 Jul 01 10:32:11.491026 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 736/1525] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:10 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1331 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:11.503670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:11.504328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:11.513919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:11.516662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:11.516662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:11.516662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:11.701887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:11.711613 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae43839c-9881-455c-b0ad-9fbd8375bb07 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1315 microversion: 2.1 time: 0.739766 Jul 01 10:32:11.712574 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 790/1526] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:10 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:11.718479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:11.719339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:11.729771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:11.729771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:11.730919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:11.731596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:11.767042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:11.888879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:11.897512 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c35d8b6c-81d5-4fe4-b6e5-074e34bdd6ba tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1470 microversion: 2.1 time: 0.405417 Jul 01 10:32:11.898174 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 737/1527] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:11 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1470 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:11.903450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:11.904443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:11.911674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:11.912082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:11.912858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:11.913314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:11.995383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:12.003579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7904d5f7-ac03-42a8-9a0b-0a973f0cf2e8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1238 microversion: 2.1 time: 0.104110 Jul 01 10:32:12.013342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 738/1528] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:11 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:12.013342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:12.013342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:12.016090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.016545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.017355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.017793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.032518 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47360353-3511-436a-a829-5446fbd50e62 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 204 len: 0 microversion: 2.1 time: 0.318362 Jul 01 10:32:12.033190 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 791/1529] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:11 2022] DELETE /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:12.039960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55e7214b-c4de-486e-ba31-7483595028ed tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:12.040644 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-55e7214b-c4de-486e-ba31-7483595028ed tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:12.047111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e7214b-c4de-486e-ba31-7483595028ed tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.047561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e7214b-c4de-486e-ba31-7483595028ed tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.048327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e7214b-c4de-486e-ba31-7483595028ed tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.048759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e7214b-c4de-486e-ba31-7483595028ed tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.187055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:12.195307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4204e2bd-992f-45f1-8973-cfb7cd270245 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.189893 Jul 01 10:32:12.215571 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 739/1530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:12 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:12.225374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:12.225374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:12.230702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.231142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.231942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.232951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.375672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:12.389325 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c0a648b5-6e85-4fe4-9daa-2e98baae432e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1467 microversion: 2.1 time: 0.172532 Jul 01 10:32:12.401377 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 740/1531] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:12 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1467 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:12.409217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0b79820f-d8be-41bf-904a-5b02554eec1b req-5156022e-bf3e-4937-975c-7d1190678fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "name": "network-vif-plugged", "status": "completed", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:12.423898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0b79820f-d8be-41bf-904a-5b02554eec1b req-5156022e-bf3e-4937-975c-7d1190678fbb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.423898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0b79820f-d8be-41bf-904a-5b02554eec1b req-5156022e-bf3e-4937-975c-7d1190678fbb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.439115 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0b79820f-d8be-41bf-904a-5b02554eec1b req-5156022e-bf3e-4937-975c-7d1190678fbb service nova] Creating event network-vif-plugged:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h1-master-1 Jul 01 10:32:12.448796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-0b79820f-d8be-41bf-904a-5b02554eec1b req-5156022e-bf3e-4937-975c-7d1190678fbb service nova] Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:32:12.466053 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0b79820f-d8be-41bf-904a-5b02554eec1b req-5156022e-bf3e-4937-975c-7d1190678fbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063663 Jul 01 10:32:12.467824 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 741/1532] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:12.475269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:12.476510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:12.484591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.485029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.486182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.486795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.499563 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-55e7214b-c4de-486e-ba31-7483595028ed tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "POST /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65/action" status: 202 len: 0 microversion: 2.1 time: 0.464905 Jul 01 10:32:12.500181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 792/1533] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:12 2022] POST /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:12.509383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:12.510209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:12.517932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.518479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.519330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.519859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.547300 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:12.763944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:32:12.778901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bf00eb3c-c871-4d20-823d-3fe16cf16aff tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 2420 microversion: 2.25 time: 0.310093 Jul 01 10:32:12.788775 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 742/1534] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:12 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 2420 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:12.788775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:12.788775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:12.794267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.795245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.796699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.797681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.852766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:12.862144 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd3330a4-2669-4796-837c-77aecc990743 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1331 microversion: 2.1 time: 0.357358 Jul 01 10:32:12.863167 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 793/1535] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:12 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1331 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:12.874148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:12.874844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:12.883295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.888536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:12.888536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:12.888536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.168593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:13.179895 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-124f1544-52fc-4020-bfb3-5b51626da846 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1469 microversion: 2.1 time: 0.398433 Jul 01 10:32:13.190082 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 743/1536] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:12 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:13.190082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:13.190082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:13.198676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.199988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.201701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.202405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.239708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'flavor' on Instance uuid 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:32:13.271503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:13.272764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Going to try to live migrate instance to n-h2-master-1 {{(pid=119764) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:32:13.283129 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b10511a7-b79d-4d85-ac13-b031cb50c6a5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1315 microversion: 2.1 time: 0.417448 Jul 01 10:32:13.284647 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 794/1537] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:12 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:13.291394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:13.292316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:13.300665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.302139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.302512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.302947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.436494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:13.446877 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-59fda0dc-3aa3-4d58-b3e7-9cb1a9c0a7f0 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1238 microversion: 2.1 time: 0.160140 Jul 01 10:32:13.451729 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 795/1538] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:13 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1238 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:13.455066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:13.456778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:13.465218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.465874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.467850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.468689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.825244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:13.837423 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-55495579-f61f-4626-9071-e0d3a3ecc2bb tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.387762 Jul 01 10:32:13.848545 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 796/1539] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:13 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:13.856486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:13.856486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:13.864071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.864887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:13.866510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:13.867184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:14.115908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:14.124414 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c74e4c85-cab3-4079-8e2c-9a5bd1c7f212 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1467 microversion: 2.1 time: 0.274294 Jul 01 10:32:14.125396 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 797/1540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:13 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:14.130759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:14.131428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:14.137875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:14.138320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:14.139647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:14.140098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:14.395734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:14.422109 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58a05e99-8611-489a-a886-697ac0f4d7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1331 microversion: 2.1 time: 0.294830 Jul 01 10:32:14.426727 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 798/1541] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:14 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1331 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:14.444038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:14.445139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:14.452708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:14.453494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:14.455407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:14.455407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:14.762606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:14.771566 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-550668ea-32aa-4c30-b1c6-933d95821971 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1469 microversion: 2.1 time: 0.334737 Jul 01 10:32:14.782471 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 799/1542] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:14 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:14.787623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:14.788727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:14.796251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:14.799257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:14.799257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:14.799257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:15.400929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:15.413849 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-29003166-df85-4694-8513-b95ec8ced8e0 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1315 microversion: 2.1 time: 0.629880 Jul 01 10:32:15.428602 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 800/1543] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:14 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:15.442845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:15.443387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:15.457250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:15.457717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:15.458495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:15.458931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:15.754992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:15.770260 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-322f743a-9baf-4cde-8735-1f52ca56260e tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1306 microversion: 2.1 time: 0.336282 Jul 01 10:32:15.771209 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 801/1544] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:15 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1306 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:15.781185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-af010d4e-afe4-4836-a3c6-907b35e03570 req-4fbe9c6b-00c9-449a-af96-bfb685ee83f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c7fb2f-c8a5-4288-b068-1074ce9da4ba", "name": "network-vif-plugged", "status": "completed", "tag": "f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:15.796014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-af010d4e-afe4-4836-a3c6-907b35e03570 req-4fbe9c6b-00c9-449a-af96-bfb685ee83f7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:15.796454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-af010d4e-afe4-4836-a3c6-907b35e03570 req-4fbe9c6b-00c9-449a-af96-bfb685ee83f7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:15.831140 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-af010d4e-afe4-4836-a3c6-907b35e03570 req-4fbe9c6b-00c9-449a-af96-bfb685ee83f7 service nova] Creating event network-vif-plugged:f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 for instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba on n-h2-master-1 Jul 01 10:32:15.840542 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-af010d4e-afe4-4836-a3c6-907b35e03570 req-4fbe9c6b-00c9-449a-af96-bfb685ee83f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068081 Jul 01 10:32:15.841524 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 802/1545] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:15.846876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:15.852755 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:15.864329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:15.864774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:15.865590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:15.866016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:16.145029 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e68a85db-3068-428b-9a2b-35bd9002703b tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/action" status: 202 len: 0 microversion: 2.25 time: 2.962305 Jul 01 10:32:16.146262 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 744/1546] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:32:13 2022] POST /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/action => generated 0 bytes in 2965 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:16.151927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:16.152758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:16.174701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:16.176047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:16.180717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:16.180717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:16.366945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:16.384397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:16.394112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-30e08b68-c777-4c7b-aae0-9619fbfa16b1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 200 len: 1425 microversion: 2.1 time: 0.246325 Jul 01 10:32:16.395100 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 745/1547] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:16 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 1425 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:16.396849 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-781e36c9-67d0-4ef2-9840-7b6598af4aff tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.553933 Jul 01 10:32:16.400293 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 803/1548] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:15 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:16.413684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:16.416465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:16.427851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:16.428651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:16.428859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:16.429506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:16.430286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:16.431256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:16.459140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:16.459591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:16.460435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:16.460877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.035103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:17.036120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:17.044514 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6c5ab93-c4b0-44e5-a2d7-b9083a1539a7 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1469 microversion: 2.1 time: 0.642207 Jul 01 10:32:17.044514 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 804/1549] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:16 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1469 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:17.072626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-bf30f163-4e28-4082-a5df-a809e888d338 req-c8723c1c-02d6-49e5-9ce1-d3b70b4b4e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d8f641-c2b2-4863-af93-3cd4d3cf86bc", "name": "network-vif-deleted", "tag": "a0c76a77-6369-46fb-884f-56ed56e3bb83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:17.081986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bf30f163-4e28-4082-a5df-a809e888d338 req-c8723c1c-02d6-49e5-9ce1-d3b70b4b4e62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.082431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bf30f163-4e28-4082-a5df-a809e888d338 req-c8723c1c-02d6-49e5-9ce1-d3b70b4b4e62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.085128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1e6048bf-994e-49c4-8bb6-12d16c1b2626 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1331 microversion: 2.1 time: 0.658900 Jul 01 10:32:17.091910 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 746/1550] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:16 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1331 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:17.100937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:17.101581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:17.114192 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-bf30f163-4e28-4082-a5df-a809e888d338 req-c8723c1c-02d6-49e5-9ce1-d3b70b4b4e62 service nova] Creating event network-vif-deleted:a0c76a77-6369-46fb-884f-56ed56e3bb83 for instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc on n-h1-master-1 Jul 01 10:32:17.119461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.119924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.122336 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-bf30f163-4e28-4082-a5df-a809e888d338 req-c8723c1c-02d6-49e5-9ce1-d3b70b4b4e62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074441 Jul 01 10:32:17.124020 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 805/1551] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:17.130751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:17.132509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:17.137114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.141418 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.146352 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.146796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.147575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.148010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.256025 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:17.287294 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:17.565131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:17.573038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0896ca83-29de-4d79-8036-44347b2010f3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1315 microversion: 2.1 time: 0.447664 Jul 01 10:32:17.574080 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 806/1552] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:17 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:17.590421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e3524a03-39da-4c03-8ba2-dc97f0b59d18 req-8c98f8bd-e82e-45fa-8bba-9d1d05ef81d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c53aec7e-a610-4fef-b617-a9e42532ac25", "tag": "1249eb41-5269-4873-9281-4ee3ed02a6fd"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:17.592931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:17.601202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e3524a03-39da-4c03-8ba2-dc97f0b59d18 req-8c98f8bd-e82e-45fa-8bba-9d1d05ef81d0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.601662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e3524a03-39da-4c03-8ba2-dc97f0b59d18 req-8c98f8bd-e82e-45fa-8bba-9d1d05ef81d0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.615613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:17.616360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e3524a03-39da-4c03-8ba2-dc97f0b59d18 req-8c98f8bd-e82e-45fa-8bba-9d1d05ef81d0 service nova] Creating event network-changed:1249eb41-5269-4873-9281-4ee3ed02a6fd for instance c53aec7e-a610-4fef-b617-a9e42532ac25 on n-h2-master-1 Jul 01 10:32:17.621829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:17.622916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e3524a03-39da-4c03-8ba2-dc97f0b59d18 req-8c98f8bd-e82e-45fa-8bba-9d1d05ef81d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037953 Jul 01 10:32:17.625967 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 807/1553] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:17.638729 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-27285076-247a-4176-a525-f92917d562ea tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.529211 Jul 01 10:32:17.643035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:17.643336 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 747/1554] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:17 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:17.643749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:17.664823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.664823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.665053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.667876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.672959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:17.673613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 83d8f641-c2b2-4863-af93-3cd4d3cf86bc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:17.690830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.694705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.694705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.694705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.718477 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] HTTP exception thrown: Instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc could not be found. Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Request method failure captured: Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc HTTP/1.1 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsyClJlHfX2TQY42VHmzW4dkgAEblLTuTBWMpogCrMV7rZ58_cYbmDSrgZ6EmqpZRhC1_to61lRWjyrJuszOvyVobI3uOO9_rKLHqyuVnNTg_GI5R3u48fEUr2KRnHGfcNYpVJKN45KV7zrmuiPOFhwYt4zg3cqNCHA0VAHC16Bq6mk Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 1ca92b2cafba4257b5f4931764621897 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ca92b2cafba4257b5f4931764621897", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 1ca92b2cafba4257b5f4931764621897 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersAdminTestJSON-1701618738-project Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 832898660e1d480e8c85a12c9cfd5c02 Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersAdminTestJSON-1701618738-project Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc could not be found. Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '83d8f641-c2b2-4863-af93-3cd4d3cf86bc'} Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc could not be found. Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc could not be found. Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:17.733507 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:17.739523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:17.739523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:17.739523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:17.739523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:17.739523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:17.739523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc could not be found. Jul 01 10:32:17.739523 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:17.744577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Returning 404 to user: Instance 83d8f641-c2b2-4863-af93-3cd4d3cf86bc could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:17.746197 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e71e0f23-a2f4-48f4-9628-80f7b508034a tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc" status: 404 len: 111 microversion: 2.1 time: 0.101867 Jul 01 10:32:17.752670 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 748/1555] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:17 2022] GET /compute/v2.1/servers/83d8f641-c2b2-4863-af93-3cd4d3cf86bc => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:17.763248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:17.763248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:17.774030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.775471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.775471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:17.778513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:17.786179 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:18.050164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:18.059660 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8d893d7-2f8a-412b-a32a-05c4fbf64856 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1306 microversion: 2.1 time: 0.420867 Jul 01 10:32:18.060304 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 808/1556] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:17 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1306 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:18.076524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:18.077292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:18.084302 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.085008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.085985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.086577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.121599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:18.126804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:18.127451 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5746a416-f251-4f50-b830-56f20c27e373 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.373470 Jul 01 10:32:18.132176 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 749/1557] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:17 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:18.158463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8c113942-33cb-493c-81ef-a4b4548de042 req-80db78dc-e293-4a95-8fbe-c68e92a08f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88347916-572c-4ee0-8918-473b01edc6d0", "name": "network-vif-plugged", "status": "completed", "tag": "8a073947-b214-44c4-80dc-9bf621ffd488"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:18.180314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8c113942-33cb-493c-81ef-a4b4548de042 req-80db78dc-e293-4a95-8fbe-c68e92a08f48 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.180812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8c113942-33cb-493c-81ef-a4b4548de042 req-80db78dc-e293-4a95-8fbe-c68e92a08f48 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.208775 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8c113942-33cb-493c-81ef-a4b4548de042 req-80db78dc-e293-4a95-8fbe-c68e92a08f48 service nova] Creating event network-vif-plugged:8a073947-b214-44c4-80dc-9bf621ffd488 for instance 88347916-572c-4ee0-8918-473b01edc6d0 on n-h2-master-1 Jul 01 10:32:18.214381 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8c113942-33cb-493c-81ef-a4b4548de042 req-80db78dc-e293-4a95-8fbe-c68e92a08f48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077643 Jul 01 10:32:18.214995 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 750/1558] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:18.221655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:18.226153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:18.234856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.235615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.238514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.238514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.491355 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=20 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:18.506968 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af09d8b7-6c48-4795-919b-652bd8a2b80e tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 204 len: 0 microversion: 2.1 time: 0.445246 Jul 01 10:32:18.507623 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 809/1559] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:18 2022] DELETE /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:18.516118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:18.516921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:18.532624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.533095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.534341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.535991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.548297 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:18.558185 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad8bcb8d-4c55-477f-aac9-7783f3782555 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1469 microversion: 2.1 time: 0.341818 Jul 01 10:32:18.567242 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:18.576664 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 751/1560] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:18 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1469 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:18.590453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:18.591413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:18.600790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.601527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.602504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.603523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.876233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:18.886581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98ab44ad-1648-40c1-ab16-09708b8010c0 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1535 microversion: 2.1 time: 0.375159 Jul 01 10:32:18.901022 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 810/1561] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:18 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1535 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:18.908356 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:18.909330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:18.917485 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:18.919609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.922598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:18.923657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:18.924344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:19.003746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:19.017485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-46984504-735f-4f39-861d-70030454e453 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1470 microversion: 2.1 time: 0.437525 Jul 01 10:32:19.017485 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 752/1562] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:18 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:19.022745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:19.023522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:19.030954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:19.031680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:19.032649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:19.033308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:19.259408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:19.276753 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f405d4a9-adc9-4077-a474-9109195683fe tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1315 microversion: 2.1 time: 0.374217 Jul 01 10:32:19.298394 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 811/1563] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:18 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:19.303705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3318eed-0ded-4fc1-886a-87a3ac9fbf94 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'create', calling method: .version_select at 0x7f6f91ecd940>, body: {"pool": "ad3f20c2-d831-42e1-81e8-72b2d1385618"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:19.732950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:19.746191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:19.747741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:19.748937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29cd5201-a0a5-4b55-8c70-e37e910083b1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.730213 Jul 01 10:32:19.749530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 753/1564] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:19 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:19.771470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:19.772374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:19.782174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:19.784545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:19.784545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:19.784545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:20.115734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:20.128397 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f82b501-6135-402b-b7f4-a820b222ae62 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1294 microversion: 2.1 time: 0.367269 Jul 01 10:32:20.136010 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 754/1565] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:19 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1294 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:20.143870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:20.144932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:20.151968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:20.152527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:20.153448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:20.154174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:20.615163 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:20.645571 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e5c2648-148c-4106-97eb-b86fdaa0f220 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.507971 Jul 01 10:32:20.646334 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 755/1566] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:20 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:20.650892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:20.651309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:20.670432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:20.670888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:20.671681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:20.672118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:21.032179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:21.045587 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7bb7d8ad-420d-4b54-ad7e-743e42cb7539 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1469 microversion: 2.1 time: 0.398319 Jul 01 10:32:21.046165 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 756/1567] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:20 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1469 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:21.050843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:21.060116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:21.073945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:21.081237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:21.082758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:21.083384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:21.374480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:21.387740 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3909c7fb-6f99-4c25-acf3-8e77263217f7 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 200 len: 1470 microversion: 2.1 time: 0.340278 Jul 01 10:32:21.388391 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 757/1568] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:21 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 1470 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:21.395043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:21.397265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:21.408428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:21.408947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:21.410843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:21.410843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:21.916868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:21.941363 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f62bb3c1-25ae-414a-acdf-0acba82d879d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1504 microversion: 2.1 time: 0.540811 Jul 01 10:32:21.942350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 758/1569] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:21 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1504 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:21.947617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-632a3f5b-9cbf-47da-9f92-97e97257cc05 req-4a6cb9e6-5ac6-4377-a248-dcf1ddae22f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465b90a8-e2f3-4131-9ea7-bca24fd5b8ed", "name": "network-vif-plugged", "status": "completed", "tag": "6725c15e-2e2e-4e48-8005-0e7cf0ee9cee"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:21.964132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-632a3f5b-9cbf-47da-9f92-97e97257cc05 req-4a6cb9e6-5ac6-4377-a248-dcf1ddae22f2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:21.977828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-632a3f5b-9cbf-47da-9f92-97e97257cc05 req-4a6cb9e6-5ac6-4377-a248-dcf1ddae22f2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:21.998714 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-632a3f5b-9cbf-47da-9f92-97e97257cc05 req-4a6cb9e6-5ac6-4377-a248-dcf1ddae22f2 service nova] Creating event network-vif-plugged:6725c15e-2e2e-4e48-8005-0e7cf0ee9cee for instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed on n-h1-master-1 Jul 01 10:32:22.012207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-632a3f5b-9cbf-47da-9f92-97e97257cc05 req-4a6cb9e6-5ac6-4377-a248-dcf1ddae22f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068393 Jul 01 10:32:22.014060 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 759/1570] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:22.023401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:22.024436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:22.032481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:22.033725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:22.034836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:22.035509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:22.439124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:22.448636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:22.450343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:22.452175 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4ce1d89-7640-404a-9c14-5ce4242eec1f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.433826 Jul 01 10:32:22.465639 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 760/1571] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:22 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:22.473590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:22.474408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:22.482050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:22.482629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:22.493455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:22.493455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:22.949668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:22.967979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-641b46fe-da7a-42f6-9c53-2dee1f83146b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1294 microversion: 2.1 time: 0.503521 Jul 01 10:32:22.969545 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 761/1572] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:22 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1294 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:22.985550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:22.986442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:22.998175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:22.998749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:22.999614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:23.000162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:23.654198 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:23.665758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99babfe8-72e0-452b-bc5b-341f134302b9 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1315 microversion: 2.1 time: 0.689223 Jul 01 10:32:23.673216 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 762/1573] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:22 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:23.673808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1451625057"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:23.690098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:23.701886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:23.702397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:23.703298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:23.703661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:24.146442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.network.security_group_api [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Adding security group 62008901-17a5-4821-a7ff-b5cec0ab4400 to port 8a073947-b214-44c4-80dc-9bf621ffd488 Jul 01 10:32:24.353397 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3318eed-0ded-4fc1-886a-87a3ac9fbf94 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.053814 Jul 01 10:32:24.354826 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 812/1574] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:32:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:24.360428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:24.361729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:24.382199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:24.388000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:24.389208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:24.389817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:24.744341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:24.763770 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-28e356b6-0cbc-45dc-82ae-33a8d8e9f97c tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1469 microversion: 2.1 time: 0.407093 Jul 01 10:32:24.773664 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 813/1575] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:24 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:24.781005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-196e7964-168c-4c9f-8145-9912cf8eb4e6 req-34e2c3d8-706e-48a1-973d-f4a9e5c31e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbbd6ec-d31e-490a-aed8-42c91588b237", "name": "network-vif-deleted", "tag": "a82ff7cb-ace7-47d6-b072-2131b708ad9c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:24.792523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-196e7964-168c-4c9f-8145-9912cf8eb4e6 req-34e2c3d8-706e-48a1-973d-f4a9e5c31e63 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:24.795169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-196e7964-168c-4c9f-8145-9912cf8eb4e6 req-34e2c3d8-706e-48a1-973d-f4a9e5c31e63 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:24.819832 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-196e7964-168c-4c9f-8145-9912cf8eb4e6 req-34e2c3d8-706e-48a1-973d-f4a9e5c31e63 service nova] Creating event network-vif-deleted:a82ff7cb-ace7-47d6-b072-2131b708ad9c for instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 on n-h1-master-1 Jul 01 10:32:24.828474 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-196e7964-168c-4c9f-8145-9912cf8eb4e6 req-34e2c3d8-706e-48a1-973d-f4a9e5c31e63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050980 Jul 01 10:32:24.829840 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 814/1576] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:24.846617 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:24.847354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 1fbbd6ec-d31e-490a-aed8-42c91588b237] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:24.859219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:24.867801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:24.868657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:24.869106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:24.901447 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] HTTP exception thrown: Instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 could not be found. Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Request method failure captured: Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 HTTP/1.1 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsyClJlHfX2TQY42VHmzW4dkgAEblLTuTBWMpogCrMV7rZ58_cYbmDSrgZ6EmqpZRhC1_to61lRWjyrJuszOvyVobI3uOO9_rKLHqyuVnNTg_GI5R3u48fEUr2KRnHGfcNYpVJKN45KV7zrmuiPOFhwYt4zg3cqNCHA0VAHC16Bq6mk Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1ca92b2cafba4257b5f4931764621897 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ca92b2cafba4257b5f4931764621897", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1ca92b2cafba4257b5f4931764621897 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdminTestJSON-1701618738-project Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 832898660e1d480e8c85a12c9cfd5c02 Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdminTestJSON-1701618738-project Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 could not be found. Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1fbbd6ec-d31e-490a-aed8-42c91588b237'} Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 could not be found. Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 could not be found. Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:24.903502 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:24.908520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:24.908520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:24.908520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:24.908520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:24.908520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:24.908520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 could not be found. Jul 01 10:32:24.908520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:24.911417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Returning 404 to user: Instance 1fbbd6ec-d31e-490a-aed8-42c91588b237 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:24.915133 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14742c32-445e-4c9c-91e6-6e1d8849c42d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237" status: 404 len: 111 microversion: 2.1 time: 0.083905 Jul 01 10:32:24.919115 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 815/1577] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:24 2022] GET /compute/v2.1/servers/1fbbd6ec-d31e-490a-aed8-42c91588b237 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:24.922827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:24.923454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:24.942214 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:24.942678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:24.943492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:24.945079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:25.237441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:25.246964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:25.253547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:25.257584 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3e8c84ea-3f46-47a7-8dd7-de76db6dae5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.338561 Jul 01 10:32:25.258335 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 816/1578] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:24 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:25.271831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:25.272830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:25.280624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:25.281371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:25.282637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:25.283273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:25.505472 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2eeba376-eb47-46eb-ac44-74ab3b88c504 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0/action" status: 202 len: 0 microversion: 2.1 time: 1.837353 Jul 01 10:32:25.507101 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 763/1579] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:23 2022] POST /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0/action => generated 0 bytes in 1839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:25.512394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7bcf437b-5fa2-4229-9390-2c3d8db67c0f req-0002a42e-498b-4884-986c-e35cc58f34db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-plugged", "status": "completed", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:25.529826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7bcf437b-5fa2-4229-9390-2c3d8db67c0f req-0002a42e-498b-4884-986c-e35cc58f34db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:25.533767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7bcf437b-5fa2-4229-9390-2c3d8db67c0f req-0002a42e-498b-4884-986c-e35cc58f34db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:25.566417 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7bcf437b-5fa2-4229-9390-2c3d8db67c0f req-0002a42e-498b-4884-986c-e35cc58f34db service nova] Creating event network-vif-plugged:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:32:25.571959 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7bcf437b-5fa2-4229-9390-2c3d8db67c0f req-0002a42e-498b-4884-986c-e35cc58f34db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063335 Jul 01 10:32:25.578608 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 764/1580] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:25.584365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.193"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:25.589209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:25.603534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:25.608749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:25.613133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:25.613856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:25.675468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Acquired lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:32:25.872593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:25.883940 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-677dcbfb-0d0c-4e9d-a656-783f2358ae38 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1294 microversion: 2.1 time: 0.619540 Jul 01 10:32:25.893239 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 817/1581] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:25 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1294 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:25.895453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:25.898805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:25.913714 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:25.914288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:25.919129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:25.929336 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:26.328576 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:26.346995 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff96273c-9a54-43a6-ba27-3e78ee40b95b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1505 microversion: 2.1 time: 0.459134 Jul 01 10:32:26.369506 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 818/1582] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:25 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:26.381633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:26.382549 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:26.389699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:26.390139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:26.390909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:26.391514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:26.426181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:26.797918 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-40a3d7c5-c66c-4cb3-b521-608ea50b4d5d tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 204 len: 0 microversion: 2.1 time: 0.425487 Jul 01 10:32:26.799627 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 819/1583] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:26 2022] DELETE /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:26.807472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2072281846"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:26.808339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:26.821028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:26.821707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:26.822795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:26.823460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:27.077243 n-d-master-1 devstack@n-api.service[119765]: INFO nova.network.security_group_api [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Adding security group 8048c8a0-32a0-4fef-98c4-6f6c5e593ad2 to port 8a073947-b214-44c4-80dc-9bf621ffd488 Jul 01 10:32:27.468422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Building network info cache for instance {{(pid=119764) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:32:27.933628 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-da8e1eba-9648-4c51-bd87-cc565ed03215 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0/action" status: 202 len: 0 microversion: 2.1 time: 1.130698 Jul 01 10:32:27.934507 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 820/1584] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:26 2022] POST /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:27.941575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:27.942209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:27.970112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:27.970588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:27.974411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:27.978814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:28.429829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:28.443738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13d0a47b-918a-4848-a9bc-07b13ea04f2a tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1469 microversion: 2.1 time: 0.507401 Jul 01 10:32:28.445116 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 821/1585] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:27 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1469 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:28.456073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:28.457678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:28.465654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:28.467799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:28.469416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:28.470131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.204067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:29.218707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:29.225464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:29.227262 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c86e7a2f-29b0-41da-9a76-8889adaf94d9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.779941 Jul 01 10:32:29.228456 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 822/1586] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:28 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:29.234123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:29.235078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:29.243976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.244744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.246159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.246774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.269868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Updating instance_info_cache with network_info: [{"id": "f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69", "address": "fa:16:3e:51:91:bc", "network": {"id": "e231d808-d9c2-44eb-8ea8-e48179fbb8a1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1508047106-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "36cd881902f945c2b1253364b13d0823", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf7a2ff18-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119764) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:32:29.300043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:29.301529 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7493b9ae-b593-46b8-8625-0ba2d4fcd13b tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed/os-instance-actions/req-7647c549-d4df-45dc-b12a-ce7194e54e07" status: 200 len: 313 microversion: 2.1 time: 0.071766 Jul 01 10:32:29.311146 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 823/1587] 10.222.0.23 () {58 vars in 1418 bytes} [Fri Jul 1 10:32:29 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed/os-instance-actions/req-7647c549-d4df-45dc-b12a-ce7194e54e07 => generated 313 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:29.318270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:29.319609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:29.328379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.329190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.330170 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.330823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.362531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Releasing lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:32:29.363992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4d66974c-0665-46e2-a296-b68244f2663c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action" status: 202 len: 0 microversion: 2.1 time: 3.784003 Jul 01 10:32:29.366002 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 765/1588] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:25 2022] POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action => generated 0 bytes in 3787 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:32:29.371412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e84c409a-1987-4d4f-860c-1881ed2aec43 req-85d773a9-017e-4590-b029-d45c8c24c839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "name": "network-vif-unplugged", "status": "completed", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}, {"name": "network-changed", "server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}, {"name": "network-changed", "server_uuid": "88347916-572c-4ee0-8918-473b01edc6d0", "tag": "8a073947-b214-44c4-80dc-9bf621ffd488"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:29.392445 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e84c409a-1987-4d4f-860c-1881ed2aec43 req-85d773a9-017e-4590-b029-d45c8c24c839 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.394271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e84c409a-1987-4d4f-860c-1881ed2aec43 req-85d773a9-017e-4590-b029-d45c8c24c839 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.414800 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e84c409a-1987-4d4f-860c-1881ed2aec43 req-85d773a9-017e-4590-b029-d45c8c24c839 service nova] Creating event network-vif-unplugged:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h2-master-1 Jul 01 10:32:29.415301 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e84c409a-1987-4d4f-860c-1881ed2aec43 req-85d773a9-017e-4590-b029-d45c8c24c839 service nova] Creating event network-changed:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h2-master-1 Jul 01 10:32:29.416479 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e84c409a-1987-4d4f-860c-1881ed2aec43 req-85d773a9-017e-4590-b029-d45c8c24c839 service nova] Creating event network-changed:8a073947-b214-44c4-80dc-9bf621ffd488 for instance 88347916-572c-4ee0-8918-473b01edc6d0 on n-h2-master-1 Jul 01 10:32:29.430745 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e84c409a-1987-4d4f-860c-1881ed2aec43 req-85d773a9-017e-4590-b029-d45c8c24c839 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.063265 Jul 01 10:32:29.432667 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 766/1589] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:29.442505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:29.443217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:29.451677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.452491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.453541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.454251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.792457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832898660e1d480e8c85a12c9cfd5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca92b2cafba4257b5f4931764621897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:29.800626 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c7997835-5f2f-4b5b-8231-4779f64765e1 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 200 len: 1470 microversion: 2.1 time: 0.487962 Jul 01 10:32:29.807023 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 824/1590] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:29 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 1470 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:29.815131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe75a802-fcbb-4611-8274-e4eef61e6bdb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:29.815343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fe75a802-fcbb-4611-8274-e4eef61e6bdb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:29.828817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe75a802-fcbb-4611-8274-e4eef61e6bdb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.832037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe75a802-fcbb-4611-8274-e4eef61e6bdb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.837428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe75a802-fcbb-4611-8274-e4eef61e6bdb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.838447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe75a802-fcbb-4611-8274-e4eef61e6bdb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.874174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:29.886726 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80c1bf03-acf5-4046-94ea-d3ee526e11db tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1294 microversion: 2.1 time: 0.447593 Jul 01 10:32:29.890026 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 767/1591] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:29 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1294 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:29.898764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-549ffadb-cfd9-43cc-aa50-1a57c347f5cf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:29.905767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-549ffadb-cfd9-43cc-aa50-1a57c347f5cf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:29.920952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-549ffadb-cfd9-43cc-aa50-1a57c347f5cf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.921727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-549ffadb-cfd9-43cc-aa50-1a57c347f5cf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.922776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-549ffadb-cfd9-43cc-aa50-1a57c347f5cf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:29.925380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-549ffadb-cfd9-43cc-aa50-1a57c347f5cf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:29.929997 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:30.259601 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-549ffadb-cfd9-43cc-aa50-1a57c347f5cf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "POST /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed/action" status: 202 len: 0 microversion: 2.1 time: 0.367992 Jul 01 10:32:30.260729 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 768/1592] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:29 2022] POST /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:30.270879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c059e572-c975-4da6-b9ef-53d709061bf7 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'create', calling method: .version_select at 0x7f6f91e268b0>, body: {"pool": "ad3f20c2-d831-42e1-81e8-72b2d1385618"} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:30.647266 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fe75a802-fcbb-4611-8274-e4eef61e6bdb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.840425 Jul 01 10:32:30.647871 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 825/1593] 10.222.0.23 () {58 vars in 1292 bytes} [Fri Jul 1 10:32:29 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0/os-security-groups => generated 1159 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:30.652467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:30.653079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:30.679173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:30.679624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:30.682173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:30.682623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:31.183957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:31.207880 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-786f3d0e-f266-4107-b7eb-24acc6801125 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1462 microversion: 2.1 time: 0.558923 Jul 01 10:32:31.209429 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 826/1594] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:30 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1462 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:31.218395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:31.224334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:31.243970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:31.244693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:31.245759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:31.246191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:31.614362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:31.628316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:31.629473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:31.631047 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a18583f-c216-42b2-9069-8c80e107e921 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.419842 Jul 01 10:32:31.631786 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 827/1595] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:31 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:31.648746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:31.650245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:31.657775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:31.658450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:31.659389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:31.659990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:31.689117 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:31.968587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:31.969123 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc9df1d8-e6c4-410f-8dc1-890090905166 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1507 microversion: 2.1 time: 0.324268 Jul 01 10:32:31.970003 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 828/1596] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:31 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:31.993254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4ffaa332-2830-494c-8166-4315633fae2f req-ca1e8513-ad28-41da-acea-2bcd9fde0b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53aec7e-a610-4fef-b617-a9e42532ac25", "name": "network-vif-plugged", "status": "completed", "tag": "1249eb41-5269-4873-9281-4ee3ed02a6fd"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:32.002732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4ffaa332-2830-494c-8166-4315633fae2f req-ca1e8513-ad28-41da-acea-2bcd9fde0b98 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:32.004409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4ffaa332-2830-494c-8166-4315633fae2f req-ca1e8513-ad28-41da-acea-2bcd9fde0b98 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:32.025448 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4ffaa332-2830-494c-8166-4315633fae2f req-ca1e8513-ad28-41da-acea-2bcd9fde0b98 service nova] Creating event network-vif-plugged:1249eb41-5269-4873-9281-4ee3ed02a6fd for instance c53aec7e-a610-4fef-b617-a9e42532ac25 on n-h2-master-1 Jul 01 10:32:32.032611 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4ffaa332-2830-494c-8166-4315633fae2f req-ca1e8513-ad28-41da-acea-2bcd9fde0b98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052096 Jul 01 10:32:32.033977 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 829/1597] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:32.040896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f5c3f111-6d11-483d-89bc-1d80fa4ebe78 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f91ed1f70>, body: {"security_group": {"name": " tempest-securitygroup -806587310 ", "description": "tempest-description-1843963557"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:33.059740 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f5c3f111-6d11-483d-89bc-1d80fa4ebe78 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.024068 Jul 01 10:32:33.061328 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 830/1598] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:32:32 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:33.066329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:33.067080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] [instance: 877d8f3c-c720-4ed7-8a6c-65fc6fe44672] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:33.074057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.074535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.075840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.076278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.092581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] HTTP exception thrown: Instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 could not be found. Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Request method failure captured: Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 HTTP/1.1 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsyClJlHfX2TQY42VHmzW4dkgAEblLTuTBWMpogCrMV7rZ58_cYbmDSrgZ6EmqpZRhC1_to61lRWjyrJuszOvyVobI3uOO9_rKLHqyuVnNTg_GI5R3u48fEUr2KRnHGfcNYpVJKN45KV7zrmuiPOFhwYt4zg3cqNCHA0VAHC16Bq6mk Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1ca92b2cafba4257b5f4931764621897 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ca92b2cafba4257b5f4931764621897", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ca92b2cafba4257b5f4931764621897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1ca92b2cafba4257b5f4931764621897 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdminTestJSON-1701618738 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdminTestJSON-1701618738-project Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 832898660e1d480e8c85a12c9cfd5c02 Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdminTestJSON-1701618738-project Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 could not be found. Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '877d8f3c-c720-4ed7-8a6c-65fc6fe44672'} Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 could not be found. Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 could not be found. Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:33.094518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 could not be found. Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] Returning 404 to user: Instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93280067-a0be-4a03-9558-67fefa14b2e0 tempest-ServersAdminTestJSON-1701618738 tempest-ServersAdminTestJSON-1701618738-project] 10.222.0.23 "GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672" status: 404 len: 111 microversion: 2.1 time: 0.033618 Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 831/1599] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:33 2022] GET /compute/v2.1/servers/877d8f3c-c720-4ed7-8a6c-65fc6fe44672 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.142287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.275790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:33.287533 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e4500af-a72c-448d-b52a-e51b483f3da8 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1294 microversion: 2.1 time: 0.190021 Jul 01 10:32:33.288429 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 832/1600] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:33 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1294 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:33.423638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a756a1a3-92bd-4800-b247-0162e71b6936 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:33.424266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a756a1a3-92bd-4800-b247-0162e71b6936 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:33.430769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a756a1a3-92bd-4800-b247-0162e71b6936 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.431348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a756a1a3-92bd-4800-b247-0162e71b6936 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.432442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a756a1a3-92bd-4800-b247-0162e71b6936 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.432881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a756a1a3-92bd-4800-b247-0162e71b6936 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.490516 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c059e572-c975-4da6-b9ef-53d709061bf7 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.228072 Jul 01 10:32:33.497365 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 769/1601] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:32:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:33.497365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8be759be-3353-4b19-8ac0-4a69d8f2e998 req-6e3a6e74-92e6-4e17-afee-f53a91757a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8c7fb2f-c8a5-4288-b068-1074ce9da4ba", "tag": "f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69"}, {"name": "network-changed", "server_uuid": "88347916-572c-4ee0-8918-473b01edc6d0", "tag": "8a073947-b214-44c4-80dc-9bf621ffd488"}, {"server_uuid": "877d8f3c-c720-4ed7-8a6c-65fc6fe44672", "name": "network-vif-deleted", "tag": "75426cac-af1d-4dc1-8b63-4c327a9be5a5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:33.506477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8be759be-3353-4b19-8ac0-4a69d8f2e998 req-6e3a6e74-92e6-4e17-afee-f53a91757a46 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.507037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8be759be-3353-4b19-8ac0-4a69d8f2e998 req-6e3a6e74-92e6-4e17-afee-f53a91757a46 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.522874 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8be759be-3353-4b19-8ac0-4a69d8f2e998 req-6e3a6e74-92e6-4e17-afee-f53a91757a46 service nova] Creating event network-changed:f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 for instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba on n-h2-master-1 Jul 01 10:32:33.523626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8be759be-3353-4b19-8ac0-4a69d8f2e998 req-6e3a6e74-92e6-4e17-afee-f53a91757a46 service nova] Creating event network-changed:8a073947-b214-44c4-80dc-9bf621ffd488 for instance 88347916-572c-4ee0-8918-473b01edc6d0 on n-h2-master-1 Jul 01 10:32:33.527373 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8be759be-3353-4b19-8ac0-4a69d8f2e998 req-6e3a6e74-92e6-4e17-afee-f53a91757a46 service nova] Creating event network-vif-deleted:75426cac-af1d-4dc1-8b63-4c327a9be5a5 for instance 877d8f3c-c720-4ed7-8a6c-65fc6fe44672 on n-h1-master-1 Jul 01 10:32:33.536020 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8be759be-3353-4b19-8ac0-4a69d8f2e998 req-6e3a6e74-92e6-4e17-afee-f53a91757a46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.043120 Jul 01 10:32:33.536699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 770/1602] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:33.542158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:33.543728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:33.557590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.558576 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.560911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.561616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.592286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a756a1a3-92bd-4800-b247-0162e71b6936 tempest-MigrationsAdminTest-205391562 tempest-MigrationsAdminTest-205391562-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1613 microversion: 2.1 time: 0.302777 Jul 01 10:32:33.592868 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 833/1603] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:33 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1613 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:33.619307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:33.619934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:33.627207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.627900 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.628877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.629343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.773627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:33.786118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:33.787814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:33.788977 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-13c252f6-e3c6-4a6b-8a15-fdb908708be5 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.251022 Jul 01 10:32:33.789560 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 771/1604] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:33 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:33.794920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a11af3f-535a-4c96-bbf0-404486ce8d6a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91bd8280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:33.801518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:33.810406 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07df7e52-2267-4f9a-bfeb-48a0e45548ba tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1505 microversion: 2.1 time: 0.215818 Jul 01 10:32:33.810975 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 834/1605] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:33 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:33.816428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.210"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:33.817564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:33.824044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.824597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.825734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.826329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.851774 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a11af3f-535a-4c96-bbf0-404486ce8d6a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4" status: 200 len: 223 microversion: 2.1 time: 0.060919 Jul 01 10:32:33.852254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Acquired lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:32:33.853683 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 772/1606] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:32:33 2022] GET /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4 => generated 223 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:33.860673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:33.861796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:33.867985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.868431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.869429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:33.870056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:33.896374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:34.180323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b0764272-200f-4e35-b1a8-fa2f4600ae68 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 204 len: 0 microversion: 2.1 time: 0.325150 Jul 01 10:32:34.180948 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 773/1607] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:33 2022] DELETE /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:34.187234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc510a8a-fc0b-4d6f-94e4-7019bfba61df tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '.version_select at 0x7f6f92291550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:34.187890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dc510a8a-fc0b-4d6f-94e4-7019bfba61df tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:34.194158 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc510a8a-fc0b-4d6f-94e4-7019bfba61df tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.194608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc510a8a-fc0b-4d6f-94e4-7019bfba61df tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.195446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc510a8a-fc0b-4d6f-94e4-7019bfba61df tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.195883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc510a8a-fc0b-4d6f-94e4-7019bfba61df tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.230582 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc510a8a-fc0b-4d6f-94e4-7019bfba61df tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.048130 Jul 01 10:32:34.231359 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 774/1608] 10.222.0.23 () {58 vars in 1295 bytes} [Fri Jul 1 10:32:34 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed/os-instance-actions => generated 611 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:34.237983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea9f2c3d-9718-4b39-9a6a-65d323b22bc5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91bd8dc0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:34.301841 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618.", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:32:34.302965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Releasing lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:32:34.303530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] HTTP exception thrown: Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618. Jul 01 10:32:34.303530 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a29c221a-2172-425e-9624-839e23a910eb'] Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Request method failure captured: Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action HTTP/1.1 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 46 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0W7xagMbEnH1uIuQq2wGVzI-_dEHzhKLpNHr_RAXTlYqMp8SWG_3hi8ZjVYlOu1XvBf9aJ5p0gbCn2OnqhkrghLEf4B948ayhkbgbH5xVuCPGVPll3hEPx1oar19hpVxmeh9GhaHR-_m43jsghGN55oxkBKfCb_7IYOdNFpxfoYo0 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36cd881902f945c2b1253364b13d0823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36cd881902f945c2b1253364b13d0823", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 6fd895513ff5473dbdf18a7aef8b65af Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: {"addFloatingIp": {"address": "172.35.6.210"}} Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618. Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a29c221a-2172-425e-9624-839e23a910eb'] Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'd8c7fb2f-c8a5-4288-b068-1074ce9da4ba', 'body': {'addFloatingIp': {'address': '172.35.6.210'}}} Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:32:34.305834 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618. Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29c221a-2172-425e-9624-839e23a910eb'] Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618. Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29c221a-2172-425e-9624-839e23a910eb'] Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618. Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29c221a-2172-425e-9624-839e23a910eb'] Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618. Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29c221a-2172-425e-9624-839e23a910eb'] Jul 01 10:32:34.312092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:34.318223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Returning 400 to user: Cannot associate floating IP 172.35.6.210 (1b7be081-fa5d-420a-92f4-a3fbbb65a56a) with port f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ad3f20c2-d831-42e1-81e8-72b2d1385618. Jul 01 10:32:34.318223 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a29c221a-2172-425e-9624-839e23a910eb'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:34.318223 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c690439-0c09-48e1-9967-39bb21ef7f7f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action" status: 400 len: 381 microversion: 2.1 time: 0.495457 Jul 01 10:32:34.318223 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 835/1609] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:33 2022] POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action => generated 381 bytes in 500 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:32:34.318223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e191b8a0-601c-422f-93d5-ef9d46725689 req-2aa38210-b9cd-430a-9f68-b5cbd73d67d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "name": "network-vif-plugged", "status": "completed", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:34.328062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e191b8a0-601c-422f-93d5-ef9d46725689 req-2aa38210-b9cd-430a-9f68-b5cbd73d67d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.329205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e191b8a0-601c-422f-93d5-ef9d46725689 req-2aa38210-b9cd-430a-9f68-b5cbd73d67d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.340382 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e191b8a0-601c-422f-93d5-ef9d46725689 req-2aa38210-b9cd-430a-9f68-b5cbd73d67d4 service nova] Creating event network-vif-plugged:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h2-master-1 Jul 01 10:32:34.346533 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e191b8a0-601c-422f-93d5-ef9d46725689 req-2aa38210-b9cd-430a-9f68-b5cbd73d67d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033236 Jul 01 10:32:34.347277 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 836/1610] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:34.357409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:34.357409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:34.360093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.360690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.361552 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.362056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.521408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:34.529816 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7dc4d1c-422e-4f35-8cff-189092d828c3 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1468 microversion: 2.1 time: 0.181331 Jul 01 10:32:34.530394 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 837/1611] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:34 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1468 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:34.534847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:34.535340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:34.541351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.541797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.542570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.543006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.568803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:34.573405 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea9f2c3d-9718-4b39-9a6a-65d323b22bc5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4" status: 202 len: 0 microversion: 2.1 time: 0.340205 Jul 01 10:32:34.574879 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 775/1612] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:32:34 2022] DELETE /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:34.580217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:34.580830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:34.589335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.589888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.590763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.591441 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.729058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:34.737477 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-309ce883-e61e-4325-aff6-ed0cc3bf3eeb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.161278 Jul 01 10:32:34.738054 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 776/1613] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:34 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:34.742518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:34.743153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:34.748920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.749407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.750182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:34.752991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:34.803385 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a19cf0a-7903-4a07-b1bd-3c9eeef290bf tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "DELETE /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 204 len: 0 microversion: 2.1 time: 0.271729 Jul 01 10:32:34.804213 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 838/1614] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:34 2022] DELETE /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:34.812731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4c3e363-5f14-4598-a00e-20fcea53fd8c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '.version_select at 0x7f6f91ed1d30>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:34.955885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:34.963488 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-91bc7d2a-3023-4c90-aacc-7294ac8b5f8f tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1485 microversion: 2.1 time: 0.224478 Jul 01 10:32:34.964076 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 777/1615] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:34 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1485 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:34.979529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb5f37c8-e1d6-4e3b-8033-f3c9da695032 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f9253c820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:35.007219 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-bb5f37c8-e1d6-4e3b-8033-f3c9da695032 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:32:35.007810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-bb5f37c8-e1d6-4e3b-8033-f3c9da695032 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:32:35.008519 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-bb5f37c8-e1d6-4e3b-8033-f3c9da695032 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:32:35.008519 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-759a8943-ece7-4ee6-9b1f-47ae12d14011'] Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb5f37c8-e1d6-4e3b-8033-f3c9da695032 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4 HTTP/1.1 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: exception: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-759a8943-ece7-4ee6-9b1f-47ae12d14011'] Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'aac60fdd-d1bc-4524-967a-44dd9d0504a4'} Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:32:35.010475 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759a8943-ece7-4ee6-9b1f-47ae12d14011'] Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759a8943-ece7-4ee6-9b1f-47ae12d14011'] Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759a8943-ece7-4ee6-9b1f-47ae12d14011'] Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759a8943-ece7-4ee6-9b1f-47ae12d14011'] Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb5f37c8-e1d6-4e3b-8033-f3c9da695032 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-759a8943-ece7-4ee6-9b1f-47ae12d14011'] {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bb5f37c8-e1d6-4e3b-8033-f3c9da695032 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4" status: 404 len: 194 microversion: 2.1 time: 0.036439 Jul 01 10:32:35.016586 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 778/1616] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:32:34 2022] GET /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:35.021624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1909ddb5-250d-47e1-ae4a-48bffdf7b49b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1599049103"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:35.022770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1909ddb5-250d-47e1-ae4a-48bffdf7b49b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:35.029695 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:35.033328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909ddb5-250d-47e1-ae4a-48bffdf7b49b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.033860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909ddb5-250d-47e1-ae4a-48bffdf7b49b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.034553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909ddb5-250d-47e1-ae4a-48bffdf7b49b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.035015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909ddb5-250d-47e1-ae4a-48bffdf7b49b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.572079 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1909ddb5-250d-47e1-ae4a-48bffdf7b49b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.557691 Jul 01 10:32:35.573182 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 779/1617] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:35 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 01 10:32:35.580032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:35.580032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:35.586848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.587358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.588256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.588707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.748585 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4c3e363-5f14-4598-a00e-20fcea53fd8c tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/1b7be081-fa5d-420a-92f4-a3fbbb65a56a" status: 202 len: 0 microversion: 2.1 time: 0.940374 Jul 01 10:32:35.752369 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 839/1618] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:32:34 2022] DELETE /compute/v2.1/os-floating-ips/1b7be081-fa5d-420a-92f4-a3fbbb65a56a => generated 0 bytes in 945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:35.759368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:35.760138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:35.768673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.770198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.770319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.770675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.779513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:35.787958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:35.789483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:35.790755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64aa4310-e916-476b-9945-e0e61534e555 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.216850 Jul 01 10:32:35.791314 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 780/1619] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:35 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:35.805307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9636b4d8-1064-4aec-8943-0a049b7fb005 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:35.805795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9636b4d8-1064-4aec-8943-0a049b7fb005 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:35.812282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9636b4d8-1064-4aec-8943-0a049b7fb005 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.812723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9636b4d8-1064-4aec-8943-0a049b7fb005 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.813508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9636b4d8-1064-4aec-8943-0a049b7fb005 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.813936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9636b4d8-1064-4aec-8943-0a049b7fb005 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.904567 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9636b4d8-1064-4aec-8943-0a049b7fb005 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102916 Jul 01 10:32:35.905395 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 781/1620] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:32:35 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:35.917943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c4fb88fb-2d85-4c72-8324-6f08f1428737 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f91b5db80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-634227584", "description": "tempest-description-1808947456"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:35.969725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:35.977617 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62818e29-b83e-438c-9efa-b0e7f554cc62 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1511 microversion: 2.1 time: 0.226390 Jul 01 10:32:35.978448 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 840/1621] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:35 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:35.983246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:35.983863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:35.989914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.990358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:35.991134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:35.991567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:36.277019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:36.287750 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e064165a-b3b8-442c-b8d7-4c29855dbc18 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1468 microversion: 2.1 time: 0.308086 Jul 01 10:32:36.288752 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 841/1622] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:35 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:36.302531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.193"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:36.513886 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c4fb88fb-2d85-4c72-8324-6f08f1428737 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.601023 Jul 01 10:32:36.514493 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 782/1623] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:32:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:36.536394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9eec3982-532b-45b7-a331-a349b78cf553 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f91b12310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-367370883", "description": "tempest-description-1191939437"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:36.704733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:36.722133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:36.722969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:36.724084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:36.724778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:37.413498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Acquired lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:32:38.266708 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9eec3982-532b-45b7-a331-a349b78cf553 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.735422 Jul 01 10:32:38.267292 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 783/1624] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:32:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:32:38.271916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2f5e3997-44b8-42df-a084-716b7c86014d req-26b07c32-c875-48ba-81bc-8c2230fc758b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-unplugged", "status": "completed", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:38.287356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2f5e3997-44b8-42df-a084-716b7c86014d req-26b07c32-c875-48ba-81bc-8c2230fc758b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:38.288549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2f5e3997-44b8-42df-a084-716b7c86014d req-26b07c32-c875-48ba-81bc-8c2230fc758b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:38.304372 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2f5e3997-44b8-42df-a084-716b7c86014d req-26b07c32-c875-48ba-81bc-8c2230fc758b service nova] Creating event network-vif-unplugged:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:32:38.309232 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2f5e3997-44b8-42df-a084-716b7c86014d req-26b07c32-c875-48ba-81bc-8c2230fc758b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040131 Jul 01 10:32:38.310146 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 784/1625] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:38.317173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:38.317942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:38.325999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:38.326532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:38.327374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:38.327807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:38.957132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:38.971978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:38.971978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:38.971978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1524d7c6-fd0e-44b9-81b7-df5cce7c08de tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.658042 Jul 01 10:32:38.974312 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 785/1626] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:38 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:38.978897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:38.979506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:38.987099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:38.987545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:38.988316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:38.988760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.024263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.024263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.024263 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lazy-loading 'fault' on Instance uuid 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:32:39.148736 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052154793cc042f3b4c84ac992b8b179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b3c5bc89d41dd9e93e1c33c7c7d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:39.158665 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a3755682-b4a4-4982-afa9-ed2992b786c3 tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 200 len: 1305 microversion: 2.1 time: 0.183315 Jul 01 10:32:39.159246 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 786/1627] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:38 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:39.338309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Action: 'update', calling method: .version_select at 0x7f6f9713c790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:39.342129 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:39.342129 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:39.343042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.344735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.363401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.364653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.380896 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] HTTP exception thrown: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Request method failure captured: Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767 HTTP/1.1 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 56 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1FNTNybIjev-5kEnJTcuWwmFPJaUIPH462xMGm344fGGmkUz8AAApFmaTtmkKC2LYTeNRLcIOJ0BRe221EyIS43pbIl-27TpmrH9XAHdMgNJCNH_6X7FsYpIHoFs-mmlwJjUnwLaWpS_yVesxRJA4GcDBbg4dl_jiS7_r1VlAOTk0 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.53 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: eb55d15f5a4d495283f5ef27f45ee98b Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb55d15f5a4d495283f5ef27f45ee98b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: eb55d15f5a4d495283f5ef27f45ee98b Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cd78581d27804492af49975d70b8e232 Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: exception: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '08a71e00-5683-4d55-890a-f1c315e75767', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:32:39.383057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:39.388944 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:39.400153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Returning 404 to user: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:39.400153 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-54cf1cf5-d5f6-4035-bf16-8cbfcc8b20e5 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767" status: 404 len: 110 microversion: 2.53 time: 0.232800 Jul 01 10:32:39.400153 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 787/1628] 10.222.0.23 () {62 vars in 1308 bytes} [Fri Jul 1 10:32:39 2022] PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767 => generated 110 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:32:39.401480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:39.402054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:39.409753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.410198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.411025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.411458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.464753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.465466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.466622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lazy-loading 'fault' on Instance uuid 97e036ea-28bb-4de6-aef3-f67c7b06fd65 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:32:39.470290 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:39.603807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:39.616519 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc67e5d4-ae92-4555-8446-3c00135b398b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 200 len: 1303 microversion: 2.1 time: 0.219403 Jul 01 10:32:39.618397 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 788/1629] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:39 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 1303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:39.625475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1d46677c-d89e-4176-96f1-850eb4c7de9a req-040b468c-b084-43e6-88a8-ae3ad544697c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730", "name": "network-vif-unplugged", "status": "completed", "tag": "b53fda29-dab0-4898-920d-4dd9caf3daae"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:39.655240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1d46677c-d89e-4176-96f1-850eb4c7de9a req-040b468c-b084-43e6-88a8-ae3ad544697c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.655772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1d46677c-d89e-4176-96f1-850eb4c7de9a req-040b468c-b084-43e6-88a8-ae3ad544697c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.671971 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1d46677c-d89e-4176-96f1-850eb4c7de9a req-040b468c-b084-43e6-88a8-ae3ad544697c service nova] Creating event network-vif-unplugged:b53fda29-dab0-4898-920d-4dd9caf3daae for instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 on n-h1-master-1 Jul 01 10:32:39.685209 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1d46677c-d89e-4176-96f1-850eb4c7de9a req-040b468c-b084-43e6-88a8-ae3ad544697c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064397 Jul 01 10:32:39.685950 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 789/1630] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:39.692875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6526b728-9be9-432c-9e30-be02ab20cd4f req-bd953f13-203f-4f51-adf7-0f73bb8a0e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e036ea-28bb-4de6-aef3-f67c7b06fd65", "name": "network-vif-deleted", "tag": "fb4f606c-f391-44ac-a8bb-8c01e6aae87d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:39.713541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6526b728-9be9-432c-9e30-be02ab20cd4f req-bd953f13-203f-4f51-adf7-0f73bb8a0e83 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:39.714537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6526b728-9be9-432c-9e30-be02ab20cd4f req-bd953f13-203f-4f51-adf7-0f73bb8a0e83 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:39.728968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6526b728-9be9-432c-9e30-be02ab20cd4f req-bd953f13-203f-4f51-adf7-0f73bb8a0e83 service nova] Creating event network-vif-deleted:fb4f606c-f391-44ac-a8bb-8c01e6aae87d for instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 on n-h2-master-1 Jul 01 10:32:39.735735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6526b728-9be9-432c-9e30-be02ab20cd4f req-bd953f13-203f-4f51-adf7-0f73bb8a0e83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048025 Jul 01 10:32:39.739798 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 790/1631] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:39.749086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9c3b544-085b-4d22-ac52-e603b35b9dbc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f91a5bd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1291458806", "description": "tempest-description-2041523183"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:40.280364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Building network info cache for instance {{(pid=119765) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:32:40.665291 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9c3b544-085b-4d22-ac52-e603b35b9dbc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.923483 Jul 01 10:32:40.666582 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 791/1632] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:32:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:40.672617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:40.677218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:40.680672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:40.681266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:40.683027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:40.683546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:40.959995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:40.969317 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a6b92e95-3b28-4606-9098-00d3129608cf tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1485 microversion: 2.1 time: 0.301433 Jul 01 10:32:40.969901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 792/1633] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:40 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1485 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:40.975208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Action: 'update', calling method: .version_select at 0x7f6f923304c0>, body: {"status": "disabled"} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:40.977375 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:40.977375 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:40.978945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:40.979580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:40.993500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:40.993500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:40.993963 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] HTTP exception thrown: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Request method failure captured: Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767 HTTP/1.1 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 22 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1FNTNybIjev-5kEnJTcuWwmFPJaUIPH462xMGm344fGGmkUz8AAApFmaTtmkKC2LYTeNRLcIOJ0BRe221EyIS43pbIl-27TpmrH9XAHdMgNJCNH_6X7FsYpIHoFs-mmlwJjUnwLaWpS_yVesxRJA4GcDBbg4dl_jiS7_r1VlAOTk0 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.53 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: eb55d15f5a4d495283f5ef27f45ee98b Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb55d15f5a4d495283f5ef27f45ee98b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: eb55d15f5a4d495283f5ef27f45ee98b Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cd78581d27804492af49975d70b8e232 Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: {"status": "disabled"} Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: exception: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '08a71e00-5683-4d55-890a-f1c315e75767', 'body': {'status': 'disabled'}} Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:32:40.995995 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:41.002093 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.003971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Returning 404 to user: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:41.005019 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1135b80c-0a04-495d-af67-32cf2ea57d0c tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767" status: 404 len: 110 microversion: 2.53 time: 0.033993 Jul 01 10:32:41.005708 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 793/1634] 10.222.0.23 () {62 vars in 1308 bytes} [Fri Jul 1 10:32:40 2022] PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767 => generated 110 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:32:41.010615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:41.011544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:41.021664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.022151 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.023056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.023532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.281378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:41.288211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Updating instance_info_cache with network_info: [{"id": "f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69", "address": "fa:16:3e:51:91:bc", "network": {"id": "e231d808-d9c2-44eb-8ea8-e48179fbb8a1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1508047106-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "36cd881902f945c2b1253364b13d0823", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf7a2ff18-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119765) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:32:41.307461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:41.309362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:41.310890 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a7cda67a-dc15-42e9-9257-edadd8dedd27 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.303996 Jul 01 10:32:41.311853 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 794/1635] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:41 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:41.316428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:41.317316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] [instance: 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:41.323777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.324526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.327276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.327807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.344236 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] HTTP exception thrown: Instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed could not be found. Jul 01 10:32:41.346677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Releasing lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119765) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:32:41.351506 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6cb6828-9ef1-402c-b993-7a58bf72fef1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action" status: 202 len: 0 microversion: 2.1 time: 5.049402 Jul 01 10:32:41.351506 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 842/1636] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:36 2022] POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action => generated 0 bytes in 5051 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:32:41.353507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:41.354360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 97e036ea-28bb-4de6-aef3-f67c7b06fd65] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Request method failure captured: Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed HTTP/1.1 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0e-DCaRQm7mQaiTmsY3uBJwoGx19pKgyuP9tw3I1QXE7Mu6f9JkVn_fxVn71lcqHSvjobR09QEZ1B_cjzC1qO2PmLlsq1caCKMEz8UMe035mzFnfF5uY5sSoHimiMwAiA6jGsRGmYMVCcIbSISu83235pR0CVnHJ8MVHs-_oj1iL0 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 721b3c5bc89d41dd9e93e1c33c7c7d1c Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-InstanceActionsTestJSON-1090659067 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/721b3c5bc89d41dd9e93e1c33c7c7d1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/721b3c5bc89d41dd9e93e1c33c7c7d1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_721b3c5bc89d41dd9e93e1c33c7c7d1c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/721b3c5bc89d41dd9e93e1c33c7c7d1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-InstanceActionsTestJSON-1090659067 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 721b3c5bc89d41dd9e93e1c33c7c7d1c Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1090659067 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-InstanceActionsTestJSON-1090659067-project Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 052154793cc042f3b4c84ac992b8b179 Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-InstanceActionsTestJSON-1090659067-project Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed could not be found. Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '465b90a8-e2f3-4131-9ea7-bca24fd5b8ed'} Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed could not be found. Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed could not be found. Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.355979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed could not be found. Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] Returning 404 to user: Instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:41.361211 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e979276f-8668-45b7-92f0-e7bb2ead9cbe tempest-InstanceActionsTestJSON-1090659067 tempest-InstanceActionsTestJSON-1090659067-project] 10.222.0.23 "GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed" status: 404 len: 111 microversion: 2.1 time: 0.047174 Jul 01 10:32:41.362705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 795/1637] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:41 2022] GET /compute/v2.1/servers/465b90a8-e2f3-4131-9ea7-bca24fd5b8ed => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:41.369103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-491f24ae-c199-4c47-839f-1392ce333036 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91a5b820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:41.376213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.376669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.381589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.385622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.407279 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] HTTP exception thrown: Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 could not be found. Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Request method failure captured: Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 HTTP/1.1 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvg3XNKRper89DBZxtwlWelu2zVyvYAjoVW1xR5EbzSvtkoBlN11YpNQsFcYFdApA1U-HtRg_YbPGIqrBrq3VYi8fGeLVfgFQd8nFyp6SbAPJdMVvFS3muhSLPWzb49TwRjTfFJXD7cAfGDIYIcyzWLYxDFIQE_5_3PYb3BsbCujIs Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_95422d1e22a44786abcef182c9b1a5ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MigrationsAdminTest-1396652826 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 0dcb8296a8934a8cbc89d6df73d4a526 Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 could not be found. Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '97e036ea-28bb-4de6-aef3-f67c7b06fd65'} Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 could not be found. Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 could not be found. Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.409219 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.413891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.413891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:41.413891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:41.413891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:41.413891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:41.413891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 could not be found. Jul 01 10:32:41.413891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.415416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Returning 404 to user: Instance 97e036ea-28bb-4de6-aef3-f67c7b06fd65 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:41.416461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c756dec7-9a5d-45a8-b6c7-3bcb65fc656b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65" status: 404 len: 111 microversion: 2.1 time: 0.067140 Jul 01 10:32:41.421015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 843/1638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:41 2022] GET /compute/v2.1/servers/97e036ea-28bb-4de6-aef3-f67c7b06fd65 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:41.427281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91f38d30>, body: {"status": "enabled"} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:41.428686 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:41.428686 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:32:41.429874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.430319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.438705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:41.439131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:41.446036 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] HTTP exception thrown: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Request method failure captured: Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767 HTTP/1.1 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 21 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1FNTNybIjev-5kEnJTcuWwmFPJaUIPH462xMGm344fGGmkUz8AAApFmaTtmkKC2LYTeNRLcIOJ0BRe221EyIS43pbIl-27TpmrH9XAHdMgNJCNH_6X7FsYpIHoFs-mmlwJjUnwLaWpS_yVesxRJA4GcDBbg4dl_jiS7_r1VlAOTk0 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.53 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: eb55d15f5a4d495283f5ef27f45ee98b Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb55d15f5a4d495283f5ef27f45ee98b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb55d15f5a4d495283f5ef27f45ee98b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: eb55d15f5a4d495283f5ef27f45ee98b Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cd78581d27804492af49975d70b8e232 Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: {"status": "enabled"} Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: exception: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '08a71e00-5683-4d55-890a-f1c315e75767', 'body': {'status': 'enabled'}} Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:32:41.448588 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Returning 404 to user: Service 08a71e00-5683-4d55-890a-f1c315e75767 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d73adbc2-49d0-4054-8757-c9adcc377e74 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767" status: 404 len: 110 microversion: 2.53 time: 0.027779 Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 844/1639] 10.222.0.23 () {62 vars in 1308 bytes} [Fri Jul 1 10:32:41 2022] PUT /compute/v2.1/os-services/08a71e00-5683-4d55-890a-f1c315e75767 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:32:41.456873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ce612c1-8d56-40e8-a5b5-0378b3db57da tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '.version_select at 0x7f6f91f56310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:42.286613 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-491f24ae-c199-4c47-839f-1392ce333036 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.924225 Jul 01 10:32:42.288046 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 796/1640] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:32:41 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:42.293191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:42.295352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:42.317205 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:42.319408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:42.320545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:42.321432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:42.364792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:42.821214 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10418741-69d7-42f9-9f08-a75dabccc384 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 204 len: 0 microversion: 2.1 time: 0.531223 Jul 01 10:32:42.825797 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 797/1641] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:42 2022] DELETE /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:42.834575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e8ec67e-fa20-48f0-b32d-1c9f5ebd2fc3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:42.838193 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:42.838193 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:42.839991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e8ec67e-fa20-48f0-b32d-1c9f5ebd2fc3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:42.841488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e8ec67e-fa20-48f0-b32d-1c9f5ebd2fc3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:42.842503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e8ec67e-fa20-48f0-b32d-1c9f5ebd2fc3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:42.843153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e8ec67e-fa20-48f0-b32d-1c9f5ebd2fc3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:42.883079 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e8ec67e-fa20-48f0-b32d-1c9f5ebd2fc3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.054979 Jul 01 10:32:42.883951 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 798/1642] 10.222.0.23 () {60 vars in 1177 bytes} [Fri Jul 1 10:32:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:42.899250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4c023b19-3491-461b-8cc5-238250179642 req-09aa3c5e-8e7b-422d-b954-e2f2ca105fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730", "tag": "b53fda29-dab0-4898-920d-4dd9caf3daae"}, {"name": "network-changed", "server_uuid": "d8c7fb2f-c8a5-4288-b068-1074ce9da4ba", "tag": "f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:42.911039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4c023b19-3491-461b-8cc5-238250179642 req-09aa3c5e-8e7b-422d-b954-e2f2ca105fbe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:42.911839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4c023b19-3491-461b-8cc5-238250179642 req-09aa3c5e-8e7b-422d-b954-e2f2ca105fbe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:42.927693 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4c023b19-3491-461b-8cc5-238250179642 req-09aa3c5e-8e7b-422d-b954-e2f2ca105fbe service nova] Creating event network-changed:b53fda29-dab0-4898-920d-4dd9caf3daae for instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 on n-h1-master-1 Jul 01 10:32:42.932209 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4c023b19-3491-461b-8cc5-238250179642 req-09aa3c5e-8e7b-422d-b954-e2f2ca105fbe service nova] Creating event network-changed:f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 for instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba on n-h2-master-1 Jul 01 10:32:42.943772 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4c023b19-3491-461b-8cc5-238250179642 req-09aa3c5e-8e7b-422d-b954-e2f2ca105fbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058403 Jul 01 10:32:42.945012 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 799/1643] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:42.951536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6a87f9ff-3c33-4781-a759-1b00aec4bba5 req-b1ae16c5-2f85-46ae-9411-651b8e42acf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465b90a8-e2f3-4131-9ea7-bca24fd5b8ed", "name": "network-vif-deleted", "tag": "6725c15e-2e2e-4e48-8005-0e7cf0ee9cee"}, {"name": "network-changed", "server_uuid": "c53aec7e-a610-4fef-b617-a9e42532ac25", "tag": "1249eb41-5269-4873-9281-4ee3ed02a6fd"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:42.962190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6a87f9ff-3c33-4781-a759-1b00aec4bba5 req-b1ae16c5-2f85-46ae-9411-651b8e42acf0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:42.966776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6a87f9ff-3c33-4781-a759-1b00aec4bba5 req-b1ae16c5-2f85-46ae-9411-651b8e42acf0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:42.985691 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6a87f9ff-3c33-4781-a759-1b00aec4bba5 req-b1ae16c5-2f85-46ae-9411-651b8e42acf0 service nova] Creating event network-vif-deleted:6725c15e-2e2e-4e48-8005-0e7cf0ee9cee for instance 465b90a8-e2f3-4131-9ea7-bca24fd5b8ed on n-h1-master-1 Jul 01 10:32:42.986504 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6a87f9ff-3c33-4781-a759-1b00aec4bba5 req-b1ae16c5-2f85-46ae-9411-651b8e42acf0 service nova] Creating event network-changed:1249eb41-5269-4873-9281-4ee3ed02a6fd for instance c53aec7e-a610-4fef-b617-a9e42532ac25 on n-h2-master-1 Jul 01 10:32:42.995696 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6a87f9ff-3c33-4781-a759-1b00aec4bba5 req-b1ae16c5-2f85-46ae-9411-651b8e42acf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049122 Jul 01 10:32:42.996961 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 800/1644] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:43.003262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6512523b-79e7-4e12-b594-19abb0570d41 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91e265e0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:43.328281 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ce612c1-8d56-40e8-a5b5-0378b3db57da tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/72242482-3ead-4654-acea-563482a73a01" status: 202 len: 0 microversion: 2.1 time: 1.876594 Jul 01 10:32:43.329546 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 845/1645] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:32:41 2022] DELETE /compute/v2.1/os-floating-ips/72242482-3ead-4654-acea-563482a73a01 => generated 0 bytes in 1878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:43.334395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:43.335296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:43.346314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:43.352558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:43.353313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:43.353733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:43.656385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:43.676301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:43.689320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:43.696712 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8530e9dd-b8b2-45c5-b8d0-a5777f65bf94 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.365773 Jul 01 10:32:43.697889 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 846/1646] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:43 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:43.712706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:43.713737 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:43.730058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:43.730611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:43.733140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:43.733693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:43.848063 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6512523b-79e7-4e12-b594-19abb0570d41 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da" status: 202 len: 0 microversion: 2.1 time: 0.849704 Jul 01 10:32:43.849093 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 801/1647] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:32:42 2022] DELETE /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da => generated 0 bytes in 851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:43.853588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-adc3fd1a-8af5-4f99-a74f-3f1a02ee35b3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:43.854904 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:43.854904 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:43.856176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adc3fd1a-8af5-4f99-a74f-3f1a02ee35b3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:43.857091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adc3fd1a-8af5-4f99-a74f-3f1a02ee35b3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:43.858532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adc3fd1a-8af5-4f99-a74f-3f1a02ee35b3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:43.859356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adc3fd1a-8af5-4f99-a74f-3f1a02ee35b3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:43.950316 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-adc3fd1a-8af5-4f99-a74f-3f1a02ee35b3 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.095712 Jul 01 10:32:43.950316 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 802/1648] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Jul 1 10:32:43 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:43.953543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b18de49a-eec4-48c7-a1ec-0cb141317359 req-887fae88-c549-4300-8ad3-1e268f5cdeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-plugged", "status": "completed", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:43.966609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b18de49a-eec4-48c7-a1ec-0cb141317359 req-887fae88-c549-4300-8ad3-1e268f5cdeb9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:43.966995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b18de49a-eec4-48c7-a1ec-0cb141317359 req-887fae88-c549-4300-8ad3-1e268f5cdeb9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:43.980790 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b18de49a-eec4-48c7-a1ec-0cb141317359 req-887fae88-c549-4300-8ad3-1e268f5cdeb9 service nova] Creating event network-vif-plugged:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:32:43.987645 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b18de49a-eec4-48c7-a1ec-0cb141317359 req-887fae88-c549-4300-8ad3-1e268f5cdeb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038460 Jul 01 10:32:43.997914 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 803/1649] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:44.000587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9cf18cae-9b85-4954-b990-797f365b23fa tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9cf18cae-9b85-4954-b990-797f365b23fa tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Request method failure captured: Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action HTTP/1.1 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 34 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0W7xagMbEnH1uIuQq2wGVzI-_dEHzhKLpNHr_RAXTlYqMp8SWG_3hi8ZjVYlOu1XvBf9aJ5p0gbCn2OnqhkrghLEf4B948ayhkbgbH5xVuCPGVPll3hEPx1oar19hpVxmeh9GhaHR-_m43jsghGN55oxkBKfCb_7IYOdNFpxfoYo0 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36cd881902f945c2b1253364b13d0823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36cd881902f945c2b1253364b13d0823", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 6fd895513ff5473dbdf18a7aef8b65af Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: {"addFloatingIp": {"address": ""}} Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd8c7fb2f-c8a5-4288-b068-1074ce9da4ba', 'body': {'addFloatingIp': {'address': ''}}} Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi '' Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:32:44.003550 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9cf18cae-9b85-4954-b990-797f365b23fa tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:44.009230 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9cf18cae-9b85-4954-b990-797f365b23fa tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action" status: 400 len: 142 microversion: 2.1 time: 0.012805 Jul 01 10:32:44.010955 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 804/1650] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:43 2022] POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:32:44.017022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8d9c9131-84f8-4987-9d15-3e2a0059c322 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91ad50d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:44.113655 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-8d9c9131-84f8-4987-9d15-3e2a0059c322 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:32:44.114247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.security_group_api [None req-8d9c9131-84f8-4987-9d15-3e2a0059c322 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group c81eb904-2d40-4dd0-b3ad-df50220a56da not found {{(pid=119764) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:32:44.114781 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8d9c9131-84f8-4987-9d15-3e2a0059c322 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:32:44.114781 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-cf35d6a4-728f-47ba-942a-e1b91656c86a'] Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8d9c9131-84f8-4987-9d15-3e2a0059c322 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da HTTP/1.1 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: exception: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-cf35d6a4-728f-47ba-942a-e1b91656c86a'] Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c81eb904-2d40-4dd0-b3ad-df50220a56da'} Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:32:44.117486 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf35d6a4-728f-47ba-942a-e1b91656c86a'] Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf35d6a4-728f-47ba-942a-e1b91656c86a'] Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf35d6a4-728f-47ba-942a-e1b91656c86a'] Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf35d6a4-728f-47ba-942a-e1b91656c86a'] Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8d9c9131-84f8-4987-9d15-3e2a0059c322 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-cf35d6a4-728f-47ba-942a-e1b91656c86a'] {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8d9c9131-84f8-4987-9d15-3e2a0059c322 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da" status: 404 len: 194 microversion: 2.1 time: 0.106202 Jul 01 10:32:44.123971 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 805/1651] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:32:44 2022] GET /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:44.133354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-204e69f5-1e75-40ec-bb0a-c8f30e7f24b8 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:44.134659 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:44.134659 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:44.139118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204e69f5-1e75-40ec-bb0a-c8f30e7f24b8 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:44.140370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204e69f5-1e75-40ec-bb0a-c8f30e7f24b8 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:44.143190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204e69f5-1e75-40ec-bb0a-c8f30e7f24b8 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:44.143673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204e69f5-1e75-40ec-bb0a-c8f30e7f24b8 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:44.185656 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-204e69f5-1e75-40ec-bb0a-c8f30e7f24b8 tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.059312 Jul 01 10:32:44.186148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:44.186705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 806/1652] 10.222.0.23 () {60 vars in 1177 bytes} [Fri Jul 1 10:32:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:44.191750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:44.193255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:44.201475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:44.201623 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cdde35d-17bb-430e-b588-646700f87472 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1534 microversion: 2.1 time: 0.502321 Jul 01 10:32:44.210853 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 847/1653] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:43 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1534 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:44.211816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:44.212535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:44.214136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:44.218943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a303c03a-270a-488d-8663-d8dabf09fad2 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91cd7430>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:44.251052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Acquired lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:32:45.057851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Releasing lock "refresh_cache-d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:32:45.058466 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] HTTP exception thrown: floating IP not found Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Request method failure captured: Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action HTTP/1.1 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 41 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0W7xagMbEnH1uIuQq2wGVzI-_dEHzhKLpNHr_RAXTlYqMp8SWG_3hi8ZjVYlOu1XvBf9aJ5p0gbCn2OnqhkrghLEf4B948ayhkbgbH5xVuCPGVPll3hEPx1oar19hpVxmeh9GhaHR-_m43jsghGN55oxkBKfCb_7IYOdNFpxfoYo0 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36cd881902f945c2b1253364b13d0823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36cd881902f945c2b1253364b13d0823", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 6fd895513ff5473dbdf18a7aef8b65af Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: exception: floating IP not found Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd8c7fb2f-c8a5-4288-b068-1074ce9da4ba', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 01 10:32:45.060473 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.066559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Returning 404 to user: floating IP not found {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:45.067746 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-07dfc432-00a7-4ca7-b37b-f89b64ae82a8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action" status: 404 len: 67 microversion: 2.1 time: 0.878337 Jul 01 10:32:45.073237 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 807/1654] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:44 2022] POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action => generated 67 bytes in 886 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:32:45.078222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07c47fd4-ef30-4a12-a4b8-cacd48a75eee tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:45.079758 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:45.079758 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:45.081086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c47fd4-ef30-4a12-a4b8-cacd48a75eee tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:45.081667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c47fd4-ef30-4a12-a4b8-cacd48a75eee tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:45.082545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c47fd4-ef30-4a12-a4b8-cacd48a75eee tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:45.083054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c47fd4-ef30-4a12-a4b8-cacd48a75eee tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:45.108302 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-07c47fd4-ef30-4a12-a4b8-cacd48a75eee tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.033754 Jul 01 10:32:45.109212 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 808/1655] 10.222.0.23 () {60 vars in 1234 bytes} [Fri Jul 1 10:32:45 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:45.115159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:45.115159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:45.121827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:45.122879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:45.125228 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:45.125228 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:45.829236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:45.850829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:45.853114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:45.858511 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-051660d9-1cca-4213-b116-a66b68599612 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.748533 Jul 01 10:32:45.864399 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 809/1656] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:45 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:45.864399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e10207ab-a876-4453-9bc8-fc734ff2a8c8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Action: 'action', calling method: .version_select at 0x7f6f94a4a8b0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:45.963999 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e10207ab-a876-4453-9bc8-fc734ff2a8c8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e10207ab-a876-4453-9bc8-fc734ff2a8c8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Request method failure captured: Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action HTTP/1.1 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 44 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0W7xagMbEnH1uIuQq2wGVzI-_dEHzhKLpNHr_RAXTlYqMp8SWG_3hi8ZjVYlOu1XvBf9aJ5p0gbCn2OnqhkrghLEf4B948ayhkbgbH5xVuCPGVPll3hEPx1oar19hpVxmeh9GhaHR-_m43jsghGN55oxkBKfCb_7IYOdNFpxfoYo0 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36cd881902f945c2b1253364b13d0823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36cd881902f945c2b1253364b13d0823", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 6fd895513ff5473dbdf18a7aef8b65af Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: exception: Floating IP not found for address 0.0.0.0. Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd8c7fb2f-c8a5-4288-b068-1074ce9da4ba', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 01 10:32:45.966157 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e10207ab-a876-4453-9bc8-fc734ff2a8c8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e10207ab-a876-4453-9bc8-fc734ff2a8c8 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action" status: 404 len: 88 microversion: 2.1 time: 0.107052 Jul 01 10:32:45.972377 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 810/1657] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:32:45 2022] POST /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba/action => generated 88 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:32:45.974008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b34f7b6f-6d88-4f13-8a9c-ec5623cb10bb tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:45.982693 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:45.982693 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:45.984139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b34f7b6f-6d88-4f13-8a9c-ec5623cb10bb tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:45.984458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b34f7b6f-6d88-4f13-8a9c-ec5623cb10bb tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:45.985499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b34f7b6f-6d88-4f13-8a9c-ec5623cb10bb tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:45.985931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b34f7b6f-6d88-4f13-8a9c-ec5623cb10bb tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.039640 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b34f7b6f-6d88-4f13-8a9c-ec5623cb10bb tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.070177 Jul 01 10:32:46.042329 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 811/1658] 10.222.0.23 () {60 vars in 1177 bytes} [Fri Jul 1 10:32:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:46.045573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:46.046388 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:46.053851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.054660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.055731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.056341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.204461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a303c03a-270a-488d-8663-d8dabf09fad2 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3" status: 202 len: 0 microversion: 2.1 time: 1.992264 Jul 01 10:32:46.205758 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 848/1659] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:32:44 2022] DELETE /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3 => generated 0 bytes in 1993 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:46.216038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:46.217530 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:46.231269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.235484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.235484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.235484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.284264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:46.331721 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:46.536208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:46.544551 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3013d620-064f-4c8f-a958-34db14c44e67 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1534 microversion: 2.1 time: 0.502139 Jul 01 10:32:46.549465 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 812/1660] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:46 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1534 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:46.566063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb632b3d-95fa-4d58-9969-0e99ef1e27be tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:46.567356 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:46.567356 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:32:46.568629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb632b3d-95fa-4d58-9969-0e99ef1e27be tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.577925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb632b3d-95fa-4d58-9969-0e99ef1e27be tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.581292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb632b3d-95fa-4d58-9969-0e99ef1e27be tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.581292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb632b3d-95fa-4d58-9969-0e99ef1e27be tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.634264 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e7564b2-aa32-448c-be1f-b1000ec077e1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 204 len: 0 microversion: 2.1 time: 0.423048 Jul 01 10:32:46.641238 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 849/1661] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:46 2022] DELETE /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:46.643688 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb632b3d-95fa-4d58-9969-0e99ef1e27be tempest-ServicesAdminNegativeV253TestJSON-242773610 tempest-ServicesAdminNegativeV253TestJSON-242773610-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.081298 Jul 01 10:32:46.650646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-002f662a-6a7a-4502-8bb3-fefae95c2d33 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f926de550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:46.651163 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 813/1662] 10.222.0.23 () {60 vars in 1238 bytes} [Fri Jul 1 10:32:46 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:46.656644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:46.666299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:46.673553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.677610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.678759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:46.679383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:46.808756 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-002f662a-6a7a-4502-8bb3-fefae95c2d33 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:32:46.809670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-002f662a-6a7a-4502-8bb3-fefae95c2d33 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group 31595849-325f-492b-b4f1-26d0c745a6e3 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:32:46.810368 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-002f662a-6a7a-4502-8bb3-fefae95c2d33 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:32:46.810368 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-32f753a8-ff9a-4f6a-b0f2-923eb3f3a15e'] Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-002f662a-6a7a-4502-8bb3-fefae95c2d33 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3 HTTP/1.1 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-32f753a8-ff9a-4f6a-b0f2-923eb3f3a15e'] Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '31595849-325f-492b-b4f1-26d0c745a6e3'} Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:32:46.812710 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32f753a8-ff9a-4f6a-b0f2-923eb3f3a15e'] Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32f753a8-ff9a-4f6a-b0f2-923eb3f3a15e'] Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32f753a8-ff9a-4f6a-b0f2-923eb3f3a15e'] Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32f753a8-ff9a-4f6a-b0f2-923eb3f3a15e'] Jul 01 10:32:46.817860 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:46.821686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-002f662a-6a7a-4502-8bb3-fefae95c2d33 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:32:46.821686 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-32f753a8-ff9a-4f6a-b0f2-923eb3f3a15e'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:46.822817 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-002f662a-6a7a-4502-8bb3-fefae95c2d33 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3" status: 404 len: 194 microversion: 2.1 time: 0.180126 Jul 01 10:32:46.823855 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 850/1663] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:32:46 2022] GET /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3 => generated 194 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:47.066921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6492fd5d-cc6b-4eb0-954d-fda9a1e8dec3 tempest-ServicesAdminNegativeV253TestJSON-2111131294 tempest-ServicesAdminNegativeV253TestJSON-2111131294-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:47.069729 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:32:47.069729 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:32:47.072156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6492fd5d-cc6b-4eb0-954d-fda9a1e8dec3 tempest-ServicesAdminNegativeV253TestJSON-2111131294 tempest-ServicesAdminNegativeV253TestJSON-2111131294-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3fa34dddec744a619af244f052948b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f45431f0a74291a563d8568038fa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6492fd5d-cc6b-4eb0-954d-fda9a1e8dec3 tempest-ServicesAdminNegativeV253TestJSON-2111131294 tempest-ServicesAdminNegativeV253TestJSON-2111131294-project] Request method failure captured: Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1Ef82zI92Tb5tfdbLyoAGexXNpPckmodSs1LTJn728IO_BjGLLVxx0HAb7rxKI2xwnG0qKusYkj1vrQUeQzsMRyPI04alzEg88hojNpCnz2x1MKFOmp9jzUcEvhkjAUA-1MLQ3Fjncb1e6PdoTpHaT8-pBLlZSEWbqN4XOw8JQr60 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.53 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 98f45431f0a74291a563d8568038fa11 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2111131294 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98f45431f0a74291a563d8568038fa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/98f45431f0a74291a563d8568038fa11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_98f45431f0a74291a563d8568038fa11", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98f45431f0a74291a563d8568038fa11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2111131294 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 98f45431f0a74291a563d8568038fa11 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2111131294 Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2111131294-project Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 3fa34dddec744a619af244f052948b4b Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2111131294-project Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: action_args: {} Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 01 10:32:47.074569 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6492fd5d-cc6b-4eb0-954d-fda9a1e8dec3 tempest-ServicesAdminNegativeV253TestJSON-2111131294 tempest-ServicesAdminNegativeV253TestJSON-2111131294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6492fd5d-cc6b-4eb0-954d-fda9a1e8dec3 tempest-ServicesAdminNegativeV253TestJSON-2111131294 tempest-ServicesAdminNegativeV253TestJSON-2111131294-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.251046 Jul 01 10:32:47.079931 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 851/1664] 10.222.0.23 () {60 vars in 1177 bytes} [Fri Jul 1 10:32:46 2022] GET /compute/v2.1/os-services => generated 112 bytes in 252 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:32:47.091905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4da598cb-3609-4471-9ffa-7c088a2d5efd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91b094c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:47.396857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:47.411772 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-59fd3300-e52c-4369-9f86-cbcda54ec8f4 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1541 microversion: 2.1 time: 0.756030 Jul 01 10:32:47.413277 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 814/1665] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:46 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1541 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:47.433603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:47.434878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:47.463849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:47.464427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:47.465364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:47.465870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:47.821693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:47.833812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:47.836975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:47.838756 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e43b188-a43d-41f4-9e8b-aca091dc4503 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.424472 Jul 01 10:32:47.839838 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 815/1666] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:47 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:47.845763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8f4f5160-525c-4f44-a3cf-9000a94a0bd7 req-ea35343a-fedb-4ec6-a542-6e70fbb5cec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9245057-43b9-492e-8f86-ac014664d207", "name": "network-vif-deleted", "tag": "c0c447ef-8eab-4c35-96c1-29d659a0f21b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:47.855465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8f4f5160-525c-4f44-a3cf-9000a94a0bd7 req-ea35343a-fedb-4ec6-a542-6e70fbb5cec0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:47.856833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8f4f5160-525c-4f44-a3cf-9000a94a0bd7 req-ea35343a-fedb-4ec6-a542-6e70fbb5cec0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:47.901246 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8f4f5160-525c-4f44-a3cf-9000a94a0bd7 req-ea35343a-fedb-4ec6-a542-6e70fbb5cec0 service nova] Creating event network-vif-deleted:c0c447ef-8eab-4c35-96c1-29d659a0f21b for instance f9245057-43b9-492e-8f86-ac014664d207 on n-h2-master-1 Jul 01 10:32:47.913172 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8f4f5160-525c-4f44-a3cf-9000a94a0bd7 req-ea35343a-fedb-4ec6-a542-6e70fbb5cec0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071188 Jul 01 10:32:47.916327 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 816/1667] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:47.935023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:47.939565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:47.952488 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4da598cb-3609-4471-9ffa-7c088a2d5efd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154" status: 202 len: 0 microversion: 2.1 time: 0.867324 Jul 01 10:32:47.954888 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 852/1668] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:32:47 2022] DELETE /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154 => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:47.964449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3430247-e360-4996-864f-7e911177a916 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91ed1ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:47.984223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:47.984724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:47.985577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:47.986021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:48.475112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:48.483590 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f5d792e4-f843-4b44-be6f-08ed8ab5c321 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 200 len: 1492 microversion: 2.1 time: 0.559527 Jul 01 10:32:48.486238 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 817/1669] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:47 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 1492 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:48.497787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:48.508768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:48.532993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:48.533494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:48.534517 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:48.535164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:48.573483 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-b3430247-e360-4996-864f-7e911177a916 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:32:48.574295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-b3430247-e360-4996-864f-7e911177a916 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group 166d0542-c07b-4949-9cdc-cbd439a06154 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b3430247-e360-4996-864f-7e911177a916 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a0b57ba5-be75-42b9-9c75-96a23a2d7c4d'] Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3430247-e360-4996-864f-7e911177a916 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154 HTTP/1.1 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a0b57ba5-be75-42b9-9c75-96a23a2d7c4d'] Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '166d0542-c07b-4949-9cdc-cbd439a06154'} Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:32:48.578209 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b57ba5-be75-42b9-9c75-96a23a2d7c4d'] Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b57ba5-be75-42b9-9c75-96a23a2d7c4d'] Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b57ba5-be75-42b9-9c75-96a23a2d7c4d'] Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b57ba5-be75-42b9-9c75-96a23a2d7c4d'] Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3430247-e360-4996-864f-7e911177a916 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:32:48.583301 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a0b57ba5-be75-42b9-9c75-96a23a2d7c4d'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:48.588283 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3430247-e360-4996-864f-7e911177a916 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154" status: 404 len: 194 microversion: 2.1 time: 0.620579 Jul 01 10:32:48.588657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 853/1670] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:32:47 2022] GET /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154 => generated 194 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:48.620854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-994190b0-1fcb-4b97-a44c-a618bfa8a109 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f926de310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:48.996382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:49.012520 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d47c159-18e6-40a3-b624-172228ef70ba tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1541 microversion: 2.1 time: 0.519720 Jul 01 10:32:49.015908 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 818/1671] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:48 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1541 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:49.031809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:49.032416 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:49.067236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:49.069162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:49.073259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:49.074085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:49.091911 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:49.793435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:49.809688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:49.813912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:49.815180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-13f9a994-6b9c-4628-8aa6-2ef53c94e1c2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.798215 Jul 01 10:32:49.819103 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 819/1672] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:49 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:49.835438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fa1db5a3-6023-4887-af79-8ae421e3790a req-77f783c2-f7ff-4c7e-a4fa-24f1febc59e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730", "name": "network-vif-unplugged", "status": "completed", "tag": "b53fda29-dab0-4898-920d-4dd9caf3daae"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:49.880522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fa1db5a3-6023-4887-af79-8ae421e3790a req-77f783c2-f7ff-4c7e-a4fa-24f1febc59e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:49.881443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fa1db5a3-6023-4887-af79-8ae421e3790a req-77f783c2-f7ff-4c7e-a4fa-24f1febc59e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:49.919872 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fa1db5a3-6023-4887-af79-8ae421e3790a req-77f783c2-f7ff-4c7e-a4fa-24f1febc59e4 service nova] Creating event network-vif-unplugged:b53fda29-dab0-4898-920d-4dd9caf3daae for instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 on n-h1-master-1 Jul 01 10:32:49.939877 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fa1db5a3-6023-4887-af79-8ae421e3790a req-77f783c2-f7ff-4c7e-a4fa-24f1febc59e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113656 Jul 01 10:32:49.942921 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 820/1673] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:49.962280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:49.962280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: f9245057-43b9-492e-8f86-ac014664d207] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:49.973856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:49.975337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:49.977503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:49.978292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:49.979367 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-994190b0-1fcb-4b97-a44c-a618bfa8a109 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 1.386580 Jul 01 10:32:49.981422 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 854/1674] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:32:48 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:49.994849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91f627c7-73e9-472a-9c28-02076635e330 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f91f8cd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-128532285", "description": "tempest-description-2128657392"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:50.029230 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] HTTP exception thrown: Instance f9245057-43b9-492e-8f86-ac014664d207 could not be found. Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Request method failure captured: Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 HTTP/1.1 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvg3XNKRper89DBZxtwlWelu2zVyvYAjoVW1xR5EbzSvtkoBlN11YpNQsFcYFdApA1U-HtRg_YbPGIqrBrq3VYi8fGeLVfgFQd8nFyp6SbAPJdMVvFS3muhSLPWzb49TwRjTfFJXD7cAfGDIYIcyzWLYxDFIQE_5_3PYb3BsbCujIs Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_95422d1e22a44786abcef182c9b1a5ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-MigrationsAdminTest-1396652826 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0dcb8296a8934a8cbc89d6df73d4a526 Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f9245057-43b9-492e-8f86-ac014664d207 could not be found. Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f9245057-43b9-492e-8f86-ac014664d207'} Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9245057-43b9-492e-8f86-ac014664d207 could not be found. Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9245057-43b9-492e-8f86-ac014664d207 could not be found. Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:50.032814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:50.038136 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:50.038136 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:50.038136 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:50.038136 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:50.038136 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:50.038136 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9245057-43b9-492e-8f86-ac014664d207 could not be found. Jul 01 10:32:50.038136 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:50.039636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Returning 404 to user: Instance f9245057-43b9-492e-8f86-ac014664d207 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:50.042821 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b56de95-9a87-44eb-9a42-5acb0ecd454b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207" status: 404 len: 111 microversion: 2.1 time: 0.098068 Jul 01 10:32:50.045181 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 821/1675] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:49 2022] GET /compute/v2.1/servers/f9245057-43b9-492e-8f86-ac014664d207 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:50.058339 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:50.061233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:50.074544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:50.075068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:50.075874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:50.076309 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:50.624344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:50.642099 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-642e8eaf-13e9-4e09-99c4-c06a0b40ce77 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1541 microversion: 2.1 time: 0.590828 Jul 01 10:32:50.659768 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 822/1676] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:50 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1541 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:50.676809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-202d4a66-00a0-4ff9-ad16-88296b8647b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '.version_select at 0x7f6f9713cca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:50.863066 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-202d4a66-00a0-4ff9-ad16-88296b8647b9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-756475534" status: 202 len: 0 microversion: 2.1 time: 0.201129 Jul 01 10:32:50.869800 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 823/1677] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:32:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-756475534 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:32:50.870068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d33e9d5e-e48c-4b19-a130-9589a55756ff req-8317eeea-ac66-4665-9220-33758e92eabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c7fb2f-c8a5-4288-b068-1074ce9da4ba", "name": "network-vif-deleted", "tag": "f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:50.898328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d33e9d5e-e48c-4b19-a130-9589a55756ff req-8317eeea-ac66-4665-9220-33758e92eabe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:50.902061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d33e9d5e-e48c-4b19-a130-9589a55756ff req-8317eeea-ac66-4665-9220-33758e92eabe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:50.953429 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d33e9d5e-e48c-4b19-a130-9589a55756ff req-8317eeea-ac66-4665-9220-33758e92eabe service nova] Creating event network-vif-deleted:f7a2ff18-8f71-4fe5-b1bf-ee03593a4d69 for instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba on n-h2-master-1 Jul 01 10:32:50.969734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d33e9d5e-e48c-4b19-a130-9589a55756ff req-8317eeea-ac66-4665-9220-33758e92eabe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104511 Jul 01 10:32:50.978646 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 824/1678] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:51.000342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:51.003145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:51.021829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:51.024662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:51.026204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:51.030577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:51.291336 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91f627c7-73e9-472a-9c28-02076635e330 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.301497 Jul 01 10:32:51.292794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 855/1679] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:32:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:51.303806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d867f8cc-a9af-4a0a-9e6f-f7e245788a86 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f92064c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1068876452", "description": "tempest-description-494027141"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:51.436536 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:51.529313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:51.561717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:51.564726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:51.579232 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5973426a-dcfb-4508-9668-48899ccb4c9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.598496 Jul 01 10:32:51.582670 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 825/1680] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:50 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:51.678572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:51.678572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:51.682563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:51.685899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:51.687048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:51.687288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:51.730782 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:51.737291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:51.738126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:51.738582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lazy-loading 'fault' on Instance uuid d8c7fb2f-c8a5-4288-b068-1074ce9da4ba {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:32:51.834982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd895513ff5473dbdf18a7aef8b65af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cd881902f945c2b1253364b13d0823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:51.843182 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ed0d6305-c904-4965-8d36-1c62071a89f1 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 200 len: 1321 microversion: 2.1 time: 0.179222 Jul 01 10:32:51.852615 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 826/1681] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:51 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:32:52.058501 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d867f8cc-a9af-4a0a-9e6f-f7e245788a86 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.758422 Jul 01 10:32:52.060051 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 856/1682] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:32:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:52.208449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-35670162", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "93cdd59a-6d6e-4390-8a35-7e503398b9db"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:52.287970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] validate_networks() for [('93cdd59a-6d6e-4390-8a35-7e503398b9db', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:32:52.600253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:52.601067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:52.603831 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:32:52.621089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:52.622146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:52.623172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:52.623617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:52.924343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:52.934953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:52.936977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:52.938217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c04b2134-3e2f-4e7f-a6de-ac2852414ff6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.342137 Jul 01 10:32:52.938775 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 857/1683] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:52 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:52.943609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:52.944200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:52.951415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:52.952656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.036339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.036339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.036339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:32:53.044490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:32:53.044902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:32:53.045412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:32:53.045825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:32:53.046238 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:32:53.055177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.055630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.056701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.057161 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.074710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Getting quotas for project 8771160d78704ad687c0ea474b14d6e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:32:53.079972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Getting quotas for user 275daef9a0aa460aaecb90de5e035c4d and project 8771160d78704ad687c0ea474b14d6e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:32:53.092576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:32:53.094989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:32:53.451162 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7e9da7a-0a12-4a70-8a38-0c82b6297b93 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.246369 Jul 01 10:32:53.452139 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 827/1684] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:32:53.459622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:53.460569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] [instance: d8c7fb2f-c8a5-4288-b068-1074ce9da4ba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:53.486583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.490381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.492687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.493392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.523930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] HTTP exception thrown: Instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba could not be found. Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Request method failure captured: Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba HTTP/1.1 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0W7xagMbEnH1uIuQq2wGVzI-_dEHzhKLpNHr_RAXTlYqMp8SWG_3hi8ZjVYlOu1XvBf9aJ5p0gbCn2OnqhkrghLEf4B948ayhkbgbH5xVuCPGVPll3hEPx1oar19hpVxmeh9GhaHR-_m43jsghGN55oxkBKfCb_7IYOdNFpxfoYo0 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36cd881902f945c2b1253364b13d0823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36cd881902f945c2b1253364b13d0823", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36cd881902f945c2b1253364b13d0823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 36cd881902f945c2b1253364b13d0823 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 6fd895513ff5473dbdf18a7aef8b65af Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: exception: Instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba could not be found. Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd8c7fb2f-c8a5-4288-b068-1074ce9da4ba'} Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba could not be found. Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba could not be found. Jul 01 10:32:53.525563 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba could not be found. Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] Returning 404 to user: Instance d8c7fb2f-c8a5-4288-b068-1074ce9da4ba could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f41c2b9-829a-40bc-914a-437b284cb89f tempest-FloatingIPsAssociationNegativeTestJSON-1298001108 tempest-FloatingIPsAssociationNegativeTestJSON-1298001108-project] 10.222.0.23 "GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba" status: 404 len: 111 microversion: 2.1 time: 0.073638 Jul 01 10:32:53.531640 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 828/1685] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:53 2022] GET /compute/v2.1/servers/d8c7fb2f-c8a5-4288-b068-1074ce9da4ba => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:32:53.538104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a0bdab11-8f33-4104-8166-f8e55fbf9a38 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:53.541204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a0bdab11-8f33-4104-8166-f8e55fbf9a38 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:53.679927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a0bdab11-8f33-4104-8166-f8e55fbf9a38 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:53.694324 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-935fbae3-b471-45fb-8415-6e7f75695f0b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "DELETE /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 204 len: 0 microversion: 2.1 time: 0.754289 Jul 01 10:32:53.696007 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 858/1686] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:32:52 2022] DELETE /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:32:53.698023 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a0bdab11-8f33-4104-8166-f8e55fbf9a38 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1214 microversion: 2.1 time: 0.154530 Jul 01 10:32:53.702467 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 829/1687] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:53 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:53.713472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:53.714510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:53.727104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.729461 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.730460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.732794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.958562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:53.959122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:53.972470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.972911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:53.973718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:53.979289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:54.224210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:54.233749 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-90dac638-a696-492f-87d5-43aab203ff2b tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1468 microversion: 2.1 time: 0.533353 Jul 01 10:32:54.242185 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 859/1688] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:53 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1468 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:54.294421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:54.303021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:54.304509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:54.310135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eee8409a-91e4-43b0-836e-7f1009be151b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 0.355639 Jul 01 10:32:54.315618 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 830/1689] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:53 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:54.719183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a3cc01a-aa38-42f4-b964-c9d6f74c4295 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:54.720707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0a3cc01a-aa38-42f4-b964-c9d6f74c4295 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:54.847764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0a3cc01a-aa38-42f4-b964-c9d6f74c4295 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:54.856531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a3cc01a-aa38-42f4-b964-c9d6f74c4295 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1214 microversion: 2.1 time: 0.140610 Jul 01 10:32:54.878337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 860/1690] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:54 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:55.257866 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:55.258487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:55.275043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:55.275499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:55.276301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:55.276740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:55.331396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:55.332839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:55.348645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:55.350534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:55.352756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:55.354976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:56.340983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:56.356901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:56.379802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:56.383344 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62b35d00-795d-434c-b693-c8a4774105ca tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 1.057770 Jul 01 10:32:56.383955 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 861/1691] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:55 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:56.405725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:56.412135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:56.428824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:56.429794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:56.430978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:56.431845 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:56.595707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:56.633100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-84e14059-f8ab-4216-97fc-bfed21214d96 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1468 microversion: 2.1 time: 1.379129 Jul 01 10:32:56.633747 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 831/1692] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:55 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1468 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:56.776385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:56.797103 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3ce39ab-a0dc-4833-a9be-a74381ac6661 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1274 microversion: 2.1 time: 0.412041 Jul 01 10:32:56.802072 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 862/1693] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:56 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1274 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:57.402367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:57.404183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:57.415624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:57.420094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:57.422024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:57.423732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:57.650711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:57.652032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:57.665395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:57.668781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:57.669982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:57.674058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:58.099669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:58.119298 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-368e1942-74e6-4365-968b-f8c621105981 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1426 microversion: 2.1 time: 0.470063 Jul 01 10:32:58.122164 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 863/1694] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:57 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1426 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:32:58.149342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:58.154493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:58.191144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:58.195147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:58.199060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:58.199060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:58.466168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:58.481234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:58.484461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:58.486561 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c3ff056-a61d-48ba-a2ba-f2cba91b83cc tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1812 microversion: 2.25 time: 1.088305 Jul 01 10:32:58.488237 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 832/1695] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:57 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1812 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:32:58.540138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-39dc2eae-d31e-4666-9c86-dc63a311c729 req-6b432e92-c607-4357-b1e2-368d205479dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802599b4-c743-4f1b-8677-94390fac1ecb", "name": "network-vif-deleted", "tag": "8340628d-90db-44e1-9112-2951c74f2772"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:32:58.560043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-39dc2eae-d31e-4666-9c86-dc63a311c729 req-6b432e92-c607-4357-b1e2-368d205479dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:58.560394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-39dc2eae-d31e-4666-9c86-dc63a311c729 req-6b432e92-c607-4357-b1e2-368d205479dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:58.591955 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-39dc2eae-d31e-4666-9c86-dc63a311c729 req-6b432e92-c607-4357-b1e2-368d205479dc service nova] Creating event network-vif-deleted:8340628d-90db-44e1-9112-2951c74f2772 for instance 802599b4-c743-4f1b-8677-94390fac1ecb on n-h2-master-1 Jul 01 10:32:58.609413 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-39dc2eae-d31e-4666-9c86-dc63a311c729 req-6b432e92-c607-4357-b1e2-368d205479dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067700 Jul 01 10:32:58.610224 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 833/1696] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:32:58.616242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:32:58.629954 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0bd1a198-0c3e-468b-b1dc-0b940ced794f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1272 microversion: 2.1 time: 0.506074 Jul 01 10:32:58.641002 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 864/1697] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:58 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1272 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:32:59.150131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:59.151151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:59.178782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:59.179342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:59.181922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:59.183115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:59.282675 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:59.292292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:59.292913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lazy-loading 'fault' on Instance uuid 802599b4-c743-4f1b-8677-94390fac1ecb {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:32:59.509763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:32:59.511305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:32:59.536389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:59.546968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:32:59.550407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:32:59.551869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:00.201998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:00.227240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7268e31-349c-4f2c-b325-342d917fac49 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 200 len: 1303 microversion: 2.1 time: 1.079310 Jul 01 10:33:00.227240 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 834/1698] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:32:59 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 1303 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:00.242647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:00.247126 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:00.279645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:00.282306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:00.285538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:00.286282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:00.834569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:00.844345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:00.858501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:00.864962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1fca140-461f-4c9d-8dca-b7a9b9965577 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1802 microversion: 2.25 time: 1.360247 Jul 01 10:33:00.866076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 865/1699] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:32:59 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1802 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:33:00.890198 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0b6b75c-0ad1-4638-99dd-fef2f4c36a77 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '.version_select at 0x7f6f92064ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:00.900106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0b6b75c-0ad1-4638-99dd-fef2f4c36a77 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:00.902175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0b6b75c-0ad1-4638-99dd-fef2f4c36a77 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:00.963137 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0b6b75c-0ad1-4638-99dd-fef2f4c36a77 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.080418 Jul 01 10:33:00.967379 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 866/1700] 10.222.0.23 () {60 vars in 1183 bytes} [Fri Jul 1 10:33:00 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:33:00.989197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:00.989197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:01.012908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.013421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:01.017109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.017109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:01.292249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:01.310597 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09f3ee30-2a37-43e7-af17-94ec65283fb9 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 1.088519 Jul 01 10:33:01.313535 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 835/1701] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:00 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:01.335591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:01.337992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 802599b4-c743-4f1b-8677-94390fac1ecb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:01.359066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.360280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:01.363410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.363966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:01.399083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] HTTP exception thrown: Instance 802599b4-c743-4f1b-8677-94390fac1ecb could not be found. Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Request method failure captured: Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb HTTP/1.1 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsvg3XNKRper89DBZxtwlWelu2zVyvYAjoVW1xR5EbzSvtkoBlN11YpNQsFcYFdApA1U-HtRg_YbPGIqrBrq3VYi8fGeLVfgFQd8nFyp6SbAPJdMVvFS3muhSLPWzb49TwRjTfFJXD7cAfGDIYIcyzWLYxDFIQE_5_3PYb3BsbCujIs Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_95422d1e22a44786abcef182c9b1a5ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-MigrationsAdminTest-1396652826 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0dcb8296a8934a8cbc89d6df73d4a526 Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 802599b4-c743-4f1b-8677-94390fac1ecb could not be found. Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '802599b4-c743-4f1b-8677-94390fac1ecb'} Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802599b4-c743-4f1b-8677-94390fac1ecb could not be found. Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802599b4-c743-4f1b-8677-94390fac1ecb could not be found. Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:01.404208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:01.410046 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:01.410046 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:01.410046 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:01.410046 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:01.410046 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:01.410046 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802599b4-c743-4f1b-8677-94390fac1ecb could not be found. Jul 01 10:33:01.410046 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:01.413570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Returning 404 to user: Instance 802599b4-c743-4f1b-8677-94390fac1ecb could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:01.415917 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-630ce256-ba59-42af-8df6-c47f7aceb4f2 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb" status: 404 len: 111 microversion: 2.1 time: 0.100174 Jul 01 10:33:01.419703 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 836/1702] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:01 2022] GET /compute/v2.1/servers/802599b4-c743-4f1b-8677-94390fac1ecb => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:01.457928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:01.457928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:01.476823 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.480456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:01.497657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.499061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:01.564223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:33:01.608685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:33:01.646593 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-511ed1b7-c883-498d-86b1-4e867db54199 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 2420 microversion: 2.25 time: 0.670043 Jul 01 10:33:01.651509 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 867/1703] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:33:00 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 2420 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:33:01.677308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:01.685768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:01.707915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.710426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:01.711870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:01.712601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:02.031665 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-40ffaf70-e953-4ce8-8a83-ceba0d5148c9 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 204 len: 0 microversion: 2.1 time: 0.600406 Jul 01 10:33:02.032490 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 837/1704] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:33:01 2022] DELETE /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:33:02.040823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:02.041574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:02.057575 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:02.058061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:02.061832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:02.062332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:02.351031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:33:02.379835 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dccce48b-3766-4043-bada-e3382ac3ce61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 2420 microversion: 2.25 time: 0.713822 Jul 01 10:33:02.413130 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 868/1705] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:33:01 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 2420 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:33:02.434660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:02.440913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:02.448141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:02.448589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:02.449476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:02.459521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:02.619771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:02.645291 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f7f6cfb-0f1b-425e-9bc6-2c3ecf7d3dd6 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1468 microversion: 2.1 time: 0.608306 Jul 01 10:33:02.647016 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 838/1706] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:02 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1468 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:02.654438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:02.655205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:02.662338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:02.677579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:02.679340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:02.679816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:02.944206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lazy-loading 'services' on Instance uuid 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:33:02.948610 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:03.024565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:03.033661 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73ffa7e5-541b-426f-8361-8e5f482b6bcc tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 0.619128 Jul 01 10:33:03.036571 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 869/1707] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:02 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:03.065467 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=18 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:03.155280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c29c7872-ab3d-4397-87cc-422850ebe0f3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "DELETE /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments/2a5f5030-fd70-44b5-b844-2e252af6fc7f" status: 202 len: 0 microversion: 2.25 time: 0.506272 Jul 01 10:33:03.157192 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 839/1708] 10.222.0.23 () {60 vars in 1456 bytes} [Fri Jul 1 10:33:02 2022] DELETE /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments/2a5f5030-fd70-44b5-b844-2e252af6fc7f => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:33:03.181856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4197632-896b-4dd5-96fb-73cae34ae9ae tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:03.192056 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4197632-896b-4dd5-96fb-73cae34ae9ae tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:03.208768 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4197632-896b-4dd5-96fb-73cae34ae9ae tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:03.217778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4197632-896b-4dd5-96fb-73cae34ae9ae tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:03.218898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4197632-896b-4dd5-96fb-73cae34ae9ae tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:03.219352 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4197632-896b-4dd5-96fb-73cae34ae9ae tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:03.265627 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4197632-896b-4dd5-96fb-73cae34ae9ae tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097244 Jul 01 10:33:03.270965 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 870/1709] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:33:03 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:03.665380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:03.666595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:03.677021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:03.677955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:03.678979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:03.679704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:03.685993 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:04.053853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:04.053853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:04.075202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:04.075933 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:04.078790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:04.079248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:04.116840 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:04.790491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcb8296a8934a8cbc89d6df73d4a526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95422d1e22a44786abcef182c9b1a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:04.802676 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8a87cd45-8d26-4922-a70b-35181a47042f tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 200 len: 1468 microversion: 2.1 time: 1.142845 Jul 01 10:33:04.816526 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 840/1710] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:03 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 1468 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:04.828152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-79fce45a-8c01-47d9-85e2-d7d2a7d241ef req-51ee0c07-4397-4cb4-93b9-62cca5017f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0327eb-9856-41c6-a66c-3833fb79f56c", "name": "network-vif-deleted", "tag": "66607fcc-6805-4701-81e1-1a67c103b4d0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:04.838413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-79fce45a-8c01-47d9-85e2-d7d2a7d241ef req-51ee0c07-4397-4cb4-93b9-62cca5017f44 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:04.839091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-79fce45a-8c01-47d9-85e2-d7d2a7d241ef req-51ee0c07-4397-4cb4-93b9-62cca5017f44 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:04.854780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-79fce45a-8c01-47d9-85e2-d7d2a7d241ef req-51ee0c07-4397-4cb4-93b9-62cca5017f44 service nova] Creating event network-vif-deleted:66607fcc-6805-4701-81e1-1a67c103b4d0 for instance 0a0327eb-9856-41c6-a66c-3833fb79f56c on n-h1-master-1 Jul 01 10:33:04.856424 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:04.865458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-79fce45a-8c01-47d9-85e2-d7d2a7d241ef req-51ee0c07-4397-4cb4-93b9-62cca5017f44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044490 Jul 01 10:33:04.866730 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 841/1711] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:04.875503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:04.876401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:04.884948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:04.885690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:04.887408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:04.888021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:05.829268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:05.841801 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c2bc7990-a545-4424-ae99-ecf9d74612fd tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 1.792640 Jul 01 10:33:05.849401 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 871/1712] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:04 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:05.849401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99c3670d-5dcd-4408-b2f8-1f3626d35bd9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:05.849401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99c3670d-5dcd-4408-b2f8-1f3626d35bd9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:05.870670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c3670d-5dcd-4408-b2f8-1f3626d35bd9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:05.876758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c3670d-5dcd-4408-b2f8-1f3626d35bd9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:05.877925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c3670d-5dcd-4408-b2f8-1f3626d35bd9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:05.878535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c3670d-5dcd-4408-b2f8-1f3626d35bd9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:05.964011 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99c3670d-5dcd-4408-b2f8-1f3626d35bd9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109434 Jul 01 10:33:05.964011 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 872/1713] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:33:05 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:05.974294 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c45738a1-34a3-4086-a477-6cc6266ca1ca req-1bb20e88-69fe-4b8b-a1a0-e33f904fb2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd8f777-3dba-4731-b2b4-00d4b2466d00", "tag": "af79b018-1aee-4c87-902c-a90dcbde6f91"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:05.994616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c45738a1-34a3-4086-a477-6cc6266ca1ca req-1bb20e88-69fe-4b8b-a1a0-e33f904fb2e8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:05.995467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c45738a1-34a3-4086-a477-6cc6266ca1ca req-1bb20e88-69fe-4b8b-a1a0-e33f904fb2e8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:06.016647 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c45738a1-34a3-4086-a477-6cc6266ca1ca req-1bb20e88-69fe-4b8b-a1a0-e33f904fb2e8 service nova] Creating event network-changed:af79b018-1aee-4c87-902c-a90dcbde6f91 for instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 on n-h2-master-1 Jul 01 10:33:06.031553 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c45738a1-34a3-4086-a477-6cc6266ca1ca req-1bb20e88-69fe-4b8b-a1a0-e33f904fb2e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069112 Jul 01 10:33:06.035522 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 873/1714] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:06.046240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:06.047836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] [instance: 0a0327eb-9856-41c6-a66c-3833fb79f56c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:06.066890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:06.067770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:06.068819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:06.071216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:06.104019 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] HTTP exception thrown: Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c could not be found. Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Request method failure captured: Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c HTTP/1.1 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsvg3XNKRper89DBZxtwlWelu2zVyvYAjoVW1xR5EbzSvtkoBlN11YpNQsFcYFdApA1U-HtRg_YbPGIqrBrq3VYi8fGeLVfgFQd8nFyp6SbAPJdMVvFS3muhSLPWzb49TwRjTfFJXD7cAfGDIYIcyzWLYxDFIQE_5_3PYb3BsbCujIs Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_95422d1e22a44786abcef182c9b1a5ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95422d1e22a44786abcef182c9b1a5ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MigrationsAdminTest-1396652826 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 95422d1e22a44786abcef182c9b1a5ca Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MigrationsAdminTest-1396652826 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 0dcb8296a8934a8cbc89d6df73d4a526 Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MigrationsAdminTest-1396652826-project Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c could not be found. Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0a0327eb-9856-41c6-a66c-3833fb79f56c'} Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c could not be found. Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c could not be found. Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:06.107336 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c could not be found. Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] Returning 404 to user: Instance 0a0327eb-9856-41c6-a66c-3833fb79f56c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-400fbaa5-5901-46f7-8eaa-4a5b84800378 tempest-MigrationsAdminTest-1396652826 tempest-MigrationsAdminTest-1396652826-project] 10.222.0.23 "GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c" status: 404 len: 111 microversion: 2.1 time: 0.074628 Jul 01 10:33:06.117651 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 874/1715] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:06 2022] GET /compute/v2.1/servers/0a0327eb-9856-41c6-a66c-3833fb79f56c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:06.426812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:06.436126 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f9817250-2109-4c2c-a693-6d79a9e062ab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 1.568006 Jul 01 10:33:06.441241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 842/1716] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:04 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:06.463024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abb85886-1966-4f4c-ac9b-f3a66434b170 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-49378011"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:06.463024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-abb85886-1966-4f4c-ac9b-f3a66434b170 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:06.472436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abb85886-1966-4f4c-ac9b-f3a66434b170 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:06.472891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abb85886-1966-4f4c-ac9b-f3a66434b170 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:06.473706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abb85886-1966-4f4c-ac9b-f3a66434b170 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:06.474150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abb85886-1966-4f4c-ac9b-f3a66434b170 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:06.874850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:06.875319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:06.891121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:06.891571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:06.892382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:06.904951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:07.568496 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-abb85886-1966-4f4c-ac9b-f3a66434b170 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 1.111756 Jul 01 10:33:07.571314 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 875/1717] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:33:06 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 01 10:33:07.597333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:07.605735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1af18cfb-5fe9-4a10-aec2-29fdd224dfa8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:07.612853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1af18cfb-5fe9-4a10-aec2-29fdd224dfa8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:07.616622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-54113909-c03b-464d-a5cc-221bb19eb890 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 0.760215 Jul 01 10:33:07.630413 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 843/1718] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:06 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:07.652153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1af18cfb-5fe9-4a10-aec2-29fdd224dfa8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:07.652634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1af18cfb-5fe9-4a10-aec2-29fdd224dfa8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:07.657846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:07.659229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1af18cfb-5fe9-4a10-aec2-29fdd224dfa8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:07.660799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1af18cfb-5fe9-4a10-aec2-29fdd224dfa8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:07.661133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:07.695612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:07.700379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:07.749674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:07.757718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.052s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:07.795697 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1af18cfb-5fe9-4a10-aec2-29fdd224dfa8 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.222630 Jul 01 10:33:07.804318 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 876/1719] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:33:07 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:08.128292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c15f7b17-2b72-486d-8277-b872c4c66f6d req-a147ac7a-63de-4213-890e-fd84d860850c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-unplugged", "status": "completed", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:08.148679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c15f7b17-2b72-486d-8277-b872c4c66f6d req-a147ac7a-63de-4213-890e-fd84d860850c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:08.151556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c15f7b17-2b72-486d-8277-b872c4c66f6d req-a147ac7a-63de-4213-890e-fd84d860850c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:08.172229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:08.179065 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c15f7b17-2b72-486d-8277-b872c4c66f6d req-a147ac7a-63de-4213-890e-fd84d860850c service nova] Creating event network-vif-unplugged:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:33:08.179999 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d14fa6f7-4671-4bb7-a7ce-b848dbba0a27 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.546320 Jul 01 10:33:08.180877 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 844/1720] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:07 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:08.194717 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c15f7b17-2b72-486d-8277-b872c4c66f6d req-a147ac7a-63de-4213-890e-fd84d860850c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069732 Jul 01 10:33:08.196318 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 877/1721] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:08.738980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:08.738980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:08.738980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:08.738980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:08.738980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:08.738980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:08.809216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67d08641-c682-44a0-8aa1-684a2739fe4b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:08.810324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67d08641-c682-44a0-8aa1-684a2739fe4b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:08.822960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67d08641-c682-44a0-8aa1-684a2739fe4b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:08.844487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67d08641-c682-44a0-8aa1-684a2739fe4b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:08.845438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67d08641-c682-44a0-8aa1-684a2739fe4b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:08.845880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67d08641-c682-44a0-8aa1-684a2739fe4b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:08.941130 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67d08641-c682-44a0-8aa1-684a2739fe4b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132447 Jul 01 10:33:08.941130 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 878/1722] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:33:08 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:33:09.201140 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:09.201991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:09.223176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:09.223176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:09.223176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:09.223176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:09.570090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:09.585858 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e1522da-687f-47c5-b6eb-c0e8b592cd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 0.937942 Jul 01 10:33:09.589397 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 845/1723] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:08 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:09.948154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1fe3b4c0-14bb-42c8-8d01-d150b2416650 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:09.949873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1fe3b4c0-14bb-42c8-8d01-d150b2416650 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:09.963427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe3b4c0-14bb-42c8-8d01-d150b2416650 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:09.963883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe3b4c0-14bb-42c8-8d01-d150b2416650 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:09.964702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe3b4c0-14bb-42c8-8d01-d150b2416650 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:09.965134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe3b4c0-14bb-42c8-8d01-d150b2416650 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:10.017408 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1fe3b4c0-14bb-42c8-8d01-d150b2416650 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.073414 Jul 01 10:33:10.017998 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 846/1724] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:33:09 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:10.034925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:10.048237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c386a5ae-3e91-41cb-8ffd-9e8f86364ef4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.853219 Jul 01 10:33:10.054064 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 879/1725] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:09 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:10.586565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-827140100", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "81710d5e-d72b-4b2c-9ecd-263880086307"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:10.610489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:10.611654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:10.625491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:10.627105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:10.629425 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:10.630115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:10.673901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] validate_networks() for [('81710d5e-d72b-4b2c-9ecd-263880086307', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:33:11.147598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:11.159632 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-494ba21c-751f-4278-9ee5-d4bf27c6092f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 0.556612 Jul 01 10:33:11.171783 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 880/1726] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:10 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:11.179880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7861c174-a2a5-4121-a0ab-5865ef571d91 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:11.183582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7861c174-a2a5-4121-a0ab-5865ef571d91 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:11.195070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7861c174-a2a5-4121-a0ab-5865ef571d91 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:11.196019 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7861c174-a2a5-4121-a0ab-5865ef571d91 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:11.198014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7861c174-a2a5-4121-a0ab-5865ef571d91 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:11.199502 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7861c174-a2a5-4121-a0ab-5865ef571d91 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:11.243396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7861c174-a2a5-4121-a0ab-5865ef571d91 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068165 Jul 01 10:33:11.244718 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 881/1727] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:33:11 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:11.250315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:11.251435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:11.258879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:11.267072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:11.267072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:11.267072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:11.733465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:11.743595 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77ba5482-baea-420f-a7fe-2d49cc17df4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1689 microversion: 2.1 time: 0.497442 Jul 01 10:33:11.744690 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 882/1728] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:11 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1689 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:11.845252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:33:11.847650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:33:11.850363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:33:11.852478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:33:11.855060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:33:11.888127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:11.889891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:11.896633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:11.896633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:11.926963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Getting quotas for project edcff43a96824fe3ab1d7a867f8bc7c8. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:11.936220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Getting quotas for user b519e73d755d410c91822c5717d31506 and project edcff43a96824fe3ab1d7a867f8bc7c8. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:11.956508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:33:11.959537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:33:12.170576 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fde32518-11fd-4dcc-a841-8cd24f9bfb08 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.147099 Jul 01 10:33:12.181065 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 847/1729] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:33:12.195241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:12.197787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:12.262355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:12.268780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:12.269791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:12.278750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:12.516756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-875a3d61-1638-47c4-bb88-b2399c231901 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Action: 'create', calling method: .version_select at 0x7f6f91a42700>, body: {"pool": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:12.615814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:12.626753 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce2158da-093f-4e02-abdf-2be30c555aa4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 0.444067 Jul 01 10:33:12.629622 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 848/1730] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:12 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:12.639937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6fb08c9a-b6f9-4cd8-bf02-42efa9761ad9 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:12.663437 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6fb08c9a-b6f9-4cd8-bf02-42efa9761ad9 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:12.860200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6fb08c9a-b6f9-4cd8-bf02-42efa9761ad9 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:12.866844 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6fb08c9a-b6f9-4cd8-bf02-42efa9761ad9 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1216 microversion: 2.1 time: 0.238195 Jul 01 10:33:12.876977 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 849/1731] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:12 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1216 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:12.880670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a221373-ab45-416d-a0ba-7b647ea49ee6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:12.884204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a221373-ab45-416d-a0ba-7b647ea49ee6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:12.908781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a221373-ab45-416d-a0ba-7b647ea49ee6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:12.919617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a221373-ab45-416d-a0ba-7b647ea49ee6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:12.921135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a221373-ab45-416d-a0ba-7b647ea49ee6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:12.925809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a221373-ab45-416d-a0ba-7b647ea49ee6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:13.045088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a221373-ab45-416d-a0ba-7b647ea49ee6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.174014 Jul 01 10:33:13.048646 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 850/1732] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:33:12 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:13.076674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:13.077883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:13.092738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:13.093310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:13.096500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:13.097024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:14.542564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:14.557278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b531fb97-ec3c-43c0-91ad-2805bb274ad0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1684 microversion: 2.1 time: 1.506728 Jul 01 10:33:14.576789 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 851/1733] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:13 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1684 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:15.044659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb8bb62d-7232-4eb6-b592-c3c6ed644aed tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.466308 Jul 01 10:33:15.045215 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 852/1734] 10.222.0.23 () {58 vars in 1127 bytes} [Fri Jul 1 10:33:14 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 468 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 10:33:15.064812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:15.064812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:15.094217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:15.094217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:15.094217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:15.094217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:15.563186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:15.576115 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-383d5be4-689c-4c1b-af52-7913fe2fef6b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 0.529807 Jul 01 10:33:15.578810 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 853/1735] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:15 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:15.590331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:15.594369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:15.607566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:15.609467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:15.610478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:15.614000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:16.084211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:16.095374 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f363d5d8-3570-4d8f-9693-3bac2722ebca tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1276 microversion: 2.1 time: 0.515209 Jul 01 10:33:16.101034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 854/1736] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:15 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1276 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:16.295023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a616df82-7f42-48c7-916f-b21ca6be73cb tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] Calling method '.version_select at 0x7f6f91ea5310>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:16.296137 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:33:16.296137 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:33:16.327626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a616df82-7f42-48c7-916f-b21ca6be73cb tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.223120 Jul 01 10:33:16.328420 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 855/1737] 10.222.0.23 () {60 vars in 1225 bytes} [Fri Jul 1 10:33:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:16.338010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-816bb15e-ebf0-4d8b-b498-ea0d6950a443 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Calling method '.version_select at 0x7f6f91bd89d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:16.677725 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-875a3d61-1638-47c4-bb88-b2399c231901 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.763758 Jul 01 10:33:16.678536 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 883/1738] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:33:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:33:16.685568 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b8f890cd-e178-4c31-af71-fe913989876d req-8aad1a13-a2e2-4e51-928e-fa36e8a0079d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd8f777-3dba-4731-b2b4-00d4b2466d00", "name": "network-vif-plugged", "status": "completed", "tag": "af79b018-1aee-4c87-902c-a90dcbde6f91"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:16.716771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b8f890cd-e178-4c31-af71-fe913989876d req-8aad1a13-a2e2-4e51-928e-fa36e8a0079d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:16.717630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b8f890cd-e178-4c31-af71-fe913989876d req-8aad1a13-a2e2-4e51-928e-fa36e8a0079d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:16.733790 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b8f890cd-e178-4c31-af71-fe913989876d req-8aad1a13-a2e2-4e51-928e-fa36e8a0079d service nova] Creating event network-vif-plugged:af79b018-1aee-4c87-902c-a90dcbde6f91 for instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 on n-h2-master-1 Jul 01 10:33:16.739796 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b8f890cd-e178-4c31-af71-fe913989876d req-8aad1a13-a2e2-4e51-928e-fa36e8a0079d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059258 Jul 01 10:33:16.740981 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 884/1739] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:16.747810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:16.748813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:16.757740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:16.761766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:16.761766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:16.761766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:17.060100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:17.080577 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e304f5f9-7b2c-4274-bef2-e18d0f6510ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1684 microversion: 2.1 time: 0.329312 Jul 01 10:33:17.085052 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 885/1740] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:16 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1684 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:17.097638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3091962a-eddc-4796-84eb-f33ad3242623 tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91f56670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:17.104125 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:33:17.104125 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:33:17.771261 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3091962a-eddc-4796-84eb-f33ad3242623 tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.684447 Jul 01 10:33:17.773325 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 886/1741] 10.222.0.23 () {62 vars in 1246 bytes} [Fri Jul 1 10:33:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:17.779220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:17.783131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:17.788347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:17.788795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:17.789645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:17.790133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:18.002590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:18.011833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4cf0cd5a-cb0a-46f8-a7d1-08c330c62f2b tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1314 microversion: 2.1 time: 0.236534 Jul 01 10:33:18.013310 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 887/1742] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:17 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:18.019374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1b6309e-76e2-4424-9c1c-5d2f795d956b tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Calling method '.version_select at 0x7f6f91f56310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:18.281261 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1b6309e-76e2-4424-9c1c-5d2f795d956b tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/f7b2ae8a-c085-44e5-907e-222ad58838fe" status: 200 len: 142 microversion: 2.1 time: 0.266360 Jul 01 10:33:18.281837 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 888/1743] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:33:18 2022] GET /compute/v2.1/os-floating-ips/f7b2ae8a-c085-44e5-907e-222ad58838fe => generated 142 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:18.287028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:18.288175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:18.298724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:18.299392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:18.300436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:18.301127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:18.552976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:18.563913 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8eb93bfc-c49a-442d-9f5b-a473a9263192 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1316 microversion: 2.1 time: 0.280483 Jul 01 10:33:18.574375 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 889/1744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:18 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:18.580505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6eb69e27-f4c3-4bb0-bb8a-5ce0e21f7905 tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] Calling method '.version_select at 0x7f6f921e5940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:18.581713 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:33:18.581713 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:33:18.614805 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6eb69e27-f4c3-4bb0-bb8a-5ce0e21f7905 tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.039262 Jul 01 10:33:18.617032 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 890/1745] 10.222.0.23 () {60 vars in 1225 bytes} [Fri Jul 1 10:33:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:18.628002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:18.631670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:18.640111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:18.640881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:18.642277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:18.644373 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:18.938750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:18.950204 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2cd3b16a-8efa-4d6b-8167-91e890be47bc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1684 microversion: 2.1 time: 0.326176 Jul 01 10:33:18.960070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 891/1746] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:18 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1684 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:18.960070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39eab353-7b63-400c-8f71-aaa1744f4700 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Calling method '.version_select at 0x7f6f91f385e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:19.263455 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39eab353-7b63-400c-8f71-aaa1744f4700 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.310857 Jul 01 10:33:19.264730 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 892/1747] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:33:18 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:19.273510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e0bd514a-d021-4b3c-bc56-5643cba25840 req-bfd28f27-f88f-45b1-99c9-10a1339a1db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24538e8f-7a7d-484f-9009-8a6fc6c90653", "tag": "131a1d9a-dfcf-4c12-ae2b-b811fddbf820"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:19.285573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e0bd514a-d021-4b3c-bc56-5643cba25840 req-bfd28f27-f88f-45b1-99c9-10a1339a1db8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:19.286428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e0bd514a-d021-4b3c-bc56-5643cba25840 req-bfd28f27-f88f-45b1-99c9-10a1339a1db8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:19.300942 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e0bd514a-d021-4b3c-bc56-5643cba25840 req-bfd28f27-f88f-45b1-99c9-10a1339a1db8 service nova] Creating event network-changed:131a1d9a-dfcf-4c12-ae2b-b811fddbf820 for instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 on n-h1-master-1 Jul 01 10:33:19.309293 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e0bd514a-d021-4b3c-bc56-5643cba25840 req-bfd28f27-f88f-45b1-99c9-10a1339a1db8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042857 Jul 01 10:33:19.311080 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 893/1748] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:19.318443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d98b97fb-82ba-4d5e-a51f-3e211074b61b tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] Action: 'update', calling method: .version_select at 0x7f6f9212a3a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:19.320921 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:33:19.320921 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:33:19.536146 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=11,nova_api:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:19.818368 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d98b97fb-82ba-4d5e-a51f-3e211074b61b tempest-QuotaClassesAdmin257Test-509664631 tempest-QuotaClassesAdmin257Test-509664631-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.505796 Jul 01 10:33:19.818917 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 894/1749] 10.222.0.23 () {62 vars in 1246 bytes} [Fri Jul 1 10:33:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:19.848235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-944ef3b4-da3a-4825-a9c9-1b01f0aaa49b req-8b4ba5f3-6e11-43a3-9eda-3fcfa091a221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-plugged", "status": "completed", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:19.861537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-944ef3b4-da3a-4825-a9c9-1b01f0aaa49b req-8b4ba5f3-6e11-43a3-9eda-3fcfa091a221 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:19.861983 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-944ef3b4-da3a-4825-a9c9-1b01f0aaa49b req-8b4ba5f3-6e11-43a3-9eda-3fcfa091a221 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:19.876537 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-944ef3b4-da3a-4825-a9c9-1b01f0aaa49b req-8b4ba5f3-6e11-43a3-9eda-3fcfa091a221 service nova] Creating event network-vif-plugged:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:33:19.882001 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-944ef3b4-da3a-4825-a9c9-1b01f0aaa49b req-8b4ba5f3-6e11-43a3-9eda-3fcfa091a221 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061966 Jul 01 10:33:19.882947 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 895/1750] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:19.889030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:19.889759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:19.896263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:19.896857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:19.897664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:19.898098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:20.100246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:20.108565 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:20.118953 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-43114194-665d-446e-ab9b-c0979d563939 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1502 microversion: 2.1 time: 0.234277 Jul 01 10:33:20.119162 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 896/1751] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:19 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:20.137761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d1cbbbd-1b97-4341-97d6-b2753162770f tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Calling method '.version_select at 0x7f6f920a83a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:21.250886 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d1cbbbd-1b97-4341-97d6-b2753162770f tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/f7b2ae8a-c085-44e5-907e-222ad58838fe" status: 202 len: 0 microversion: 2.1 time: 1.130649 Jul 01 10:33:21.257721 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 897/1752] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:33:20 2022] DELETE /compute/v2.1/os-floating-ips/f7b2ae8a-c085-44e5-907e-222ad58838fe => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:21.260923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:21.261728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:21.274794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:21.279919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:21.279919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:21.279919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:21.482516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:21.491054 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9caafd47-7642-498a-84dd-abed8f7c1911 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1316 microversion: 2.1 time: 0.236163 Jul 01 10:33:21.507835 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 898/1753] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:21 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:21.522139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:21.524803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:21.539020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:21.540532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:21.542914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:21.544873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:21.765377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:21.774583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96bd7b75-5c01-4ce6-a01c-3a7612a013b4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1684 microversion: 2.1 time: 0.260312 Jul 01 10:33:21.775381 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 899/1754] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:21 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1684 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:21.782243 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-128532285"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:21.782777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:21.789650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:21.790352 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:21.791313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:21.791937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:21.905602 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:21.978883 n-d-master-1 devstack@n-api.service[119765]: INFO nova.network.security_group_api [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Adding security group 54928574-3a76-42ec-afbd-bedaed5a36c1 to port af79b018-1aee-4c87-902c-a90dcbde6f91 Jul 01 10:33:22.651335 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-868be010-15d6-41e7-8c16-b3022ead9e72 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00/action" status: 202 len: 0 microversion: 2.1 time: 0.874613 Jul 01 10:33:22.653137 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 900/1755] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:33:21 2022] POST /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:22.663670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5e71acea-3bc1-4689-a518-bbc199a00067 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Action: 'create', calling method: .version_select at 0x7f6f92064160>, body: {"pool": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:25.425127 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5e71acea-3bc1-4689-a518-bbc199a00067 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.769823 Jul 01 10:33:25.432394 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 901/1756] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:33:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:25.438248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:25.439350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:25.447619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:25.450369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:25.450369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:25.450369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:25.607456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:25.615664 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1eae7bbb-9db9-4d61-935c-76a0645f6642 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1316 microversion: 2.1 time: 0.181611 Jul 01 10:33:25.616795 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 902/1757] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:25 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:25.634706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ede9346e-d2ae-445f-a710-9b587eb7feea tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f925fdf70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:25.852570 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-ede9346e-d2ae-445f-a710-9b587eb7feea tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use.", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:25.853463 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ede9346e-d2ae-445f-a710-9b587eb7feea tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use. Jul 01 10:33:25.853463 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-687fad00-12f4-4b76-9291-9afc4888e1ec'] Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ede9346e-d2ae-445f-a710-9b587eb7feea tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1 HTTP/1.1 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: exception: Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use. Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-687fad00-12f4-4b76-9291-9afc4888e1ec'] Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '54928574-3a76-42ec-afbd-bedaed5a36c1'} Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:25.855915 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use. Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-687fad00-12f4-4b76-9291-9afc4888e1ec'] Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use. Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-687fad00-12f4-4b76-9291-9afc4888e1ec'] Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use. Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-687fad00-12f4-4b76-9291-9afc4888e1ec'] Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use. Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-687fad00-12f4-4b76-9291-9afc4888e1ec'] Jul 01 10:33:25.860528 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:25.864521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ede9346e-d2ae-445f-a710-9b587eb7feea tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 400 to user: Security Group 54928574-3a76-42ec-afbd-bedaed5a36c1 in use. Jul 01 10:33:25.864521 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-687fad00-12f4-4b76-9291-9afc4888e1ec'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:25.865879 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ede9346e-d2ae-445f-a710-9b587eb7feea tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1" status: 400 len: 185 microversion: 2.1 time: 0.247351 Jul 01 10:33:25.866616 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 903/1758] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:25 2022] DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1 => generated 185 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:33:25.872138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a1ed7dd4-5786-4a5b-9a94-5e6882807632 req-b2389088-789d-45a6-828e-f1eaa9b02122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd8f777-3dba-4731-b2b4-00d4b2466d00", "tag": "af79b018-1aee-4c87-902c-a90dcbde6f91"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:25.886676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a1ed7dd4-5786-4a5b-9a94-5e6882807632 req-b2389088-789d-45a6-828e-f1eaa9b02122 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:25.892586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a1ed7dd4-5786-4a5b-9a94-5e6882807632 req-b2389088-789d-45a6-828e-f1eaa9b02122 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:25.898959 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a1ed7dd4-5786-4a5b-9a94-5e6882807632 req-b2389088-789d-45a6-828e-f1eaa9b02122 service nova] Creating event network-changed:af79b018-1aee-4c87-902c-a90dcbde6f91 for instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 on n-h2-master-1 Jul 01 10:33:25.906244 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a1ed7dd4-5786-4a5b-9a94-5e6882807632 req-b2389088-789d-45a6-828e-f1eaa9b02122 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037890 Jul 01 10:33:25.907790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 904/1759] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:25.919362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:25.921380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:25.929954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:25.930959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:25.932252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:25.934451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:26.090023 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:26.265895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:26.274271 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-483a771d-82da-4654-ba95-04cba51fd54f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1684 microversion: 2.1 time: 0.364813 Jul 01 10:33:26.278681 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 905/1760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:25 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1684 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:26.283595 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-83822870-7c8f-4fd4-807c-c91b52740900 req-08bc3abd-5898-44db-aea9-7424ea5df9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24538e8f-7a7d-484f-9009-8a6fc6c90653", "name": "network-vif-plugged", "status": "completed", "tag": "131a1d9a-dfcf-4c12-ae2b-b811fddbf820"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:26.303310 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:26.309728 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:26.310147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-83822870-7c8f-4fd4-807c-c91b52740900 req-08bc3abd-5898-44db-aea9-7424ea5df9ce service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:26.310901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-83822870-7c8f-4fd4-807c-c91b52740900 req-08bc3abd-5898-44db-aea9-7424ea5df9ce service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:26.332840 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-83822870-7c8f-4fd4-807c-c91b52740900 req-08bc3abd-5898-44db-aea9-7424ea5df9ce service nova] Creating event network-vif-plugged:131a1d9a-dfcf-4c12-ae2b-b811fddbf820 for instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 on n-h1-master-1 Jul 01 10:33:26.349126 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-83822870-7c8f-4fd4-807c-c91b52740900 req-08bc3abd-5898-44db-aea9-7424ea5df9ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068726 Jul 01 10:33:26.350470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 906/1761] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:26.364366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d7728c56-27d0-4252-a5fd-fb2f40f926ef tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Calling method '.version_select at 0x7f6f91b09430>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:28.611605 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d7728c56-27d0-4252-a5fd-fb2f40f926ef tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545" status: 202 len: 0 microversion: 2.1 time: 2.259583 Jul 01 10:33:28.612654 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 907/1762] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:33:26 2022] DELETE /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545 => generated 0 bytes in 2261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:28.619120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca165fb0-097e-41c4-abe3-40fff1ad7d3d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:28.621247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca165fb0-097e-41c4-abe3-40fff1ad7d3d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:28.632746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca165fb0-097e-41c4-abe3-40fff1ad7d3d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:28.633271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca165fb0-097e-41c4-abe3-40fff1ad7d3d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:28.634051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca165fb0-097e-41c4-abe3-40fff1ad7d3d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:28.634734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca165fb0-097e-41c4-abe3-40fff1ad7d3d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:28.956013 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca165fb0-097e-41c4-abe3-40fff1ad7d3d tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00/action" status: 202 len: 0 microversion: 2.1 time: 0.341646 Jul 01 10:33:28.959102 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 908/1763] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:33:28 2022] POST /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:28.963567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:28.964968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:28.975246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:28.976045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:28.977365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:28.978022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:29.243337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:29.259049 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6b13cab1-1fb3-46e6-b42e-1a16c771c54a tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1506 microversion: 2.1 time: 0.300045 Jul 01 10:33:29.259325 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 909/1764] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:28 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:29.272721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:29.272949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:29.289907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:29.294718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:29.294718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:29.294718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:29.561892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:29.570692 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0cb8fb39-8be0-4b86-a4b3-a1dd146ae445 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1684 microversion: 2.1 time: 0.310245 Jul 01 10:33:29.571276 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 910/1765] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:29 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1684 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:29.763515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07a6c0b2-1bae-4ac1-aa5b-3552898658fb tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Action: 'update', calling method: .version_select at 0x7f6f9212a0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:29.839801 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:29.841365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a6c0b2-1bae-4ac1-aa5b-3552898658fb tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:29.841894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a6c0b2-1bae-4ac1-aa5b-3552898658fb tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:29.842820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a6c0b2-1bae-4ac1-aa5b-3552898658fb tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:29.843346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a6c0b2-1bae-4ac1-aa5b-3552898658fb tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:29.980425 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07a6c0b2-1bae-4ac1-aa5b-3552898658fb tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157" status: 200 len: 240 microversion: 2.36 time: 0.407529 Jul 01 10:33:29.981158 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 911/1766] 10.222.0.23 () {62 vars in 1302 bytes} [Fri Jul 1 10:33:29 2022] PUT /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157 => generated 240 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:29.986090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd1ba9cd-a6d7-4eaa-bf9b-1af74d5a94c2 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Calling method '.version_select at 0x7f6f91b099d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.060452 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-bd1ba9cd-a6d7-4eaa-bf9b-1af74d5a94c2 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3bd2bf49-97c0-4053-b449-024b79928545 could not be found", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:30.061298 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-bd1ba9cd-a6d7-4eaa-bf9b-1af74d5a94c2 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] HTTP exception thrown: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd1ba9cd-a6d7-4eaa-bf9b-1af74d5a94c2 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Request method failure captured: Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545 HTTP/1.1 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1n7uwjXyBF6iuxwr4g2JZRzpTsJDNBYjvEJ1gqDspp4D72gQKizpS0LiQK7I1lgZIO0izjpF_ZpZXw7CgNJua_Y3XO3Ch_clCtCKzYrZEYmmFtqtbt3Nspwg4oQs4zNMRe8sqHg-TiD2LIJF2oXMoWAg1b2LBqkz9k1lHEyWLAxtQ Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 14cc87fdee2e40d0963b72fb09054124 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-FloatingIPsTestJSON-1324464205 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14cc87fdee2e40d0963b72fb09054124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14cc87fdee2e40d0963b72fb09054124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14cc87fdee2e40d0963b72fb09054124", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14cc87fdee2e40d0963b72fb09054124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-FloatingIPsTestJSON-1324464205 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 14cc87fdee2e40d0963b72fb09054124 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1324464205 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-FloatingIPsTestJSON-1324464205-project Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: acf5d8b58e0545439d476c5ea27a0c89 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-FloatingIPsTestJSON-1324464205-project Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: exception: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3bd2bf49-97c0-4053-b449-024b79928545'} Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3bd2bf49-97c0-4053-b449-024b79928545 could not be found Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b752e34-06c4-40c8-8f02-6eff661b8aa0'] Jul 01 10:33:30.063443 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545. Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd1ba9cd-a6d7-4eaa-bf9b-1af74d5a94c2 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Returning 404 to user: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd1ba9cd-a6d7-4eaa-bf9b-1af74d5a94c2 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545" status: 404 len: 111 microversion: 2.1 time: 0.083590 Jul 01 10:33:30.068894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 912/1767] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:33:29 2022] GET /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:30.071940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.071940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:30.079342 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.082332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.082332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.082332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.310947 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-816bb15e-ebf0-4d8b-b498-ea0d6950a443 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] HTTP exception thrown: Image not found. Jul 01 10:33:30.312912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-816bb15e-ebf0-4d8b-b498-ea0d6950a443 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Request method failure captured: Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1pQWAa_TOXmd5q3r5irB4zZKOCDHgCCqWm1ex2LPvhOL4mquueqZ71xSm1bpa7qxuOKR9NJacQ7DQk61JjMKnGy3kpoQ-Ppn8WtDIAHYK5Anak75x3DvQbhzd8eqCCW0CgD26OUxJXVKAwz1E4IWl1eZTwGA2yFDbmfCpe3XDpR1w Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382db04ab5304858987d5fd86f550bfa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b8e04220b1274e4a96e1612dd8f58866 Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '-1'} Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.314245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-816bb15e-ebf0-4d8b-b498-ea0d6950a443 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-816bb15e-ebf0-4d8b-b498-ea0d6950a443 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 13.986788 Jul 01 10:33:30.319686 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 856/1768] 10.222.0.23 () {58 vars in 1133 bytes} [Fri Jul 1 10:33:16 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 13988 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:33:30.322553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea1cccac-eee6-449a-b6d9-d06886fa1529 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.323062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea1cccac-eee6-449a-b6d9-d06886fa1529 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:30.328999 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9aed1b2c-a057-4a18-baf6-47c6147e2a32 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1572 microversion: 2.1 time: 0.259366 Jul 01 10:33:30.332091 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 913/1769] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:30 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1572 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:30.332647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea1cccac-eee6-449a-b6d9-d06886fa1529 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.333100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea1cccac-eee6-449a-b6d9-d06886fa1529 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.333921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea1cccac-eee6-449a-b6d9-d06886fa1529 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.334362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea1cccac-eee6-449a-b6d9-d06886fa1529 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.336672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-deff8f20-311a-4d33-8506-d5766b9590f4 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Calling method '.version_select at 0x7f6f91f56a60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.383586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea1cccac-eee6-449a-b6d9-d06886fa1529 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653/ips" status: 200 len: 110 microversion: 2.1 time: 0.065108 Jul 01 10:33:30.384177 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 857/1770] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:33:30 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653/ips => generated 110 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:30.388782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00baf3f7-caf3-4c3b-ab99-01862666c984 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Calling method '.version_select at 0x7f6f9249d820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.430793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-deff8f20-311a-4d33-8506-d5766b9590f4 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.431246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-deff8f20-311a-4d33-8506-d5766b9590f4 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.432374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-deff8f20-311a-4d33-8506-d5766b9590f4 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.432973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-deff8f20-311a-4d33-8506-d5766b9590f4 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.454028 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-00baf3f7-caf3-4c3b-ab99-01862666c984 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3bd2bf49-97c0-4053-b449-024b79928545 could not be found", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:30.455045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-00baf3f7-caf3-4c3b-ab99-01862666c984 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] HTTP exception thrown: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.456288 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-deff8f20-311a-4d33-8506-d5766b9590f4 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157/detail" status: 200 len: 672 microversion: 2.36 time: 0.126045 Jul 01 10:33:30.465015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 914/1771] 10.222.0.23 () {60 vars in 1303 bytes} [Fri Jul 1 10:33:30 2022] GET /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157/detail => generated 672 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00baf3f7-caf3-4c3b-ab99-01862666c984 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Request method failure captured: Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545 HTTP/1.1 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1n7uwjXyBF6iuxwr4g2JZRzpTsJDNBYjvEJ1gqDspp4D72gQKizpS0LiQK7I1lgZIO0izjpF_ZpZXw7CgNJua_Y3XO3Ch_clCtCKzYrZEYmmFtqtbt3Nspwg4oQs4zNMRe8sqHg-TiD2LIJF2oXMoWAg1b2LBqkz9k1lHEyWLAxtQ Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 14cc87fdee2e40d0963b72fb09054124 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-FloatingIPsTestJSON-1324464205 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14cc87fdee2e40d0963b72fb09054124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14cc87fdee2e40d0963b72fb09054124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14cc87fdee2e40d0963b72fb09054124", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14cc87fdee2e40d0963b72fb09054124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-FloatingIPsTestJSON-1324464205 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 14cc87fdee2e40d0963b72fb09054124 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1324464205 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-FloatingIPsTestJSON-1324464205-project Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: acf5d8b58e0545439d476c5ea27a0c89 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-FloatingIPsTestJSON-1324464205-project Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: exception: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3bd2bf49-97c0-4053-b449-024b79928545'} Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3bd2bf49-97c0-4053-b449-024b79928545 could not be found Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21390ecf-f004-41f5-b627-2ad13f1f6a19'] Jul 01 10:33:30.465893 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545. Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00baf3f7-caf3-4c3b-ab99-01862666c984 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] Returning 404 to user: Floating IP not found for ID 3bd2bf49-97c0-4053-b449-024b79928545 {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:30.474164 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00baf3f7-caf3-4c3b-ab99-01862666c984 tempest-FloatingIPsTestJSON-1324464205 tempest-FloatingIPsTestJSON-1324464205-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545" status: 404 len: 111 microversion: 2.1 time: 0.073298 Jul 01 10:33:30.484467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c692039d-96c6-44c3-9d6f-23641ad99489 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Calling method '.version_select at 0x7f6f91b09040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.484814 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 858/1772] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:33:30 2022] DELETE /compute/v2.1/os-floating-ips/3bd2bf49-97c0-4053-b449-024b79928545 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:30.484814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b124771b-a8c7-4d2f-b13e-f04286bdd5da tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.484814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b124771b-a8c7-4d2f-b13e-f04286bdd5da tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:30.485107 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c692039d-96c6-44c3-9d6f-23641ad99489 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] HTTP exception thrown: Image not found. Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c692039d-96c6-44c3-9d6f-23641ad99489 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Request method failure captured: Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/3b42f94e-a4ba-4a52-abe1-1672093dab4j HTTP/1.1 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1pQWAa_TOXmd5q3r5irB4zZKOCDHgCCqWm1ex2LPvhOL4mquueqZ71xSm1bpa7qxuOKR9NJacQ7DQk61JjMKnGy3kpoQ-Ppn8WtDIAHYK5Anak75x3DvQbhzd8eqCCW0CgD26OUxJXVKAwz1E4IWl1eZTwGA2yFDbmfCpe3XDpR1w Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382db04ab5304858987d5fd86f550bfa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b8e04220b1274e4a96e1612dd8f58866 Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3b42f94e-a4ba-4a52-abe1-1672093dab4j'} Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3b42f94e-a4ba-4a52-abe1-1672093dab4j to delete Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b42f94e-a4ba-4a52-abe1-1672093dab4j could not be found. Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.485796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c692039d-96c6-44c3-9d6f-23641ad99489 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:30.491691 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c692039d-96c6-44c3-9d6f-23641ad99489 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] 10.222.0.23 "DELETE /compute/v2.1/images/3b42f94e-a4ba-4a52-abe1-1672093dab4j" status: 404 len: 62 microversion: 2.1 time: 0.029372 Jul 01 10:33:30.493853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b124771b-a8c7-4d2f-b13e-f04286bdd5da tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.493853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b124771b-a8c7-4d2f-b13e-f04286bdd5da tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.493853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b124771b-a8c7-4d2f-b13e-f04286bdd5da tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.494139 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 915/1773] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:30 2022] DELETE /compute/v2.1/images/3b42f94e-a4ba-4a52-abe1-1672093dab4j => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:33:30.495087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b124771b-a8c7-4d2f-b13e-f04286bdd5da tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.497236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-353a8dc9-18ac-4334-a099-17d6065b181d tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Calling method '.version_select at 0x7f6f91f38670>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.515236 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-353a8dc9-18ac-4334-a099-17d6065b181d tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] HTTP exception thrown: Image not found. Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-353a8dc9-18ac-4334-a099-17d6065b181d tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Request method failure captured: Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/cf369290-6187-4547-97d6-66cbff894f211 HTTP/1.1 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1pQWAa_TOXmd5q3r5irB4zZKOCDHgCCqWm1ex2LPvhOL4mquueqZ71xSm1bpa7qxuOKR9NJacQ7DQk61JjMKnGy3kpoQ-Ppn8WtDIAHYK5Anak75x3DvQbhzd8eqCCW0CgD26OUxJXVKAwz1E4IWl1eZTwGA2yFDbmfCpe3XDpR1w Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382db04ab5304858987d5fd86f550bfa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b8e04220b1274e4a96e1612dd8f58866 Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'cf369290-6187-4547-97d6-66cbff894f211'} Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cf369290-6187-4547-97d6-66cbff894f211 to delete Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cf369290-6187-4547-97d6-66cbff894f211 could not be found. Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.517648 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-353a8dc9-18ac-4334-a099-17d6065b181d tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-353a8dc9-18ac-4334-a099-17d6065b181d tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] 10.222.0.23 "DELETE /compute/v2.1/images/cf369290-6187-4547-97d6-66cbff894f211" status: 404 len: 62 microversion: 2.1 time: 0.025645 Jul 01 10:33:30.523041 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 916/1774] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:33:30 2022] DELETE /compute/v2.1/images/cf369290-6187-4547-97d6-66cbff894f211 => generated 62 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:33:30.533062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba1a04fd-17e4-475c-9848-497ecaf839be tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Calling method '.version_select at 0x7f6f91fc5820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.534360 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b124771b-a8c7-4d2f-b13e-f04286bdd5da tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653/ips" status: 200 len: 110 microversion: 2.1 time: 0.066544 Jul 01 10:33:30.542553 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 859/1775] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:33:30 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653/ips => generated 110 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:30.560728 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ba1a04fd-17e4-475c-9848-497ecaf839be tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] HTTP exception thrown: Image not found. Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba1a04fd-17e4-475c-9848-497ecaf839be tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Request method failure captured: Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/tempest-invalid-1235662720 HTTP/1.1 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1pQWAa_TOXmd5q3r5irB4zZKOCDHgCCqWm1ex2LPvhOL4mquueqZ71xSm1bpa7qxuOKR9NJacQ7DQk61JjMKnGy3kpoQ-Ppn8WtDIAHYK5Anak75x3DvQbhzd8eqCCW0CgD26OUxJXVKAwz1E4IWl1eZTwGA2yFDbmfCpe3XDpR1w Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382db04ab5304858987d5fd86f550bfa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b8e04220b1274e4a96e1612dd8f58866 Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'tempest-invalid-1235662720'} Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1235662720 to delete Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1235662720 could not be found. Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.562876 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba1a04fd-17e4-475c-9848-497ecaf839be tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:30.568721 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba1a04fd-17e4-475c-9848-497ecaf839be tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-1235662720" status: 404 len: 62 microversion: 2.1 time: 0.037273 Jul 01 10:33:30.572112 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 917/1776] 10.222.0.23 () {58 vars in 1205 bytes} [Fri Jul 1 10:33:30 2022] DELETE /compute/v2.1/images/tempest-invalid-1235662720 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:33:30.577951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2badebde-d05e-4294-b7cc-db1be0f43de4 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Calling method '.version_select at 0x7f6f922cda60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.579837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7bf4de2-1645-46af-a26d-bcc18035f060 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.584071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7bf4de2-1645-46af-a26d-bcc18035f060 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:30.601719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bf4de2-1645-46af-a26d-bcc18035f060 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.606953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bf4de2-1645-46af-a26d-bcc18035f060 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.606953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bf4de2-1645-46af-a26d-bcc18035f060 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.606953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bf4de2-1645-46af-a26d-bcc18035f060 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.609394 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2badebde-d05e-4294-b7cc-db1be0f43de4 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] HTTP exception thrown: Image not found. Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2badebde-d05e-4294-b7cc-db1be0f43de4 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Request method failure captured: Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/cd445b7e-e09d-4468-a439-3fc04eb8ae3f HTTP/1.1 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1pQWAa_TOXmd5q3r5irB4zZKOCDHgCCqWm1ex2LPvhOL4mquueqZ71xSm1bpa7qxuOKR9NJacQ7DQk61JjMKnGy3kpoQ-Ppn8WtDIAHYK5Anak75x3DvQbhzd8eqCCW0CgD26OUxJXVKAwz1E4IWl1eZTwGA2yFDbmfCpe3XDpR1w Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382db04ab5304858987d5fd86f550bfa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382db04ab5304858987d5fd86f550bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 382db04ab5304858987d5fd86f550bfa Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-592600065 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b8e04220b1274e4a96e1612dd8f58866 Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-592600065-project Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'cd445b7e-e09d-4468-a439-3fc04eb8ae3f'} Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd445b7e-e09d-4468-a439-3fc04eb8ae3f to delete Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd445b7e-e09d-4468-a439-3fc04eb8ae3f could not be found. Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.611386 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2badebde-d05e-4294-b7cc-db1be0f43de4 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:30.616890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2badebde-d05e-4294-b7cc-db1be0f43de4 tempest-ImagesDeleteNegativeTestJSON-592600065 tempest-ImagesDeleteNegativeTestJSON-592600065-project] 10.222.0.23 "DELETE /compute/v2.1/images/cd445b7e-e09d-4468-a439-3fc04eb8ae3f" status: 404 len: 62 microversion: 2.1 time: 0.041217 Jul 01 10:33:30.621009 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 918/1777] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:30 2022] DELETE /compute/v2.1/images/cd445b7e-e09d-4468-a439-3fc04eb8ae3f => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:33:30.637783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.638772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:30.647655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.648608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.649785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.650415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.708227 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7bf4de2-1645-46af-a26d-bcc18035f060 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653/ips/tempest-ServerAddressesTestJSON-1023293693-network" status: 200 len: 95 microversion: 2.1 time: 0.159654 Jul 01 10:33:30.711996 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 860/1778] 10.222.0.23 () {58 vars in 1400 bytes} [Fri Jul 1 10:33:30 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653/ips/tempest-ServerAddressesTestJSON-1023293693-network => generated 95 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:33:30.741062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:30.741696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:30.754624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.756318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.757394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:30.758101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:30.800470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:33:30.869945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:30.887839 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-910a66cf-365a-4286-911a-88292d285fb3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1684 microversion: 2.1 time: 0.266501 Jul 01 10:33:30.888438 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 919/1779] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:30 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1684 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:30.907063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Action: 'update', calling method: .version_select at 0x7f6f921e5940>, body: {"quota_set": {"ram": "2048"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:31.010377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.010377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.013795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.014988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.096276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.099991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.099991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.099991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.163239 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06ce1422-ddd5-4d10-9f8a-2f32fd870c15 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 204 len: 0 microversion: 2.1 time: 0.433619 Jul 01 10:33:31.163922 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 861/1780] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:33:30 2022] DELETE /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:33:31.174224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:31.175628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:31.187870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.194339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.195385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.195820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.261567 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-561e940a-f1ff-4fec-90e1-e51240e2e34c tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157?user_id=10611afc5c154390aa0fb691edc728fe" status: 200 len: 240 microversion: 2.36 time: 0.362262 Jul 01 10:33:31.261567 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 920/1781] 10.222.0.23 () {62 vars in 1383 bytes} [Fri Jul 1 10:33:30 2022] PUT /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157?user_id=10611afc5c154390aa0fb691edc728fe => generated 240 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:31.264857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a5b3f71-2db4-4684-81e9-f27469fbc3a6 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] Calling method '.version_select at 0x7f6f91ecedc0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:31.400023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:31.408003 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e44c590c-a942-405b-92ad-c285826d2454 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1512 microversion: 2.1 time: 0.238524 Jul 01 10:33:31.408588 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 862/1782] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:31 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:31.413566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:31.414393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:31.421049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.421773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.422777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.423433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.660447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:31.672802 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b0d28a3-eb04-442b-9030-81d611613748 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1570 microversion: 2.1 time: 0.261645 Jul 01 10:33:31.673546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 863/1783] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:31 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1570 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:31.702622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1068876452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:31.706639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:31.707051 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a5b3f71-2db4-4684-81e9-f27469fbc3a6 tempest-QuotasAdminTestV236-1461344735 tempest-QuotasAdminTestV236-1461344735-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157?user_id=10611afc5c154390aa0fb691edc728fe" status: 200 len: 282 microversion: 2.36 time: 0.443402 Jul 01 10:33:31.707051 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 921/1784] 10.222.0.23 () {60 vars in 1363 bytes} [Fri Jul 1 10:33:31 2022] GET /compute/v2.1/os-quota-sets/5d3efec3a7db4427a97341faf3276157?user_id=10611afc5c154390aa0fb691edc728fe => generated 282 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:33:31.723068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.723543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.724638 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.725115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.873457 n-d-master-1 devstack@n-api.service[119764]: INFO nova.network.security_group_api [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Adding security group 0ce68847-f870-4d03-8c54-d493009895bc to port af79b018-1aee-4c87-902c-a90dcbde6f91 Jul 01 10:33:31.913621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:31.915159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:31.930380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.932134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:31.933410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:31.934506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:32.286890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:32.298620 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-444a1a98-6599-422f-8429-4892a9556c3a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.397168 Jul 01 10:33:32.304444 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 922/1785] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:31 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:32.426139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:32.427140 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:32.445367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:32.446147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:32.447702 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:32.448220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:32.809785 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56d7bb99-edd6-41b1-a3c7-0f9913b380d7 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00/action" status: 202 len: 0 microversion: 2.1 time: 1.115211 Jul 01 10:33:32.810631 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 864/1786] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:33:31 2022] POST /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:32.818159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbf86f27-001c-4fca-a76e-2aa7d1b588cb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91bd8f70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:32.960060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:32.969662 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-37adb0b7-e8d7-4aaf-98ba-cd5a2b41cdf6 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1512 microversion: 2.1 time: 0.547940 Jul 01 10:33:32.974234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 923/1787] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:32 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1512 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:33.003553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-163c6849-3bd6-4517-9262-e45fb616e11c req-5318f9d2-c184-4af9-bbb7-d1e46db3ea32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd8f777-3dba-4731-b2b4-00d4b2466d00", "tag": "af79b018-1aee-4c87-902c-a90dcbde6f91"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:33.045603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-163c6849-3bd6-4517-9262-e45fb616e11c req-5318f9d2-c184-4af9-bbb7-d1e46db3ea32 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.048588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-163c6849-3bd6-4517-9262-e45fb616e11c req-5318f9d2-c184-4af9-bbb7-d1e46db3ea32 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.088467 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-163c6849-3bd6-4517-9262-e45fb616e11c req-5318f9d2-c184-4af9-bbb7-d1e46db3ea32 service nova] Creating event network-changed:af79b018-1aee-4c87-902c-a90dcbde6f91 for instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 on n-h2-master-1 Jul 01 10:33:33.105811 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-163c6849-3bd6-4517-9262-e45fb616e11c req-5318f9d2-c184-4af9-bbb7-d1e46db3ea32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126495 Jul 01 10:33:33.108523 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 924/1788] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:33.117933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:33.119676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:33.150782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.151922 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.152771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.155802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.279707 n-d-master-1 devstack@n-api.service[119764]: DEBUG neutronclient.v2_0.client [None req-dbf86f27-001c-4fca-a76e-2aa7d1b588cb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use.", "detail": ""}} {{(pid=119764) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:33.281279 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-dbf86f27-001c-4fca-a76e-2aa7d1b588cb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use. Jul 01 10:33:33.281279 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-c22c38f9-0ebb-490d-accb-dbd92a9fb2bb'] Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbf86f27-001c-4fca-a76e-2aa7d1b588cb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc HTTP/1.1 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: exception: Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use. Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-c22c38f9-0ebb-490d-accb-dbd92a9fb2bb'] Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '0ce68847-f870-4d03-8c54-d493009895bc'} Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:33.284623 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use. Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c22c38f9-0ebb-490d-accb-dbd92a9fb2bb'] Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use. Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c22c38f9-0ebb-490d-accb-dbd92a9fb2bb'] Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use. Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c22c38f9-0ebb-490d-accb-dbd92a9fb2bb'] Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use. Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c22c38f9-0ebb-490d-accb-dbd92a9fb2bb'] Jul 01 10:33:33.291639 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:33.297849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbf86f27-001c-4fca-a76e-2aa7d1b588cb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 400 to user: Security Group 0ce68847-f870-4d03-8c54-d493009895bc in use. Jul 01 10:33:33.297849 n-d-master-1 devstack@n-api.service[119764]: Neutron server returns request_ids: ['req-c22c38f9-0ebb-490d-accb-dbd92a9fb2bb'] {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:33.300284 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbf86f27-001c-4fca-a76e-2aa7d1b588cb tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc" status: 400 len: 185 microversion: 2.1 time: 0.481554 Jul 01 10:33:33.304897 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 865/1789] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:32 2022] DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc => generated 185 bytes in 491 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:33:33.311491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:33.312606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:33.329193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.330064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.332430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.334850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.403099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:33:33.779960 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7efe9094-1cf2-4bc1-8f88-285a234ca154 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 204 len: 0 microversion: 2.1 time: 0.473129 Jul 01 10:33:33.783926 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 866/1790] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:33:33 2022] DELETE /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:33:33.790057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:33.790932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:33.806737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.807994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.812559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.813691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.856423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:33.874211 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b34cfd11-f713-4547-933c-2a9a125776df tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.763378 Jul 01 10:33:33.877688 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 925/1791] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:33 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:33.909169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c8061f91-28a6-4c67-835f-ee138322447f req-017c4673-d39d-41fc-a77b-00f5a54e4cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24538e8f-7a7d-484f-9009-8a6fc6c90653", "name": "network-vif-unplugged", "status": "completed", "tag": "131a1d9a-dfcf-4c12-ae2b-b811fddbf820"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:33.925992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c8061f91-28a6-4c67-835f-ee138322447f req-017c4673-d39d-41fc-a77b-00f5a54e4cfc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:33.927576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c8061f91-28a6-4c67-835f-ee138322447f req-017c4673-d39d-41fc-a77b-00f5a54e4cfc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:33.957814 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c8061f91-28a6-4c67-835f-ee138322447f req-017c4673-d39d-41fc-a77b-00f5a54e4cfc service nova] Creating event network-vif-unplugged:131a1d9a-dfcf-4c12-ae2b-b811fddbf820 for instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 on n-h1-master-1 Jul 01 10:33:33.971433 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c8061f91-28a6-4c67-835f-ee138322447f req-017c4673-d39d-41fc-a77b-00f5a54e4cfc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065468 Jul 01 10:33:33.974938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 926/1792] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:33.991919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:33.992884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:34.009409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:34.011889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:34.012928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:34.013577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:34.039309 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:34.451041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:34.468184 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d83ccd7d-19ec-461b-9ca6-ce6470d19e49 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1645 microversion: 2.1 time: 0.682681 Jul 01 10:33:34.470578 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 867/1793] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:33 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1645 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:34.477799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1c1a3ffe-34b8-4ac3-b306-b380cb2e156f req-4031bd6d-c51c-464f-a60c-8744f3561769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24538e8f-7a7d-484f-9009-8a6fc6c90653", "name": "network-vif-deleted", "tag": "131a1d9a-dfcf-4c12-ae2b-b811fddbf820"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:34.503701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1c1a3ffe-34b8-4ac3-b306-b380cb2e156f req-4031bd6d-c51c-464f-a60c-8744f3561769 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:34.504636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1c1a3ffe-34b8-4ac3-b306-b380cb2e156f req-4031bd6d-c51c-464f-a60c-8744f3561769 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:34.518301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:34.543087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93fd90df-5e8f-4ae3-b61d-898ae971b2ea tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1512 microversion: 2.1 time: 0.556226 Jul 01 10:33:34.546343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1c1a3ffe-34b8-4ac3-b306-b380cb2e156f req-4031bd6d-c51c-464f-a60c-8744f3561769 service nova] Creating event network-vif-deleted:131a1d9a-dfcf-4c12-ae2b-b811fddbf820 for instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 on n-h1-master-1 Jul 01 10:33:34.549896 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 927/1794] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:33 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:34.553710 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1c1a3ffe-34b8-4ac3-b306-b380cb2e156f req-4031bd6d-c51c-464f-a60c-8744f3561769 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081375 Jul 01 10:33:34.557847 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 868/1795] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:35.072967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2933d2d5-f9ce-4515-8c82-1f9dad57d726 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f91ab3ee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRv5TzAotLsFsOPAmVZtOIleXR2bo71X+7p/jBbpcpkOvFkxg+/ev+7CzIJCdIrBmUG9cPkguaA4MG2IKjtOm1TjHwiapPdicqHXPB0yYhUQ16tk3ZhVwHC1S+82GTpIQ=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:35.097820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2933d2d5-f9ce-4515-8c82-1f9dad57d726 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2933d2d5-f9ce-4515-8c82-1f9dad57d726 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 257 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRv5TzAotLsFsOPAmVZtOIleXR2bo71X+7p/jBbpcpkOvFkxg+/ev+7CzIJCdIrBmUG9cPkguaA4MG2IKjtOm1TjHwiapPdicqHXPB0yYhUQ16tk3ZhVwHC1S+82GTpIQ=="}} Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRv5TzAotLsFsOPAmVZtOIleXR2bo71X+7p/jBbpcpkOvFkxg+/ev+7CzIJCdIrBmUG9cPkguaA4MG2IKjtOm1TjHwiapPdicqHXPB0yYhUQ16tk3ZhVwHC1S+82GTpIQ=='}}} Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:35.105838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2933d2d5-f9ce-4515-8c82-1f9dad57d726 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:35.112833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2933d2d5-f9ce-4515-8c82-1f9dad57d726 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.271799 Jul 01 10:33:35.116521 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 928/1796] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:33:34 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:33:35.127555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50071fdd-b354-4da5-bcc5-b8294dc3b144 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f9249d8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-955350811", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:35.159893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-50071fdd-b354-4da5-bcc5-b8294dc3b144 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:35.174161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-50071fdd-b354-4da5-bcc5-b8294dc3b144 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for user 839bdd4c0c1c4fb59769dd0b64a8574c and project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:35.241993 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-50071fdd-b354-4da5-bcc5-b8294dc3b144 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50071fdd-b354-4da5-bcc5-b8294dc3b144 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 2166 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-955350811", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:33:35.263546 n-d-master-1 devstack@n-api.service[119764]: exception: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-955350811', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:35.266487 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50071fdd-b354-4da5-bcc5-b8294dc3b144 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50071fdd-b354-4da5-bcc5-b8294dc3b144 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.142596 Jul 01 10:33:35.269916 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 869/1797] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Jul 1 10:33:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 01 10:33:35.278442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ba61545-7b20-4384-b3a6-ae74aebd5b45 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f970e5550>, body: {"keypair": {"name": "tempest-keypair-1872823151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBO7/A4ivDmmoeGkloQVfd7hmoOpMmcAsZ4vQOF0LHV2FHYHC7C3K9dLC1L9kdEuLhFm9z9kfdutI/Xj/IZbqORP0qZWfnMnSmYp8h7l1aMfMgki6S63vWQPEfGcIW6ShQ=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:35.299452 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=94,nova_api:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:35.332294 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3ba61545-7b20-4384-b3a6-ae74aebd5b45 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:35.347551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3ba61545-7b20-4384-b3a6-ae74aebd5b45 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for user 839bdd4c0c1c4fb59769dd0b64a8574c and project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:35.486513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:35.490754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:35.498842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:35.499302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:35.501111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:35.501651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:35.610363 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ba61545-7b20-4384-b3a6-ae74aebd5b45 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.336501 Jul 01 10:33:35.612062 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 929/1798] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:33:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:35.617617 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:35.619737 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:35.633612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:35.634294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:35.635322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:35.636122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:35.714327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:35.714798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:35.715318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lazy-loading 'fault' on Instance uuid 24538e8f-7a7d-484f-9009-8a6fc6c90653 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:33:35.833555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519e73d755d410c91822c5717d31506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcff43a96824fe3ab1d7a867f8bc7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:35.836905 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-64cb08fd-5358-4b7f-9f5e-e3dfe086d1d0 tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 200 len: 1306 microversion: 2.1 time: 0.221492 Jul 01 10:33:35.849835 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 930/1799] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:35 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 1306 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:35.856542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-807e93c3-74f9-4dbe-a30e-86f00c718f89 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f970e5940>, body: {"keypair": {"name": "tempest-keypair-1872823151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJxntWgPq+PxSdJA3RU3XrbWeG6jfe70NMhvc/M1bA81NBsyMVc3F1oKoDzcMWMtG+jt1AJvgECxwAdXPDfdceH5aSPgkVp8wSNpS0nahZ3HXBUu+jP2+gtrjamdMQzpA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:35.875122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-807e93c3-74f9-4dbe-a30e-86f00c718f89 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:35.885426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-807e93c3-74f9-4dbe-a30e-86f00c718f89 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for user 839bdd4c0c1c4fb59769dd0b64a8574c and project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:36.007847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:36.016206 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8259d638-c52e-4f87-9ad3-4205d7d88ff5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1645 microversion: 2.1 time: 0.533444 Jul 01 10:33:36.016934 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 870/1800] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:35 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1645 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:36.031492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-45710723-9e5f-4c69-a54a-8ad51ed82d41 req-265f3ce7-139a-490c-ba38-b24ab27777d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-unplugged", "status": "completed", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:36.040036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-45710723-9e5f-4c69-a54a-8ad51ed82d41 req-265f3ce7-139a-490c-ba38-b24ab27777d0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:36.040744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-45710723-9e5f-4c69-a54a-8ad51ed82d41 req-265f3ce7-139a-490c-ba38-b24ab27777d0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:36.053789 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-45710723-9e5f-4c69-a54a-8ad51ed82d41 req-265f3ce7-139a-490c-ba38-b24ab27777d0 service nova] Creating event network-vif-unplugged:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:33:36.059614 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-45710723-9e5f-4c69-a54a-8ad51ed82d41 req-265f3ce7-139a-490c-ba38-b24ab27777d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031773 Jul 01 10:33:36.060759 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 871/1801] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:33:36.227285 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-807e93c3-74f9-4dbe-a30e-86f00c718f89 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] HTTP exception thrown: Key pair 'tempest-keypair-1872823151' already exists. Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-807e93c3-74f9-4dbe-a30e-86f00c718f89 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 273 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: {"keypair": {"name": "tempest-keypair-1872823151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJxntWgPq+PxSdJA3RU3XrbWeG6jfe70NMhvc/M1bA81NBsyMVc3F1oKoDzcMWMtG+jt1AJvgECxwAdXPDfdceH5aSPgkVp8wSNpS0nahZ3HXBUu+jP2+gtrjamdMQzpA=="}} Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: exception: Key pair 'tempest-keypair-1872823151' already exists. Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1872823151', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJxntWgPq+PxSdJA3RU3XrbWeG6jfe70NMhvc/M1bA81NBsyMVc3F1oKoDzcMWMtG+jt1AJvgECxwAdXPDfdceH5aSPgkVp8wSNpS0nahZ3HXBUu+jP2+gtrjamdMQzpA=='}}} Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result.read() Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '839bdd4c0c1c4fb59769dd0b64a8574c-tempest-keypair-1872823151' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 01 10:33:36.250607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi session.flush() Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result.read() Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 01 10:33:36.259237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '839bdd4c0c1c4fb59769dd0b64a8574c-tempest-keypair-1872823151' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 1, 10, 33, 35, 932304), 'updated_at': None, 'name': 'tempest-keypair-1872823151', 'user_id': '839bdd4c0c1c4fb59769dd0b64a8574c', 'fingerprint': 'f5:ab:09:0c:7f:60:4c:32:04:80:1c:69:16:64:47:5b', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJxntWgPq+PxSdJA3RU3XrbWeG6jfe70NMhvc/M1bA81NBsyMVc3F1oKoDzcMWMtG+jt1AJvgECxwAdXPDfdceH5aSPgkVp8wSNpS0nahZ3HXBUu+jP2+gtrjamdMQzpA==', 'type': 'ssh'}] Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi keypair.create() Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._create() Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1872823151' already exists. Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 01 10:33:36.264223 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1872823151' already exists. Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1872823151' already exists. Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-807e93c3-74f9-4dbe-a30e-86f00c718f89 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 409 to user: Key pair 'tempest-keypair-1872823151' already exists. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-807e93c3-74f9-4dbe-a30e-86f00c718f89 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.404438 Jul 01 10:33:36.269391 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 931/1802] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:33:35 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 410 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:33:36.270531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-568daa64-65d3-46c7-9bc0-eac27b2f09c6 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Calling method '.version_select at 0x7f6f97125280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:36.409722 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-568daa64-65d3-46c7-9bc0-eac27b2f09c6 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872823151" status: 202 len: 0 microversion: 2.1 time: 0.148429 Jul 01 10:33:36.418643 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 872/1803] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872823151 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:36.425386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-01af6f32-4009-4601-9f2e-92927a9765c3 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f91ab3310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0tNZrLrR7MMmzofqU+XRYF/pe+lr6/MWgk+d20JslwRo4FrCMBtircdoLHHT219jwtTmhnrujcSuT4+YHhVAiqZsMYcY2KaCBWVpJ8b0Quyh8JAA6HVVQWbkMZPaOITg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-01af6f32-4009-4601-9f2e-92927a9765c3 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 247 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0tNZrLrR7MMmzofqU+XRYF/pe+lr6/MWgk+d20JslwRo4FrCMBtircdoLHHT219jwtTmhnrujcSuT4+YHhVAiqZsMYcY2KaCBWVpJ8b0Quyh8JAA6HVVQWbkMZPaOITg=="}} Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0tNZrLrR7MMmzofqU+XRYF/pe+lr6/MWgk+d20JslwRo4FrCMBtircdoLHHT219jwtTmhnrujcSuT4+YHhVAiqZsMYcY2KaCBWVpJ8b0Quyh8JAA6HVVQWbkMZPaOITg=='}}} Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '' Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:33:36.431276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-01af6f32-4009-4601-9f2e-92927a9765c3 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:36.441074 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-01af6f32-4009-4601-9f2e-92927a9765c3 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018926 Jul 01 10:33:36.447244 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 932/1804] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:33:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:33:36.453957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5141cbfa-9a11-4e4d-a24a-ce7c9f683855 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f970dddc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2024295705", "public_key": " "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:36.482745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5141cbfa-9a11-4e4d-a24a-ce7c9f683855 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:36.490099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5141cbfa-9a11-4e4d-a24a-ce7c9f683855 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for user 839bdd4c0c1c4fb59769dd0b64a8574c and project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:36.512765 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5141cbfa-9a11-4e4d-a24a-ce7c9f683855 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5141cbfa-9a11-4e4d-a24a-ce7c9f683855 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 95 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2024295705", "public_key": " "}} Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: exception: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2024295705', 'public_key': ' '}}} Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.515086 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.520939 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.524242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5141cbfa-9a11-4e4d-a24a-ce7c9f683855 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:36.525361 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5141cbfa-9a11-4e4d-a24a-ce7c9f683855 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076748 Jul 01 10:33:36.526498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 873/1805] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Jul 1 10:33:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:33:36.539597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be54bb10-6243-46a7-88a2-0c65137bec7c tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f970e5e50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgr+sllDbHUsc6fBVIKZ4m33Va8a9EzHa8OHkg5pTTaLinxC5D2Gc/ExXyx6/JXgkWKyzRCvoQYt0rDRny29J4lPS/9GScxCQwHHo9Vyz9x9tGZKxV2KEyUaZGyr2yBZA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be54bb10-6243-46a7-88a2-0c65137bec7c tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 507 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgr+sllDbHUsc6fBVIKZ4m33Va8a9EzHa8OHkg5pTTaLinxC5D2Gc/ExXyx6/JXgkWKyzRCvoQYt0rDRny29J4lPS/9GScxCQwHHo9Vyz9x9tGZKxV2KEyUaZGyr2yBZA=="}} Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgr+sllDbHUsc6fBVIKZ4m33Va8a9EzHa8OHkg5pTTaLinxC5D2Gc/ExXyx6/JXgkWKyzRCvoQYt0rDRny29J4lPS/9GScxCQwHHo9Vyz9x9tGZKxV2KEyUaZGyr2yBZA=='}}} Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 01 10:33:36.545060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.549726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be54bb10-6243-46a7-88a2-0c65137bec7c tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:36.552308 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-be54bb10-6243-46a7-88a2-0c65137bec7c tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012146 Jul 01 10:33:36.552308 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 933/1806] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:33:36 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:33:36.574348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e478695d-3cd8-4403-8c66-267739a41046 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Action: 'create', calling method: .version_select at 0x7f6f970fee50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1514514716", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:36.603277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e478695d-3cd8-4403-8c66-267739a41046 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:36.633769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e478695d-3cd8-4403-8c66-267739a41046 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Getting quotas for user 839bdd4c0c1c4fb59769dd0b64a8574c and project 751a6886a26b4ac790c3e50a5b285207. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:36.688417 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e478695d-3cd8-4403-8c66-267739a41046 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e478695d-3cd8-4403-8c66-267739a41046 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 118 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1514514716", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: exception: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1514514716', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 01 10:33:36.698734 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.704825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e478695d-3cd8-4403-8c66-267739a41046 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:36.711527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e478695d-3cd8-4403-8c66-267739a41046 tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.128034 Jul 01 10:33:36.713044 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 874/1807] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:33:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:33:36.724758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36021142-f254-451b-b062-1283d8def89e tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Calling method '.version_select at 0x7f6f9212a790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:36.739213 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-36021142-f254-451b-b062-1283d8def89e tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1483753150 not found for user 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36021142-f254-451b-b062-1283d8def89e tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Request method failure captured: Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1483753150 HTTP/1.1 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs1-8njnLH67YKOSF3AXvHR_NS3rOb1GoARNW8H_YfvySKalCfHO3ZTx-A3fEC99JSh4hj0axe3EOHvqWNNfpHNgQpZFJtv26lNNFoYtUdsiYW7oEmgd0CZt81QPl7EUbiuhPp7c12IXVQsPG_RFjCyn1RuxcF9YRrq8wHXplSlYSPM Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751a6886a26b4ac790c3e50a5b285207", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751a6886a26b4ac790c3e50a5b285207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 751a6886a26b4ac790c3e50a5b285207 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1846407579 Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1846407579-project Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: exception: Keypair tempest-keypair-non-existent-1483753150 not found for user 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'tempest-keypair-non-existent-1483753150'} Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1483753150 not found for user 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.741431 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1483753150 not found for user 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1483753150 not found for user 839bdd4c0c1c4fb59769dd0b64a8574c Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36021142-f254-451b-b062-1283d8def89e tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1483753150 not found for user 839bdd4c0c1c4fb59769dd0b64a8574c {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-36021142-f254-451b-b062-1283d8def89e tempest-KeyPairsNegativeTestJSON-1846407579 tempest-KeyPairsNegativeTestJSON-1846407579-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1483753150" status: 404 len: 145 microversion: 2.1 time: 0.022719 Jul 01 10:33:36.756821 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 934/1808] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1483753150 => generated 145 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:36.867494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:36.869633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] [instance: 24538e8f-7a7d-484f-9009-8a6fc6c90653] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:36.884041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:36.884810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:36.911782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:36.912248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:37.019879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] HTTP exception thrown: Instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 could not be found. Jul 01 10:33:37.036520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:37.038153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Request method failure captured: Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 HTTP/1.1 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs1lBlO-8ILRtEIa4div7t0Cnw_Bzl77grPA7E6q2LzFkq5vn8TCj4s8Wu76CPYiHV_5RyJNnfb0SaLE9ElKlgJ9Ec1drJjWVPxhYPQFbd3mdNOiepAN74d3tebyuggMC1ZNGKWKEqj48PSoSvsAk037d-5WNmK25ko1pW79Eso3vAg Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: edcff43a96824fe3ab1d7a867f8bc7c8 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerAddressesTestJSON-799080478 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edcff43a96824fe3ab1d7a867f8bc7c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edcff43a96824fe3ab1d7a867f8bc7c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edcff43a96824fe3ab1d7a867f8bc7c8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edcff43a96824fe3ab1d7a867f8bc7c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerAddressesTestJSON-799080478 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: edcff43a96824fe3ab1d7a867f8bc7c8 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerAddressesTestJSON-799080478 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerAddressesTestJSON-799080478-project Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b519e73d755d410c91822c5717d31506 Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerAddressesTestJSON-799080478-project Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 could not be found. Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '24538e8f-7a7d-484f-9009-8a6fc6c90653'} Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 could not be found. Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 could not be found. Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:37.050007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:37.055384 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:37.055384 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:37.055384 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:37.055384 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:37.055384 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:37.055384 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 could not be found. Jul 01 10:33:37.055384 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:37.059108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] Returning 404 to user: Instance 24538e8f-7a7d-484f-9009-8a6fc6c90653 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:37.062631 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b8eb4bc-4a95-4258-82b6-6699254d776b tempest-ServerAddressesTestJSON-799080478 tempest-ServerAddressesTestJSON-799080478-project] 10.222.0.23 "GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653" status: 404 len: 111 microversion: 2.1 time: 0.209251 Jul 01 10:33:37.066084 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 875/1809] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:36 2022] GET /compute/v2.1/servers/24538e8f-7a7d-484f-9009-8a6fc6c90653 => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:37.068857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:37.076197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:37.077218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:37.080682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:37.126925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-637bcec4-626d-4628-8873-552e8e0fd39e req-2b6e808d-cbc8-4265-8f2b-a752665b20ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd8f777-3dba-4731-b2b4-00d4b2466d00", "name": "network-vif-deleted", "tag": "af79b018-1aee-4c87-902c-a90dcbde6f91"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:37.149101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-637bcec4-626d-4628-8873-552e8e0fd39e req-2b6e808d-cbc8-4265-8f2b-a752665b20ec service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:37.151415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-637bcec4-626d-4628-8873-552e8e0fd39e req-2b6e808d-cbc8-4265-8f2b-a752665b20ec service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:37.185342 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-637bcec4-626d-4628-8873-552e8e0fd39e req-2b6e808d-cbc8-4265-8f2b-a752665b20ec service nova] Creating event network-vif-deleted:af79b018-1aee-4c87-902c-a90dcbde6f91 for instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 on n-h2-master-1 Jul 01 10:33:37.223687 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-637bcec4-626d-4628-8873-552e8e0fd39e req-2b6e808d-cbc8-4265-8f2b-a752665b20ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104090 Jul 01 10:33:37.227279 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 876/1810] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:37.314232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:37.323917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9202510e-99d2-467c-a0e9-bcff3832bd7c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1466 microversion: 2.1 time: 0.293167 Jul 01 10:33:37.337093 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 935/1811] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:37 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1466 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:38.345089 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:38.346731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:38.361945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:38.362388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:38.373107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:38.373581 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:38.419391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:38.420104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:38.420731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lazy-loading 'fault' on Instance uuid fbd8f777-3dba-4731-b2b4-00d4b2466d00 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:33:38.571162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:38.584315 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc968109-ec45-41ad-855c-241784a4c012 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 200 len: 1304 microversion: 2.1 time: 0.241395 Jul 01 10:33:38.585102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 877/1812] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:38 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:38.872342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:38.873626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:38.896368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:38.903014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:38.903863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:38.904298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:39.221207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:39.240321 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cc1a32a2-bdc0-4ea2-920f-3d1a89c34bd3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.376573 Jul 01 10:33:39.241718 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 936/1813] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:38 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:39.261586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:39.262547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:39.293026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:39.294133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:39.299693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:39.302734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:39.561240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:39.573655 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f58356e4-0f19-42cc-abf6-a4d0cd803157 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.319119 Jul 01 10:33:39.574913 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 878/1814] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:39 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:39.592530 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:39.596162 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:39.608052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:39.610377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:39.611749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:39.615735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:39.615890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:39.615992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:39.636401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:39.636855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:39.647176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:39.647743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:39.692307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 HTTP/1.1 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: exception: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'fbd8f777-3dba-4731-b2b4-00d4b2466d00'} Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:39.704470 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:39.712112 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:39.712112 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:39.712112 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:39.712112 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:39.712112 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:39.712112 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:39.712112 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:39.717290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:39.718803 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43444b6d-6189-46b9-9498-4d6810d34bf6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 404 len: 111 microversion: 2.1 time: 0.118623 Jul 01 10:33:39.720569 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 879/1815] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:39 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:39.729267 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6e824bbb-a3e0-45ab-bd49-bcca4dd27469 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f9709e160>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:40.431298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:40.445903 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d50c1f9f-dcb5-41d4-b6d6-b9c472cb16b7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.859504 Jul 01 10:33:40.449248 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 937/1816] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:39 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:40.468826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-83b71fd8-3cad-4ecd-9176-767322883d39 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:40.472439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-83b71fd8-3cad-4ecd-9176-767322883d39 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:40.493005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83b71fd8-3cad-4ecd-9176-767322883d39 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:40.518106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83b71fd8-3cad-4ecd-9176-767322883d39 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:40.519021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83b71fd8-3cad-4ecd-9176-767322883d39 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:40.519479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83b71fd8-3cad-4ecd-9176-767322883d39 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:40.746377 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6e824bbb-a3e0-45ab-bd49-bcca4dd27469 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1" status: 202 len: 0 microversion: 2.1 time: 1.021791 Jul 01 10:33:40.748032 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 880/1817] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:39 2022] DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1 => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:40.756567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-19ca13ae-c4ea-4552-be36-6c5314b10132 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f97081040>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:41.003006 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-83b71fd8-3cad-4ecd-9176-767322883d39 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.536398 Jul 01 10:33:41.003006 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 938/1818] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:33:40 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:41.014953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:41.015684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:41.039889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:41.044123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:41.047917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:41.052850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:41.118529 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=9 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:41.330998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:41.355965 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1454913c-590f-48db-858f-f0f09c3b07dd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1673 microversion: 2.1 time: 0.349182 Jul 01 10:33:41.356881 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 939/1819] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:41 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1673 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:41.459089 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-19ca13ae-c4ea-4552-be36-6c5314b10132 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc" status: 202 len: 0 microversion: 2.1 time: 0.707309 Jul 01 10:33:41.459672 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 881/1820] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:40 2022] DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:41.476666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-265d0ccb-c6f6-4d8c-b6f7-a4d0903934d3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'create', calling method: .version_select at 0x7f6f96f418b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1464253093", "description": "tempest-description-213759384"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:42.043054 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-265d0ccb-c6f6-4d8c-b6f7-a4d0903934d3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.572616 Jul 01 10:33:42.043657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 940/1821] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:33:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:33:42.055397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-24fb4da4-e7c9-46b1-8eca-5e7e99842864 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Action: 'update', calling method: .version_select at 0x7f6f970ece50>, body: {"security_group": {"name": "tempest-sg-hth-1593508174", "description": "tempest-description-hth-1006186610"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:42.376526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:42.377267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:42.392315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:42.392761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:42.393643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:42.394085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:42.411993 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-24fb4da4-e7c9-46b1-8eca-5e7e99842864 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/252e3cfa-7957-4619-bc99-fda33d8405e1" status: 200 len: 218 microversion: 2.1 time: 0.360744 Jul 01 10:33:42.413630 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 882/1822] 10.222.0.23 () {60 vars in 1289 bytes} [Fri Jul 1 10:33:42 2022] PUT /compute/v2.1/os-security-groups/252e3cfa-7957-4619-bc99-fda33d8405e1 => generated 218 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:42.424256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53a33c1c-9c96-478a-971b-8ffe1d950463 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f970fed30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:42.582743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53a33c1c-9c96-478a-971b-8ffe1d950463 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/252e3cfa-7957-4619-bc99-fda33d8405e1" status: 200 len: 218 microversion: 2.1 time: 0.162264 Jul 01 10:33:42.583634 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 883/1823] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:33:42 2022] GET /compute/v2.1/os-security-groups/252e3cfa-7957-4619-bc99-fda33d8405e1 => generated 218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:33:42.596450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58f92487-f560-4429-b969-bc7af1a995a4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f91bd8ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:42.778290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:42.790297 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b65b44ce-01c5-40cf-ab9e-0288136feaf0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1673 microversion: 2.1 time: 0.416935 Jul 01 10:33:42.811091 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 941/1824] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:42 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1673 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:43.227380 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58f92487-f560-4429-b969-bc7af1a995a4 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/252e3cfa-7957-4619-bc99-fda33d8405e1" status: 202 len: 0 microversion: 2.1 time: 0.634468 Jul 01 10:33:43.228138 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 884/1825] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:42 2022] DELETE /compute/v2.1/os-security-groups/252e3cfa-7957-4619-bc99-fda33d8405e1 => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:33:43.247720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.248190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:43.259924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:43.260946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:43.261783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:43.262278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:43.290879 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 HTTP/1.1 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: exception: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'fbd8f777-3dba-4731-b2b4-00d4b2466d00'} Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:33:43.292625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51b776bf-43f9-40bb-a6e0-67282c767a6e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 404 len: 111 microversion: 2.1 time: 0.061066 Jul 01 10:33:43.301956 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 942/1826] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:43.310096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.310690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: fbd8f777-3dba-4731-b2b4-00d4b2466d00] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:43.325313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:43.325313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:43.325313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:43.325313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:43.359165 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 HTTP/1.1 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: exception: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'fbd8f777-3dba-4731-b2b4-00d4b2466d00'} Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.360748 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Instance fbd8f777-3dba-4731-b2b4-00d4b2466d00 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.366465 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-882baebc-9ce2-47bb-ae49-98e11fa5dc6c tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00" status: 404 len: 111 microversion: 2.1 time: 0.062430 Jul 01 10:33:43.370918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46ac6bfc-d517-4337-9394-a9f8aaa61059 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f96ee04c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.374310 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 885/1827] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:43 2022] GET /compute/v2.1/servers/fbd8f777-3dba-4731-b2b4-00d4b2466d00 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:43.399520 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-46ac6bfc-d517-4337-9394-a9f8aaa61059 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:43.400247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-46ac6bfc-d517-4337-9394-a9f8aaa61059 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group 0ce68847-f870-4d03-8c54-d493009895bc not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:33:43.400866 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-46ac6bfc-d517-4337-9394-a9f8aaa61059 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist Jul 01 10:33:43.400866 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-88ab51d1-f47a-4827-a189-b58e6eb2d711'] Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46ac6bfc-d517-4337-9394-a9f8aaa61059 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc HTTP/1.1 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-88ab51d1-f47a-4827-a189-b58e6eb2d711'] Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0ce68847-f870-4d03-8c54-d493009895bc'} Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:43.403317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ab51d1-f47a-4827-a189-b58e6eb2d711'] Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ab51d1-f47a-4827-a189-b58e6eb2d711'] Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ab51d1-f47a-4827-a189-b58e6eb2d711'] Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ab51d1-f47a-4827-a189-b58e6eb2d711'] Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46ac6bfc-d517-4337-9394-a9f8aaa61059 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group 0ce68847-f870-4d03-8c54-d493009895bc does not exist Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-88ab51d1-f47a-4827-a189-b58e6eb2d711'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46ac6bfc-d517-4337-9394-a9f8aaa61059 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc" status: 404 len: 194 microversion: 2.1 time: 0.038878 Jul 01 10:33:43.408796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 943/1828] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/os-security-groups/0ce68847-f870-4d03-8c54-d493009895bc => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:43.417206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7543b75c-98a8-45f7-96bc-5ddecb8b47c6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f97105ee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.448853 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-7543b75c-98a8-45f7-96bc-5ddecb8b47c6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:43.450032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-7543b75c-98a8-45f7-96bc-5ddecb8b47c6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group 54928574-3a76-42ec-afbd-bedaed5a36c1 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:33:43.450578 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7543b75c-98a8-45f7-96bc-5ddecb8b47c6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist Jul 01 10:33:43.450578 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a0eec279-4cb0-4bfa-8642-fda147f9d3c0'] Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7543b75c-98a8-45f7-96bc-5ddecb8b47c6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1 HTTP/1.1 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a0eec279-4cb0-4bfa-8642-fda147f9d3c0'] Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '54928574-3a76-42ec-afbd-bedaed5a36c1'} Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:43.452781 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0eec279-4cb0-4bfa-8642-fda147f9d3c0'] Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0eec279-4cb0-4bfa-8642-fda147f9d3c0'] Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0eec279-4cb0-4bfa-8642-fda147f9d3c0'] Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0eec279-4cb0-4bfa-8642-fda147f9d3c0'] Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7543b75c-98a8-45f7-96bc-5ddecb8b47c6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group 54928574-3a76-42ec-afbd-bedaed5a36c1 does not exist Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-a0eec279-4cb0-4bfa-8642-fda147f9d3c0'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7543b75c-98a8-45f7-96bc-5ddecb8b47c6 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1" status: 404 len: 194 microversion: 2.1 time: 0.043653 Jul 01 10:33:43.458085 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 944/1829] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/os-security-groups/54928574-3a76-42ec-afbd-bedaed5a36c1 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:33:43.470524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12934161-7365-4407-8c82-8dcf39fec28e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f97105dc0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.524711 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-12934161-7365-4407-8c82-8dcf39fec28e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:43.525966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-12934161-7365-4407-8c82-8dcf39fec28e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group 166d0542-c07b-4949-9cdc-cbd439a06154 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:33:43.527152 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-12934161-7365-4407-8c82-8dcf39fec28e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:33:43.527152 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-301be51e-4834-4a38-ba66-c29108d82879'] Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12934161-7365-4407-8c82-8dcf39fec28e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154 HTTP/1.1 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-301be51e-4834-4a38-ba66-c29108d82879'] Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '166d0542-c07b-4949-9cdc-cbd439a06154'} Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:43.529427 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-301be51e-4834-4a38-ba66-c29108d82879'] Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-301be51e-4834-4a38-ba66-c29108d82879'] Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-301be51e-4834-4a38-ba66-c29108d82879'] Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-301be51e-4834-4a38-ba66-c29108d82879'] Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12934161-7365-4407-8c82-8dcf39fec28e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group 166d0542-c07b-4949-9cdc-cbd439a06154 does not exist Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-301be51e-4834-4a38-ba66-c29108d82879'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-12934161-7365-4407-8c82-8dcf39fec28e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154" status: 404 len: 194 microversion: 2.1 time: 0.073642 Jul 01 10:33:43.540155 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 945/1830] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/os-security-groups/166d0542-c07b-4949-9cdc-cbd439a06154 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:33:43.549585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-042ffac0-e2a2-4a17-b3b5-1da933df4837 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f96f415e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.632667 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-042ffac0-e2a2-4a17-b3b5-1da933df4837 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:43.634467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-042ffac0-e2a2-4a17-b3b5-1da933df4837 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group 31595849-325f-492b-b4f1-26d0c745a6e3 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:33:43.635038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-042ffac0-e2a2-4a17-b3b5-1da933df4837 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:33:43.635038 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-cb10852f-5149-4bcf-94e5-32abeb5579e7'] Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-042ffac0-e2a2-4a17-b3b5-1da933df4837 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3 HTTP/1.1 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-cb10852f-5149-4bcf-94e5-32abeb5579e7'] Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '31595849-325f-492b-b4f1-26d0c745a6e3'} Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:43.638904 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb10852f-5149-4bcf-94e5-32abeb5579e7'] Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb10852f-5149-4bcf-94e5-32abeb5579e7'] Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb10852f-5149-4bcf-94e5-32abeb5579e7'] Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb10852f-5149-4bcf-94e5-32abeb5579e7'] Jul 01 10:33:43.643311 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.652060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-042ffac0-e2a2-4a17-b3b5-1da933df4837 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group 31595849-325f-492b-b4f1-26d0c745a6e3 does not exist Jul 01 10:33:43.652060 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-cb10852f-5149-4bcf-94e5-32abeb5579e7'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.652060 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-042ffac0-e2a2-4a17-b3b5-1da933df4837 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3" status: 404 len: 194 microversion: 2.1 time: 0.106109 Jul 01 10:33:43.652060 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 946/1831] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/os-security-groups/31595849-325f-492b-b4f1-26d0c745a6e3 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:43.655802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b00e6fb0-6716-4319-b02e-7b9b833d0a5f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f97105820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.692362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-416449540", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:43.725651 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-b00e6fb0-6716-4319-b02e-7b9b833d0a5f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:43.726242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-b00e6fb0-6716-4319-b02e-7b9b833d0a5f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group c81eb904-2d40-4dd0-b3ad-df50220a56da not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:33:43.726764 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b00e6fb0-6716-4319-b02e-7b9b833d0a5f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:33:43.726764 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-17cb53d2-0d34-4474-9cf9-587c76c1cd2d'] Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b00e6fb0-6716-4319-b02e-7b9b833d0a5f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da HTTP/1.1 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: exception: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-17cb53d2-0d34-4474-9cf9-587c76c1cd2d'] Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c81eb904-2d40-4dd0-b3ad-df50220a56da'} Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:43.728608 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17cb53d2-0d34-4474-9cf9-587c76c1cd2d'] Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17cb53d2-0d34-4474-9cf9-587c76c1cd2d'] Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17cb53d2-0d34-4474-9cf9-587c76c1cd2d'] Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17cb53d2-0d34-4474-9cf9-587c76c1cd2d'] Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b00e6fb0-6716-4319-b02e-7b9b833d0a5f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group c81eb904-2d40-4dd0-b3ad-df50220a56da does not exist Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-17cb53d2-0d34-4474-9cf9-587c76c1cd2d'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.733037 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b00e6fb0-6716-4319-b02e-7b9b833d0a5f tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da" status: 404 len: 194 microversion: 2.1 time: 0.078161 Jul 01 10:33:43.736046 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 947/1832] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/os-security-groups/c81eb904-2d40-4dd0-b3ad-df50220a56da => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:43.738721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e91fd3d-a48e-498b-aac4-394291c9436a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f97105040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.784371 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-0e91fd3d-a48e-498b-aac4-394291c9436a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:33:43.785705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-0e91fd3d-a48e-498b-aac4-394291c9436a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Neutron security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:33:43.786388 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0e91fd3d-a48e-498b-aac4-394291c9436a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:33:43.786388 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-26256f13-a90a-4444-b3ff-9fe921dbe8dc'] Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e91fd3d-a48e-498b-aac4-394291c9436a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4 HTTP/1.1 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: exception: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-26256f13-a90a-4444-b3ff-9fe921dbe8dc'] Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'aac60fdd-d1bc-4524-967a-44dd9d0504a4'} Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:33:43.789373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26256f13-a90a-4444-b3ff-9fe921dbe8dc'] Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26256f13-a90a-4444-b3ff-9fe921dbe8dc'] Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26256f13-a90a-4444-b3ff-9fe921dbe8dc'] Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26256f13-a90a-4444-b3ff-9fe921dbe8dc'] Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e91fd3d-a48e-498b-aac4-394291c9436a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Security group aac60fdd-d1bc-4524-967a-44dd9d0504a4 does not exist Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-26256f13-a90a-4444-b3ff-9fe921dbe8dc'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e91fd3d-a48e-498b-aac4-394291c9436a tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4" status: 404 len: 194 microversion: 2.1 time: 0.060606 Jul 01 10:33:43.802605 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 948/1833] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/os-security-groups/aac60fdd-d1bc-4524-967a-44dd9d0504a4 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:43.806380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:33:43.813773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:43.814532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:43.837065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:43.840804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:43.842545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:43.843176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:43.918762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:33:44.142990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:33:44.143653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:33:44.144403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:33:44.145326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:33:44.145978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:33:44.160862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.161378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.162186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.162634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.169636 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:44.184442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Getting quotas for project 1011ee3644bf4a5bbe5543dd53a20920. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:44.189697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Getting quotas for user 14ec7c115028492e8b2a6449b4c3dee7 and project 1011ee3644bf4a5bbe5543dd53a20920. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:44.204730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:33:44.207264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:33:44.236329 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:44.441427 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b14d30fe-ba3f-4462-a324-e9c7f80ef69c tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056701 Jul 01 10:33:44.445009 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 886/1834] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:33:44.454987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:44.455744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:44.463138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.464094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.465989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.468814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.586701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-79d19ee1-1030-4690-aae2-16b78e039d96 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 204 len: 0 microversion: 2.1 time: 0.785861 Jul 01 10:33:44.587563 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 949/1835] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:33:43 2022] DELETE /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:33:44.593587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62ba6d4a-7fc3-481d-a4ee-4dc0beb63c68 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:44.594320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62ba6d4a-7fc3-481d-a4ee-4dc0beb63c68 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:44.641695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:44.655682 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8d7d385e-7387-486e-8121-04b6aa935e7e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.208103 Jul 01 10:33:44.656826 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 887/1836] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:44 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:44.661661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:44.661908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62ba6d4a-7fc3-481d-a4ee-4dc0beb63c68 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:44.662493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:44.673724 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62ba6d4a-7fc3-481d-a4ee-4dc0beb63c68 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1222 microversion: 2.1 time: 0.084472 Jul 01 10:33:44.674785 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 950/1837] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:44 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:44.677989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.678808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.679728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef6a8acf-c967-4df1-a7ff-504a6ba5573c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:44.680465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.680632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef6a8acf-c967-4df1-a7ff-504a6ba5573c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:44.680916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.687284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef6a8acf-c967-4df1-a7ff-504a6ba5573c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.687735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef6a8acf-c967-4df1-a7ff-504a6ba5573c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.688506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef6a8acf-c967-4df1-a7ff-504a6ba5573c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.689177 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef6a8acf-c967-4df1-a7ff-504a6ba5573c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.755075 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef6a8acf-c967-4df1-a7ff-504a6ba5573c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 200 len: 322 microversion: 2.1 time: 0.078796 Jul 01 10:33:44.759543 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 951/1838] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:33:44 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 322 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:44.777191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:44.777191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:44.781670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.782378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:44.783375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:44.784021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:45.067360 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:45.075936 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ca93bcb-565e-40cf-9bf0-c0ad05c802b3 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1648 microversion: 2.1 time: 0.417797 Jul 01 10:33:45.076511 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 888/1839] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:44 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1648 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:45.085508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:45.092575 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6fb0a018-d84e-4a77-9ddd-3288df05a331 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.330597 Jul 01 10:33:45.093226 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 952/1840] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:44 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:45.111018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:45.111612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:45.118162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:45.118610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:45.119386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:45.120465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:45.265305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:45.284929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a3af8e79-f94c-4673-b1eb-478a885aaed8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.166277 Jul 01 10:33:45.284929 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 889/1841] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:45 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:45.291379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:45.292663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:45.300242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:45.300773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:45.301602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:45.302138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:45.454030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:45.461659 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-efd0b3da-09ac-4885-9af5-932cc30da929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.175064 Jul 01 10:33:45.462331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 953/1842] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:45 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:45.478301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:45.478940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:45.486184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:45.486758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:45.487779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:45.488216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:45.633659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-888670d8-1f74-4998-98de-2978eb0f7d6f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91ab3160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:45.672303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:45.684329 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0986d1c1-da29-4e3e-a73c-9a350b42c9ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.207815 Jul 01 10:33:45.687697 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-888670d8-1f74-4998-98de-2978eb0f7d6f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/9f8ca204-477d-4f38-8821-f29617381eec" status: 200 len: 662 microversion: 2.1 time: 0.058017 Jul 01 10:33:45.688517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 954/1843] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:33:45 2022] GET /compute/v2.1/images/9f8ca204-477d-4f38-8821-f29617381eec => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:45.693466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-882e6f0a-058f-403d-8fce-59ad7b44e888 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:45.698952 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 890/1844] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:45 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:45.699936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-882e6f0a-058f-403d-8fce-59ad7b44e888 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:45.764398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-74fc2114-c46a-42a2-9443-bb0673a00579 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970821f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:45.789225 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-74fc2114-c46a-42a2-9443-bb0673a00579 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/9f8ca204-477d-4f38-8821-f29617381eec" status: 200 len: 662 microversion: 2.1 time: 0.088516 Jul 01 10:33:45.790631 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 891/1845] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:33:45 2022] GET /compute/v2.1/images/9f8ca204-477d-4f38-8821-f29617381eec => generated 662 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:45.834855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-882e6f0a-058f-403d-8fce-59ad7b44e888 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:45.844673 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-882e6f0a-058f-403d-8fce-59ad7b44e888 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1222 microversion: 2.1 time: 0.154668 Jul 01 10:33:45.845673 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 955/1846] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:45 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:45.943914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1302840786", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "04eeb7f2-cad2-4f5d-96c5-202b3781e660"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:46.019897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] validate_networks() for [('04eeb7f2-cad2-4f5d-96c5-202b3781e660', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:33:46.099095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:46.101513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:46.113613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:46.114057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:46.114864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:46.115292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:46.745714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:46.754075 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c8cf9c1-cf3d-4b72-8538-4a0fd2c98994 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1648 microversion: 2.1 time: 0.661229 Jul 01 10:33:46.765913 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 956/1847] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:46 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1648 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:46.863783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:46.865802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:46.876906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:46.877288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:46.878290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:46.878726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:47.007540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:33:47.008770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:33:47.009464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:33:47.010049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:33:47.011318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:33:47.030954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:47.031416 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:47.032348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:47.032799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:47.100974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:47.100974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for user adf336817b04429b930e1f80ea25b1f7 and project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:47.119127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:33:47.122394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:33:47.205716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:47.208678 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:47.219070 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a8298b55-b64c-4dc4-ba64-c22f380888ba tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1226 microversion: 2.1 time: 0.358943 Jul 01 10:33:47.228273 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 957/1848] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:46 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1226 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:47.316333 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4b6e7952-2f13-42df-8ade-2830677a68c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376199 Jul 01 10:33:47.322022 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 892/1849] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:33:47.327603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1b1a08d7-076b-42b1-b0e8-e465c025ce43 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:47.328345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1b1a08d7-076b-42b1-b0e8-e465c025ce43 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:47.469661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1b1a08d7-076b-42b1-b0e8-e465c025ce43 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:47.479741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1b1a08d7-076b-42b1-b0e8-e465c025ce43 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1215 microversion: 2.1 time: 0.153874 Jul 01 10:33:47.480321 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 958/1850] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:47 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:47.772080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:47.773008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:47.786057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:47.787590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:47.795856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:47.796785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:47.918763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:47.923264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e83dfc7f-a87a-4d04-8815-56794693bacd req-6ba46bdc-14f7-4131-a6d2-00398e4573b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88347916-572c-4ee0-8918-473b01edc6d0", "name": "network-vif-deleted", "tag": "8a073947-b214-44c4-80dc-9bf621ffd488"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:47.927581 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1de7cdd9-dcf7-4e8e-a8f3-9f73914f6860 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1468 microversion: 2.1 time: 0.159022 Jul 01 10:33:47.928539 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 893/1851] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:47 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:47.934677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e83dfc7f-a87a-4d04-8815-56794693bacd req-6ba46bdc-14f7-4131-a6d2-00398e4573b1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:47.935447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e83dfc7f-a87a-4d04-8815-56794693bacd req-6ba46bdc-14f7-4131-a6d2-00398e4573b1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:47.950181 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e83dfc7f-a87a-4d04-8815-56794693bacd req-6ba46bdc-14f7-4131-a6d2-00398e4573b1 service nova] Creating event network-vif-deleted:8a073947-b214-44c4-80dc-9bf621ffd488 for instance 88347916-572c-4ee0-8918-473b01edc6d0 on n-h2-master-1 Jul 01 10:33:47.956748 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e83dfc7f-a87a-4d04-8815-56794693bacd req-6ba46bdc-14f7-4131-a6d2-00398e4573b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037986 Jul 01 10:33:47.957593 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 959/1852] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:33:48.236787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:48.240144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:48.250489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:48.250951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:48.251723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:48.252155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:48.397266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4383d5eb-36d0-44f5-b47a-35374322ef40 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96ed8820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:48.440451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:48.454009 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3d24927-d785-4c33-9e7b-e92fb6526cac tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1274 microversion: 2.1 time: 0.221545 Jul 01 10:33:48.457656 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4383d5eb-36d0-44f5-b47a-35374322ef40 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/dfbf1d01-f27d-4286-898c-8cf7f01dc817" status: 200 len: 662 microversion: 2.1 time: 0.065414 Jul 01 10:33:48.464772 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 960/1853] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:33:48 2022] GET /compute/v2.1/images/dfbf1d01-f27d-4286-898c-8cf7f01dc817 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:48.465262 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 894/1854] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:48 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1274 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:48.470676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e23918e9-cfea-4911-a418-9f5dc1ccb0f0 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f32b80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:48.497034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3432c35a-0154-47ec-9006-dedb261e95b6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:48.497755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3432c35a-0154-47ec-9006-dedb261e95b6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:48.519533 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e23918e9-cfea-4911-a418-9f5dc1ccb0f0 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/dfbf1d01-f27d-4286-898c-8cf7f01dc817" status: 200 len: 662 microversion: 2.1 time: 0.052632 Jul 01 10:33:48.520580 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 961/1855] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:33:48 2022] GET /compute/v2.1/images/dfbf1d01-f27d-4286-898c-8cf7f01dc817 => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:48.604126 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3432c35a-0154-47ec-9006-dedb261e95b6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:48.612934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3432c35a-0154-47ec-9006-dedb261e95b6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1215 microversion: 2.1 time: 0.119708 Jul 01 10:33:48.613901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 895/1856] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:48 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:48.946087 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:48.946953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:48.962645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:48.962645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:48.962645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:48.962645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:48.998783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:48.999273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:48.999720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lazy-loading 'fault' on Instance uuid 88347916-572c-4ee0-8918-473b01edc6d0 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:33:49.112554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275daef9a0aa460aaecb90de5e035c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8771160d78704ad687c0ea474b14d6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:49.124484 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-264b892b-7910-4d00-9126-d483e2829fec tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 200 len: 1305 microversion: 2.1 time: 0.182650 Jul 01 10:33:49.126487 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 962/1857] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:48 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:49.472731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:49.474031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:49.483392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:49.484146 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:49.484920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:49.485564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:49.599937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:49.608037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d457566e-11dd-4edc-8072-2bb11e473f73 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1292 microversion: 2.1 time: 0.139554 Jul 01 10:33:49.617721 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 896/1858] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:49 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1292 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:49.630674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:49.631485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:49.638306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:49.638757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:49.639715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:49.640162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:49.744058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:49.753297 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f889b0d8-422a-49b9-8436-0149b79d69d5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1219 microversion: 2.1 time: 0.126639 Jul 01 10:33:49.763638 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 963/1859] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:49 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:50.142850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:50.143945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] [instance: 88347916-572c-4ee0-8918-473b01edc6d0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:50.151977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:50.156431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:50.156431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:50.156431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:50.174877 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] HTTP exception thrown: Instance 88347916-572c-4ee0-8918-473b01edc6d0 could not be found. Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Request method failure captured: Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 HTTP/1.1 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs0XXhwaaxcdr-ErhvoW1-OASU0rJwoq6lU1H8JelsgwXx1a1IzX5TPBEio6hFNcK5b2psV0ZtDmfFVEZMAm8bs4lB9aMkFpdHXJEXgHaGl9BkJA30wPt7mP2ooFT9_3JpNIgJDpVGJL4LmU9zSVOgPYD3QC_Tufq_248Wz1CAtTBNM Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8771160d78704ad687c0ea474b14d6e1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8771160d78704ad687c0ea474b14d6e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8771160d78704ad687c0ea474b14d6e1 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-849877799 Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 275daef9a0aa460aaecb90de5e035c4d Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupsTestJSON-849877799-project Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 88347916-572c-4ee0-8918-473b01edc6d0 could not be found. Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '88347916-572c-4ee0-8918-473b01edc6d0'} Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88347916-572c-4ee0-8918-473b01edc6d0 could not be found. Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88347916-572c-4ee0-8918-473b01edc6d0 could not be found. Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:33:50.176735 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:50.182288 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:33:50.182288 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:33:50.182288 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:33:50.182288 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:33:50.182288 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:33:50.182288 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88347916-572c-4ee0-8918-473b01edc6d0 could not be found. Jul 01 10:33:50.182288 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:33:50.184539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Returning 404 to user: Instance 88347916-572c-4ee0-8918-473b01edc6d0 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:33:50.185744 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-feff4594-e984-4ea6-9853-ce8f1731ec21 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0" status: 404 len: 111 microversion: 2.1 time: 0.047351 Jul 01 10:33:50.186888 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 897/1860] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:50 2022] GET /compute/v2.1/servers/88347916-572c-4ee0-8918-473b01edc6d0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:33:50.195036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e2e2e70-bc0c-4e12-a735-dd17052cc1c5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f96efc820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:50.630369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:50.631713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:50.649826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:50.652474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:50.662013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:50.662013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:50.767228 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:50.778623 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ad3d97b-1dd9-47a6-80eb-150c71df01e2 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1280 microversion: 2.1 time: 0.156464 Jul 01 10:33:50.779257 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 898/1861] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:50 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:50.810375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:50.811600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:50.819253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:50.820214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:50.821345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:50.821848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:50.906967 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e2e2e70-bc0c-4e12-a735-dd17052cc1c5 tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/8048c8a0-32a0-4fef-98c4-6f6c5e593ad2" status: 202 len: 0 microversion: 2.1 time: 0.715923 Jul 01 10:33:50.913760 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 964/1862] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:50 2022] DELETE /compute/v2.1/os-security-groups/8048c8a0-32a0-4fef-98c4-6f6c5e593ad2 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:50.933158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:50.944177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-860ea32f-d616-459f-b953-eea7642c2fde tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1267 microversion: 2.1 time: 0.153830 Jul 01 10:33:50.953667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7367aaed-9e62-440a-a4ef-c9e7009dcd4e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] Calling method '.version_select at 0x7f6f96efc700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:50.956968 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 899/1863] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:50 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:51.046278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a9099b4-968c-47e0-859f-5ee1ab94fd59 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9709d700>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:51.106062 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a9099b4-968c-47e0-859f-5ee1ab94fd59 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/12d02cc6-eb90-47b6-b831-5959f82db7b0" status: 200 len: 662 microversion: 2.1 time: 0.063562 Jul 01 10:33:51.112945 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 900/1864] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:33:51 2022] GET /compute/v2.1/images/12d02cc6-eb90-47b6-b831-5959f82db7b0 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:51.122947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1120377-12cd-4fc9-aa01-7282a9cbe95d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9709e280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:51.176117 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1120377-12cd-4fc9-aa01-7282a9cbe95d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/12d02cc6-eb90-47b6-b831-5959f82db7b0" status: 200 len: 662 microversion: 2.1 time: 0.061179 Jul 01 10:33:51.176760 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 901/1865] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:33:51 2022] GET /compute/v2.1/images/12d02cc6-eb90-47b6-b831-5959f82db7b0 => generated 662 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:51.346724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-178824305", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:51.437296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:33:51.805403 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7367aaed-9e62-440a-a4ef-c9e7009dcd4e tempest-SecurityGroupsTestJSON-849877799 tempest-SecurityGroupsTestJSON-849877799-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/62008901-17a5-4821-a7ff-b5cec0ab4400" status: 202 len: 0 microversion: 2.1 time: 0.885334 Jul 01 10:33:51.809343 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 965/1866] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:33:50 2022] DELETE /compute/v2.1/os-security-groups/62008901-17a5-4821-a7ff-b5cec0ab4400 => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:33:51.817614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:51.819425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:51.834390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:51.835636 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:51.836671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:51.837472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:52.064176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:33:52.066078 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:33:52.067104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:33:52.067688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:33:52.069850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:33:52.087197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:52.087987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:52.089185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:52.089858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:52.114192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Getting quotas for project 31881aca19fe4da29fd3acf404dbdc1b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:52.120466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Getting quotas for user 8a322a37fe40476d86cf3f473752088a and project 31881aca19fe4da29fd3acf404dbdc1b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:52.136603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:33:52.140025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:33:52.152301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:52.173726 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8f672d1-2235-473e-bf00-4129301a5d1a tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1322 microversion: 2.1 time: 0.361580 Jul 01 10:33:52.187196 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 966/1867] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:51 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:52.192667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:52.193828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:52.202859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:52.203358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:52.204840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:52.205559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:52.293352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:52.307392 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1dce157d-2513-4cae-9a11-0b9292cbb8fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1273 microversion: 2.1 time: 0.118493 Jul 01 10:33:52.312651 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 967/1868] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:52 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:52.335634 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e57651ac-c7f9-4677-b04c-2d54f176c04b tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992833 Jul 01 10:33:52.336553 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 902/1869] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:33:52.402086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1944541622", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:52.479507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:33:53.217133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:53.219652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:53.255994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:53.270349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:53.270349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:53.270349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:53.271058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:33:53.271058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:33:53.271058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:33:53.271058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:33:53.271058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:33:53.290759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:53.298312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:53.302322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:53.320233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:53.384008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Getting quotas for project 31881aca19fe4da29fd3acf404dbdc1b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:33:53.391190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Getting quotas for user 8a322a37fe40476d86cf3f473752088a and project 31881aca19fe4da29fd3acf404dbdc1b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:33:53.407337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:33:53.410977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:33:53.497981 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:33:53.733613 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0b768ecc-1d2a-48ff-a797-cfc142f27fef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.336883 Jul 01 10:33:53.735517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 968/1870] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:33:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:33:53.754809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:53.755506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:53.777976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:53.778432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:53.779573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:53.780258 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:54.210448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:54.234820 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-55358ae7-dc98-481c-8032-e6b8d6a55d3d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1322 microversion: 2.1 time: 1.045009 Jul 01 10:33:54.243612 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 903/1871] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:53 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1322 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:54.251858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ceba6e5-d25f-4781-9089-411aa3b556eb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:54.260187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ceba6e5-d25f-4781-9089-411aa3b556eb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:54.443580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ceba6e5-d25f-4781-9089-411aa3b556eb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:54.457913 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ceba6e5-d25f-4781-9089-411aa3b556eb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1218 microversion: 2.1 time: 0.211702 Jul 01 10:33:54.458895 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 904/1872] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:54 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:54.470223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-309203f7-7425-45e2-9d5c-c04a8a85bcd7 req-bff46222-f8f5-423e-9fd8-b016fa247ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef9d5ac-3284-487d-8de9-7ff5fa832e77", "tag": "24606744-2e45-45e9-91a4-d3d40a60242a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:54.493950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-309203f7-7425-45e2-9d5c-c04a8a85bcd7 req-bff46222-f8f5-423e-9fd8-b016fa247ef3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:54.503055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-309203f7-7425-45e2-9d5c-c04a8a85bcd7 req-bff46222-f8f5-423e-9fd8-b016fa247ef3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:54.518453 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-309203f7-7425-45e2-9d5c-c04a8a85bcd7 req-bff46222-f8f5-423e-9fd8-b016fa247ef3 service nova] Creating event network-changed:24606744-2e45-45e9-91a4-d3d40a60242a for instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 on n-h1-master-1 Jul 01 10:33:54.529458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-309203f7-7425-45e2-9d5c-c04a8a85bcd7 req-bff46222-f8f5-423e-9fd8-b016fa247ef3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068526 Jul 01 10:33:54.531288 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 905/1873] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:54.561499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:54.574316 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d913eed-725c-48eb-8fc0-acfef80b3988 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1315 microversion: 2.1 time: 0.837456 Jul 01 10:33:54.575527 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 969/1874] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:53 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:55.258712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:55.259499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:55.273722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:55.274237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:55.275292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:55.276068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:55.476633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:55.477184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:55.499903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:55.506526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:55.508311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:55.508949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:55.789990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:55.799989 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3fae533f-9426-487a-b8b7-3120b48fbf99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1222 microversion: 2.1 time: 0.327350 Jul 01 10:33:55.800591 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 970/1875] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:55 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1222 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:55.805720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:55.806818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:55.813971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:55.814689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:55.815679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:55.816348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:56.147085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:56.165973 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f935ebc-2f20-4728-8efd-132da49a46cf tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1322 microversion: 2.1 time: 0.902001 Jul 01 10:33:56.177404 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 906/1876] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:55 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1322 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:56.230919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:56.245099 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-289aacbe-8015-4672-821e-8ba095614b90 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1315 microversion: 2.1 time: 0.440361 Jul 01 10:33:56.251756 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 971/1877] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:55 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:56.419589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef9e08cb-bccd-4b48-ba37-7a78a5fba616 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f97082dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-560454554", "description": "tempest-description-1121851763"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:56.825048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:56.825973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:56.838718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:56.839173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:56.844143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:56.844673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:57.151501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:57.170419 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f652cdc-f549-4858-b8fe-243a29b31f7a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1270 microversion: 2.1 time: 0.356717 Jul 01 10:33:57.171452 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 972/1878] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:56 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1270 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:33:57.188970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:57.198010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:57.230091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:57.230550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:57.234380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:57.240099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:57.815213 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:57.832471 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-79c22a7f-019e-424c-b630-ad6bdc7ac92d tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1322 microversion: 2.1 time: 0.645574 Jul 01 10:33:57.833874 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 973/1879] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:57 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:57.843450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:57.850089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:57.861435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:57.867269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:57.868492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:57.869240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:57.973655 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef9e08cb-bccd-4b48-ba37-7a78a5fba616 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.794264 Jul 01 10:33:57.976347 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 907/1880] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:33:56 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:57.991018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9dc7d0aa-414a-4212-8f7e-63ad7d1fd686 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f9708ddc0>, body: {"security_group_rule": {"parent_group_id": "1aa6e325-4a2b-477d-ac3e-387779c2218d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:58.811512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:58.823012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f37da9c0-edee-42a2-a5b7-2bc5d9acd1d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1315 microversion: 2.1 time: 0.987824 Jul 01 10:33:58.829263 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 974/1881] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:57 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:58.856495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6a7c935d-6720-483d-ba76-fb6fb82c1844 req-e3cca64d-30b3-41b3-a56f-79ba033a659b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ac2563-eab2-46bc-9f37-d99f043604d9", "tag": "88f28118-7e7b-49bb-8de1-107cc8b4288e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:33:58.863829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6a7c935d-6720-483d-ba76-fb6fb82c1844 req-e3cca64d-30b3-41b3-a56f-79ba033a659b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:58.864276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6a7c935d-6720-483d-ba76-fb6fb82c1844 req-e3cca64d-30b3-41b3-a56f-79ba033a659b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:58.889793 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6a7c935d-6720-483d-ba76-fb6fb82c1844 req-e3cca64d-30b3-41b3-a56f-79ba033a659b service nova] Creating event network-changed:88f28118-7e7b-49bb-8de1-107cc8b4288e for instance 29ac2563-eab2-46bc-9f37-d99f043604d9 on n-h1-master-1 Jul 01 10:33:58.899788 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6a7c935d-6720-483d-ba76-fb6fb82c1844 req-e3cca64d-30b3-41b3-a56f-79ba033a659b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069178 Jul 01 10:33:58.905684 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 975/1882] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:58.918859 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:58.920114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:58.932774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:58.933559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:58.934548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:58.935174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:59.191349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:59.244702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-55ac2eed-9401-46a1-824a-71e5db8c1c36 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1276 microversion: 2.1 time: 0.318833 Jul 01 10:33:59.265228 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 976/1883] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:58 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1276 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:33:59.293667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:59.305156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:33:59.309994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Searching by: {'deleted': False, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:33:59.325899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:59.326901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:59.329691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:59.333040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:59.581261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:33:59.771644 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d234f5b4-e340-46f0-bf96-f0a6cb7a53e4 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.503565 Jul 01 10:33:59.775588 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 977/1884] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:33:59 2022] GET /compute/v2.1/servers => generated 344 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:33:59.789600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:33:59.790207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:33:59.806249 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:59.816263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:33:59.816263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:33:59.816263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:00.828227 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9dc7d0aa-414a-4212-8f7e-63ad7d1fd686 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.843146 Jul 01 10:34:00.830237 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 908/1885] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:33:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:00.844095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:00.856366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:00.857685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Searching by: {'deleted': False, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:34:00.881784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:00.883213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:00.885173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:00.886722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:01.009569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:34:01.117970 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=35 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:01.122801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:01.139930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:01.142332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:01.383557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:01.403718 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76b159a1-9425-49f7-bd8a-16cd9e3f1eb9 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1322 microversion: 2.1 time: 1.626488 Jul 01 10:34:01.405679 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 978/1886] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:33:59 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1322 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:01.424693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:01.425488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:01.436385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:01.439058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:01.439058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:01.439058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:01.740062 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b36cd5c-fb7b-45ba-a792-55f8259a1691 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.908426 Jul 01 10:34:01.752541 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 909/1887] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:34:00 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:01.752541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:01.752541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:01.755745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:01.764323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:01.764323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:01.764323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:01.959509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:01.981470 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-12a90002-9914-4074-aa2e-9abf70b15a79 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1276 microversion: 2.1 time: 0.239056 Jul 01 10:34:01.992217 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 910/1888] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:01 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1276 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:02.007477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8244c46a-b19f-4017-9b17-12e1135508c5 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f92131e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-265663681", "description": "tempest-description-636107693"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:02.024288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:02.035229 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-26e93992-34a6-4ab2-89fb-a797c7699105 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1315 microversion: 2.1 time: 0.626786 Jul 01 10:34:02.036224 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 979/1889] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:01 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:02.042326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-218509999", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "510d1e57-c4e3-47f6-a81f-66e48831c93c"}], "block_device_mapping_v2": [{"uuid": "fb478ace-5752-463f-a8d9-65715fc72798", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:02.200631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] validate_networks() for [('510d1e57-c4e3-47f6-a81f-66e48831c93c', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:34:03.095360 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8244c46a-b19f-4017-9b17-12e1135508c5 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.101394 Jul 01 10:34:03.096705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 911/1890] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:34:01 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:03.116007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-118b18ff-e6e1-40c4-a44b-8aa72f8d8bae tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:03.129536 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-118b18ff-e6e1-40c4-a44b-8aa72f8d8bae tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031151 Jul 01 10:34:03.134273 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 912/1891] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:34:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:03.148201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-48073e2f-693f-4859-a347-e2389bdd8a94 req-408dd841-e98a-4c6c-80bd-c53168c7c20e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef9d5ac-3284-487d-8de9-7ff5fa832e77", "name": "network-vif-plugged", "status": "completed", "tag": "24606744-2e45-45e9-91a4-d3d40a60242a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:03.178948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-48073e2f-693f-4859-a347-e2389bdd8a94 req-408dd841-e98a-4c6c-80bd-c53168c7c20e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:03.179400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-48073e2f-693f-4859-a347-e2389bdd8a94 req-408dd841-e98a-4c6c-80bd-c53168c7c20e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:03.208059 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-48073e2f-693f-4859-a347-e2389bdd8a94 req-408dd841-e98a-4c6c-80bd-c53168c7c20e service nova] Creating event network-vif-plugged:24606744-2e45-45e9-91a4-d3d40a60242a for instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 on n-h1-master-1 Jul 01 10:34:03.215068 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-48073e2f-693f-4859-a347-e2389bdd8a94 req-408dd841-e98a-4c6c-80bd-c53168c7c20e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077355 Jul 01 10:34:03.217834 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 913/1892] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:03.226415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:03.227331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:03.247166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:03.247923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:03.252755 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:03.253294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:03.400069 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=46 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:04.444597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:04.456117 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3dd51919-aeb1-4d07-a453-648a52b7b670 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1322 microversion: 2.1 time: 1.236546 Jul 01 10:34:04.465973 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 914/1893] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:03 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1322 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:04.465973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:04.465973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:04.468504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:34:04.468980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:34:04.469507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:34:04.469927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:34:04.470336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:34:04.471586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:04.472110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:04.472958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:04.473541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:04.482073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:04.482596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:04.484348 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:04.487086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:04.493054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:04.512482 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:04.519605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Getting quotas for user cd7034799f014e95bbe8ed18fdc424a6 and project c1c22e4753be4dd8a7d262df2fedd7c1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:04.588956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:34:04.591499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb478ace-5752-463f-a8d9-65715fc72798',volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:34:04.935670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:04.944500 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-023c13d8-05a8-4fe5-b82a-b0cc3d2cf9f6 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.486380 Jul 01 10:34:04.945229 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 915/1894] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:04 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:04.950278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:04.951264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:04.974065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:04.974878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:04.975958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:04.976548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:05.196106 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f890c641-efc2-4d41-949e-4ae808424b80 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.158432 Jul 01 10:34:05.198628 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 980/1895] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3161 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:34:05.203924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-413e17eb-2095-4d29-adb2-78165f5c5389 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f91472a60>, body: {"security_group_rule": {"parent_group_id": "f14e38a8-0a3a-4ca6-965b-8fd161e524c1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:05.573738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:05.584864 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-34ed9f6e-6eb3-4b9b-ae11-79862364701e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1315 microversion: 2.1 time: 0.638223 Jul 01 10:34:05.586092 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 916/1896] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:04 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:05.591766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:05.592506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:05.600385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:05.601209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:05.602718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:05.604526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:05.652076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:34:05.945193 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d07ceb5-c43a-4626-b412-b8aba5233753 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 204 len: 0 microversion: 2.1 time: 0.357571 Jul 01 10:34:05.946219 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 917/1897] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:34:05 2022] DELETE /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:34:05.959285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81c46ff7-02fb-4790-9f24-63af6170a2ff tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:05.960619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-81c46ff7-02fb-4790-9f24-63af6170a2ff tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:06.067105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81c46ff7-02fb-4790-9f24-63af6170a2ff tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:06.075694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81c46ff7-02fb-4790-9f24-63af6170a2ff tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:06.077627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81c46ff7-02fb-4790-9f24-63af6170a2ff tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:06.079082 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81c46ff7-02fb-4790-9f24-63af6170a2ff tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1103 microversion: 2.25 time: 0.131009 Jul 01 10:34:06.079932 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 918/1898] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:05 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1103 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:06.084955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:06.085860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:06.093536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:06.094363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:06.095392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:06.096057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:06.587000 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-413e17eb-2095-4d29-adb2-78165f5c5389 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.386288 Jul 01 10:34:06.592384 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 981/1899] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:34:05 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:06.606505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:06.608480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:06.620151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:06.621304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:06.622387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:06.625824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:06.657756 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:06.712145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:06.725835 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2bdb36f-fd7c-48e4-a4e2-6bf6406c7b22 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1472 microversion: 2.1 time: 0.644587 Jul 01 10:34:06.733121 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 919/1900] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:06 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1472 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:06.739141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:06.740460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:06.757116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:06.761437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:06.767391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:06.767391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:07.124621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:07.133649 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fb2878fb-6bf8-4f6d-9ddf-234a788cb57a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1610 microversion: 2.1 time: 0.537270 Jul 01 10:34:07.135083 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 982/1901] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:06 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1610 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:07.150127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7bdbcfd0-9d20-4b5d-bb97-2e1670039176 req-0c222053-01dd-4f34-b520-d9c2e5f64e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba55d6c-e17b-4175-832b-048bfa530c81", "tag": "c2e325b6-bdbf-4cd7-b5af-f6a08f267996"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:07.168719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7bdbcfd0-9d20-4b5d-bb97-2e1670039176 req-0c222053-01dd-4f34-b520-d9c2e5f64e30 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:07.169186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7bdbcfd0-9d20-4b5d-bb97-2e1670039176 req-0c222053-01dd-4f34-b520-d9c2e5f64e30 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:07.184459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:07.197614 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4229e95e-b38f-4ecc-b0ef-728e77a74b81 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.462459 Jul 01 10:34:07.229451 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 920/1902] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:06 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:07.245667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d0e64d7-ef78-4ca5-8fa4-3764d1610497 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f97125a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-672376893", "description": "tempest-description-1233834691"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:07.275702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7bdbcfd0-9d20-4b5d-bb97-2e1670039176 req-0c222053-01dd-4f34-b520-d9c2e5f64e30 service nova] Creating event network-changed:c2e325b6-bdbf-4cd7-b5af-f6a08f267996 for instance 2ba55d6c-e17b-4175-832b-048bfa530c81 on n-h2-master-1 Jul 01 10:34:07.296353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7bdbcfd0-9d20-4b5d-bb97-2e1670039176 req-0c222053-01dd-4f34-b520-d9c2e5f64e30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148246 Jul 01 10:34:07.299000 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 983/1903] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:07.320589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:07.324222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:07.361880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:07.363805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:07.366462 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:07.369609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:07.690773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:07.712378 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-639bbb78-7a94-4d83-ab99-97e18e24ba89 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1315 microversion: 2.1 time: 0.410890 Jul 01 10:34:07.715490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 984/1904] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:07 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:07.720930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:07.723628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:07.735100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:07.735807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:07.737347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:07.737961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:07.781776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Request method failure captured: Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77/diagnostics HTTP/1.1 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2FdAIYzTn9d773l6dEbC8Y5LNH0EVcQUR6EFek5c3Jtb8QqsYWdi3vIfrsPgmMDEIszrd7j9OjA456FjFuRBv0r5OJ4_VVpmRfzeoY_uuPa4n82hl0FAhH-mWgb59RV-XMihYWLw3zDwkzyvf18Y0oun58MYQ910SI2L-nR-QuqrQ Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1011ee3644bf4a5bbe5543dd53a20920 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1722007048 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1011ee3644bf4a5bbe5543dd53a20920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1011ee3644bf4a5bbe5543dd53a20920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1011ee3644bf4a5bbe5543dd53a20920", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1011ee3644bf4a5bbe5543dd53a20920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1722007048 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1011ee3644bf4a5bbe5543dd53a20920 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1722007048 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerDiagnosticsNegativeTest-1722007048-project Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 14ec7c115028492e8b2a6449b4c3dee7 Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1722007048-project Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '1ef9d5ac-3284-487d-8de9-7ff5fa832e77'} Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise self.value Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:07.792409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:07.800628 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:07.800628 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:07.800628 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 01 10:34:07.800628 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 01 10:34:07.800628 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 01 10:34:07.800628 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:07.805467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:34:07.806475 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9e4613b8-dc80-4cee-8c0d-960d140ec9f8 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.089257 Jul 01 10:34:07.807724 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 985/1905] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:07 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77/diagnostics => generated 117 bytes in 91 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:34:07.813538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:07.819959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:07.821322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:07.822411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:07.823752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:07.824357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:08.020103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:08.036643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:08.038581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:08.048442 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d84f22ea-d264-4117-bc34-627c09b20382 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1176 microversion: 2.25 time: 0.239567 Jul 01 10:34:08.049405 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 986/1906] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:07 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1176 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:08.229390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d0e64d7-ef78-4ca5-8fa4-3764d1610497 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.000567 Jul 01 10:34:08.230322 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 921/1907] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:34:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:08.236505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:08.237012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:08.248271 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:08.249891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:08.250344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:08.261300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:08.262086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:08.318195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:34:08.357750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a01f11e8-cfd2-4c3d-99ad-6b9d7d4a400f tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Action: 'create', calling method: .version_select at 0x7f6f97105940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:08.408177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a01f11e8-cfd2-4c3d-99ad-6b9d7d4a400f tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Getting quotas for project 1d4342c748ea4341915e1d5ef1d473b8. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:08.418343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a01f11e8-cfd2-4c3d-99ad-6b9d7d4a400f tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Getting quotas for user d508dbd470c04a619f036736c0ca5722 and project 1d4342c748ea4341915e1d5ef1d473b8. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:08.608930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a01f11e8-cfd2-4c3d-99ad-6b9d7d4a400f tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Getting quotas for project 1d4342c748ea4341915e1d5ef1d473b8. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:08.629472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a01f11e8-cfd2-4c3d-99ad-6b9d7d4a400f tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Getting quotas for user d508dbd470c04a619f036736c0ca5722 and project 1d4342c748ea4341915e1d5ef1d473b8. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:08.674001 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a01f11e8-cfd2-4c3d-99ad-6b9d7d4a400f tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.619739 Jul 01 10:34:08.674001 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 987/1908] 10.222.0.23 () {62 vars in 1213 bytes} [Fri Jul 1 10:34:08 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:34:08.677035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-877006e0-cdfe-417d-be23-985d491ae859 req-cf1f955a-4776-47bb-9345-60e1c60d87d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ac2563-eab2-46bc-9f37-d99f043604d9", "name": "network-vif-plugged", "status": "completed", "tag": "88f28118-7e7b-49bb-8de1-107cc8b4288e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:08.689610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-877006e0-cdfe-417d-be23-985d491ae859 req-cf1f955a-4776-47bb-9345-60e1c60d87d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:08.690450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-877006e0-cdfe-417d-be23-985d491ae859 req-cf1f955a-4776-47bb-9345-60e1c60d87d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:08.702932 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-877006e0-cdfe-417d-be23-985d491ae859 req-cf1f955a-4776-47bb-9345-60e1c60d87d8 service nova] Creating event network-vif-plugged:88f28118-7e7b-49bb-8de1-107cc8b4288e for instance 29ac2563-eab2-46bc-9f37-d99f043604d9 on n-h1-master-1 Jul 01 10:34:08.709421 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-877006e0-cdfe-417d-be23-985d491ae859 req-cf1f955a-4776-47bb-9345-60e1c60d87d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036665 Jul 01 10:34:08.710677 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 988/1909] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:08.717302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:08.718972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:08.729827 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d53f4744-98ab-411d-bc61-3c2d0e7de40f tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 204 len: 0 microversion: 2.1 time: 0.498168 Jul 01 10:34:08.733747 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 922/1910] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:34:08 2022] DELETE /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:34:08.739882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:08.742399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:08.742707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:08.743121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:08.744028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:08.747180 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:08.759121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:08.760116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:08.762935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:08.763420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:10.201765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:10.215761 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4c513c6a-db13-4798-8438-e413f4fd6a7f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 1.480409 Jul 01 10:34:10.216357 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 923/1911] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:08 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:10.241184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0228ad61-2954-4c22-8816-8aa1ffdbf3ef tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f97027280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1909851058", "description": "tempest-description-798527081"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:10.668690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:10.677135 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8117030e-fe93-4d53-a51a-2c698afd0894 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1610 microversion: 2.1 time: 1.965062 Jul 01 10:34:10.680162 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 989/1912] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:08 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1610 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:10.698807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77769dd6-b73e-4f5a-8d1d-76da64e23490 tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:10.717518 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77769dd6-b73e-4f5a-8d1d-76da64e23490 tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.026817 Jul 01 10:34:10.718102 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 990/1913] 10.222.0.23 () {60 vars in 1192 bytes} [Fri Jul 1 10:34:10 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:34:10.734669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:10.735907 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:10.752205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:10.752894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:10.756163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:10.757134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:10.941271 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:10.980146 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:10.992331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cd8f39a-f6e7-42db-a22a-669136828401 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1315 microversion: 2.1 time: 0.269840 Jul 01 10:34:10.994625 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 991/1914] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:10 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:11.011789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:11.012427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:11.051550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:11.051973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:11.052798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:11.053216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:11.540770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:11.575003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd93ffed-10ed-4a95-882d-02c3c21924ea tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1478 microversion: 2.1 time: 0.577706 Jul 01 10:34:11.585673 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 992/1915] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:10 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1478 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:11.611162 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:11.614761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:11.656682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:11.659035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:11.660093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:11.663815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:11.837660 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0228ad61-2954-4c22-8816-8aa1ffdbf3ef tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.613403 Jul 01 10:34:11.838251 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 924/1916] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:34:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:11.845967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9052f102-eead-462a-adac-a96a64a67102 req-0b5318d1-e240-46e0-a55c-28db539ffc6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8d36e5-c3e7-4311-a5ad-e1abdf184f41", "tag": "d01e6bd9-dd9d-4cc7-817a-6f65329276f9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:11.866732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9052f102-eead-462a-adac-a96a64a67102 req-0b5318d1-e240-46e0-a55c-28db539ffc6c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:11.868110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9052f102-eead-462a-adac-a96a64a67102 req-0b5318d1-e240-46e0-a55c-28db539ffc6c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:11.944276 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9052f102-eead-462a-adac-a96a64a67102 req-0b5318d1-e240-46e0-a55c-28db539ffc6c service nova] Creating event network-changed:d01e6bd9-dd9d-4cc7-817a-6f65329276f9 for instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 on n-h2-master-1 Jul 01 10:34:11.959776 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9052f102-eead-462a-adac-a96a64a67102 req-0b5318d1-e240-46e0-a55c-28db539ffc6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119093 Jul 01 10:34:11.963274 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 925/1917] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:11.975138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f71b5340-f427-45ef-8c74-4fa843f36a7a tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:12.015435 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f71b5340-f427-45ef-8c74-4fa843f36a7a tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/ea1a15dc-97f6-461e-8166-6390af13ec5f" status: 200 len: 235 microversion: 2.64 time: 0.050598 Jul 01 10:34:12.020106 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 926/1918] 10.222.0.23 () {60 vars in 1303 bytes} [Fri Jul 1 10:34:11 2022] GET /compute/v2.1/os-server-groups/ea1a15dc-97f6-461e-8166-6390af13ec5f => generated 235 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:34:12.037277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:12.042506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:12.062768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:12.064980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:12.067959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:12.070507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:12.435823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:12.467255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:12.470808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:12.472235 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-18fa446f-7160-449d-9d9f-1f7e32381666 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.885470 Jul 01 10:34:12.473348 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 993/1919] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:11 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:12.480216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:12.481650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:12.496432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:12.496891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:12.498223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:12.498670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:12.707557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:12.723291 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-629cf402-3334-4618-bde5-b40feee86715 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1542 microversion: 2.1 time: 0.248579 Jul 01 10:34:12.733399 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 994/1920] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:12 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1542 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:12.738467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c35ac3f7-3f41-4c0b-8f4d-6fc07f7a4422 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f9145aee0>, body: {"security_group_rule": {"parent_group_id": "eebd20db-9e95-4647-84c3-0e9d6d9354d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "91eb3ed7-cc6f-4edc-a5c2-e292fce14a96"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:12.808002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:12.818583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-127852fe-2e0b-4a40-bf94-672c9674c389 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.794862 Jul 01 10:34:12.822883 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 927/1921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:12 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:12.833117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:12.841850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:12.862465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:12.863269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:12.865372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:12.866002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:13.709626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:13.731905 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d16b94e5-05dd-4fa1-b034-861200a17412 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1503 microversion: 2.1 time: 0.907620 Jul 01 10:34:13.744002 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 928/1922] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:12 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1503 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:13.749196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-308cfcfd-f2d5-4b87-8821-2f65b6ab4512 tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:13.906805 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-308cfcfd-f2d5-4b87-8821-2f65b6ab4512 tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/ea1a15dc-97f6-461e-8166-6390af13ec5f" status: 204 len: 0 microversion: 2.64 time: 0.161495 Jul 01 10:34:13.907460 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 929/1923] 10.222.0.23 () {60 vars in 1306 bytes} [Fri Jul 1 10:34:13 2022] DELETE /compute/v2.1/os-server-groups/ea1a15dc-97f6-461e-8166-6390af13ec5f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:34:13.918546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:13.921987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:13.949300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:13.954840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:13.955882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:13.963665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:14.090488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:14.096750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:14.097828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lazy-loading 'fault' on Instance uuid 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:34:14.301219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ec7c115028492e8b2a6449b4c3dee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1011ee3644bf4a5bbe5543dd53a20920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:14.314546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fe6c3d1d-4f58-4f45-80b1-759b3dfa7649 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 200 len: 1312 microversion: 2.1 time: 0.406015 Jul 01 10:34:14.315462 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 930/1924] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:13 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 1312 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:14.320461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-62e145c0-6be0-4a2e-ab4a-4651ce0c792d req-0187dae4-7612-4c00-be43-d3f98fa0df06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef9d5ac-3284-487d-8de9-7ff5fa832e77", "name": "network-vif-deleted", "tag": "24606744-2e45-45e9-91a4-d3d40a60242a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:14.351775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-62e145c0-6be0-4a2e-ab4a-4651ce0c792d req-0187dae4-7612-4c00-be43-d3f98fa0df06 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:14.355214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-62e145c0-6be0-4a2e-ab4a-4651ce0c792d req-0187dae4-7612-4c00-be43-d3f98fa0df06 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:14.383992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-62e145c0-6be0-4a2e-ab4a-4651ce0c792d req-0187dae4-7612-4c00-be43-d3f98fa0df06 service nova] Creating event network-vif-deleted:24606744-2e45-45e9-91a4-d3d40a60242a for instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 on n-h1-master-1 Jul 01 10:34:14.396331 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-62e145c0-6be0-4a2e-ab4a-4651ce0c792d req-0187dae4-7612-4c00-be43-d3f98fa0df06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079125 Jul 01 10:34:14.397428 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 931/1925] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:14.403245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:14.414890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:14.428457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:14.429064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:14.429967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:14.430880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:14.500012 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:14.820658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:14.835844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:14.842880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:14.844286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3cf64b8f-9bb8-4490-9176-a164e095e944 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.445684 Jul 01 10:34:14.848842 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 932/1926] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:14 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:14.861329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:14.861329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:14.876198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:14.876855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:14.878264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:14.881424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:14.904690 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c35ac3f7-3f41-4c0b-8f4d-6fc07f7a4422 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.169876 Jul 01 10:34:14.905359 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 995/1927] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:34:12 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:14.911784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-afa41ccd-8a25-4acf-8bd1-d4a39ffc3289 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:14.933815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afa41ccd-8a25-4acf-8bd1-d4a39ffc3289 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:14.937038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afa41ccd-8a25-4acf-8bd1-d4a39ffc3289 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:15.036745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:15.046682 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f057517-f210-4c88-b916-0304376b1b59 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1253 microversion: 2.1 time: 0.196379 Jul 01 10:34:15.055938 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 933/1928] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:14 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1253 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:15.064113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-afa41ccd-8a25-4acf-8bd1-d4a39ffc3289 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Going to try to stop instance {{(pid=119765) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:34:15.071995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:15.073236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:15.092343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:15.097059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:15.098154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:15.100354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:15.129213 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:15.308872 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-afa41ccd-8a25-4acf-8bd1-d4a39ffc3289 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9/action" status: 202 len: 0 microversion: 2.1 time: 0.398806 Jul 01 10:34:15.311973 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 996/1929] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:34:14 2022] POST /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:15.367026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17bb3929-4580-4751-9397-308881a2ac0a tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:15.368871 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-17bb3929-4580-4751-9397-308881a2ac0a tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] HTTP exception thrown: Instance group ea1a15dc-97f6-461e-8166-6390af13ec5f could not be found. Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17bb3929-4580-4751-9397-308881a2ac0a tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Request method failure captured: Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-server-groups/ea1a15dc-97f6-461e-8166-6390af13ec5f HTTP/1.1 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2fsVaUEMKhi-4VEmqh_u0YjrTih3hwiL_EzaUCB1Unhy_lC8lldSIOA8TuE3WM8zaHlCj06DhpWhbCIvkZLLFrbz0umo0ZeBPksrjHqd5lfWmINsw-dPr_cIzDmYmPXtZWsCXFQh_YCStPW6NgfFQNEg9sK7obn2p2W5vN3iASIf8 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.64 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1d4342c748ea4341915e1d5ef1d473b8 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerGroup264TestJSON-343749340 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d4342c748ea4341915e1d5ef1d473b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d4342c748ea4341915e1d5ef1d473b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d4342c748ea4341915e1d5ef1d473b8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d4342c748ea4341915e1d5ef1d473b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerGroup264TestJSON-343749340 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1d4342c748ea4341915e1d5ef1d473b8 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerGroup264TestJSON-343749340 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerGroup264TestJSON-343749340-project Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d508dbd470c04a619f036736c0ca5722 Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerGroup264TestJSON-343749340-project Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: exception: Instance group ea1a15dc-97f6-461e-8166-6390af13ec5f could not be found. Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ea1a15dc-97f6-461e-8166-6390af13ec5f'} Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ea1a15dc-97f6-461e-8166-6390af13ec5f could not be found. Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ea1a15dc-97f6-461e-8166-6390af13ec5f could not be found. Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:15.373215 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:15.379021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:15.379021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:15.379021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:34:15.379021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:34:15.379021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ea1a15dc-97f6-461e-8166-6390af13ec5f could not be found. Jul 01 10:34:15.379021 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:15.390133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17bb3929-4580-4751-9397-308881a2ac0a tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] Returning 404 to user: Instance group ea1a15dc-97f6-461e-8166-6390af13ec5f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:34:15.416283 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17bb3929-4580-4751-9397-308881a2ac0a tempest-ServerGroup264TestJSON-343749340 tempest-ServerGroup264TestJSON-343749340-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/ea1a15dc-97f6-461e-8166-6390af13ec5f" status: 404 len: 117 microversion: 2.64 time: 0.077042 Jul 01 10:34:15.424944 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 997/1930] 10.222.0.23 () {60 vars in 1306 bytes} [Fri Jul 1 10:34:15 2022] DELETE /compute/v2.1/os-server-groups/ea1a15dc-97f6-461e-8166-6390af13ec5f => generated 117 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:34:15.437718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6b924d57-d1e5-405c-877a-14707a49d910 req-107e6620-8987-49f3-979e-850507bc6be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53aec7e-a610-4fef-b617-a9e42532ac25", "name": "network-vif-deleted", "tag": "1249eb41-5269-4873-9281-4ee3ed02a6fd"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:15.466072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b924d57-d1e5-405c-877a-14707a49d910 req-107e6620-8987-49f3-979e-850507bc6be1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:15.466529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b924d57-d1e5-405c-877a-14707a49d910 req-107e6620-8987-49f3-979e-850507bc6be1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:15.479989 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6b924d57-d1e5-405c-877a-14707a49d910 req-107e6620-8987-49f3-979e-850507bc6be1 service nova] Creating event network-vif-deleted:1249eb41-5269-4873-9281-4ee3ed02a6fd for instance c53aec7e-a610-4fef-b617-a9e42532ac25 on n-h2-master-1 Jul 01 10:34:15.485536 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6b924d57-d1e5-405c-877a-14707a49d910 req-107e6620-8987-49f3-979e-850507bc6be1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059037 Jul 01 10:34:15.486598 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 998/1931] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:15.635101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2088186023", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ce42240f-1f36-4657-993c-cfa415e6f19d"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:15.659292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:15.679636 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04998124-5dfb-42a2-909a-c44548b2da65 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.619268 Jul 01 10:34:15.688590 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 934/1932] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:15 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:15.693488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-674057ec-8139-46a7-aea2-b5f2780eac04 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f97027d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1322010775", "description": "tempest-description-6089694"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:15.783216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] validate_networks() for [('ce42240f-1f36-4657-993c-cfa415e6f19d', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:34:16.076177 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:16.974795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:34:16.976236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:34:16.976894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:34:16.978739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:34:16.979338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:34:16.998601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:16.999579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.001282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.001918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.028974 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:17.044211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:17.053105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for user cc8012fcb48840f1b778ab759457e66c and project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:17.071168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:34:17.074769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:34:17.256751 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b3bb99b-fb87-45b4-ac12-65d505d32755 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767000 Jul 01 10:34:17.263041 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 999/1933] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:34:17.271035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:17.271856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:17.292694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.293082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.293947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.294578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.307519 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-674057ec-8139-46a7-aea2-b5f2780eac04 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.616456 Jul 01 10:34:17.308128 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 935/1934] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:34:15 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:17.325347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:17.326086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] [instance: 1ef9d5ac-3284-487d-8de9-7ff5fa832e77] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:17.369396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.373550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.373550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.373550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.431249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] HTTP exception thrown: Instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 could not be found. Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Request method failure captured: Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 HTTP/1.1 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2FdAIYzTn9d773l6dEbC8Y5LNH0EVcQUR6EFek5c3Jtb8QqsYWdi3vIfrsPgmMDEIszrd7j9OjA456FjFuRBv0r5OJ4_VVpmRfzeoY_uuPa4n82hl0FAhH-mWgb59RV-XMihYWLw3zDwkzyvf18Y0oun58MYQ910SI2L-nR-QuqrQ Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 1011ee3644bf4a5bbe5543dd53a20920 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1722007048 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1011ee3644bf4a5bbe5543dd53a20920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1011ee3644bf4a5bbe5543dd53a20920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1011ee3644bf4a5bbe5543dd53a20920", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1011ee3644bf4a5bbe5543dd53a20920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1722007048 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 1011ee3644bf4a5bbe5543dd53a20920 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1722007048 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerDiagnosticsNegativeTest-1722007048-project Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 14ec7c115028492e8b2a6449b4c3dee7 Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1722007048-project Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 could not be found. Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '1ef9d5ac-3284-487d-8de9-7ff5fa832e77'} Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 could not be found. Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 could not be found. Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:17.433612 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 could not be found. Jul 01 10:34:17.438524 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:17.443364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] Returning 404 to user: Instance 1ef9d5ac-3284-487d-8de9-7ff5fa832e77 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:34:17.447605 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ed89c52-e8f3-4a86-836d-b6b597e36c16 tempest-ServerDiagnosticsNegativeTest-1722007048 tempest-ServerDiagnosticsNegativeTest-1722007048-project] 10.222.0.23 "GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77" status: 404 len: 111 microversion: 2.1 time: 0.138471 Jul 01 10:34:17.448865 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 936/1935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:17 2022] GET /compute/v2.1/servers/1ef9d5ac-3284-487d-8de9-7ff5fa832e77 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:34:17.458144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:17.458144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:17.465252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.466073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.468058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.468814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.755607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:17.770573 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-447b0810-dbac-4d0d-a54e-64b3e065e9d7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.511593 Jul 01 10:34:17.771164 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1000/1936] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:17 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:17.801401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:17.802023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:17.825910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.826363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.827161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:17.827594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:17.947598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:17.959285 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-33837d94-d985-4c06-9921-9b6c21e82be7 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1253 microversion: 2.1 time: 0.172976 Jul 01 10:34:17.969092 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1001/1937] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:17 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1253 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:17.978154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:17.986445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:17.987957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:17.989107 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fd215701-123e-46d4-8243-710eaed736f6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.538998 Jul 01 10:34:17.994422 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 937/1938] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:17 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:17.996838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5a6cf9fc-a1e8-4314-816d-c0c84ad18f40 req-85a7ac7a-cc5b-4df0-9970-8caf2a4b14e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65557a00-fd3c-4f95-95e7-44e4975cdb4e", "tag": "218dd2f5-3c30-4c14-8197-b3ad76f0d8a1"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:18.003341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:18.003952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:18.011190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5a6cf9fc-a1e8-4314-816d-c0c84ad18f40 req-85a7ac7a-cc5b-4df0-9970-8caf2a4b14e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:18.011633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5a6cf9fc-a1e8-4314-816d-c0c84ad18f40 req-85a7ac7a-cc5b-4df0-9970-8caf2a4b14e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:18.027429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:18.027429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:18.027429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:18.027429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:18.040014 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5a6cf9fc-a1e8-4314-816d-c0c84ad18f40 req-85a7ac7a-cc5b-4df0-9970-8caf2a4b14e9 service nova] Creating event network-changed:218dd2f5-3c30-4c14-8197-b3ad76f0d8a1 for instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e on n-h2-master-1 Jul 01 10:34:18.057582 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5a6cf9fc-a1e8-4314-816d-c0c84ad18f40 req-85a7ac7a-cc5b-4df0-9970-8caf2a4b14e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086736 Jul 01 10:34:18.058245 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1002/1939] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:18.084441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a58b555c-e276-4560-b8cc-769f12b13bdb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:18.090156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a58b555c-e276-4560-b8cc-769f12b13bdb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:18.190020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a58b555c-e276-4560-b8cc-769f12b13bdb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:18.202957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a58b555c-e276-4560-b8cc-769f12b13bdb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1215 microversion: 2.1 time: 0.141520 Jul 01 10:34:18.207424 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1003/1940] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:18 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:18.221050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a72f187-7519-4e4a-b081-57d2dc44fd58 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f9146c700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1332624560", "description": "tempest-description-1087436579"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:18.305753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:18.314856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4fbab099-ad8c-428f-a718-8e68f55a4a4c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.324143 Jul 01 10:34:18.315762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 938/1941] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:17 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:18.755658 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a72f187-7519-4e4a-b081-57d2dc44fd58 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.545984 Jul 01 10:34:18.757039 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1004/1942] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:34:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:18.769203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e9f1f07-2dd2-44cb-9fdb-641456d6bbe8 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f9708f940>, body: {"security_group_rule": {"parent_group_id": "92a6975a-b941-4d76-b610-e7ec87adaf92", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "19d12e09-2b2d-42ca-833b-4cd5d1e797f6"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:18.796878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:18.799218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:18.829136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:18.830014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:18.831226 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:18.831994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:19.268688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:19.281988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1ff16d84-0c55-4203-bc3b-c7e059a7a250 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.497837 Jul 01 10:34:19.293091 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1005/1943] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:18 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:19.301746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6034654b-0260-4262-8dd3-450255aae6e8 req-69bb7da9-4925-4c56-8cd6-0e1e925f68c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba55d6c-e17b-4175-832b-048bfa530c81", "name": "network-vif-plugged", "status": "completed", "tag": "c2e325b6-bdbf-4cd7-b5af-f6a08f267996"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:19.345875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6034654b-0260-4262-8dd3-450255aae6e8 req-69bb7da9-4925-4c56-8cd6-0e1e925f68c8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:19.346319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6034654b-0260-4262-8dd3-450255aae6e8 req-69bb7da9-4925-4c56-8cd6-0e1e925f68c8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:19.370144 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6034654b-0260-4262-8dd3-450255aae6e8 req-69bb7da9-4925-4c56-8cd6-0e1e925f68c8 service nova] Creating event network-vif-plugged:c2e325b6-bdbf-4cd7-b5af-f6a08f267996 for instance 2ba55d6c-e17b-4175-832b-048bfa530c81 on n-h2-master-1 Jul 01 10:34:19.381093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6034654b-0260-4262-8dd3-450255aae6e8 req-69bb7da9-4925-4c56-8cd6-0e1e925f68c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096748 Jul 01 10:34:19.382311 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1006/1944] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:19.395321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:19.414167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:19.422374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:19.423128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:19.425915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:19.429789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:19.574246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:19.591147 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3fc5cb9e-98c7-465e-9392-a12cf649b834 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1253 microversion: 2.1 time: 0.204859 Jul 01 10:34:19.592383 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1007/1945] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:19 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1253 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:19.610845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:19.610845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:19.625482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:19.626436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:19.629375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:19.631671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:19.672454 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:19.771085 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e9f1f07-2dd2-44cb-9fdb-641456d6bbe8 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.006830 Jul 01 10:34:19.772007 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 939/1946] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:34:18 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:19.776672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:19.777326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:19.791984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:19.793171 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:19.797366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:19.798128 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:20.014141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:20.022811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:20.027022 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5443a5ae-54a0-403b-b841-045af370d0f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1211 microversion: 2.1 time: 0.252686 Jul 01 10:34:20.040896 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 940/1947] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:19 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1211 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:20.041245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:20.043029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:20.044194 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dba1a18c-42fd-4aa7-bf19-303edd8853ba tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.450226 Jul 01 10:34:20.048959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1008/1948] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:19 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:20.049590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:20.051523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:20.056954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aee39fe5-a26c-40d4-a44f-07c86e0b067b tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f9146cb80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:20.067063 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:20.068783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:20.069992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:20.072354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:20.361946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:20.372713 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2192f020-e608-48af-816d-9e5212bca73f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.330597 Jul 01 10:34:20.373326 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 941/1949] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:20 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:20.388623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:20.388623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:20.401785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:20.405394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:20.409619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:20.409619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:20.684602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:20.696050 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e03caece-1047-4a12-9496-5438aa7c1d59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.314902 Jul 01 10:34:20.705699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 942/1950] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:20 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:20.705699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:20.711010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:20.719932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:20.720463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:20.721360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:20.722057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:20.788572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:20.797618 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8a3d81f-8d91-4d1a-b66c-c893254be084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1253 microversion: 2.1 time: 0.099803 Jul 01 10:34:20.807389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 943/1951] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:20 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1253 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:20.823862 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aee39fe5-a26c-40d4-a44f-07c86e0b067b tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/19d12e09-2b2d-42ca-833b-4cd5d1e797f6" status: 202 len: 0 microversion: 2.1 time: 0.773646 Jul 01 10:34:20.825447 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1009/1952] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:20 2022] DELETE /compute/v2.1/os-security-groups/19d12e09-2b2d-42ca-833b-4cd5d1e797f6 => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:20.836117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d31441b-1565-4cd8-ad9e-85444a97e135 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f9708f160>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:21.005107 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d31441b-1565-4cd8-ad9e-85444a97e135 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/92a6975a-b941-4d76-b610-e7ec87adaf92" status: 200 len: 245 microversion: 2.1 time: 0.173985 Jul 01 10:34:21.012645 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 944/1953] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:34:20 2022] GET /compute/v2.1/os-security-groups/92a6975a-b941-4d76-b610-e7ec87adaf92 => generated 245 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:21.029583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d166abee-5f69-41d5-ad33-c6e8f03513f9 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f96f09c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-240272025", "description": "tempest-description-981636492"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:21.044305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:21.045248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:21.059657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.060298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.061273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.061908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.159627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:21.168956 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ed573c3-52b7-4ccc-acd1-5dede1e59358 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1285 microversion: 2.1 time: 0.128736 Jul 01 10:34:21.169575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 945/1954] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:21 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:21.179038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:21.179923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:21.196034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.197173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.206420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.207198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.500848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:21.512346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:21.514969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:21.517863 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01ded473-8ff9-4bcf-a35a-45eaa1895b57 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.344873 Jul 01 10:34:21.517863 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 946/1955] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:21 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:21.526390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:21.527427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:21.538767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.541374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.547043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.547043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.776071 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d166abee-5f69-41d5-ad33-c6e8f03513f9 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.749905 Jul 01 10:34:21.784905 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1010/1956] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:34:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:21.793061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-54da50bd-5a24-4701-b880-f727c5eda489 req-3a5c5bc4-c77d-4680-8ce1-e6e838aaef09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8d36e5-c3e7-4311-a5ad-e1abdf184f41", "name": "network-vif-plugged", "status": "completed", "tag": "d01e6bd9-dd9d-4cc7-817a-6f65329276f9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:21.817480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-54da50bd-5a24-4701-b880-f727c5eda489 req-3a5c5bc4-c77d-4680-8ce1-e6e838aaef09 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.818712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-54da50bd-5a24-4701-b880-f727c5eda489 req-3a5c5bc4-c77d-4680-8ce1-e6e838aaef09 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.830553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:21.839538 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e4286712-c60e-4dbe-8f43-f023c42e60be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.319848 Jul 01 10:34:21.840834 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 947/1957] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:21 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:21.847015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:21.847927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:21.853279 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-54da50bd-5a24-4701-b880-f727c5eda489 req-3a5c5bc4-c77d-4680-8ce1-e6e838aaef09 service nova] Creating event network-vif-plugged:d01e6bd9-dd9d-4cc7-817a-6f65329276f9 for instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 on n-h2-master-1 Jul 01 10:34:21.855716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.856211 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.857005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:21.857506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:21.867981 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-54da50bd-5a24-4701-b880-f727c5eda489 req-3a5c5bc4-c77d-4680-8ce1-e6e838aaef09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079872 Jul 01 10:34:21.869912 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1011/1958] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:21.876297 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-005fd098-10ed-47e2-b263-c9cd571b13ad tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f96f09c10>, body: {"security_group_rule": {"parent_group_id": "3c3ca100-6a2a-406c-b0df-9086a8ce7ee1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:22.098113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:22.106689 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1cf138d4-23ce-4152-af0c-794f67c30858 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.264305 Jul 01 10:34:22.117068 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 948/1959] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:21 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:22.128943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:22.129906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:22.144002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.144002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:22.144002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.144002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:22.248110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:22.259662 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-871d39f9-0653-412b-924d-15116637907a tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1253 microversion: 2.1 time: 0.139816 Jul 01 10:34:22.260621 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 949/1960] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:22 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1253 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:22.266137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:22.266804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:22.283971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.284795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:22.286680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.287293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:22.550789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:22.571057 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f6db901-211b-4032-b579-485d868bcaaf tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.309175 Jul 01 10:34:22.582456 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 950/1961] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:22 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:22.589309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:22.590332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:22.602422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.605352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:22.607320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.607770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:22.664412 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-005fd098-10ed-47e2-b263-c9cd571b13ad tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.792618 Jul 01 10:34:22.665932 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1012/1962] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:34:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:22.686306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6008fa81-18ce-4283-a941-49de516fc5ae tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Action: 'create', calling method: .version_select at 0x7f6f97105940>, body: {"security_group_rule": {"parent_group_id": "3c3ca100-6a2a-406c-b0df-9086a8ce7ee1", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:22.926757 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:22.936767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:22.941730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:22.944287 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-44510ba4-5b52-4154-a102-4c569701f9e3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.359071 Jul 01 10:34:22.947156 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 951/1963] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:22 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:22.952628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:22.957335 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:22.967451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.970069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:22.970894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:22.971340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.433610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:23.444325 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-427ed1eb-fd58-4542-943f-12ea8b2bb39d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1318 microversion: 2.1 time: 0.495691 Jul 01 10:34:23.445258 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 952/1964] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:22 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:23.450408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:23.451251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:23.457728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:23.458118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.459209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:23.459865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.683771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:23.693734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af73dc41-2758-4ac2-80e3-f666aada3f13 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.247246 Jul 01 10:34:23.703230 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 953/1965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:23 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:23.708500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:23.709285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:23.718590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:23.719125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.719976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:23.720485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.742735 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6008fa81-18ce-4283-a941-49de516fc5ae tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.066274 Jul 01 10:34:23.752205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1013/1966] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:34:22 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:23.759301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:23.760449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:23.767758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:23.768566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.769030 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lazy-loading 'fault' on Instance uuid c53aec7e-a610-4fef-b617-a9e42532ac25 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:34:23.771798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:23.775265 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:23.775454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.775454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:23.776610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:23.841692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ee2f955624a3aa3ccbc8f18516539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6c31c774f94b0cb1cdd78fb57f2916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:23.870516 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6540acc7-bfd6-4159-8576-a3fc28d21c1b tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 200 len: 1258 microversion: 2.1 time: 0.165688 Jul 01 10:34:23.873706 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 954/1967] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:23 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:23.884471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1ef171c6-ecb7-4602-9e29-229f8a7c2ac5 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f970ec310>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:23.987541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1ef171c6-ecb7-4602-9e29-229f8a7c2ac5 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/3c3ca100-6a2a-406c-b0df-9086a8ce7ee1" status: 200 len: 663 microversion: 2.1 time: 0.112242 Jul 01 10:34:23.988431 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 955/1968] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:34:23 2022] GET /compute/v2.1/os-security-groups/3c3ca100-6a2a-406c-b0df-9086a8ce7ee1 => generated 663 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:23.997470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:23.998096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:24.005238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:24.005691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:24.010181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:24.010181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:24.029912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:24.040709 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-50d1010b-ac6f-4412-8579-37e9310773c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.285799 Jul 01 10:34:24.041674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1014/1969] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:23 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:24.052863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a4b7f0b-a79b-448e-b9c8-4300f8a9d37c tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f9146c3a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:24.432856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:24.447967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:24.449530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:24.450695 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-167e119b-8dd4-436e-8a6f-0ad6e36f3584 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.461275 Jul 01 10:34:24.473466 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 956/1970] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:23 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:24.481899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:24.483579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:24.500736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:24.503065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:24.504077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:24.504525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:24.679133 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a4b7f0b-a79b-448e-b9c8-4300f8a9d37c tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/d4dbc046-ba87-4505-afef-00ddc99e7a48" status: 202 len: 0 microversion: 2.1 time: 0.633323 Jul 01 10:34:24.679133 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1015/1971] 10.222.0.23 () {58 vars in 1286 bytes} [Fri Jul 1 10:34:24 2022] DELETE /compute/v2.1/os-security-group-rules/d4dbc046-ba87-4505-afef-00ddc99e7a48 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:24.683067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5d0b7fcc-4f1b-49ca-9472-67af2b2bd660 req-88a2c9ec-7489-4206-a327-5033d3820ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd", "tag": "2c3c27e3-43a6-4f64-8571-644bcc658b82"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:24.712858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5d0b7fcc-4f1b-49ca-9472-67af2b2bd660 req-88a2c9ec-7489-4206-a327-5033d3820ca1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:24.713776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5d0b7fcc-4f1b-49ca-9472-67af2b2bd660 req-88a2c9ec-7489-4206-a327-5033d3820ca1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:24.726575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:24.743579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-365c316f-6e8a-443d-b2c6-b6d4e7297056 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1468 microversion: 2.1 time: 0.259500 Jul 01 10:34:24.743579 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 957/1972] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:24 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1468 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:24.743801 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5d0b7fcc-4f1b-49ca-9472-67af2b2bd660 req-88a2c9ec-7489-4206-a327-5033d3820ca1 service nova] Creating event network-changed:2c3c27e3-43a6-4f64-8571-644bcc658b82 for instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd on n-h1-master-1 Jul 01 10:34:24.744248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-642ff2c0-ae37-4f5c-9e20-f488957bee7b tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f9708f8b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:24.751889 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5d0b7fcc-4f1b-49ca-9472-67af2b2bd660 req-88a2c9ec-7489-4206-a327-5033d3820ca1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073680 Jul 01 10:34:24.752247 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1016/1973] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:24.764360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:24.768495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:24.781871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:24.784663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:24.786055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:24.789576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:24.988982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:24.999238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8af52128-105a-494f-a99d-57b0bf0a78f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.243327 Jul 01 10:34:25.000875 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1017/1974] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:24 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:25.174686 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-642ff2c0-ae37-4f5c-9e20-f488957bee7b tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3c3ca100-6a2a-406c-b0df-9086a8ce7ee1" status: 202 len: 0 microversion: 2.1 time: 0.434813 Jul 01 10:34:25.177443 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 958/1975] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:24 2022] DELETE /compute/v2.1/os-security-groups/3c3ca100-6a2a-406c-b0df-9086a8ce7ee1 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:25.184421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:25.185331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:25.193093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.193952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.195226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.195862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.284804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1316630238", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": "none"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:25.363379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:34:25.364141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:34:25.364848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:34:25.365513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:34:25.366349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:34:25.378808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.380205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.381205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.381819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.401502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:25.412310 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f25ca275-120a-4028-86de-477f3440b274 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 1466 microversion: 2.1 time: 0.230509 Jul 01 10:34:25.412932 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 959/1976] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:25 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 1466 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:25.423703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Getting quotas for project e3486a6f99724576bd777319814c023e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:25.429550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:25.430402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] [instance: c53aec7e-a610-4fef-b617-a9e42532ac25] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:25.439871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.440505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.441661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.442448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.443880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Getting quotas for user 3bf129f7f65e4291b2877d025fb6eb09 and project e3486a6f99724576bd777319814c023e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:25.465064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:34:25.471130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:34:25.474498 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] HTTP exception thrown: Instance c53aec7e-a610-4fef-b617-a9e42532ac25 could not be found. Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Request method failure captured: Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 HTTP/1.1 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivszwHgk5xA74t0jjo0QqO0z3zPcUff8Y6Y4S1rAigd2b7c7-3-9L8sh5-3yLNY15QahQwfwedXsi1yLrhkQna4oy8uzmCJ7mZIrIew8O4hjJ4Cak3C6WPcxcQByU1SXRS0FwHxsOX2rFMzfYOB0-Z1FkhvnPySvbJquixFyAKonfLSk Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 7e6c31c774f94b0cb1cdd78fb57f2916 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestBootFromVolume-185905306 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e6c31c774f94b0cb1cdd78fb57f2916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e6c31c774f94b0cb1cdd78fb57f2916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e6c31c774f94b0cb1cdd78fb57f2916", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e6c31c774f94b0cb1cdd78fb57f2916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestBootFromVolume-185905306 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 7e6c31c774f94b0cb1cdd78fb57f2916 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestBootFromVolume-185905306 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestBootFromVolume-185905306-project Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: ed8ee2f955624a3aa3ccbc8f18516539 Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestBootFromVolume-185905306-project Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: exception: Instance c53aec7e-a610-4fef-b617-a9e42532ac25 could not be found. Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c53aec7e-a610-4fef-b617-a9e42532ac25'} Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53aec7e-a610-4fef-b617-a9e42532ac25 could not be found. Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53aec7e-a610-4fef-b617-a9e42532ac25 could not be found. Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:25.476066 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53aec7e-a610-4fef-b617-a9e42532ac25 could not be found. Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Returning 404 to user: Instance c53aec7e-a610-4fef-b617-a9e42532ac25 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9480d8f6-50f4-42b2-ba8d-1e9dc8523084 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25" status: 404 len: 111 microversion: 2.1 time: 0.052013 Jul 01 10:34:25.482139 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 960/1977] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:25 2022] GET /compute/v2.1/servers/c53aec7e-a610-4fef-b617-a9e42532ac25 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:34:25.498515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:25.499134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:25.505320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.512331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.512331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.512331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.602426 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2aa31b1-3ec6-440e-8e4b-f36334919e23 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.599880 Jul 01 10:34:25.609315 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1018/1978] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:34:25.616071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d2c297c-ad65-40db-a149-2510e99f0e1d tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f97105ee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:25.693638 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-2d2c297c-ad65-40db-a149-2510e99f0e1d tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:34:25.694351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-2d2c297c-ad65-40db-a149-2510e99f0e1d tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Neutron security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:34:25.694989 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2d2c297c-ad65-40db-a149-2510e99f0e1d tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] HTTP exception thrown: Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist Jul 01 10:34:25.694989 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-dcba26e6-c822-431a-a5ee-bf5de0888d0c'] Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d2c297c-ad65-40db-a149-2510e99f0e1d tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Request method failure captured: Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-groups/19d12e09-2b2d-42ca-833b-4cd5d1e797f6 HTTP/1.1 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2TmyNwqnRT0xoAYe-WFuNDOiLr8fcdmSLsLhRrruPIsy4RNqJPagPjPcSiUn_NHKhmvUUJsKJy3xfx4NEdFP38vFPDwWqlgVTLeDxB8jCExH9CHwUEkaJDrWRM0LUPioSZ6XkQu5mA3ER_oUKvF0ZaBDQIlVmSadO-uEBHA01ATG4 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: dca1cf6f9df343dcb9232c8422e47fc1 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2056066610 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dca1cf6f9df343dcb9232c8422e47fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dca1cf6f9df343dcb9232c8422e47fc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dca1cf6f9df343dcb9232c8422e47fc1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dca1cf6f9df343dcb9232c8422e47fc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2056066610 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: dca1cf6f9df343dcb9232c8422e47fc1 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2056066610 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupRulesTestJSON-2056066610-project Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 191ac326d5644238a2d4cabd4630bd58 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2056066610-project Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-dcba26e6-c822-431a-a5ee-bf5de0888d0c'] Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '19d12e09-2b2d-42ca-833b-4cd5d1e797f6'} Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:34:25.698158 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dcba26e6-c822-431a-a5ee-bf5de0888d0c'] Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dcba26e6-c822-431a-a5ee-bf5de0888d0c'] Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dcba26e6-c822-431a-a5ee-bf5de0888d0c'] Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dcba26e6-c822-431a-a5ee-bf5de0888d0c'] Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d2c297c-ad65-40db-a149-2510e99f0e1d tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Returning 404 to user: Security group 19d12e09-2b2d-42ca-833b-4cd5d1e797f6 does not exist Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-dcba26e6-c822-431a-a5ee-bf5de0888d0c'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d2c297c-ad65-40db-a149-2510e99f0e1d tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/19d12e09-2b2d-42ca-833b-4cd5d1e797f6" status: 404 len: 194 microversion: 2.1 time: 0.090047 Jul 01 10:34:25.704028 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1019/1979] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:25 2022] DELETE /compute/v2.1/os-security-groups/19d12e09-2b2d-42ca-833b-4cd5d1e797f6 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:34:25.717652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:25.722344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3f7d4ec-cbec-4193-bcc2-5acfe667d397 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-468377522"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:25.727187 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9bed170c-f11f-4b81-bd0b-fbe04b2eeca3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.231802 Jul 01 10:34:25.733198 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 961/1980] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:25 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:25.733401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3f7d4ec-cbec-4193-bcc2-5acfe667d397 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:25.743449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f7d4ec-cbec-4193-bcc2-5acfe667d397 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.744138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f7d4ec-cbec-4193-bcc2-5acfe667d397 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.745826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f7d4ec-cbec-4193-bcc2-5acfe667d397 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.746445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f7d4ec-cbec-4193-bcc2-5acfe667d397 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.749021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:25.749676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:25.770744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.770744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.770744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:25.770744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:25.999985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.010306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.014060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.015407 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d6c58feb-1bcf-45a7-b097-f154bdc07d5e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1292 microversion: 2.25 time: 0.285655 Jul 01 10:34:26.017836 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 962/1981] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:25 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1292 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:26.034828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e381dcf-162c-423f-b4da-4f3e5c7ffb27 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] Calling method '.version_select at 0x7f6f9708faf0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:26.134364 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e381dcf-162c-423f-b4da-4f3e5c7ffb27 tempest-ServersTestBootFromVolume-185905306 tempest-ServersTestBootFromVolume-185905306-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170409016" status: 202 len: 0 microversion: 2.1 time: 0.115247 Jul 01 10:34:26.135035 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 963/1982] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:34:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170409016 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:26.143568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3e61b07-052e-4bd6-b200-c6abe6d8c93b tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:26.143568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3e61b07-052e-4bd6-b200-c6abe6d8c93b tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:26.276935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3e61b07-052e-4bd6-b200-c6abe6d8c93b tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.289001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3e61b07-052e-4bd6-b200-c6abe6d8c93b tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.304098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3e61b07-052e-4bd6-b200-c6abe6d8c93b tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.324240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3e61b07-052e-4bd6-b200-c6abe6d8c93b tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "PUT /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1359 microversion: 2.75 time: 0.187848 Jul 01 10:34:26.326222 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 964/1983] 10.222.0.23 () {62 vars in 1296 bytes} [Fri Jul 1 10:34:26 2022] PUT /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:26.339165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8488ccc-a678-4d20-832f-3599d4638a08 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f970274c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:26.512217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3f7d4ec-cbec-4193-bcc2-5acfe667d397 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "POST /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81/action" status: 202 len: 0 microversion: 2.1 time: 0.807426 Jul 01 10:34:26.521439 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1020/1984] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:34:25 2022] POST /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:34:26.523422 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:26.524129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:26.533198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:26.533669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:26.534488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:26.534924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8488ccc-a678-4d20-832f-3599d4638a08 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/92a6975a-b941-4d76-b610-e7ec87adaf92" status: 202 len: 0 microversion: 2.1 time: 0.358741 Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 965/1985] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:26 2022] DELETE /compute/v2.1/os-security-groups/92a6975a-b941-4d76-b610-e7ec87adaf92 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37a7c39f-a16f-4206-a4de-368d6c862341 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37a7c39f-a16f-4206-a4de-368d6c862341 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37a7c39f-a16f-4206-a4de-368d6c862341 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37a7c39f-a16f-4206-a4de-368d6c862341 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37a7c39f-a16f-4206-a4de-368d6c862341 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37a7c39f-a16f-4206-a4de-368d6c862341 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1359 microversion: 2.75 time: 0.145066 Jul 01 10:34:26.942521 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 966/1986] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:26 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:26.945137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:26.948556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb82bee8-01a4-4c28-9bf5-b677f2ba7a76 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9708f0d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:26.949894 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-25f4507d-fa59-49c3-8cb5-2f60fe81d31c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.324059 Jul 01 10:34:26.949894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1021/1987] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:26 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:26.949894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-554a5177-7590-4609-a704-07528191aec3 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f9136e1f0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb82bee8-01a4-4c28-9bf5-b677f2ba7a76 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.058040 Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 967/1988] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:26 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:26.950907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:27.138871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:27.149845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b9a5168-7f82-404b-8779-2c17af31ce43 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.254303 Jul 01 10:34:27.152071 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 968/1989] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:26 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:27.158768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:27.159584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:27.177777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:27.178217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:27.184284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:27.184781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:27.385788 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-554a5177-7590-4609-a704-07528191aec3 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/91eb3ed7-cc6f-4edc-a5c2-e292fce14a96" status: 202 len: 0 microversion: 2.1 time: 0.537186 Jul 01 10:34:27.386294 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1022/1990] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:26 2022] DELETE /compute/v2.1/os-security-groups/91eb3ed7-cc6f-4edc-a5c2-e292fce14a96 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:27.394120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9807b603-8435-466e-93b7-e2b0e09568c4 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f9146c820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:27.425715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:27.436174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:27.437707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:27.439035 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4dd2edc-f1d6-435f-9ca9-2fc865f4ea5f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 0.285222 Jul 01 10:34:27.456790 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 969/1991] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:27 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:27.802391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9807b603-8435-466e-93b7-e2b0e09568c4 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/eebd20db-9e95-4647-84c3-0e9d6d9354d5" status: 202 len: 0 microversion: 2.1 time: 0.411867 Jul 01 10:34:27.803373 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1023/1992] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:27 2022] DELETE /compute/v2.1/os-security-groups/eebd20db-9e95-4647-84c3-0e9d6d9354d5 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:34:27.812391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cf57577f-216d-4518-ae37-b28bf9dfc96a tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f97040c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:27.860188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:27.861373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:27.873213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:27.873775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:27.874499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:27.881367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:28.134667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:28.152701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d53f8e06-c3df-4e75-999a-32b0a111be4e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.296018 Jul 01 10:34:28.159498 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1024/1993] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:27 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:28.175020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:28.178479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:28.198368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:28.199274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:28.200320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:28.201647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:28.368306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cf57577f-216d-4518-ae37-b28bf9dfc96a tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f14e38a8-0a3a-4ca6-965b-8fd161e524c1" status: 202 len: 0 microversion: 2.1 time: 0.560145 Jul 01 10:34:28.368832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 970/1994] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:27 2022] DELETE /compute/v2.1/os-security-groups/f14e38a8-0a3a-4ca6-965b-8fd161e524c1 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:28.379608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:28.386775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83c15927-b3e6-49e6-ba33-cc65a398d028 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970501f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:28.390437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:28.399329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:28.415271 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58c8b27f-3204-408a-9ef9-1d8e44429d79 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1411 microversion: 2.75 time: 0.254125 Jul 01 10:34:28.417319 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1025/1995] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:28 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1411 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:28.422075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:28.423175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:28.433111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:28.433754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:28.434671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:28.435246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:28.443022 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-83c15927-b3e6-49e6-ba33-cc65a398d028 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.073096 Jul 01 10:34:28.443600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 971/1996] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:28 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:28.470889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1daab0c5-62e9-498b-94b1-f9d698a20848 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] Calling method '.version_select at 0x7f6f9708f8b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:28.799929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:28.819937 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0457627e-d4c4-4ad5-b9ff-61c7c55a7404 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.398113 Jul 01 10:34:28.826689 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1026/1997] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:28 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:28.840635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:28.841804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:28.855674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:28.856332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:28.857204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:28.857800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:29.048228 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1daab0c5-62e9-498b-94b1-f9d698a20848 tempest-SecurityGroupRulesTestJSON-2056066610 tempest-SecurityGroupRulesTestJSON-2056066610-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1aa6e325-4a2b-477d-ac3e-387779c2218d" status: 202 len: 0 microversion: 2.1 time: 0.598278 Jul 01 10:34:29.048823 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 972/1998] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:34:28 2022] DELETE /compute/v2.1/os-security-groups/1aa6e325-4a2b-477d-ac3e-387779c2218d => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:34:29.143095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:29.154153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:29.156191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:29.157481 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f9842889-7085-4369-b9a7-04badc681328 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 0.329541 Jul 01 10:34:29.158534 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1027/1999] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:28 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:29.175653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:29.176525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:29.183678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:29.183817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:29.184550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:29.184991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:29.441058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:29.441717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:29.456260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:29.456971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:29.458660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:29.459256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:29.621903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:29.630677 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f421c3ce-4aec-4801-a2f9-bc001f6eb888 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.458755 Jul 01 10:34:29.648963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:29.661671 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 973/2000] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:29 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:29.684109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:29.691033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d00d24c1-bf18-45fa-bd72-522eb212f903 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97050e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:29.692254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:29.704715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2eb2250f-b2d0-4c46-8d12-a68e4cf7ec70 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1417 microversion: 2.75 time: 0.269899 Jul 01 10:34:29.724983 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1028/2001] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:29 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1417 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:34:29.764914 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d00d24c1-bf18-45fa-bd72-522eb212f903 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.097368 Jul 01 10:34:29.766252 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 974/2002] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:29 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:29.839312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:29.839943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:29.846654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:29.847105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:29.847892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:29.848319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:30.178123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:30.179113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:30.187661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:30.188468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:30.189464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:30.190234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:30.771119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:30.785619 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-888cb23e-31ba-4ae5-9fe3-4b085b92cfef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.946645 Jul 01 10:34:30.786741 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1029/2003] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:29 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:30.799947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:30.800912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:30.814128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:30.814754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:30.816495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:30.818518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:31.158638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:31.172065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:31.173998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:31.175688 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-997b7967-c5a0-4c4a-bcd2-dbb739460955 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 1.003372 Jul 01 10:34:31.177326 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 975/2004] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:30 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:34:31.188998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:31.189686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:31.204602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:31.205053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:31.206300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:31.206745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:31.254312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:31.263583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a82ff92e-c127-4814-8e73-eff00244ecfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.475477 Jul 01 10:34:31.277514 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1030/2005] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:30 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:31.282337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2b46b89-b9c6-4094-bb46-3a123ba02b8d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f913568b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:31.397954 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2b46b89-b9c6-4094-bb46-3a123ba02b8d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.118366 Jul 01 10:34:31.397954 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1031/2006] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:31 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:31.582469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:31.595408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:31.596924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:31.614442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29a8a184-80eb-473b-87c0-931abc45b874 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1417 microversion: 2.75 time: 0.435759 Jul 01 10:34:31.616220 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 976/2007] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:31 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1417 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:31.803147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:31.807048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:31.818884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:31.819370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:31.820162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:31.829010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:32.198934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:32.201379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:32.213074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:32.218074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:32.220600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:32.221264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:32.299712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:32.314896 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8cc76102-9c8d-48b1-b6d1-62a43e95892e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.515704 Jul 01 10:34:32.319375 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1032/2008] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:31 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:32.324275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:32.339132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:32.371162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:32.379889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:32.379889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:32.379889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.079760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.098525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.100481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.101959 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-83725b56-b5cb-4f4f-9368-933369445283 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 0.908370 Jul 01 10:34:33.103743 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 977/2009] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:32 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:33.109455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d1a6d1c1-7ba8-4837-a888-b3a1ece34e73 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97082550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:33.162653 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d1a6d1c1-7ba8-4837-a888-b3a1ece34e73 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.057548 Jul 01 10:34:33.163227 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 978/2010] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:33 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:33.169384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:33.170441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:33.205795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.206385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.210287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.211536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.246967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.257464 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8cfcebf6-fbf1-40f4-8375-d96767276132 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.936849 Jul 01 10:34:33.261105 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1033/2011] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:32 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:33.334358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:33.335054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:33.356911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.357318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.358174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.361405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.362306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.371825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.373368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.401353 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a481c907-8cda-4618-b7dc-cdc583ec4422 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1438 microversion: 2.75 time: 0.236769 Jul 01 10:34:33.405758 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 979/2012] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:33 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1438 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:33.425662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:33.427568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:33.445596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.446298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.447286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.447905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.593122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:34:33.593122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:34:33.593122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:34:33.593122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:34:33.593122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:34:33.820250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:33.834556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.835194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.836724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.837440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:33.891687 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:33.894144 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:33.908787 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d05f3678-e833-4813-9f0d-ba5e2b7fa0ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.579190 Jul 01 10:34:33.915373 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1034/2013] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:33 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:34:33.960201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a5d276db-174f-4161-b9b5-b4078bbf94cf req-0946d7ae-f106-404b-8b94-b31f4d5cb921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd", "name": "network-vif-plugged", "status": "completed", "tag": "2c3c27e3-43a6-4f64-8571-644bcc658b82"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:33.992210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a5d276db-174f-4161-b9b5-b4078bbf94cf req-0946d7ae-f106-404b-8b94-b31f4d5cb921 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:33.993963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a5d276db-174f-4161-b9b5-b4078bbf94cf req-0946d7ae-f106-404b-8b94-b31f4d5cb921 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:34.019318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:34.031438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:34.032982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:34.046913 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a5d276db-174f-4161-b9b5-b4078bbf94cf req-0946d7ae-f106-404b-8b94-b31f4d5cb921 service nova] Creating event network-vif-plugged:2c3c27e3-43a6-4f64-8571-644bcc658b82 for instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd on n-h1-master-1 Jul 01 10:34:34.063336 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c1e4f66-5e52-4a84-bbb1-64791f5841eb tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "POST /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d/action" status: 202 len: 1495 microversion: 2.75 time: 0.641624 Jul 01 10:34:34.078095 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 980/2014] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:34:33 2022] POST /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d/action => generated 1495 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 01 10:34:34.078292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a5d276db-174f-4161-b9b5-b4078bbf94cf req-0946d7ae-f106-404b-8b94-b31f4d5cb921 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110550 Jul 01 10:34:34.078292 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1035/2015] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:34:34.100116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:34.101514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:34.108087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:34.108669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:34.109742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:34.110433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:34.123099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:34.124273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:34.135708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:34.139118 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:34.140663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:34.141322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:34.172227 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:34.731080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:34.739437 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:34.740961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:34.760804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5e2395f-ea7a-4ed0-bf26-ca54f5f2d379 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.665005 Jul 01 10:34:34.772692 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 981/2016] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:34 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:34.772692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-16b54fcb-8cf5-4fff-9ea8-2d90a90a1b73 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fe1550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:34.893626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-16b54fcb-8cf5-4fff-9ea8-2d90a90a1b73 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.130612 Jul 01 10:34:34.894855 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 982/2017] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:34 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:34.906181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:34.909292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:34.930600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:34.932270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:34.933339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:34.933922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:35.140155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.152555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.158801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.160005 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cabb9117-1cd4-476b-910e-d0c5de8a60a2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 1.042541 Jul 01 10:34:35.160590 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1036/2018] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:34 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:35.176226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:35.177955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:35.207996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:35.208738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:35.209854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:35.210563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:35.391068 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:35.459632 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=28 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:35.762212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.770329 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f92d9a79-f297-488e-a5a7-061cf0875cf8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1315 microversion: 2.1 time: 0.601852 Jul 01 10:34:35.781953 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1037/2019] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:35 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:35.787168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:35.788007 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:35.804969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:35.805866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:35.807014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:35.807506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:35.884567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.906010 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-40dbcbdd-95af-4b23-8be2-f5b0383f2b4b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 1.001243 Jul 01 10:34:35.906904 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 983/2020] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:34 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:35.924750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cee02a77-38aa-428d-8ea4-dbf151cc4feb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fe1940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:35.951876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.970059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.971770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:35.978340 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2401af08-6e49-4bd3-8c40-59d7cca873d2 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.194993 Jul 01 10:34:35.981940 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1038/2021] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:35 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:36.041570 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cee02a77-38aa-428d-8ea4-dbf151cc4feb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.133295 Jul 01 10:34:36.043996 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 984/2022] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:35 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:36.156886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a215543a-1c7f-453f-987c-0205be475287 req-72be05a7-8986-45cb-95cf-53a0f3377642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba55d6c-e17b-4175-832b-048bfa530c81", "name": "network-vif-plugged", "status": "completed", "tag": "c2e325b6-bdbf-4cd7-b5af-f6a08f267996"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:36.178621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:36.179643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:36.186807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a215543a-1c7f-453f-987c-0205be475287 req-72be05a7-8986-45cb-95cf-53a0f3377642 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:36.188655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a215543a-1c7f-453f-987c-0205be475287 req-72be05a7-8986-45cb-95cf-53a0f3377642 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:36.190175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:36.195018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:36.200673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:36.200673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:36.229928 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a215543a-1c7f-453f-987c-0205be475287 req-72be05a7-8986-45cb-95cf-53a0f3377642 service nova] Creating event network-vif-plugged:c2e325b6-bdbf-4cd7-b5af-f6a08f267996 for instance 2ba55d6c-e17b-4175-832b-048bfa530c81 on n-h2-master-1 Jul 01 10:34:36.236794 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a215543a-1c7f-453f-987c-0205be475287 req-72be05a7-8986-45cb-95cf-53a0f3377642 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083513 Jul 01 10:34:36.237699 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1039/2023] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:36.507828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:36.521947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:36.525924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:36.528950 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4125a8b8-8a37-4287-8ccb-ef2331447ec1 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 0.354258 Jul 01 10:34:36.529546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 985/2024] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:36 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:34:36.819206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:36.820686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:36.841994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:36.842513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:36.843337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:36.843778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:36.924090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:36.925370 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:36.936429 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:36.947986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:36.948652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:36.949642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:36.950218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:37.210853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.222805 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0de71666-04c4-4bc5-8bdd-c35e7c31d28e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1502 microversion: 2.1 time: 0.404913 Jul 01 10:34:37.233516 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1040/2025] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:36 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:37.239041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:37.240049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:37.251200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:37.251891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:37.253027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:37.253637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:37.305764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.329626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e6b7c3c-33c8-4bb8-96d0-a064e506f0db tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.409455 Jul 01 10:34:37.330805 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 986/2026] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:36 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:34:37.335627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b830f82-0546-447b-9dc1-ba0536c1f037 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fd9430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:37.428341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b830f82-0546-447b-9dc1-ba0536c1f037 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.096208 Jul 01 10:34:37.435118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 987/2027] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:37 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:37.451979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:37.452855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:37.471620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:37.472233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:37.473194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:37.473769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:37.494337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.502705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.504188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.512076 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f86e09fc-6946-413c-a56c-74049362aba9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.277173 Jul 01 10:34:37.523182 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1041/2028] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:37 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:37.548522 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:37.549178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:37.560484 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:37.569434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:34:37.576043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:37.576518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:37.577392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:37.577831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:37.947857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.956602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.958137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:37.959259 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eaf95ca8-3f3a-4108-9b9d-fcca1faf8af6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 0.414875 Jul 01 10:34:37.959823 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1042/2029] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:37 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:34:37.973272 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5544be7a-19d8-4a71-83ca-65aa6fb9efec tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 204 len: 0 microversion: 2.1 time: 0.536367 Jul 01 10:34:37.977690 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 988/2030] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:34:37 2022] DELETE /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:34:37.993786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:37.994821 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:38.002212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.002715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.003769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.004434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.236445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:38.236445 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e05c9af-a81e-421f-8d8d-cf26b9b8e824 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1508 microversion: 2.1 time: 0.239051 Jul 01 10:34:38.236445 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1043/2031] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:37 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:38.267727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-03a45ab0-621c-4007-bfde-01ad45bb29f4 req-6935b32c-f98f-4cb4-8970-ecc380ff72db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65557a00-fd3c-4f95-95e7-44e4975cdb4e", "name": "network-vif-plugged", "status": "completed", "tag": "218dd2f5-3c30-4c14-8197-b3ad76f0d8a1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:38.282731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-03a45ab0-621c-4007-bfde-01ad45bb29f4 req-6935b32c-f98f-4cb4-8970-ecc380ff72db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.283970 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-03a45ab0-621c-4007-bfde-01ad45bb29f4 req-6935b32c-f98f-4cb4-8970-ecc380ff72db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.300559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-03a45ab0-621c-4007-bfde-01ad45bb29f4 req-6935b32c-f98f-4cb4-8970-ecc380ff72db service nova] Creating event network-vif-plugged:218dd2f5-3c30-4c14-8197-b3ad76f0d8a1 for instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e on n-h2-master-1 Jul 01 10:34:38.307047 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-03a45ab0-621c-4007-bfde-01ad45bb29f4 req-6935b32c-f98f-4cb4-8970-ecc380ff72db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049143 Jul 01 10:34:38.307659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 989/2032] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:38.347172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:38.347829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:38.357047 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.357680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.358659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.359185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.454282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d384acd-a30d-43f0-aa7e-54418dc702fd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fa0310>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:38.534240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d384acd-a30d-43f0-aa7e-54418dc702fd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.088377 Jul 01 10:34:38.535396 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 990/2033] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:38 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:38.541019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:38.542169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:38.552294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.565324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.565324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.565324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.671691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:38.682831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-036c633f-d081-4c67-bad5-b4246ccbc823 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 0.339442 Jul 01 10:34:38.683511 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1044/2034] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:38 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:38.769388 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:38.790162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:38.793465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:38.802846 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6243699e-3f9f-4a4a-bcf1-b532224f805f tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.266112 Jul 01 10:34:38.804021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 991/2035] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:38 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:38.981816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:38.982762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:38.990475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.991164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:38.992161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:38.992854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:39.239939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:39.241902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:39.258126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:39.279889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:39.280697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:39.287663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:39.288386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:39.292720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:39.297456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:39.304975 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d043466e-bad9-48ea-9a14-c5ad2f4740c9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 0.324971 Jul 01 10:34:39.305903 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1045/2036] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:38 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:39.549206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2175b184-c893-4c7a-97e4-ee71dc7ad798 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f912df3a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:39.640818 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2175b184-c893-4c7a-97e4-ee71dc7ad798 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.095694 Jul 01 10:34:39.648467 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1046/2037] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:39 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:34:39.700428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:39.701090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:39.714108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:39.714722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:39.715570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:39.716010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:39.869537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:39.878024 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc444472-1c37-415b-8e40-c52ded92b829 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1508 microversion: 2.1 time: 0.645658 Jul 01 10:34:39.893488 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 992/2038] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:39 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1508 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:34:39.910515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:39.918440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:39.931901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:39.932507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:39.933443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:39.936368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:40.111643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:40.124252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:40.142296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:40.155300 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-767e23c4-11cb-4395-8c3d-a47fa881a4c0 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.259134 Jul 01 10:34:40.156260 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 993/2039] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:39 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:40.324503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:40.328034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:40.337726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:40.341887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:40.343207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:40.343879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:40.775786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:40.786247 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5b282efa-7ef2-4b64-9be7-d1f06af885d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1513 microversion: 2.1 time: 1.090115 Jul 01 10:34:40.798957 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1047/2040] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:39 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1513 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:34:40.814436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05dd34ff-3ea4-44ef-9036-c734b0ff6431 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9146ce50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:40.903973 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-05dd34ff-3ea4-44ef-9036-c734b0ff6431 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.103308 Jul 01 10:34:40.905240 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1048/2041] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:40 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:40.925475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:40.927764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:40.946762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:40.947312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:40.953536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:40.954050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:41.000981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:41.015652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:41.020433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:41.025076 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9f2b71f4-be68-47a8-8226-6496084df36e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1280 microversion: 2.25 time: 0.704857 Jul 01 10:34:41.032789 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 994/2042] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:40 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1280 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:34:41.050808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3c99c856-ca50-4579-9d68-be750a6a6527 req-eb143634-1736-4cde-b34e-cc30f4d8de4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd", "name": "network-vif-deleted", "tag": "2c3c27e3-43a6-4f64-8571-644bcc658b82"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:41.073934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3c99c856-ca50-4579-9d68-be750a6a6527 req-eb143634-1736-4cde-b34e-cc30f4d8de4c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:41.075813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3c99c856-ca50-4579-9d68-be750a6a6527 req-eb143634-1736-4cde-b34e-cc30f4d8de4c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:41.092062 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3c99c856-ca50-4579-9d68-be750a6a6527 req-eb143634-1736-4cde-b34e-cc30f4d8de4c service nova] Creating event network-vif-deleted:2c3c27e3-43a6-4f64-8571-644bcc658b82 for instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd on n-h1-master-1 Jul 01 10:34:41.100733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3c99c856-ca50-4579-9d68-be750a6a6527 req-eb143634-1736-4cde-b34e-cc30f4d8de4c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065399 Jul 01 10:34:41.101848 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 995/2043] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:41.176992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:41.178076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:41.189917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:41.193933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:41.194817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:41.196425 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:41.197109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:41.202128 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3c00d9dd-e639-4571-9adb-4c0f0a8e42f2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 200 len: 1300 microversion: 2.1 time: 0.286092 Jul 01 10:34:41.212630 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1049/2044] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:40 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 1300 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:41.339496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:41.360771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:41.360771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:41.362841 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ca06c3d-4f38-4d6b-b567-fe0b7efe2d58 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.190386 Jul 01 10:34:41.364238 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 996/2045] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:41 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:41.809986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:41.813955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:41.829449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:41.830261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:41.832596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:41.834449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:41.919436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51982de2-92fe-4192-8576-5df439746403 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fa08b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:42.010157 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51982de2-92fe-4192-8576-5df439746403 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.095340 Jul 01 10:34:42.015953 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 997/2046] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:41 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:42.054782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:42.055720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:42.073125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:42.073956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:42.075013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:42.075690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.047743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:43.061165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:43.073168 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-28c09e49-4fa2-414b-b698-10e7b767173b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1490 microversion: 2.1 time: 1.267064 Jul 01 10:34:43.077805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:43.082062 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1050/2047] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:41 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1490 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:43.085458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:43.088902 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f45ff35a-4780-4b2b-9dd3-cb147146a51c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1476 microversion: 2.25 time: 1.038662 Jul 01 10:34:43.109289 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 998/2048] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:42 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1476 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:43.113799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:43.114583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:43.119717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:43.125702 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.126139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:43.126267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.127179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.127612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.142363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.145810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.146981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.150140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.155808 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd HTTP/1.1 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: exception: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'd5c714a3-ef52-4f61-9e38-db2a6d5cf2fd'} Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:34:43.157510 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a5f10fcb-814d-4a66-88fe-8a37aece0a7d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 404 len: 111 microversion: 2.1 time: 0.074806 Jul 01 10:34:43.160742 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1051/2049] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:43 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:34:43.376898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d923b536-2035-4888-88c8-939ef64f7ec7 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Action: 'create', calling method: .version_select at 0x7f6f912e5280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-941140593", "policies": ["affinity"]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:43.418415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d923b536-2035-4888-88c8-939ef64f7ec7 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:43.435626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d923b536-2035-4888-88c8-939ef64f7ec7 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:43.443115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:43.452865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:43.464700 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:43.491838 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62dd93fa-666c-42d1-a69e-3a1666dc7c43 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.391367 Jul 01 10:34:43.496479 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 999/2050] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:43 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:43.520985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6223b33e-2719-4cab-b382-0c80ee6f35eb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fa0ee0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:43.621754 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6223b33e-2719-4cab-b382-0c80ee6f35eb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.118965 Jul 01 10:34:43.623125 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1000/2051] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:43 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:43.632806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d923b536-2035-4888-88c8-939ef64f7ec7 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:43.636535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4fe780b-59e7-4403-9481-54c9f9bcbb30 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:43.648409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f4fe780b-59e7-4403-9481-54c9f9bcbb30 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:43.669240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d923b536-2035-4888-88c8-939ef64f7ec7 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:43.677335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4fe780b-59e7-4403-9481-54c9f9bcbb30 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.682049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4fe780b-59e7-4403-9481-54c9f9bcbb30 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.690196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4fe780b-59e7-4403-9481-54c9f9bcbb30 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.690729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4fe780b-59e7-4403-9481-54c9f9bcbb30 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.713794 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d923b536-2035-4888-88c8-939ef64f7ec7 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.539357 Jul 01 10:34:43.714760 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1052/2052] 10.222.0.23 () {60 vars in 1173 bytes} [Fri Jul 1 10:34:43 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:43.831002 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4fe780b-59e7-4403-9481-54c9f9bcbb30 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 200 len: 133 microversion: 2.1 time: 0.206386 Jul 01 10:34:43.848692 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1001/2053] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:34:43 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 133 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:43.865754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1777361770", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ce42240f-1f36-4657-993c-cfa415e6f19d"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:43.947353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:43.948294 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:43.956089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.956748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.958350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:43.960199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:43.990496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] validate_networks() for [('ce42240f-1f36-4657-993c-cfa415e6f19d', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:34:44.556471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 65557a00-fd3c-4f95-95e7-44e4975cdb4e {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:34:44.582622 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2982fe7-d887-4ec6-9737-8c103fea853f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1968 microversion: 2.25 time: 0.865738 Jul 01 10:34:44.583545 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1053/2054] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:43 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1968 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:44.590748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62dfaf33-b51c-4074-87e0-6e3dd8ecc46d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Action: 'create', calling method: .version_select at 0x7f6f9136e040>, body: {"server_group": {"name": "tempest-server-group-1519016126", "policies": ["affinity"]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:44.620663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-62dfaf33-b51c-4074-87e0-6e3dd8ecc46d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:44.648511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-62dfaf33-b51c-4074-87e0-6e3dd8ecc46d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:44.863603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-62dfaf33-b51c-4074-87e0-6e3dd8ecc46d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:44.872149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-62dfaf33-b51c-4074-87e0-6e3dd8ecc46d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:44.907407 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62dfaf33-b51c-4074-87e0-6e3dd8ecc46d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.322519 Jul 01 10:34:44.911357 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1054/2055] 10.222.0.23 () {60 vars in 1172 bytes} [Fri Jul 1 10:34:44 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:44.917078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:44.923715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:44.936762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:44.950255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:44.951327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:44.951935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:45.456608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:45.477790 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e5b1539c-baa1-4271-b610-3e8ef48ff8e4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.563279 Jul 01 10:34:45.477790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1055/2056] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:44 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:45.499615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:45.504175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:45.535176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:45.536134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:45.542115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:45.542856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:45.732997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:45.743776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:45.748119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:45.765187 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc4eeca1-9e52-4c47-9064-b483b95e8490 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.287274 Jul 01 10:34:45.769397 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1056/2057] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:45 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:45.772957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:45.776060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:45.792796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:45.793586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:45.798169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:45.798169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:45.799561 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:45.875977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:34:45.876498 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:34:45.877053 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:34:45.877697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:34:45.878323 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:34:45.895793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:45.897862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:45.900180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:45.903036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:45.978008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:45.989438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for user cc8012fcb48840f1b778ab759457e66c and project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:46.051242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:34:46.058313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:34:46.293499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 65557a00-fd3c-4f95-95e7-44e4975cdb4e {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:34:46.323061 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e41d16e9-710b-4c8d-ae3a-71c84fb2e6b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.472728 Jul 01 10:34:46.324032 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1002/2058] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:34:46.333603 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca69ccbb-6bb9-4e9d-adc0-c72ff1498965 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1968 microversion: 2.25 time: 0.553651 Jul 01 10:34:46.341212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1057/2059] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:45 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1968 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:46.346880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4b613a0-7626-42e5-96cb-6cb2aa5a24ce tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fe1af0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:46.360108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3bea2aa-209f-4e6c-8074-a1f82afb8e43 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Action: 'create', calling method: .version_select at 0x7f6f9127bf70>, body: {"server_group": {"name": "tempest-server-group-1519016126", "policies": ["affinity"]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:46.469318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b3bea2aa-209f-4e6c-8074-a1f82afb8e43 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:46.485832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4b613a0-7626-42e5-96cb-6cb2aa5a24ce tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.159983 Jul 01 10:34:46.488257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b3bea2aa-209f-4e6c-8074-a1f82afb8e43 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:46.493875 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1003/2060] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:46 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:46.506508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:46.507357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:46.531092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:46.531820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:46.542307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:46.542876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:46.738917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:46.747813 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-932e7a8b-a428-4c65-bb1e-05ea26a69031 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.250133 Jul 01 10:34:46.748320 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1004/2061] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:46 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:46.753175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b96201a-ea8d-4745-b661-3845b2aee56e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:46.753826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b96201a-ea8d-4745-b661-3845b2aee56e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:46.821060 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:46.839277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b3bea2aa-209f-4e6c-8074-a1f82afb8e43 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:46.849129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b96201a-ea8d-4745-b661-3845b2aee56e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:46.850124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b3bea2aa-209f-4e6c-8074-a1f82afb8e43 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:46.857559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b96201a-ea8d-4745-b661-3845b2aee56e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1215 microversion: 2.1 time: 0.108153 Jul 01 10:34:46.862485 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1005/2062] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:46 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:46.873348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11ddab1b-4fc1-4ccc-a37c-0b71617bd483 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:46.875201 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:34:46.875201 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:34:46.876613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ddab1b-4fc1-4ccc-a37c-0b71617bd483 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:46.877191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ddab1b-4fc1-4ccc-a37c-0b71617bd483 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:46.882444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ddab1b-4fc1-4ccc-a37c-0b71617bd483 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:46.883033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ddab1b-4fc1-4ccc-a37c-0b71617bd483 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:46.900738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3bea2aa-209f-4e6c-8074-a1f82afb8e43 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.557752 Jul 01 10:34:46.902288 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1058/2063] 10.222.0.23 () {60 vars in 1172 bytes} [Fri Jul 1 10:34:46 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:46.921123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:46.926194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:46.933793 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:46.947321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:46.948710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:46.950202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:46.962663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:46.976606 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11ddab1b-4fc1-4ccc-a37c-0b71617bd483 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.112751 Jul 01 10:34:46.983606 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1006/2064] 10.222.0.23 () {60 vars in 1216 bytes} [Fri Jul 1 10:34:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:34:46.996893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:47.012028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:47.023596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:47.024410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:47.030215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:47.031134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:47.068865 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:47.423497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:47.439004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:47.445322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:47.491867 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4c2f832d-df07-4eda-96b4-9914267145c3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.493531 Jul 01 10:34:47.492944 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1007/2065] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:46 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:47.501247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a856d89e-9c27-44e5-bc88-10b627cb47f9 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:47.533665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:47.545545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a265d24-b8d5-4844-84fc-1c709a69554c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.638952 Jul 01 10:34:47.546346 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1059/2066] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:46 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:47.554703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:47.563753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:47.590674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:47.591021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:47.596777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:47.598496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:47.680095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'flavor' on Instance uuid 65557a00-fd3c-4f95-95e7-44e4975cdb4e {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:34:47.712498 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a856d89e-9c27-44e5-bc88-10b627cb47f9 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/8f8023b2-751b-4aab-b6c3-bc6e0f760583" status: 204 len: 0 microversion: 2.1 time: 0.218300 Jul 01 10:34:47.713393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1008/2067] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:34:47 2022] DELETE /compute/v2.1/os-server-groups/8f8023b2-751b-4aab-b6c3-bc6e0f760583 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:34:47.718141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00e21afd-084c-4502-b833-618437eafd91 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fa0e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:47.723806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Going to try to live migrate instance to n-h1-master-1 {{(pid=119765) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:34:47.856991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00e21afd-084c-4502-b833-618437eafd91 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.142373 Jul 01 10:34:47.857613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1009/2068] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:47 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:47.862571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:47.863365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:47.918423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:47.919047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:47.919796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:47.920367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:49.091444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:49.107041 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96238f1b-b4c4-4edf-815a-ea36cdd2fcab tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 1.247983 Jul 01 10:34:49.107989 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1010/2069] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:47 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:49.113887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-347166d8-b7d5-4f6b-99be-8cb5ee397afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:49.155831 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-347166d8-b7d5-4f6b-99be-8cb5ee397afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.045915 Jul 01 10:34:49.158654 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1011/2070] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:34:49 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:49.173005 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:49.174240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:49.205560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:49.206747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:49.212355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:49.212355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:49.416669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:49.436313 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5355d86d-b5f3-4cb5-bee0-4ccfba52df81 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1275 microversion: 2.1 time: 0.274364 Jul 01 10:34:49.437685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1012/2071] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:49 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:49.461062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:49.463929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:49.483329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:49.486039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:49.487093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:49.489799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:49.666321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:49.676510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:49.684978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:49.700937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-743fbde6-d5c4-4280-a904-064fe4f8d1d6 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.249341 Jul 01 10:34:49.702605 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1013/2072] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:49 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:49.709989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-94948d45-9d8e-438c-925e-3913359ac47c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fe18b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:49.784376 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-94948d45-9d8e-438c-925e-3913359ac47c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.080034 Jul 01 10:34:49.788644 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1014/2073] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:49 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:49.796740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-12455934-849b-4ae3-95cf-07a17048767f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:49.907217 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-12455934-849b-4ae3-95cf-07a17048767f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/04c40ce7-d2aa-4569-bbf5-b7a435e7a22d" status: 204 len: 0 microversion: 2.1 time: 0.115585 Jul 01 10:34:49.912236 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1015/2074] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:34:49 2022] DELETE /compute/v2.1/os-server-groups/04c40ce7-d2aa-4569-bbf5-b7a435e7a22d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:34:49.918412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1083078832", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "04eeb7f2-cad2-4f5d-96c5-202b3781e660"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:50.059655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] validate_networks() for [('04eeb7f2-cad2-4f5d-96c5-202b3781e660', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:34:51.160709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:34:51.161311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:34:51.161775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:34:51.162290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:34:51.162781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:34:51.186694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:51.187152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:51.189209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:51.189209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:51.261291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:51.269717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for user adf336817b04429b930e1f80ea25b1f7 and project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:51.299847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:34:51.302025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:34:51.492810 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c426173c-3e83-4a25-aeb1-2d0f7831f548 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578166 Jul 01 10:34:51.494110 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1016/2075] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:34:51.509926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb50c74b-be4c-4650-8c7e-4ec9921c6c3e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:51.537626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb50c74b-be4c-4650-8c7e-4ec9921c6c3e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040518 Jul 01 10:34:51.538158 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1017/2076] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:34:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:51.576483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:51.577104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:51.601235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:51.602238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:51.603040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:51.603483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:51.926185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:51.940034 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-867284bd-7d1e-46fa-afaf-19c9e162091b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.396153 Jul 01 10:34:51.942042 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1018/2077] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:51 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:51.963156 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:51.963792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:51.987036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:51.988541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:51.989858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:51.991963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:52.129322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:52.152729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:52.160679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:52.169530 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3fae9972-f2e6-4e6e-8f55-45104d712649 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.226010 Jul 01 10:34:52.171234 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1019/2078] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:51 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:52.176308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f5f497b-3882-47b3-8d21-ab5c8a837715 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f6a940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:52.231407 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f5f497b-3882-47b3-8d21-ab5c8a837715 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.058706 Jul 01 10:34:52.232998 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1020/2079] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:52 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:52.253116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8431401d-3a16-45c9-8b19-795ce852093e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:52.253988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8431401d-3a16-45c9-8b19-795ce852093e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:52.410817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8431401d-3a16-45c9-8b19-795ce852093e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:52.458446 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8431401d-3a16-45c9-8b19-795ce852093e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1215 microversion: 2.1 time: 0.223654 Jul 01 10:34:52.468847 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1021/2080] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:52 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1215 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:52.502463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ea74704-e0b3-4836-98ba-9bc3a93f9855 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Action: 'create', calling method: .version_select at 0x7f6f97082f70>, body: {"server_group": {"name": "tempest-server-group-610383552", "policies": ["affinity"]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:52.603767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0ea74704-e0b3-4836-98ba-9bc3a93f9855 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:52.627074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0ea74704-e0b3-4836-98ba-9bc3a93f9855 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:52.902853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0ea74704-e0b3-4836-98ba-9bc3a93f9855 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:52.970570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0ea74704-e0b3-4836-98ba-9bc3a93f9855 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:53.052227 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ea74704-e0b3-4836-98ba-9bc3a93f9855 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.571264 Jul 01 10:34:53.054518 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1022/2081] 10.222.0.23 () {60 vars in 1172 bytes} [Fri Jul 1 10:34:52 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:53.077235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:53.079101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:53.147649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:53.150160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:53.152637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:53.156669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:53.562667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:53.589587 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2acc244-64f1-48e5-b34e-dbbda1444ec1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.532857 Jul 01 10:34:53.591077 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1023/2082] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:53 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:53.605968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33fe0bae-b5d7-49cd-a1d1-15cd726a3152 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:53.768896 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33fe0bae-b5d7-49cd-a1d1-15cd726a3152 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/42b12d22-7105-40c0-ad60-56b0c9af452a" status: 204 len: 0 microversion: 2.1 time: 0.176430 Jul 01 10:34:53.772143 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1024/2083] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:34:53 2022] DELETE /compute/v2.1/os-server-groups/42b12d22-7105-40c0-ad60-56b0c9af452a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:34:53.775867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:53.777804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:53.814335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:53.827664 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0912742-a92a-4705-938e-1f905ab57d3e tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e/action" status: 202 len: 0 microversion: 2.25 time: 6.280039 Jul 01 10:34:53.829631 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1060/2084] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:34:47 2022] POST /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e/action => generated 0 bytes in 6281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:34:53.829742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:53.831809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:53.832932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:53.833694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96b12dec-edb3-4020-ab08-015a6f829ce7 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9146cc10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:53.957921 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96b12dec-edb3-4020-ab08-015a6f829ce7 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.127546 Jul 01 10:34:53.958820 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1061/2085] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:53 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:53.963611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:53.964233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:54.019387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:54.020035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:54.020861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:54.031953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:54.052420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:54.074189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:54.078826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:54.105744 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:54.108016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef87ebc5-61cf-47f1-ba4e-b77372daadb3 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.337301 Jul 01 10:34:54.108946 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1025/2086] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:53 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:54.122504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-317f1bb7-3753-4f4a-b17e-5e7a8c69f9c5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:54.197229 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-317f1bb7-3753-4f4a-b17e-5e7a8c69f9c5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.075905 Jul 01 10:34:54.200481 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1026/2087] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:34:54 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:54.224845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:54.226109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:54.270220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:54.274528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:54.275571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:54.278677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:54.304270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:54.318934 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74922c9d-ad71-4203-940d-611fd35024d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1211 microversion: 2.1 time: 0.357388 Jul 01 10:34:54.334670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1062/2088] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:53 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1211 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:54.351127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6447eb73-834b-47f6-af69-8dc4f1e1180f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Action: 'create', calling method: .version_select at 0x7f6f912df790>, body: {"server_group": {"name": "tempest-server-group-360161365", "policies": ["anti-affinity"]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:54.425926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6447eb73-834b-47f6-af69-8dc4f1e1180f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:54.439500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6447eb73-834b-47f6-af69-8dc4f1e1180f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:54.682923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6447eb73-834b-47f6-af69-8dc4f1e1180f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:54.702535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-6447eb73-834b-47f6-af69-8dc4f1e1180f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_groups'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:54.719813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:54.745405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:54.756041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:54.760685 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-344b82b8-39e1-4d10-be2e-ed92bfc1a780 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.558917 Jul 01 10:34:54.776648 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1027/2089] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:54 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:54.796303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:54.797013 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6447eb73-834b-47f6-af69-8dc4f1e1180f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.458672 Jul 01 10:34:54.798331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1063/2090] 10.222.0.23 () {60 vars in 1172 bytes} [Fri Jul 1 10:34:54 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:54.801951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:54.809539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47000551-be16-4d99-9c74-84944bd39daf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:54.817701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:54.821766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:54.823555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:54.825880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:55.056121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:55.064854 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb8dc70c-a85a-4ed0-953b-5009422720ac tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.284938 Jul 01 10:34:55.074853 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1028/2091] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:54 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:55.080277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d49f6f22-fb7e-4d79-a46d-f449edac3933 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fd35e0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:55.123950 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47000551-be16-4d99-9c74-84944bd39daf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38" status: 204 len: 0 microversion: 2.1 time: 0.319690 Jul 01 10:34:55.128121 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1064/2092] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:34:54 2022] DELETE /compute/v2.1/os-server-groups/c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:34:55.133456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:55.135471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:55.150225 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d49f6f22-fb7e-4d79-a46d-f449edac3933 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1454 microversion: 2.1 time: 0.073930 Jul 01 10:34:55.150947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:55.152301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:55.153466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:55.154082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:55.155948 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1029/2093] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:55 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:55.162780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b299ef58-4971-491c-a070-f3ecda870a6e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:55.222936 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b299ef58-4971-491c-a070-f3ecda870a6e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.065606 Jul 01 10:34:55.233594 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1030/2094] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:34:55 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:55.298406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:55.318817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:55.323595 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:55.342663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:55.343316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:55.350173 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-75b9e94d-1e3e-4a78-af0f-dfe891e12587 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.220602 Jul 01 10:34:55.352794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:55.352794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:55.352794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:55.352794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:55.353059 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1065/2095] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:55 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:55.440554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-903254862", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "b23aad96-8e53-4300-a88d-41d25651573c"}]}, "os:scheduler_hints": {"group": "28cb30af-74ab-472d-a226-d815f3925fe4"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:55.579341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] validate_networks() for [('b23aad96-8e53-4300-a88d-41d25651573c', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:34:55.654365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:55.670109 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d94de68-7624-4876-b07d-41a3eebae93e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1275 microversion: 2.1 time: 0.331103 Jul 01 10:34:55.671081 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1031/2096] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:55 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1275 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:34:55.676185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b8c1f9cf-efb7-4974-a4a3-55b2a8e4b6c9 req-822190e6-c49c-4e08-847a-997aa2fd034b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e04ea24-b9fd-4851-bc55-68c32ab78300", "tag": "d7c43a44-58ec-469d-896d-2157bf976c84"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:55.732389 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b8c1f9cf-efb7-4974-a4a3-55b2a8e4b6c9 req-822190e6-c49c-4e08-847a-997aa2fd034b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:55.732389 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b8c1f9cf-efb7-4974-a4a3-55b2a8e4b6c9 req-822190e6-c49c-4e08-847a-997aa2fd034b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:55.786328 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b8c1f9cf-efb7-4974-a4a3-55b2a8e4b6c9 req-822190e6-c49c-4e08-847a-997aa2fd034b service nova] Creating event network-changed:d7c43a44-58ec-469d-896d-2157bf976c84 for instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 on n-h2-master-1 Jul 01 10:34:55.809806 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b8c1f9cf-efb7-4974-a4a3-55b2a8e4b6c9 req-822190e6-c49c-4e08-847a-997aa2fd034b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128941 Jul 01 10:34:55.813479 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1032/2097] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:34:55.847287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:55.849049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:55.885592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:55.895775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:55.896921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:55.901871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:56.773185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:56.795933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:56.810750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:56.812555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-acfdeefa-b60b-4379-b45e-7409e0ed788b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.997509 Jul 01 10:34:56.813651 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1033/2098] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:55 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:56.831237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:56.833543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:56.855040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:56.856517 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:56.859546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:56.860152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:57.512289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:57.526498 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0462452d-f458-4864-b248-a9d517066bdc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.709923 Jul 01 10:34:57.540976 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1034/2099] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:56 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:57.544300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-faee894e-6bc8-4744-851a-4060054cbb3d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9708f9d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:57.660834 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-faee894e-6bc8-4744-851a-4060054cbb3d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1463 microversion: 2.1 time: 0.120574 Jul 01 10:34:57.668830 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1035/2100] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:57 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1463 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:57.709516 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:57.711039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:57.720853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:34:57.721404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:34:57.722505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:34:57.723634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:34:57.724925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:34:57.746456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:57.752251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:57.753297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:57.753830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:57.777529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:57.778241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:57.779210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:57.781350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:57.831913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:57.847746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:57.900121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:34:57.904377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:34:57.992047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:58.020290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:58.025315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:58.037931 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-05d2ce1d-f90e-4184-bb47-310af24402a9 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.355672 Jul 01 10:34:58.039510 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1036/2101] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:57 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:58.044344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:58.045228 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:58.052822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:58.053439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:58.054320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:58.054990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:58.122881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:58.134581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:58.177362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:58.187083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bbffcc02-e739-495a-8b07-248bdbb88b02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1273 microversion: 2.1 time: 0.146250 Jul 01 10:34:58.188231 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1037/2102] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:58 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:58.193727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d35fe571-ccf0-4179-924f-91f8311713ad tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fd3280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:58.309954 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d35fe571-ccf0-4179-924f-91f8311713ad tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 200 len: 1463 microversion: 2.1 time: 0.120307 Jul 01 10:34:58.310659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1038/2103] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:34:58 2022] GET /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 1463 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:58.319869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:58.328337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:58.328550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:34:58.344464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Getting quotas for user b2c3b26cef03455c805823630a0d36c2 and project f8a7baf7e8584eeab815f3db59a7b237. Resources: {'server_group_members'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:34:58.358632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:58.369237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:58.370206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:58.371024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:58.388459 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb9cc6c6-d6af-4968-8179-8ee3b8b365af tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.961665 Jul 01 10:34:58.390351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1066/2104] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:34:58.397729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:58.399122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:58.407884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:58.409203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:58.410254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:58.411221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:58.891950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:58.904430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:58.909635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:58.911594 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0d9eb7d5-78e6-4b99-9651-528ce0a83850 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.599904 Jul 01 10:34:58.912172 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1039/2105] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:58 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:34:58.936469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e85d71bf-47a4-453c-8834-d99cfe66a1db tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:58.939215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e85d71bf-47a4-453c-8834-d99cfe66a1db tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:58.995786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:59.009573 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0351ffd-0479-4bb8-9bc8-02479f744e21 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 1466 microversion: 2.1 time: 0.616274 Jul 01 10:34:59.010239 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1067/2106] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:58 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 1466 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:59.031362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:59.031991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:59.041597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:59.042345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:59.043145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:59.043587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:59.084173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e85d71bf-47a4-453c-8834-d99cfe66a1db tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:59.084173 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e85d71bf-47a4-453c-8834-d99cfe66a1db tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1212 microversion: 2.1 time: 0.145789 Jul 01 10:34:59.084173 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1040/2107] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:58 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:59.097032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ded52fbe-507e-4441-a629-555079e3efb5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-302940100"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:34:59.102154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ded52fbe-507e-4441-a629-555079e3efb5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:59.124363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ded52fbe-507e-4441-a629-555079e3efb5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:59.124822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ded52fbe-507e-4441-a629-555079e3efb5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:59.125632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ded52fbe-507e-4441-a629-555079e3efb5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:59.134636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ded52fbe-507e-4441-a629-555079e3efb5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:59.172371 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:59.920974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:34:59.930157 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d45c9fd-99f7-45eb-873f-0ba5e47ac67e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.908385 Jul 01 10:34:59.936033 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1068/2108] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:59 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:34:59.949236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:59.949978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:34:59.952079 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:34:59.971097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:59.971780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ded52fbe-507e-4441-a629-555079e3efb5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "POST /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41/action" status: 202 len: 0 microversion: 2.1 time: 0.892194 Jul 01 10:34:59.972044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:59.977254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:34:59.977254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:34:59.977534 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1041/2109] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:34:59 2022] POST /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:34:59.989969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:34:59.991870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:00.008776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.010198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:00.012411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.013059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:00.200386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.215110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.216992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.227269 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99a257b9-cf18-44ed-8213-e96c5019de78 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.289955 Jul 01 10:35:00.237235 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1069/2110] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:34:59 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:00.252333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:00.253225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:00.262455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.263222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:00.264540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.265133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:00.567012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.585162 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-202a59df-ca3b-4388-8c42-afafe1a2160e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.604066 Jul 01 10:35:00.595983 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1042/2111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:34:59 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:00.606756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-55f506dd-6896-4f23-ab6b-055461ab1f6c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97081040>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:00.726903 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-55f506dd-6896-4f23-ab6b-055461ab1f6c tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.129007 Jul 01 10:35:00.727503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1043/2112] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:00 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:00.743544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:00.744190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:00.755761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.756503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:00.757337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.757796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:00.818513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.840089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.848502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.850360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78eedacb-a517-4eb7-99c2-ac17e30fa23b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.604612 Jul 01 10:35:00.864961 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1070/2113] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:00 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:00.870068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:00.884051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11f17eac-6b6d-44b1-810b-27c50091261a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1208 microversion: 2.1 time: 0.145649 Jul 01 10:35:00.902662 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1044/2114] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:00 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1208 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:00.952912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:00.953953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:00.966957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.967822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:00.968596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:00.969951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:01.033025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-631df5c1-ec9f-4dde-b868-cc6feea709d8 req-f7df5d37-be63-45fa-b991-ba88fbbbab26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc136f1-7c35-4323-846e-3cfb690ad678", "tag": "899c4965-a8ed-4a54-bb17-041d0d35059b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:01.046164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-631df5c1-ec9f-4dde-b868-cc6feea709d8 req-f7df5d37-be63-45fa-b991-ba88fbbbab26 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:01.047867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-631df5c1-ec9f-4dde-b868-cc6feea709d8 req-f7df5d37-be63-45fa-b991-ba88fbbbab26 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:01.062650 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-631df5c1-ec9f-4dde-b868-cc6feea709d8 req-f7df5d37-be63-45fa-b991-ba88fbbbab26 service nova] Creating event network-changed:899c4965-a8ed-4a54-bb17-041d0d35059b for instance ebc136f1-7c35-4323-846e-3cfb690ad678 on n-h1-master-1 Jul 01 10:35:01.069702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-631df5c1-ec9f-4dde-b868-cc6feea709d8 req-f7df5d37-be63-45fa-b991-ba88fbbbab26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042193 Jul 01 10:35:01.072018 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1045/2115] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:35:01.249932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:01.250865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:01.262915 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:01.269548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:01.274928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:01.274928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:01.274928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:01.469444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:01.483969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:01.498418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:01.503070 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8843b25-0ab5-4c23-a26e-bb660d0d5179 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.544360 Jul 01 10:35:01.503070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1071/2116] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:00 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:01.503248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:01.512206 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04ed8f41-5376-4ab6-865c-4efb37fe2e9c tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.266727 Jul 01 10:35:01.515044 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1046/2117] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:01 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:01.604919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:01.606381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:01.615390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:01.616296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:01.617999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:01.618657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:01.740533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d2120440-f316-4a0e-bad3-eeb9971241bb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f1ec10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:01.807183 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d2120440-f316-4a0e-bad3-eeb9971241bb tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.070374 Jul 01 10:35:01.823297 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1047/2118] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:01 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:01.872751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:01.873554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:01.881067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:01.881875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:01.882975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:01.883560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:02.111731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.132319 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc11525a-02c2-44d2-a331-7e8ca22e032d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.530508 Jul 01 10:35:02.145058 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1072/2119] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:01 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:02.175831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:02.176934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:02.211399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:02.215525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:02.220999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:02.225002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:02.233283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.239855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.247326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.266238 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e65097a9-0578-4648-9885-f8317eae408c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.387468 Jul 01 10:35:02.278564 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1048/2120] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:01 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:35:02.509391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.518117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f6f18db-0a60-46be-b53f-21c17172ed83 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1282 microversion: 2.1 time: 0.370524 Jul 01 10:35:02.521999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:02.541265 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1073/2121] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:02 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1282 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:02.542688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:02.543321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:02.545583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:02.557853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:02.558307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:02.559095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:02.559527 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:02.569842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:02.569842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:02.586783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:02.587801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:02.712655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.725077 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.729327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:02.742675 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c86a6703-ff5a-4d9a-933d-95424c8e23c1 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1447 microversion: 2.75 time: 0.206939 Jul 01 10:35:02.743744 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1074/2122] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:02 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:02.830607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf9152f1-ecf2-46a3-80d2-b1b1106840cd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f912dfb80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:02.906545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf9152f1-ecf2-46a3-80d2-b1b1106840cd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.079902 Jul 01 10:35:02.914574 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1075/2123] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:02 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:03.153927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:03.154917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:03.194227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:03.196234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:03.197687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:03.199593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:03.432413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:03.454783 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bbfb6daa-960d-47ea-8694-9ffc4fd33ab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.941483 Jul 01 10:35:03.456488 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1049/2124] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:02 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:03.463459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:03.467537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:03.471462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:03.473007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:03.478583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:03.479999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:03.889071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:03.906066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4ae9454-ec2c-4d88-bf34-f147aeedaa76 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.759470 Jul 01 10:35:03.920958 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1076/2125] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:03 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:03.932232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-269d9aac-2e4c-44af-93a7-a1fae19a7c11 req-5809f83a-e2f5-4c98-8914-e966e0f04a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba55d6c-e17b-4175-832b-048bfa530c81", "name": "network-vif-unplugged", "status": "completed", "tag": "c2e325b6-bdbf-4cd7-b5af-f6a08f267996"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:03.957458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-269d9aac-2e4c-44af-93a7-a1fae19a7c11 req-5809f83a-e2f5-4c98-8914-e966e0f04a19 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:03.958373 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-269d9aac-2e4c-44af-93a7-a1fae19a7c11 req-5809f83a-e2f5-4c98-8914-e966e0f04a19 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:03.981031 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:03.987073 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-269d9aac-2e4c-44af-93a7-a1fae19a7c11 req-5809f83a-e2f5-4c98-8914-e966e0f04a19 service nova] Creating event network-vif-unplugged:c2e325b6-bdbf-4cd7-b5af-f6a08f267996 for instance 2ba55d6c-e17b-4175-832b-048bfa530c81 on n-h2-master-1 Jul 01 10:35:03.995576 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-269d9aac-2e4c-44af-93a7-a1fae19a7c11 req-5809f83a-e2f5-4c98-8914-e966e0f04a19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072968 Jul 01 10:35:03.996804 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1077/2126] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:04.005111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:04.006209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:04.015955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.016648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:04.017733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.018400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:04.208412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:04.225090 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a6b0d306-6c81-4580-8abe-e865d1e915a8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1270 microversion: 2.1 time: 0.225902 Jul 01 10:35:04.235573 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1078/2127] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:03 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1270 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:04.244772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:04.245436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:04.260185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.270136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:04.271233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.271858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:04.312766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:04.328505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:04.342789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:04.342789 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cec3238e-3f4f-4433-8487-3cf4fbc76fd2 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.877072 Jul 01 10:35:04.344785 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1050/2128] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:03 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:04.364043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a4955ac7-22c6-41c1-8e73-844eddc6dd97 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f2cd30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:04.425739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:04.449370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:04.451233 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a4955ac7-22c6-41c1-8e73-844eddc6dd97 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.104921 Jul 01 10:35:04.458449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:04.458651 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1051/2129] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:04 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:04.460248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd7aeba2-56c1-4b75-85bc-e2d5b42f3d95 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1453 microversion: 2.75 time: 0.229520 Jul 01 10:35:04.462211 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1079/2130] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:04 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1453 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:04.473688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:04.474914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:04.482889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.483600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:04.485795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.486315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:04.931910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:04.932615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:04.945478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.946779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:04.949377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:04.950049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:05.069495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:05.085265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d8a39f15-11aa-4c7f-a3d7-3cc2bd65555a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.612221 Jul 01 10:35:05.087126 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1052/2131] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:04 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:05.246615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:05.247682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:05.269669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:05.277296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:05.279651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:05.283365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:06.001052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.012504 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37950001-eaf6-41e4-8ccb-7136b5bffe65 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.770033 Jul 01 10:35:06.028156 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1053/2132] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:05 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:06.034097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:06.039355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:06.047976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:06.053878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:06.055506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:06.056109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:06.169702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.184270 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-28b4965f-e73f-4459-8259-c5dea195db4c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 1.257557 Jul 01 10:35:06.198517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1080/2133] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:04 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:06.212506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-746f2b69-0ca5-41bf-b057-8339e02d0706 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9129d280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:06.298255 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-746f2b69-0ca5-41bf-b057-8339e02d0706 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.098270 Jul 01 10:35:06.303838 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1081/2134] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:06 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:06.321592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:06.322203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:06.344801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:06.356339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:06.358062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:06.358062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:06.554258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.570337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.571837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.581334 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9197404a-ae70-44f8-a718-6958c4165088 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1438 microversion: 2.75 time: 0.276250 Jul 01 10:35:06.597266 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1082/2135] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:06 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1438 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:06.603055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:06.608976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.618220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:06.621572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.624458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:06.628158 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-027f9d54-e978-4fa0-9211-7da71e9dd2f4 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.597984 Jul 01 10:35:06.631172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:06.631867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:06.632846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:06.633441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:06.644182 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1054/2136] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:06 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:07.108953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:07.111453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:07.120575 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.121284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:07.122229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.122814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:07.171605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:07.180702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87698e3d-e0b0-487a-af99-e8aade9331f9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.582013 Jul 01 10:35:07.181319 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1083/2137] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:06 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:07.194292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:07.195529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:07.222508 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.222960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:07.223736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.224334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:07.236371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:35:07.237029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:35:07.237707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:35:07.238737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:35:07.239302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:35:07.526364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:07.542586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.545942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:07.555195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.555195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:07.740456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:07.751023 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b81c2aca-5c2b-4cf2-8754-05a75dd585bf tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.566045 Jul 01 10:35:07.755317 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1084/2138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:07 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:07.806393 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:07.828224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:07.877069 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b19850f-92b4-44dc-b54c-40389bb95dcb tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d/action" status: 202 len: 1942 microversion: 2.75 time: 1.232059 Jul 01 10:35:07.880980 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1055/2139] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:35:06 2022] POST /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d/action => generated 1942 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 01 10:35:07.917818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:07.924282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:07.947665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.948279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:07.949285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:07.950156 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:08.054027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5500b0bd-03c4-405a-8636-6e852379918d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Action: 'create', calling method: .version_select at 0x7f6f91261ee0>, body: {"keypair": {"name": "tempest-keypair-292551823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfIq60gnaVuWk09KFPPrfwl0AYP6ssxfBopVAikTVzZz2DSTuDtVZyYCXaTHD/WqWjHfvbrEP+SAlIzAirWRaIPIz05SMk2O9e9Jmv38ekIijmAaQVLQgRf1zjWGy1aTg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:08.105089 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=47 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:08.124433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5500b0bd-03c4-405a-8636-6e852379918d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Getting quotas for project 360f3add500e4f4ca9c4d01b7045c82f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:35:08.140999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5500b0bd-03c4-405a-8636-6e852379918d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Getting quotas for user 9638c88215d041858456bc3bb63c6df3 and project 360f3add500e4f4ca9c4d01b7045c82f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:35:08.466469 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5500b0bd-03c4-405a-8636-6e852379918d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.709691 Jul 01 10:35:08.468042 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1085/2140] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:35:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:08.476955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68230610-5449-44d1-b4a8-36fdce0c2659 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f912b4820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:08.510381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:08.532614 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-388beefb-5fa6-4f0e-8773-370022f0282b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.648787 Jul 01 10:35:08.535663 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1056/2141] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:07 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:08.559042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:08.562741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:08.577831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:08.578349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:08.584193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:08.587069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:08.598498 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68230610-5449-44d1-b4a8-36fdce0c2659 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.125975 Jul 01 10:35:08.599732 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1086/2142] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:08 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:08.614081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:08.620826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:08.640041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:08.640815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:08.643085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:08.643085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:08.930716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:08.941230 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:08.952958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:08.957079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:08.962434 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-46e695f9-4c65-459d-ada9-25b74c2e69cf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.423666 Jul 01 10:35:08.972592 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1057/2143] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:08 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:08.986584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:08.988947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:09.006770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:09.009619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:09.013930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:09.015317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:09.040052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:09.094646 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-59e84507-e364-483d-9cc9-719258f0bac1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.489654 Jul 01 10:35:09.097594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1087/2144] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:08 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:09.106175 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=26 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:09.108151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-42e39078-0f65-4cff-83d7-cef843e4f276 req-1e8d1051-f45d-48ea-9352-d839bd2d2e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e04ea24-b9fd-4851-bc55-68c32ab78300", "name": "network-vif-plugged", "status": "completed", "tag": "d7c43a44-58ec-469d-896d-2157bf976c84"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:09.140237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-42e39078-0f65-4cff-83d7-cef843e4f276 req-1e8d1051-f45d-48ea-9352-d839bd2d2e0c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:09.140960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-42e39078-0f65-4cff-83d7-cef843e4f276 req-1e8d1051-f45d-48ea-9352-d839bd2d2e0c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:09.168109 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-42e39078-0f65-4cff-83d7-cef843e4f276 req-1e8d1051-f45d-48ea-9352-d839bd2d2e0c service nova] Creating event network-vif-plugged:d7c43a44-58ec-469d-896d-2157bf976c84 for instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 on n-h2-master-1 Jul 01 10:35:09.186158 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-42e39078-0f65-4cff-83d7-cef843e4f276 req-1e8d1051-f45d-48ea-9352-d839bd2d2e0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087033 Jul 01 10:35:09.190126 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1088/2145] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:09.202358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0e63bc5b-541d-47a2-b85a-cd97024b3b37 req-71f74036-abf1-49b7-b00c-473d9fb18523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cbeb3c-aba1-4017-bdf1-cebee3dc43e2", "tag": "cf91ca4b-db6b-4ae4-a9b0-4b81ed2d0176"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:09.227563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0e63bc5b-541d-47a2-b85a-cd97024b3b37 req-71f74036-abf1-49b7-b00c-473d9fb18523 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:09.229390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0e63bc5b-541d-47a2-b85a-cd97024b3b37 req-71f74036-abf1-49b7-b00c-473d9fb18523 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:09.269509 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0e63bc5b-541d-47a2-b85a-cd97024b3b37 req-71f74036-abf1-49b7-b00c-473d9fb18523 service nova] Creating event network-changed:cf91ca4b-db6b-4ae4-a9b0-4b81ed2d0176 for instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 on n-h2-master-1 Jul 01 10:35:09.282564 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0e63bc5b-541d-47a2-b85a-cd97024b3b37 req-71f74036-abf1-49b7-b00c-473d9fb18523 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090547 Jul 01 10:35:09.292606 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1089/2146] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:09.300419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:09.302836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:09.328837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:09.329760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:09.330713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:09.331300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:10.219846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:10.228176 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-abcff1df-c4a5-4fc5-a79b-becc40aa283b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 1.254018 Jul 01 10:35:10.228717 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1058/2147] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:08 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:10.242879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:10.253342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:10.259739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:10.263407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:10.264440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:10.265102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:10.567340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:10.577269 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9da717a8-953c-442c-ae63-39c146f38afc tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 1.291999 Jul 01 10:35:10.583231 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1090/2148] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:09 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:10.604573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-703bc1ea-6d29-4cf6-a13b-d4970fcbe0e9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f912b49d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:10.708468 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-703bc1ea-6d29-4cf6-a13b-d4970fcbe0e9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.123876 Jul 01 10:35:10.709926 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1091/2149] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:10 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:10.735166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:10.736109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:10.747349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:10.749995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:10.751057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:10.751665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:11.152612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:11.166633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:11.171811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:11.182098 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-876103a1-331a-42e8-8ecb-5dd60042e5a3 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.465079 Jul 01 10:35:11.183219 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1092/2150] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:10 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:11.188116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:11.195368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:11.217346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:11.222071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:11.223106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:11.227599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:11.591605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:11.600132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:11.600725 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c3eb032c-7e3c-4cec-a32b-dc4a17792ec4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 1.370785 Jul 01 10:35:11.616875 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1059/2151] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:10 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:11.637759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:11.643040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:11.687278 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-79a69238-cb07-44c8-a7a6-1995df4cef2b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.502775 Jul 01 10:35:11.690508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:11.690968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:11.691764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:11.692197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:11.710971 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1093/2152] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:11 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:11.724181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d5ef8786-a718-4895-a6d3-9e17aac2baa8 req-df660c90-2afb-4f97-86b3-55b6a4c3a4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8d36e5-c3e7-4311-a5ad-e1abdf184f41", "name": "network-vif-plugged", "status": "completed", "tag": "d01e6bd9-dd9d-4cc7-817a-6f65329276f9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:11.766756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d5ef8786-a718-4895-a6d3-9e17aac2baa8 req-df660c90-2afb-4f97-86b3-55b6a4c3a4c6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:11.769014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d5ef8786-a718-4895-a6d3-9e17aac2baa8 req-df660c90-2afb-4f97-86b3-55b6a4c3a4c6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:11.823426 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d5ef8786-a718-4895-a6d3-9e17aac2baa8 req-df660c90-2afb-4f97-86b3-55b6a4c3a4c6 service nova] Creating event network-vif-plugged:d01e6bd9-dd9d-4cc7-817a-6f65329276f9 for instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 on n-h2-master-1 Jul 01 10:35:11.834255 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d5ef8786-a718-4895-a6d3-9e17aac2baa8 req-df660c90-2afb-4f97-86b3-55b6a4c3a4c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120448 Jul 01 10:35:11.842956 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1094/2153] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:11.855621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:11.858808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:11.875648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:11.887388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:11.887388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:11.887388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:12.020001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:12.029715 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1ac528ea-34ae-46c2-87c0-8570d16d42f5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1315 microversion: 2.1 time: 0.412665 Jul 01 10:35:12.035745 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1060/2154] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:11 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:12.041798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d73ff20-0a95-4a06-ab57-2ab845829ca8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f8a820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:12.117502 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d73ff20-0a95-4a06-ab57-2ab845829ca8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.079844 Jul 01 10:35:12.120723 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1061/2155] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:12 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:12.201601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:12.206609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:12.217444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:12.218988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:12.223283 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:12.232990 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-031f01bf-07cf-4ec9-b93a-f410de862bae tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.387577 Jul 01 10:35:12.234265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:12.235623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:12.239161 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1095/2156] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:11 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:12.481893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:12.491369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:12.493670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:12.495185 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-573e19c6-2618-471d-ae35-f301fcff5e5a tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 0.298706 Jul 01 10:35:12.506140 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1062/2157] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:12 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:12.626539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:12.632940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:12.664791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:12.668850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:12.670838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:12.673075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:12.713253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:12.714572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:12.730901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:12.734603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:12.737343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:12.739844 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:13.082723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:13.167340 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e19329ce-aee9-4ca3-8af6-728b49e0cc65 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.457948 Jul 01 10:35:13.169388 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1063/2158] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:12 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:35:13.181980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:13.185801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:13.215643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:13.216921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:13.219927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:13.221531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:13.291687 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:13.300465 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93797a07-9ab4-424e-a3a3-31eebcadfc1a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.686122 Jul 01 10:35:13.309410 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1096/2159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:12 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:13.314233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12dcf315-9afb-405f-ae46-3538aa81e15f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91426ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:13.557876 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-12dcf315-9afb-405f-ae46-3538aa81e15f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1454 microversion: 2.1 time: 0.246940 Jul 01 10:35:13.558386 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1097/2160] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:13 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1454 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:13.577004 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:13.593463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:13.614833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:13.618725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:13.619765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:13.622121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:13.661623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:13.679026 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6173f18b-4bb2-4462-89cc-411f768e2149 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1502 microversion: 2.1 time: 0.506788 Jul 01 10:35:13.679973 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1064/2161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:13 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1502 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:13.698222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:13.699110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:13.708822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:13.710885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:13.711985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:13.713063 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:14.518611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:14.559468 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6304e233-4ddf-43c5-a36a-c356298ddc97 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.999963 Jul 01 10:35:14.560656 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1098/2162] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:13 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:14.581006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "5973ffad-b078-4af5-a6e5-c1e0d975f176"}], "security_groups": [{"name": "tempest-securitygroup--596487050"}], "key_name": "tempest-keypair-292551823", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:14.677493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:14.699215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:14.703180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:14.706123 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1cf76d09-d2de-4a1f-bacc-ebe8dfbc677f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1486 microversion: 2.25 time: 1.011888 Jul 01 10:35:14.708048 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1065/2163] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:13 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1486 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:14.713710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:14.714591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:14.735150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:14.735690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:14.743735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:14.744231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:14.895101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:14.934173 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-66cc8696-6457-4c0a-84cf-0fa7c1e61eea tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.224556 Jul 01 10:35:14.937351 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1066/2164] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:14 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:14.944479 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:14.948042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:14.977371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:14.978279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:14.979584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:14.980041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:15.426859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:15.447941 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-566f1b12-68de-499f-95ad-6c5b59934929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.497120 Jul 01 10:35:15.447941 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1067/2165] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:14 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:15.447941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dfbb62fe-34c8-4a67-9b00-e9b89d207771 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fe18b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:18.223905 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:24.528774 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=89 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:24.610830 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:24.954956 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=87 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:25.432260 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=58 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:26.661349 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dfbb62fe-34c8-4a67-9b00-e9b89d207771 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1463 microversion: 2.1 time: 11.223084 Jul 01 10:35:26.668400 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1068/2166] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:15 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1463 bytes in 11225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:26.668400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:26.670536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:26.680899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:26.681404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:26.682491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:26.685267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:26.713901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] validate_networks() for [('5973ffad-b078-4af5-a6e5-c1e0d975f176', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:35:26.916484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:26.925545 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0779976f-a2ec-41fc-8293-e67a833b5479 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.261015 Jul 01 10:35:26.926130 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1069/2167] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:26 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:26.932880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:26.935435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:26.939922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:26.940548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:26.941419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:26.941861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.166029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:27.175236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:27.179681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:27.182188 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7be766d1-2330-4c9d-86bd-4ce901c73247 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1476 microversion: 2.25 time: 0.253434 Jul 01 10:35:27.192389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1070/2168] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:26 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1476 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:27.192389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:27.192389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:27.199639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.200100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.201064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.201649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.293865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:27.311602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:35:27.312053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:35:27.312554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:35:27.312965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:35:27.313402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:35:27.313575 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fdcada80-7dea-4314-9ebf-44fd8050aece tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.129706 Jul 01 10:35:27.314407 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1071/2169] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:27 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:27.323213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9cfb2ca6-b8f2-41da-99c8-99e597e94a6f req-92b24162-578c-4698-aed7-b78922009b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc136f1-7c35-4323-846e-3cfb690ad678", "name": "network-vif-plugged", "status": "completed", "tag": "899c4965-a8ed-4a54-bb17-041d0d35059b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:27.328705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.329277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.330139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.330573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.332729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9cfb2ca6-b8f2-41da-99c8-99e597e94a6f req-92b24162-578c-4698-aed7-b78922009b49 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.333547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9cfb2ca6-b8f2-41da-99c8-99e597e94a6f req-92b24162-578c-4698-aed7-b78922009b49 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.349780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9cfb2ca6-b8f2-41da-99c8-99e597e94a6f req-92b24162-578c-4698-aed7-b78922009b49 service nova] Creating event network-vif-plugged:899c4965-a8ed-4a54-bb17-041d0d35059b for instance ebc136f1-7c35-4323-846e-3cfb690ad678 on n-h1-master-1 Jul 01 10:35:27.351734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Getting quotas for project 360f3add500e4f4ca9c4d01b7045c82f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:35:27.353577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9cfb2ca6-b8f2-41da-99c8-99e597e94a6f req-92b24162-578c-4698-aed7-b78922009b49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038190 Jul 01 10:35:27.355129 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1072/2170] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:27.357693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Getting quotas for user 9638c88215d041858456bc3bb63c6df3 and project 360f3add500e4f4ca9c4d01b7045c82f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:35:27.361370 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c1027773-f046-49ab-8062-04c88802561c req-e30f4802-e39f-42fb-9850-32885396fb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65557a00-fd3c-4f95-95e7-44e4975cdb4e", "name": "network-vif-unplugged", "status": "completed", "tag": "218dd2f5-3c30-4c14-8197-b3ad76f0d8a1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:27.370181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c1027773-f046-49ab-8062-04c88802561c req-e30f4802-e39f-42fb-9850-32885396fb62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.370733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c1027773-f046-49ab-8062-04c88802561c req-e30f4802-e39f-42fb-9850-32885396fb62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.373386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:35:27.375970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:35:27.382023 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c1027773-f046-49ab-8062-04c88802561c req-e30f4802-e39f-42fb-9850-32885396fb62 service nova] Creating event network-vif-unplugged:218dd2f5-3c30-4c14-8197-b3ad76f0d8a1 for instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e on n-h1-master-1 Jul 01 10:35:27.387465 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c1027773-f046-49ab-8062-04c88802561c req-e30f4802-e39f-42fb-9850-32885396fb62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030990 Jul 01 10:35:27.388152 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1073/2171] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:27.403859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:27.403859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:27.408834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.409417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.410191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.410634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.505433 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-88d71960-131b-44b2-bca8-6396b9ecd392 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 12.943362 Jul 01 10:35:27.512040 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1099/2172] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:35:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 12950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:35:27.517481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d50230bd-06c2-4b44-8cdf-619961fe5155 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dd1406f-e730-49e9-a220-870ee5d7e206"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:27.519014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d50230bd-06c2-4b44-8cdf-619961fe5155 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:27.526992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50230bd-06c2-4b44-8cdf-619961fe5155 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.527691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50230bd-06c2-4b44-8cdf-619961fe5155 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.528623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50230bd-06c2-4b44-8cdf-619961fe5155 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.529259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d50230bd-06c2-4b44-8cdf-619961fe5155 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.619413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:27.631267 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a3670ce-6503-4d81-9b02-05e24f87f0a3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.240578 Jul 01 10:35:27.631960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1074/2173] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:27 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:27.637819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38c6bd1f-ae31-477d-8b37-5c5596c23346 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96fe18b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:27.697128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38c6bd1f-ae31-477d-8b37-5c5596c23346 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 200 len: 1463 microversion: 2.1 time: 0.063295 Jul 01 10:35:27.699831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1075/2174] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:27 2022] GET /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 1463 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:27.706057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4aaa7f2d-7e35-4267-aa1c-02d8f8b25e61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '.version_select at 0x7f6f97040b80>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:27.708919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4aaa7f2d-7e35-4267-aa1c-02d8f8b25e61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.709446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4aaa7f2d-7e35-4267-aa1c-02d8f8b25e61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.721957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4aaa7f2d-7e35-4267-aa1c-02d8f8b25e61 tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.020712 Jul 01 10:35:27.722848 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1076/2175] 10.222.0.23 () {60 vars in 1183 bytes} [Fri Jul 1 10:35:27 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:27.728382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17e7359a-2277-4eb2-b2b4-c94cfd3d690b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:27.729000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17e7359a-2277-4eb2-b2b4-c94cfd3d690b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:27.792170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17e7359a-2277-4eb2-b2b4-c94cfd3d690b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:27.796384 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17e7359a-2277-4eb2-b2b4-c94cfd3d690b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1225 microversion: 2.1 time: 0.072298 Jul 01 10:35:27.796952 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1077/2176] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:27 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1225 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:27.802262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:27.802871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:27.809879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.811871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.812676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.813115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.966863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:27.974857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08aa4dbb-19c9-4f46-81ab-56d825d357f9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1468 microversion: 2.1 time: 0.176047 Jul 01 10:35:27.976355 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1078/2177] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:27 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1468 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:27.980704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:27.981334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:27.987388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.987832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:27.988584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:27.989009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.131361 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] Lazy-loading 'services' on Instance uuid 65557a00-fd3c-4f95-95e7-44e4975cdb4e {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:28.149926 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bea7fd12-653f-44ba-82a2-922ec085a42f tempest-LiveAutoBlockMigrationV225Test-597593769 tempest-LiveAutoBlockMigrationV225Test-597593769-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1968 microversion: 2.25 time: 0.172523 Jul 01 10:35:28.159259 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1079/2178] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:27 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1968 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:28.159259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:28.159259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:28.162300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.162421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.163472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.164178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.303642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:28.313170 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1367b07d-290d-45cf-a28d-21bf735937cd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.161565 Jul 01 10:35:28.313505 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d50230bd-06c2-4b44-8cdf-619961fe5155 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799872 Jul 01 10:35:28.318814 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1100/2179] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:35:27 2022] POST /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:28.318969 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1080/2180] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:28 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:28.321122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:28.321987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:28.323797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a758d528-1138-419b-81ac-5eaddf593b06 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-775987834"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:28.324975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a758d528-1138-419b-81ac-5eaddf593b06 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:28.330654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.331105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.331891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.332328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.334230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a758d528-1138-419b-81ac-5eaddf593b06 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.334755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a758d528-1138-419b-81ac-5eaddf593b06 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.336937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a758d528-1138-419b-81ac-5eaddf593b06 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.337435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a758d528-1138-419b-81ac-5eaddf593b06 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.387549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:35:28.714892 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb8fb39f-073a-4754-8e30-fee9ca39e85f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 204 len: 0 microversion: 2.25 time: 0.398762 Jul 01 10:35:28.716869 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1081/2181] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:35:28 2022] DELETE /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:35:28.722672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:28.723535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:28.730855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.731599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.732641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.733084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.828981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:28.855713 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f19c3bc-13a6-4768-917f-4726256e128c tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.137260 Jul 01 10:35:28.856603 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1082/2182] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:28 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:28.861994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:28.862606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:28.869739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.870428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.871426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.872132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.883181 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a758d528-1138-419b-81ac-5eaddf593b06 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "POST /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81/action" status: 202 len: 0 microversion: 2.1 time: 0.566097 Jul 01 10:35:28.884422 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1101/2183] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:28 2022] POST /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:35:28.905085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:28.906217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:28.930407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.931292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:28.932536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:28.933200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.127151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:29.146027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:29.151128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1563962f-d886-4b35-9ea2-dd36991cba06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1315 microversion: 2.1 time: 0.292360 Jul 01 10:35:29.156114 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1083/2184] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:28 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:29.165274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:29.166729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:29.167943 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61413923-3b88-4711-8a41-989fe4a5930b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1482 microversion: 2.25 time: 0.282145 Jul 01 10:35:29.175478 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1102/2185] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:28 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1482 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:29.175717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:29.176681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:29.185273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.185728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-348f1b9a-0a82-4b80-93f6-f78b3cc69fbc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91244310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:29.188113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.188113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.188113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.249898 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-348f1b9a-0a82-4b80-93f6-f78b3cc69fbc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.072349 Jul 01 10:35:29.250758 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1103/2186] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:29 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:29.274241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:29.282147 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bdc364f5-ed79-450b-a9a1-b312943cb867 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1221 microversion: 2.1 time: 0.123748 Jul 01 10:35:29.282729 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1084/2187] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:29 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:29.331126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:29.331839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:29.341325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.341709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.342491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.342919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.371783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-334fdf69-2f50-4dfa-a81e-deb824f5457c req-c1e8588c-63fa-4ff4-b8a4-ca5e67a653db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cbeb3c-aba1-4017-bdf1-cebee3dc43e2", "name": "network-vif-plugged", "status": "completed", "tag": "cf91ca4b-db6b-4ae4-a9b0-4b81ed2d0176"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:29.386046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-334fdf69-2f50-4dfa-a81e-deb824f5457c req-c1e8588c-63fa-4ff4-b8a4-ca5e67a653db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.401253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-334fdf69-2f50-4dfa-a81e-deb824f5457c req-c1e8588c-63fa-4ff4-b8a4-ca5e67a653db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.441223 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-334fdf69-2f50-4dfa-a81e-deb824f5457c req-c1e8588c-63fa-4ff4-b8a4-ca5e67a653db service nova] Creating event network-vif-plugged:cf91ca4b-db6b-4ae4-a9b0-4b81ed2d0176 for instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 on n-h2-master-1 Jul 01 10:35:29.450689 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-334fdf69-2f50-4dfa-a81e-deb824f5457c req-c1e8588c-63fa-4ff4-b8a4-ca5e67a653db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080871 Jul 01 10:35:29.450689 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1085/2188] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:29.473452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-69e0705c-fb54-4f24-842d-0ea9b1699fb4 req-cafacc12-2bde-4b71-b0f0-52f63c417cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65557a00-fd3c-4f95-95e7-44e4975cdb4e", "tag": "218dd2f5-3c30-4c14-8197-b3ad76f0d8a1"}, {"server_uuid": "65557a00-fd3c-4f95-95e7-44e4975cdb4e", "name": "network-vif-unplugged", "status": "completed", "tag": "218dd2f5-3c30-4c14-8197-b3ad76f0d8a1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:29.494942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-69e0705c-fb54-4f24-842d-0ea9b1699fb4 req-cafacc12-2bde-4b71-b0f0-52f63c417cac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.495390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-69e0705c-fb54-4f24-842d-0ea9b1699fb4 req-cafacc12-2bde-4b71-b0f0-52f63c417cac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.509563 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-69e0705c-fb54-4f24-842d-0ea9b1699fb4 req-cafacc12-2bde-4b71-b0f0-52f63c417cac service nova] Creating event network-changed:218dd2f5-3c30-4c14-8197-b3ad76f0d8a1 for instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e on n-h1-master-1 Jul 01 10:35:29.509996 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-69e0705c-fb54-4f24-842d-0ea9b1699fb4 req-cafacc12-2bde-4b71-b0f0-52f63c417cac service nova] Creating event network-vif-unplugged:218dd2f5-3c30-4c14-8197-b3ad76f0d8a1 for instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e on n-h1-master-1 Jul 01 10:35:29.515438 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-69e0705c-fb54-4f24-842d-0ea9b1699fb4 req-cafacc12-2bde-4b71-b0f0-52f63c417cac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.063379 Jul 01 10:35:29.516484 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1086/2189] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:29.575618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:29.588769 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ad47509-7d0a-4cc9-9a80-13cae0198568 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.261357 Jul 01 10:35:29.597951 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1104/2190] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:29 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:29.876799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:29.877862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:29.886102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.886849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:29.888000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:29.888749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:30.066563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:30.072818 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:30.099033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-832f3b6a-de2a-4c3b-8c6d-d3b91a611a7b tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.225138 Jul 01 10:35:30.099861 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1087/2191] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:29 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:30.171256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:30.172274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:30.183329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:30.187738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:30.188568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:30.189046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:30.198091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:30.213438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:30.231893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:30.232548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:30.233461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:30.233903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:30.912506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:30.921186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:30.926818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:30.928859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:30.930256 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-411032b6-afa6-4d30-854b-efa6405cda22 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1482 microversion: 2.25 time: 0.737939 Jul 01 10:35:30.931345 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1088/2192] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:30 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1482 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:35:30.932379 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed2cadb8-6dc5-4979-8804-74fe0a62a5c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1503 microversion: 2.1 time: 0.764977 Jul 01 10:35:30.933045 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1105/2193] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:30 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1503 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:30.938534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:30.944240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:30.948962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c63e4cc5-107b-4a41-8d2a-6ee08578292d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f66ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:30.957091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:30.957881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:30.959029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:30.965766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.025883 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c63e4cc5-107b-4a41-8d2a-6ee08578292d tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.092779 Jul 01 10:35:31.027149 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1089/2194] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:30 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:31.036883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:31.057340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:31.057340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.057340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.057340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.058998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.156379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:31.171032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7f61c749-a2f5-4026-8e50-710e442758c9 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1285 microversion: 2.1 time: 0.236515 Jul 01 10:35:31.173407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1106/2195] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:30 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:31.187304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-54c63f75-3741-43b1-8faa-286469c6ad01 req-7a27012f-ae7c-4f46-bd33-b2f6d5cf8265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65557a00-fd3c-4f95-95e7-44e4975cdb4e", "name": "network-vif-deleted", "tag": "218dd2f5-3c30-4c14-8197-b3ad76f0d8a1"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:31.196864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-54c63f75-3741-43b1-8faa-286469c6ad01 req-7a27012f-ae7c-4f46-bd33-b2f6d5cf8265 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.197657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-54c63f75-3741-43b1-8faa-286469c6ad01 req-7a27012f-ae7c-4f46-bd33-b2f6d5cf8265 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.212897 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-54c63f75-3741-43b1-8faa-286469c6ad01 req-7a27012f-ae7c-4f46-bd33-b2f6d5cf8265 service nova] Creating event network-vif-deleted:218dd2f5-3c30-4c14-8197-b3ad76f0d8a1 for instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e on n-h1-master-1 Jul 01 10:35:31.221805 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-54c63f75-3741-43b1-8faa-286469c6ad01 req-7a27012f-ae7c-4f46-bd33-b2f6d5cf8265 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046083 Jul 01 10:35:31.227174 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1107/2196] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:31.232825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af92fca0-fb01-4feb-b3be-f0c89107cb57 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:31.234389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af92fca0-fb01-4feb-b3be-f0c89107cb57 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:31.244354 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af92fca0-fb01-4feb-b3be-f0c89107cb57 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.245296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af92fca0-fb01-4feb-b3be-f0c89107cb57 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.246761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af92fca0-fb01-4feb-b3be-f0c89107cb57 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.247359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af92fca0-fb01-4feb-b3be-f0c89107cb57 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.324588 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af92fca0-fb01-4feb-b3be-f0c89107cb57 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.094776 Jul 01 10:35:31.327865 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1108/2197] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:31 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:31.332534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:31.333364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:31.359776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.360211 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.360985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.361469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.382115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:31.393501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68c79544-0606-415c-8368-d43cd6f28d57 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1312 microversion: 2.1 time: 0.364908 Jul 01 10:35:31.394028 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1090/2198] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:31 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:31.465820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fd2c3a46-8661-46b1-8ea1-30e4825e06fe req-774a19bf-534c-46dd-a06d-6a7b82a17878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8d36e5-c3e7-4311-a5ad-e1abdf184f41", "name": "network-vif-unplugged", "status": "completed", "tag": "d01e6bd9-dd9d-4cc7-817a-6f65329276f9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:31.481064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fd2c3a46-8661-46b1-8ea1-30e4825e06fe req-774a19bf-534c-46dd-a06d-6a7b82a17878 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.481543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fd2c3a46-8661-46b1-8ea1-30e4825e06fe req-774a19bf-534c-46dd-a06d-6a7b82a17878 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.496529 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fd2c3a46-8661-46b1-8ea1-30e4825e06fe req-774a19bf-534c-46dd-a06d-6a7b82a17878 service nova] Creating event network-vif-unplugged:d01e6bd9-dd9d-4cc7-817a-6f65329276f9 for instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 on n-h2-master-1 Jul 01 10:35:31.510997 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fd2c3a46-8661-46b1-8ea1-30e4825e06fe req-774a19bf-534c-46dd-a06d-6a7b82a17878 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048898 Jul 01 10:35:31.521542 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1091/2199] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:35:31.577810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:31.617977 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6bc05804-1e1a-4f74-9b12-4f7b28b1bce1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.290803 Jul 01 10:35:31.619375 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1109/2200] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:31 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:31.949404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:31.950099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:31.956642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.957097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:31.957888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:31.958467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.035721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:32.039960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b09f28d5-b5fe-4a29-ae14-b6c44d39ac53 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f911ad820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:32.050245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:32.053283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:32.060697 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a3892740-7776-41df-9fe3-b68efa92d5b9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1265 microversion: 2.25 time: 0.114510 Jul 01 10:35:32.064688 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1092/2201] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:31 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:32.103456 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b09f28d5-b5fe-4a29-ae14-b6c44d39ac53 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.067907 Jul 01 10:35:32.104428 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1110/2202] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:32 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:32.190959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:32.191833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:32.200040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.200586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.201532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.202826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.305978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:32.322781 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fbe90c85-0a4f-4099-8ad8-0556379e22c3 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1283 microversion: 2.1 time: 0.136996 Jul 01 10:35:32.329389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1093/2203] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:32 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:32.336499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3d8c416-7d7a-494d-9253-32d22ffbcced tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:32.337508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a3d8c416-7d7a-494d-9253-32d22ffbcced tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:32.346266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3d8c416-7d7a-494d-9253-32d22ffbcced tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.347075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3d8c416-7d7a-494d-9253-32d22ffbcced tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.348087 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3d8c416-7d7a-494d-9253-32d22ffbcced tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.348801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3d8c416-7d7a-494d-9253-32d22ffbcced tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.411926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:32.414570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:32.424567 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a3d8c416-7d7a-494d-9253-32d22ffbcced tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.090833 Jul 01 10:35:32.428935 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1111/2204] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:32 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:32.431623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.439875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.439875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.439875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.642463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:32.643444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:32.651945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.652666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.653639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.654224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.784333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:32.805675 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f61f6920-4b25-4def-b594-47db63579690 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1497 microversion: 2.1 time: 0.398297 Jul 01 10:35:32.806584 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1094/2205] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:32 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1497 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:32.809697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:32.823806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b0172b4-4a98-4de0-8c51-1c2dca323f6e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:32.833277 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d3643a88-5eaa-44bc-b8e3-04fafe5962b6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.194779 Jul 01 10:35:32.834483 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1112/2206] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:32 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:32.841846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.server_groups [None req-2b0172b4-4a98-4de0-8c51-1c2dca323f6e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Querying cell dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) for 1 instances {{(pid=119764) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 01 10:35:32.842775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b0172b4-4a98-4de0-8c51-1c2dca323f6e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.843280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b0172b4-4a98-4de0-8c51-1c2dca323f6e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.872607 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b0172b4-4a98-4de0-8c51-1c2dca323f6e tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/28cb30af-74ab-472d-a226-d815f3925fe4" status: 200 len: 221 microversion: 2.1 time: 0.053908 Jul 01 10:35:32.873567 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1095/2207] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:35:32 2022] GET /compute/v2.1/os-server-groups/28cb30af-74ab-472d-a226-d815f3925fe4 => generated 221 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:35:32.888122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:32.891390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:32.916888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.917727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.918753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:32.919482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:32.956775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:35:33.080093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:33.081311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:33.089172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.089841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.097358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.097358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.171665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:33.188409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:33.191091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:33.192613 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-97bd0bd4-7fe0-4b95-a19f-21508be36a25 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1265 microversion: 2.25 time: 0.116733 Jul 01 10:35:33.194631 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1096/2208] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:33 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:35:33.201057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7da0a17c-2b5b-4a52-a5da-1faae31cbda5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97018ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:33.246917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77603e3b-c896-4d3c-bf1c-88f04eff5d74 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 204 len: 0 microversion: 2.1 time: 0.362430 Jul 01 10:35:33.247670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1113/2209] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:35:32 2022] DELETE /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:35:33.260615 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7da0a17c-2b5b-4a52-a5da-1faae31cbda5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.058270 Jul 01 10:35:33.260615 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1097/2210] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:33 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:33.260884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:33.262127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:33.273007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.273671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.274980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.275531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.300236 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:33.341369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:33.460820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:33.460820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.460820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.460820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.460820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.598998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:33.611547 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e009245-6d5c-4cb3-a930-735d40b7e99d tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1503 microversion: 2.1 time: 0.358585 Jul 01 10:35:33.622511 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1114/2211] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:33 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:33.622776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:33.628973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dfdb45ec-5c45-4274-9916-a7dc5a07ec7b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:33.634022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dfdb45ec-5c45-4274-9916-a7dc5a07ec7b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:33.634868 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0658c00-62a3-4da5-8202-2a42d262577a tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1350 microversion: 2.1 time: 0.295467 Jul 01 10:35:33.635756 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1098/2212] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:33 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1350 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:33.650281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfdb45ec-5c45-4274-9916-a7dc5a07ec7b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.653347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfdb45ec-5c45-4274-9916-a7dc5a07ec7b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.654247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfdb45ec-5c45-4274-9916-a7dc5a07ec7b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.655030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfdb45ec-5c45-4274-9916-a7dc5a07ec7b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.732060 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dfdb45ec-5c45-4274-9916-a7dc5a07ec7b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.118326 Jul 01 10:35:33.736049 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1115/2213] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:33 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:33.855519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:33.855917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:33.864172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.864967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.866474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:33.867193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:33.981898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:34.002090 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e08ff99-bf54-444b-8007-3daffa990a08 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.153065 Jul 01 10:35:34.014062 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1099/2214] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:33 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:34.163672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-690a3094-a8f4-4024-9015-6bff48c59c8f req-0c037b4d-a5ff-4b1e-b829-d4ceddd85572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba55d6c-e17b-4175-832b-048bfa530c81", "name": "network-vif-plugged", "status": "completed", "tag": "c2e325b6-bdbf-4cd7-b5af-f6a08f267996"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:34.181191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-571477f4-f380-419c-8f92-635e0d0b7cb4 req-8a7ee506-e312-4a3e-b24c-c769ac6faf28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a032d2-5ef0-4bf8-a282-fce29edda700", "tag": "4fc6b77c-2b84-434e-b42d-a07d1f87688f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:34.192484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-690a3094-a8f4-4024-9015-6bff48c59c8f req-0c037b4d-a5ff-4b1e-b829-d4ceddd85572 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.192951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-571477f4-f380-419c-8f92-635e0d0b7cb4 req-8a7ee506-e312-4a3e-b24c-c769ac6faf28 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.195929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-690a3094-a8f4-4024-9015-6bff48c59c8f req-0c037b4d-a5ff-4b1e-b829-d4ceddd85572 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.196354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-571477f4-f380-419c-8f92-635e0d0b7cb4 req-8a7ee506-e312-4a3e-b24c-c769ac6faf28 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.212609 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-571477f4-f380-419c-8f92-635e0d0b7cb4 req-8a7ee506-e312-4a3e-b24c-c769ac6faf28 service nova] Creating event network-changed:4fc6b77c-2b84-434e-b42d-a07d1f87688f for instance b2a032d2-5ef0-4bf8-a282-fce29edda700 on n-h2-master-1 Jul 01 10:35:34.216238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-690a3094-a8f4-4024-9015-6bff48c59c8f req-0c037b4d-a5ff-4b1e-b829-d4ceddd85572 service nova] Creating event network-vif-plugged:c2e325b6-bdbf-4cd7-b5af-f6a08f267996 for instance 2ba55d6c-e17b-4175-832b-048bfa530c81 on n-h2-master-1 Jul 01 10:35:34.221431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-690a3094-a8f4-4024-9015-6bff48c59c8f req-0c037b4d-a5ff-4b1e-b829-d4ceddd85572 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062158 Jul 01 10:35:34.222520 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1116/2215] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:34.226806 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-571477f4-f380-419c-8f92-635e0d0b7cb4 req-8a7ee506-e312-4a3e-b24c-c769ac6faf28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052707 Jul 01 10:35:34.228886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:34.229470 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1100/2216] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:35:34.233107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:34.259125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.259738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.260359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.260939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.271196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd70b621-0237-4c1d-b28e-617c5fcdcbd4 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970183a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:34.327730 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd70b621-0237-4c1d-b28e-617c5fcdcbd4 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.063297 Jul 01 10:35:34.330159 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1101/2217] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:34 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:34.383893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:34.406710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:34.409243 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:34.410976 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-746f7552-c8f1-42bc-b570-e9493bf20068 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1265 microversion: 2.25 time: 0.186893 Jul 01 10:35:34.412096 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1117/2218] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:34 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:34.634363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:34.635203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:34.652411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:34.653441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:34.665523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.668546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.669480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.670191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.671286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.681268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.682116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:34.688611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:34.986698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:34.998503 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-370cd448-7006-41a6-acd1-74c86e6bf4a4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1350 microversion: 2.1 time: 0.349965 Jul 01 10:35:34.999088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1118/2219] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:34 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1350 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:35.016581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7823f2e5-ad9f-4027-b560-92acc304f9fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:35.023335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7823f2e5-ad9f-4027-b560-92acc304f9fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:35.043867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7823f2e5-ad9f-4027-b560-92acc304f9fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:35.044545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7823f2e5-ad9f-4027-b560-92acc304f9fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:35.058282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7823f2e5-ad9f-4027-b560-92acc304f9fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:35.058956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7823f2e5-ad9f-4027-b560-92acc304f9fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:35.103429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:35.117569 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7841d5d7-745e-4fa0-998d-16d976d9cc24 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1503 microversion: 2.1 time: 0.487567 Jul 01 10:35:35.128102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1102/2220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:34 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1503 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:35.141691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:35.142689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:35.160624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:35.162239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:35.165505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:35.166089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:35.421945 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7823f2e5-ad9f-4027-b560-92acc304f9fe tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.408957 Jul 01 10:35:35.426432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:35.427952 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1119/2221] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:34 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:35.452656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4b248fc-7785-4f3d-8674-65b0fd496566 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f911f3310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:35.510402 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58deb246-9a72-42a1-b420-47e11993637f tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1929 microversion: 2.75 time: 0.380628 Jul 01 10:35:35.513598 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1103/2222] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:35 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1929 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:35.531681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:35.534543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:35.548232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:35.550908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:35.551907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:35.552776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:35.586261 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4b248fc-7785-4f3d-8674-65b0fd496566 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.156763 Jul 01 10:35:35.593884 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1120/2223] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:35 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:35.679297 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:35.689425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:35.691477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:35.692809 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86841a92-e1b2-45bd-8ad1-d7468253b492 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1265 microversion: 2.25 time: 0.178096 Jul 01 10:35:35.703825 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1104/2224] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:35 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:36.018581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:36.020290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:36.036491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.036963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.040148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.040608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.135488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:36.136519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:36.150683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.152735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.157773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.158540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.300802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:36.318963 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65c34792-628f-4d59-98dd-e15801360ad8 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1461 microversion: 2.1 time: 0.180501 Jul 01 10:35:36.320584 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1105/2225] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:36 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1461 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:36.394074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0498c4b8-04b5-43d1-8fcc-333aa30529b3 req-7811a260-ce85-42b6-acde-45cf93b92baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cbeb3c-aba1-4017-bdf1-cebee3dc43e2", "name": "network-vif-deleted", "tag": "cf91ca4b-db6b-4ae4-a9b0-4b81ed2d0176"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:36.404032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0498c4b8-04b5-43d1-8fcc-333aa30529b3 req-7811a260-ce85-42b6-acde-45cf93b92baf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.404721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0498c4b8-04b5-43d1-8fcc-333aa30529b3 req-7811a260-ce85-42b6-acde-45cf93b92baf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.415176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:36.417433 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0498c4b8-04b5-43d1-8fcc-333aa30529b3 req-7811a260-ce85-42b6-acde-45cf93b92baf service nova] Creating event network-vif-deleted:cf91ca4b-db6b-4ae4-a9b0-4b81ed2d0176 for instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 on n-h2-master-1 Jul 01 10:35:36.422525 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0498c4b8-04b5-43d1-8fcc-333aa30529b3 req-7811a260-ce85-42b6-acde-45cf93b92baf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032763 Jul 01 10:35:36.426921 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1106/2226] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:36.435916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d40d33f7-2ebf-41bb-9a8d-b30c56b1e7f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:36.438875 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e6b33531-ee74-4404-a401-39ce6874674e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1350 microversion: 2.1 time: 0.417225 Jul 01 10:35:36.445452 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1121/2227] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:36 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1350 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:36.446985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d40d33f7-2ebf-41bb-9a8d-b30c56b1e7f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:36.457825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d40d33f7-2ebf-41bb-9a8d-b30c56b1e7f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.458279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d40d33f7-2ebf-41bb-9a8d-b30c56b1e7f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.459053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d40d33f7-2ebf-41bb-9a8d-b30c56b1e7f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.460071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d40d33f7-2ebf-41bb-9a8d-b30c56b1e7f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.532556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:36.534250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:36.555755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.557089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.560804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.561501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.725002 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d40d33f7-2ebf-41bb-9a8d-b30c56b1e7f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.294103 Jul 01 10:35:36.725669 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1107/2228] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:36 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:36.735259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6e57e95-c836-4ee2-a259-5a8fcc37b7bd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970279d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:36.751606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:36.817360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-154a8471-504f-4e0a-b0b8-debdb819439e tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1935 microversion: 2.75 time: 0.264578 Jul 01 10:35:36.837306 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1122/2229] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:36 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1935 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:36.844605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:36.845756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:36.845885 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d6e57e95-c836-4ee2-a259-5a8fcc37b7bd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.118754 Jul 01 10:35:36.846578 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1108/2230] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:36 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:36.853954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.858587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.858587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:36.858587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:36.945397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:36.954771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:36.956720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:36.958419 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ec338dc-1582-4516-8add-3d8ed473bf9e tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1265 microversion: 2.25 time: 0.119486 Jul 01 10:35:36.969713 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1123/2231] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:36 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:37.338868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:37.339768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:37.350542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.351382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.352463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.353108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.387389 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.388161 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.388806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lazy-loading 'fault' on Instance uuid 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:37.440481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:37.451934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f3b8074-9dd8-4e04-a449-f2c6632c63e5 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1302 microversion: 2.1 time: 0.117528 Jul 01 10:35:37.453046 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1109/2232] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:37 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:37.456744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:37.458201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:37.476335 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:37.477914 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:37.480139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.480761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.481746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.483631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.661726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:37.671206 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e5cad2ba-266c-4f69-acc2-9f275c8326ce tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1350 microversion: 2.1 time: 0.218976 Jul 01 10:35:37.671796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1124/2233] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:37 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1350 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:37.741303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29daddbb-023b-4d94-bbda-536f22b9fa8a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:37.742307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29daddbb-023b-4d94-bbda-536f22b9fa8a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:37.752903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29daddbb-023b-4d94-bbda-536f22b9fa8a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.757642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29daddbb-023b-4d94-bbda-536f22b9fa8a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.759590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29daddbb-023b-4d94-bbda-536f22b9fa8a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.760058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29daddbb-023b-4d94-bbda-536f22b9fa8a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.764710 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:37.795616 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:37.847562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:37.847904 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29daddbb-023b-4d94-bbda-536f22b9fa8a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.115033 Jul 01 10:35:37.849106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:37.860466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.861986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.862170 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1110/2234] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:37 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:37.862320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:37.862320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:37.873217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d1f3c740-fedc-4988-af1d-0fdaa89b94bc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970408b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:37.954383 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d1f3c740-fedc-4988-af1d-0fdaa89b94bc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.090906 Jul 01 10:35:37.956155 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1111/2235] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:37 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:37.991861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:37.994502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:38.016481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.016717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:38.016942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.017789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.018242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.043876 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed7204bc-3485-437e-a9a9-b66f2417ffb6 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1935 microversion: 2.75 time: 0.200232 Jul 01 10:35:38.048442 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1125/2236] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:37 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1935 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:35:38.198079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:38.208120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:38.214004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:38.215250 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0cadfb75-4432-4170-9320-5eb81a1b6ea9 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1265 microversion: 2.25 time: 0.228874 Jul 01 10:35:38.221447 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1112/2237] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:37 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:38.470332 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:38.471678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:38.483431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.488374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.489612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.491840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.580088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.580447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.581006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lazy-loading 'fault' on Instance uuid 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:38.688452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:38.697779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:38.705077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.705598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.706536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.717377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.732338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c3b26cef03455c805823630a0d36c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a7baf7e8584eeab815f3db59a7b237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:38.742171 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d732221-9d87-4003-a0b0-93c70fc38471 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 200 len: 1302 microversion: 2.1 time: 0.275501 Jul 01 10:35:38.754284 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1126/2238] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:38 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 1302 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:38.863108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-793d579d-9b41-4b1e-b85d-b90e56843dbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:38.864483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-793d579d-9b41-4b1e-b85d-b90e56843dbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:38.876255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-793d579d-9b41-4b1e-b85d-b90e56843dbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.891884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-793d579d-9b41-4b1e-b85d-b90e56843dbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.892938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-793d579d-9b41-4b1e-b85d-b90e56843dbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:38.893584 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-793d579d-9b41-4b1e-b85d-b90e56843dbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:38.987742 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-793d579d-9b41-4b1e-b85d-b90e56843dbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.124931 Jul 01 10:35:38.987742 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1127/2239] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:38 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:38.990367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71fbb71f-276b-4a31-86c5-5858eb9f58ab tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91170ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.084970 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71fbb71f-276b-4a31-86c5-5858eb9f58ab tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.099189 Jul 01 10:35:39.089410 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1128/2240] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:38 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:39.106178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.106903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:39.136998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.137517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.147970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.148484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.310736 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:39.320683 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-924aab17-1d1a-4845-96bd-06798a939a0d tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1350 microversion: 2.1 time: 0.636286 Jul 01 10:35:39.330158 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] Lazy-loading 'services' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:39.342882 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1113/2241] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:38 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1350 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:39.352060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.353221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:39.366336 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:39.370584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.371426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.372172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0fd1cb66-e8cc-48d5-aef8-7050ddac47c1 tempest-ServersAdmin275Test-467446013 tempest-ServersAdmin275Test-467446013-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1920 microversion: 2.75 time: 0.269955 Jul 01 10:35:39.372618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.373112 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1129/2242] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:39 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1920 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:39.373523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.407108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.407681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:39.419210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.419682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.420458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.420871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.438168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.438626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.439089 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lazy-loading 'fault' on Instance uuid 65557a00-fd3c-4f95-95e7-44e4975cdb4e {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:39.515678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:35:39.558126 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:39.570247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:39.576063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:39.577921 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2eeb4d0-dec7-4f2b-9471-991b61875756 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 200 len: 1270 microversion: 2.25 time: 0.233635 Jul 01 10:35:39.589679 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1114/2243] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:39 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:39.760122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.761470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:39.768301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.772011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.772829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.773329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.794513 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] HTTP exception thrown: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Request method failure captured: Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 HTTP/1.1 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Ct05OtS9GLku-sfJdZTOhf7XmPAwu6MFqmlCBYh4yJhKzWumgWljYKPYAx7OxCGzzYPDCeWvOwWb6OrC-Fo7Utb_zA9wDjpDZ1Npt_uH-N5BqbTDC3QXhdX37DvrAgyfSMOs4l6wtjwzRnhjS5I1UDYM0yJRiAG7CZQxC6i5F1N4 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8a7baf7e8584eeab815f3db59a7b237", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b2c3b26cef03455c805823630a0d36c2 Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90cbeb3c-aba1-4017-bdf1-cebee3dc43e2'} Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:39.796761 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Returning 404 to user: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:39.801034 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0470978d-5dcd-4887-be47-e570da743afd tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 404 len: 111 microversion: 2.1 time: 0.042038 Jul 01 10:35:39.804459 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1115/2244] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:39 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:35:39.809987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8d499a43-1c8a-41e7-8504-9f05d3e5aa21 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.828813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.server_groups [None req-8d499a43-1c8a-41e7-8504-9f05d3e5aa21 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Querying cell dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) for 1 instances {{(pid=119764) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 01 10:35:39.829957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d499a43-1c8a-41e7-8504-9f05d3e5aa21 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.830404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d499a43-1c8a-41e7-8504-9f05d3e5aa21 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.855139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8d499a43-1c8a-41e7-8504-9f05d3e5aa21 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.049522 Jul 01 10:35:39.856229 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1116/2245] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:35:39 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:39.868111 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28bfd8a5-e96f-450a-b636-d81f09a2579a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.888597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.server_groups [None req-28bfd8a5-e96f-450a-b636-d81f09a2579a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Querying cell dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) for 1 instances {{(pid=119764) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 01 10:35:39.889774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bfd8a5-e96f-450a-b636-d81f09a2579a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.890436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28bfd8a5-e96f-450a-b636-d81f09a2579a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.905965 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28bfd8a5-e96f-450a-b636-d81f09a2579a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/28cb30af-74ab-472d-a226-d815f3925fe4" status: 200 len: 183 microversion: 2.1 time: 0.042753 Jul 01 10:35:39.913921 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1117/2246] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:35:39 2022] GET /compute/v2.1/os-server-groups/28cb30af-74ab-472d-a226-d815f3925fe4 => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:35:39.922541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.923441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:39.930945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.931663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.933009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.933910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.950285 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] HTTP exception thrown: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Request method failure captured: Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 HTTP/1.1 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Ct05OtS9GLku-sfJdZTOhf7XmPAwu6MFqmlCBYh4yJhKzWumgWljYKPYAx7OxCGzzYPDCeWvOwWb6OrC-Fo7Utb_zA9wDjpDZ1Npt_uH-N5BqbTDC3QXhdX37DvrAgyfSMOs4l6wtjwzRnhjS5I1UDYM0yJRiAG7CZQxC6i5F1N4 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8a7baf7e8584eeab815f3db59a7b237", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b2c3b26cef03455c805823630a0d36c2 Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90cbeb3c-aba1-4017-bdf1-cebee3dc43e2'} Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:35:39.952356 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:39.957030 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:39.959036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Returning 404 to user: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:39.960737 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-adda6d2b-2796-4e31-8320-c054207e3dcb tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 404 len: 111 microversion: 2.1 time: 0.045461 Jul 01 10:35:39.966607 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1118/2247] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:35:39 2022] DELETE /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:35:39.973351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:39.982923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] [instance: 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:39.982923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.983627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:39.984600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:39.985317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.006500 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] HTTP exception thrown: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Request method failure captured: Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 HTTP/1.1 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Ct05OtS9GLku-sfJdZTOhf7XmPAwu6MFqmlCBYh4yJhKzWumgWljYKPYAx7OxCGzzYPDCeWvOwWb6OrC-Fo7Utb_zA9wDjpDZ1Npt_uH-N5BqbTDC3QXhdX37DvrAgyfSMOs4l6wtjwzRnhjS5I1UDYM0yJRiAG7CZQxC6i5F1N4 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8a7baf7e8584eeab815f3db59a7b237", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b2c3b26cef03455c805823630a0d36c2 Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90cbeb3c-aba1-4017-bdf1-cebee3dc43e2'} Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.010984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.014446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.014446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.014446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.014446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:40.014446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:40.014446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. Jul 01 10:35:40.014446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.017016 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Returning 404 to user: Instance 90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:40.018411 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d015085-10be-41f7-b5df-eae3dfd0d293 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2" status: 404 len: 111 microversion: 2.1 time: 0.050294 Jul 01 10:35:40.025029 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1119/2248] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:39 2022] GET /compute/v2.1/servers/90cbeb3c-aba1-4017-bdf1-cebee3dc43e2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:35:40.031188 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c068002-3957-4b18-8e07-1069330fad29 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 204 len: 0 microversion: 2.75 time: 0.633925 Jul 01 10:35:40.031882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17487200-dd45-4bff-9888-88807b77e929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:40.033430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17487200-dd45-4bff-9888-88807b77e929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:40.035058 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1130/2249] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:35:39 2022] DELETE /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:35:40.041285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0281f7e2-0035-41b4-92ca-5d8bd3dc4fec tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.044359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17487200-dd45-4bff-9888-88807b77e929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.045506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17487200-dd45-4bff-9888-88807b77e929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.047221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17487200-dd45-4bff-9888-88807b77e929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.047882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17487200-dd45-4bff-9888-88807b77e929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.062117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0281f7e2-0035-41b4-92ca-5d8bd3dc4fec tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] HTTP exception thrown: Instance group c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 could not be found. Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0281f7e2-0035-41b4-92ca-5d8bd3dc4fec tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Request method failure captured: Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-server-groups/c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 HTTP/1.1 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs3Ct05OtS9GLku-sfJdZTOhf7XmPAwu6MFqmlCBYh4yJhKzWumgWljYKPYAx7OxCGzzYPDCeWvOwWb6OrC-Fo7Utb_zA9wDjpDZ1Npt_uH-N5BqbTDC3QXhdX37DvrAgyfSMOs4l6wtjwzRnhjS5I1UDYM0yJRiAG7CZQxC6i5F1N4 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8a7baf7e8584eeab815f3db59a7b237", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b2c3b26cef03455c805823630a0d36c2 Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: exception: Instance group c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 could not be found. Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38'} Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 could not be found. Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 could not be found. Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.076692 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 could not be found. Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0281f7e2-0035-41b4-92ca-5d8bd3dc4fec tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Returning 404 to user: Instance group c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:40.088513 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0281f7e2-0035-41b4-92ca-5d8bd3dc4fec tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38" status: 404 len: 117 microversion: 2.1 time: 0.041959 Jul 01 10:35:40.093404 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1131/2250] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:35:40 2022] DELETE /compute/v2.1/os-server-groups/c7ecd8cf-9cbb-4134-9aa7-e7d91b518c38 => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:35:40.106802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.116903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:40.125693 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17487200-dd45-4bff-9888-88807b77e929 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.098493 Jul 01 10:35:40.129926 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1120/2251] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:40 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:40.132363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d50d6b29-6295-4adf-98eb-49e612c1bd91 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.142438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.142894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.143695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.148070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.159423 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-d50d6b29-6295-4adf-98eb-49e612c1bd91 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] HTTP exception thrown: Instance group 42b12d22-7105-40c0-ad60-56b0c9af452a could not be found. Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d50d6b29-6295-4adf-98eb-49e612c1bd91 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Request method failure captured: Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-server-groups/42b12d22-7105-40c0-ad60-56b0c9af452a HTTP/1.1 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Ct05OtS9GLku-sfJdZTOhf7XmPAwu6MFqmlCBYh4yJhKzWumgWljYKPYAx7OxCGzzYPDCeWvOwWb6OrC-Fo7Utb_zA9wDjpDZ1Npt_uH-N5BqbTDC3QXhdX37DvrAgyfSMOs4l6wtjwzRnhjS5I1UDYM0yJRiAG7CZQxC6i5F1N4 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8a7baf7e8584eeab815f3db59a7b237", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b2c3b26cef03455c805823630a0d36c2 Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: exception: Instance group 42b12d22-7105-40c0-ad60-56b0c9af452a could not be found. Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '42b12d22-7105-40c0-ad60-56b0c9af452a'} Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 42b12d22-7105-40c0-ad60-56b0c9af452a could not be found. Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 42b12d22-7105-40c0-ad60-56b0c9af452a could not be found. Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.161824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 42b12d22-7105-40c0-ad60-56b0c9af452a could not be found. Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d50d6b29-6295-4adf-98eb-49e612c1bd91 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Returning 404 to user: Instance group 42b12d22-7105-40c0-ad60-56b0c9af452a could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:40.165960 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d50d6b29-6295-4adf-98eb-49e612c1bd91 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/42b12d22-7105-40c0-ad60-56b0c9af452a" status: 404 len: 117 microversion: 2.1 time: 0.036236 Jul 01 10:35:40.173373 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1121/2252] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:35:40 2022] DELETE /compute/v2.1/os-server-groups/42b12d22-7105-40c0-ad60-56b0c9af452a => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:35:40.183584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c7ae873-377e-4a3a-92c5-704f362fbb88 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970fe790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.256970 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c7ae873-377e-4a3a-92c5-704f362fbb88 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.081424 Jul 01 10:35:40.263663 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1122/2253] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:40 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:40.269172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ce65989-9cfe-4c39-9937-134a1d92220f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.279226 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-4ce65989-9cfe-4c39-9937-134a1d92220f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] HTTP exception thrown: Instance group 04c40ce7-d2aa-4569-bbf5-b7a435e7a22d could not be found. Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ce65989-9cfe-4c39-9937-134a1d92220f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Request method failure captured: Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-server-groups/04c40ce7-d2aa-4569-bbf5-b7a435e7a22d HTTP/1.1 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Ct05OtS9GLku-sfJdZTOhf7XmPAwu6MFqmlCBYh4yJhKzWumgWljYKPYAx7OxCGzzYPDCeWvOwWb6OrC-Fo7Utb_zA9wDjpDZ1Npt_uH-N5BqbTDC3QXhdX37DvrAgyfSMOs4l6wtjwzRnhjS5I1UDYM0yJRiAG7CZQxC6i5F1N4 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8a7baf7e8584eeab815f3db59a7b237", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b2c3b26cef03455c805823630a0d36c2 Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: exception: Instance group 04c40ce7-d2aa-4569-bbf5-b7a435e7a22d could not be found. Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '04c40ce7-d2aa-4569-bbf5-b7a435e7a22d'} Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 04c40ce7-d2aa-4569-bbf5-b7a435e7a22d could not be found. Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 04c40ce7-d2aa-4569-bbf5-b7a435e7a22d could not be found. Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.281301 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.284718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.284718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.284718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:40.284718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:40.284718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 04c40ce7-d2aa-4569-bbf5-b7a435e7a22d could not be found. Jul 01 10:35:40.284718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.287877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ce65989-9cfe-4c39-9937-134a1d92220f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Returning 404 to user: Instance group 04c40ce7-d2aa-4569-bbf5-b7a435e7a22d could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:40.288953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4ce65989-9cfe-4c39-9937-134a1d92220f tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/04c40ce7-d2aa-4569-bbf5-b7a435e7a22d" status: 404 len: 117 microversion: 2.1 time: 0.024042 Jul 01 10:35:40.295183 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1123/2254] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:35:40 2022] DELETE /compute/v2.1/os-server-groups/04c40ce7-d2aa-4569-bbf5-b7a435e7a22d => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:35:40.308478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e1635f5f-64bc-4b81-9e07-3ce0ef502194 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.319410 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e1635f5f-64bc-4b81-9e07-3ce0ef502194 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] HTTP exception thrown: Instance group 8f8023b2-751b-4aab-b6c3-bc6e0f760583 could not be found. Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e1635f5f-64bc-4b81-9e07-3ce0ef502194 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Request method failure captured: Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-server-groups/8f8023b2-751b-4aab-b6c3-bc6e0f760583 HTTP/1.1 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Ct05OtS9GLku-sfJdZTOhf7XmPAwu6MFqmlCBYh4yJhKzWumgWljYKPYAx7OxCGzzYPDCeWvOwWb6OrC-Fo7Utb_zA9wDjpDZ1Npt_uH-N5BqbTDC3QXhdX37DvrAgyfSMOs4l6wtjwzRnhjS5I1UDYM0yJRiAG7CZQxC6i5F1N4 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8a7baf7e8584eeab815f3db59a7b237", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8a7baf7e8584eeab815f3db59a7b237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f8a7baf7e8584eeab815f3db59a7b237 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerGroupTestJSON-1418794307 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b2c3b26cef03455c805823630a0d36c2 Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerGroupTestJSON-1418794307-project Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: exception: Instance group 8f8023b2-751b-4aab-b6c3-bc6e0f760583 could not be found. Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '8f8023b2-751b-4aab-b6c3-bc6e0f760583'} Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8f8023b2-751b-4aab-b6c3-bc6e0f760583 could not be found. Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8f8023b2-751b-4aab-b6c3-bc6e0f760583 could not be found. Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.323223 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.327828 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.327828 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.327828 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:40.327828 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:40.327828 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8f8023b2-751b-4aab-b6c3-bc6e0f760583 could not be found. Jul 01 10:35:40.327828 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.330233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e1635f5f-64bc-4b81-9e07-3ce0ef502194 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Returning 404 to user: Instance group 8f8023b2-751b-4aab-b6c3-bc6e0f760583 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:40.336770 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e1635f5f-64bc-4b81-9e07-3ce0ef502194 tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/8f8023b2-751b-4aab-b6c3-bc6e0f760583" status: 404 len: 117 microversion: 2.1 time: 0.031431 Jul 01 10:35:40.336770 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1124/2255] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:35:40 2022] DELETE /compute/v2.1/os-server-groups/8f8023b2-751b-4aab-b6c3-bc6e0f760583 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:35:40.337207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:40.344153 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:40.361195 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:40.365553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.367416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:40.369017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:40.384992 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:40.390095 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b7274b71-2f37-442a-b57a-699dc3f63722 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1444 microversion: 2.75 time: 0.295567 Jul 01 10:35:40.394613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.410795 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1132/2256] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:40 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1444 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:40.415188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.416553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.421365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.429641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-397a8100-d1b5-4a1d-b5c3-07c1c3a3587a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.608682 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-397a8100-d1b5-4a1d-b5c3-07c1c3a3587a tempest-ServerGroupTestJSON-1418794307 tempest-ServerGroupTestJSON-1418794307-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/28cb30af-74ab-472d-a226-d815f3925fe4" status: 204 len: 0 microversion: 2.1 time: 0.196453 Jul 01 10:35:40.610190 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1133/2257] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 10:35:40 2022] DELETE /compute/v2.1/os-server-groups/28cb30af-74ab-472d-a226-d815f3925fe4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:35:40.620322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:40.627455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 65557a00-fd3c-4f95-95e7-44e4975cdb4e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:40.642906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.649943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.653554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.654505 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.676775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:40.691184 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-71cb597d-5ade-47b5-b451-2b06cba93425 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1350 microversion: 2.1 time: 0.339918 Jul 01 10:35:40.702144 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] HTTP exception thrown: Instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e could not be found. Jul 01 10:35:40.703157 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1125/2258] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:40 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1350 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Request method failure captured: Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e HTTP/1.1 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxQWZMioDH35YUWt_zW1cgAwhpfbogmairFdHzUZZcaQoexYROJrbGYaflFCQKeLVLLF6JLpxOcPLaxGdf6FueBXxxtYUsg-tCK0tZRmglhNWSndcTTb6aVVRY3D2zhwSo53Sn7Z64hrqpwkrB5wgyQtM4t4RJzUjqW4H5E2XL2cSI Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.25 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1c22e4753be4dd8a7d262df2fedd7c1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cd7034799f014e95bbe8ed18fdc424a6 Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e could not be found. Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '65557a00-fd3c-4f95-95e7-44e4975cdb4e'} Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e could not be found. Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e could not be found. Jul 01 10:35:40.706983 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e could not be found. Jul 01 10:35:40.711383 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:40.711981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4758ad9b-cb8a-4b95-84e7-490a27daa010 req-0b561800-b2a1-4f12-9421-3e94741c3e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a032d2-5ef0-4bf8-a282-fce29edda700", "name": "network-vif-plugged", "status": "completed", "tag": "4fc6b77c-2b84-434e-b42d-a07d1f87688f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:40.712959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Returning 404 to user: Instance 65557a00-fd3c-4f95-95e7-44e4975cdb4e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:40.715466 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8287a650-a725-4a5b-a71a-d39206b0321c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e" status: 404 len: 111 microversion: 2.25 time: 0.104057 Jul 01 10:35:40.717533 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1134/2259] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:40 2022] GET /compute/v2.1/servers/65557a00-fd3c-4f95-95e7-44e4975cdb4e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:35:40.724004 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4758ad9b-cb8a-4b95-84e7-490a27daa010 req-0b561800-b2a1-4f12-9421-3e94741c3e91 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:40.724618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4758ad9b-cb8a-4b95-84e7-490a27daa010 req-0b561800-b2a1-4f12-9421-3e94741c3e91 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:40.751858 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4758ad9b-cb8a-4b95-84e7-490a27daa010 req-0b561800-b2a1-4f12-9421-3e94741c3e91 service nova] Creating event network-vif-plugged:4fc6b77c-2b84-434e-b42d-a07d1f87688f for instance b2a032d2-5ef0-4bf8-a282-fce29edda700 on n-h2-master-1 Jul 01 10:35:40.785569 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4758ad9b-cb8a-4b95-84e7-490a27daa010 req-0b561800-b2a1-4f12-9421-3e94741c3e91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078611 Jul 01 10:35:40.786781 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1126/2260] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:41.140021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-24f3abf2-ce8f-424a-884b-b4ad9e5dd6d6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:41.140936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-24f3abf2-ce8f-424a-884b-b4ad9e5dd6d6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:41.157998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24f3abf2-ce8f-424a-884b-b4ad9e5dd6d6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:41.158113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24f3abf2-ce8f-424a-884b-b4ad9e5dd6d6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:41.158795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24f3abf2-ce8f-424a-884b-b4ad9e5dd6d6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:41.159386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24f3abf2-ce8f-424a-884b-b4ad9e5dd6d6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:41.270916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e32b1970-d77c-4dd8-b3f6-55066e86ef99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97049550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:41.322068 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e32b1970-d77c-4dd8-b3f6-55066e86ef99 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.056074 Jul 01 10:35:41.322643 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1127/2261] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:41 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:41.416821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:41.417624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:41.425251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:41.425819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:41.427029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:41.427534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:41.450184 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-24f3abf2-ce8f-424a-884b-b4ad9e5dd6d6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 14 microversion: 2.1 time: 0.314617 Jul 01 10:35:41.450898 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1135/2262] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:41 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:35:41.498181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:41.506871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:41.508990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:41.513985 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5653b443-2049-431d-bdde-4fd1ec53b386 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1444 microversion: 2.75 time: 0.101928 Jul 01 10:35:41.514903 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1128/2263] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:41 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:35:41.711275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:41.712622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:41.726289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:41.726289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:41.726289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:41.726289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:41.919574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:41.944716 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ba7a0e3-0d4d-479e-9740-ca9b1beceb88 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1350 microversion: 2.1 time: 0.221272 Jul 01 10:35:41.944716 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1136/2264] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:41 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:42.335540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc7a3b79-d2ea-4c9d-88b3-6fb702d901ed tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970491f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:42.420727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc7a3b79-d2ea-4c9d-88b3-6fb702d901ed tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.089668 Jul 01 10:35:42.429250 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1129/2265] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:42 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:42.462917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cd2a58d5-dfaf-40e2-acdb-68e9bed84a02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:42.468574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cd2a58d5-dfaf-40e2-acdb-68e9bed84a02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:42.489913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd2a58d5-dfaf-40e2-acdb-68e9bed84a02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.491248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd2a58d5-dfaf-40e2-acdb-68e9bed84a02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.492271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd2a58d5-dfaf-40e2-acdb-68e9bed84a02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.492854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd2a58d5-dfaf-40e2-acdb-68e9bed84a02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.535260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:42.536158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:42.547004 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.561456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.562855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.571588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.648026 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cd2a58d5-dfaf-40e2-acdb-68e9bed84a02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action" status: 200 len: 8188 microversion: 2.1 time: 0.190376 Jul 01 10:35:42.648690 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1137/2266] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:42 2022] POST /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678/action => generated 8188 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:42.664190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:42.665252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:42.680837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.685359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.690154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lazy-loading 'fault' on Instance uuid 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:42.699664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.700116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.700922 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.701423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.815978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:42.850625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:42.852308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bf129f7f65e4291b2877d025fb6eb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3486a6f99724576bd777319814c023e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:42.892381 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f25e49c-29a3-4897-b9fe-e7e19ab34a1a tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 200 len: 1449 microversion: 2.75 time: 0.354535 Jul 01 10:35:42.899948 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1130/2267] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:42 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 1449 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:42.944942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:42.945681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:42.965524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.965982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:42.966792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:42.967238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:43.480444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:43.515602 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3b7f5e13-f7b9-4d2d-8702-0d84abc438fb tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.856469 Jul 01 10:35:43.519361 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1138/2268] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:42 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:43.548494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-522c6f71-df9d-4d6e-9af8-bf2b47c932ef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f913d85e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:43.605749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:43.616488 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-61a0ee99-b8f2-4e92-99d1-1e7292b60108 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1540 microversion: 2.1 time: 0.675147 Jul 01 10:35:43.620490 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1131/2269] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:42 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1540 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:43.625393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:43.643526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:43.666029 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-522c6f71-df9d-4d6e-9af8-bf2b47c932ef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.143773 Jul 01 10:35:43.666761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:43.667370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:43.668180 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1139/2270] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:43 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:43.668564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:43.669173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:43.675085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d81044a-c47a-4856-abc3-964144661090 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:43.680351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d81044a-c47a-4856-abc3-964144661090 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:43.713494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d81044a-c47a-4856-abc3-964144661090 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:43.713961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d81044a-c47a-4856-abc3-964144661090 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:43.714759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d81044a-c47a-4856-abc3-964144661090 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:43.715197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d81044a-c47a-4856-abc3-964144661090 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:44.377482 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d81044a-c47a-4856-abc3-964144661090 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.708095 Jul 01 10:35:44.378450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1140/2271] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:35:43 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700/os-interface => generated 284 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:44.400722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:44.401437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] [instance: 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:44.436065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:44.436065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:44.436065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:44.436065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:44.479343 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] HTTP exception thrown: Instance 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d could not be found. Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Request method failure captured: Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d HTTP/1.1 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2vcIL0V_qRG5iyNtEJYzBPGQKQHKbXf2TgVxYjKK6JEaeQPR9dq_5Ylv0_SkmHKrc8NUQKugQuCIbhORZvKvUJV3NXWCRRqnXbGw_E_BLELV1FZNUUmvXNmEEMnxyczBsGeHIHfNstXxsyiI6H9RndMOdR-ZfWanskiBrObeaoZEQ Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.75 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e3486a6f99724576bd777319814c023e Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdmin275Test-1463402856 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3486a6f99724576bd777319814c023e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3486a6f99724576bd777319814c023e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3486a6f99724576bd777319814c023e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3486a6f99724576bd777319814c023e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdmin275Test-1463402856 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e3486a6f99724576bd777319814c023e Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdmin275Test-1463402856 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdmin275Test-1463402856-project Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 3bf129f7f65e4291b2877d025fb6eb09 Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdmin275Test-1463402856-project Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d could not be found. Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1fd2dad2-a4de-4dc5-81de-ceeeeb52856d'} Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d could not be found. Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d could not be found. Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:44.481929 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d could not be found. Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:44.486506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] Returning 404 to user: Instance 1fd2dad2-a4de-4dc5-81de-ceeeeb52856d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:44.496589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:44.507299 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf0b51df-5226-4103-aba8-188888a61ee7 tempest-ServersAdmin275Test-1463402856 tempest-ServersAdmin275Test-1463402856-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d" status: 404 len: 111 microversion: 2.75 time: 0.127491 Jul 01 10:35:44.509759 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f278001c-37ad-41b1-aea2-0be36569d189 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.887904 Jul 01 10:35:44.510354 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1141/2272] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:44 2022] GET /compute/v2.1/servers/1fd2dad2-a4de-4dc5-81de-ceeeeb52856d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:35:44.511461 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1132/2273] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:43 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:44.530348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:44.533431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:44.550709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:44.551274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:44.552647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:44.553916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:44.679942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80018b6c-8560-458b-9677-5f775d3964fc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f1e8b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:44.785130 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80018b6c-8560-458b-9677-5f775d3964fc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.109805 Jul 01 10:35:44.785837 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1133/2274] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:44 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:45.682807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:45.699390 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd0b8802-9a84-456a-baf1-92382ebf3d02 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 1.173254 Jul 01 10:35:45.700258 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1142/2275] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:44 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:45.720080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:45.723618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:45.743024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:45.748182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:45.749263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:45.753775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:45.800572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdae5367-c654-4bc7-80ac-5eeb8b2208be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f913569d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:45.863358 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdae5367-c654-4bc7-80ac-5eeb8b2208be tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.068121 Jul 01 10:35:45.863941 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1143/2276] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:45 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:46.540468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:46.549677 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-233cd4be-360a-4bf8-80b1-e54cefbc9a79 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.837677 Jul 01 10:35:46.561250 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1134/2277] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:45 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:46.567042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:46.577136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:46.580822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:46.581499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:46.582626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:46.583151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:46.877840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d57a091c-7696-413a-be54-e1d0c048c33f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97049a60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:46.907432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Locking {{(pid=119765) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 01 10:35:46.986177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d57a091c-7696-413a-be54-e1d0c048c33f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.112644 Jul 01 10:35:46.986758 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1135/2278] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:46 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:47.118771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b6c244f5-9abd-444f-aad6-1c24ae1a6a06 req-8360eab5-1ac3-42b8-b4d8-5d2260248e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a032d2-5ef0-4bf8-a282-fce29edda700", "tag": "4fc6b77c-2b84-434e-b42d-a07d1f87688f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:47.153521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b6c244f5-9abd-444f-aad6-1c24ae1a6a06 req-8360eab5-1ac3-42b8-b4d8-5d2260248e88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:47.154300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b6c244f5-9abd-444f-aad6-1c24ae1a6a06 req-8360eab5-1ac3-42b8-b4d8-5d2260248e88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:47.187578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b6c244f5-9abd-444f-aad6-1c24ae1a6a06 req-8360eab5-1ac3-42b8-b4d8-5d2260248e88 service nova] Creating event network-changed:4fc6b77c-2b84-434e-b42d-a07d1f87688f for instance b2a032d2-5ef0-4bf8-a282-fce29edda700 on n-h2-master-1 Jul 01 10:35:47.202191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b6c244f5-9abd-444f-aad6-1c24ae1a6a06 req-8360eab5-1ac3-42b8-b4d8-5d2260248e88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093231 Jul 01 10:35:47.204858 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1136/2279] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:35:47.305547 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-88721785-d470-46b6-a056-fcd8649e0850 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.742605 Jul 01 10:35:47.317637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1144/2280] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:46 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:35:47.317773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:47.318258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:47.329997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:47.332057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:47.333050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:47.334837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:48.004040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-660ad202-5739-42a0-8038-6a992f413aea tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f911dde50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:48.127012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-660ad202-5739-42a0-8038-6a992f413aea tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.128323 Jul 01 10:35:48.131737 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1145/2281] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:47 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:48.255764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:48.272976 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6c60a907-00fd-4ab4-b76d-307e85b9629a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.960083 Jul 01 10:35:48.276933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1137/2282] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:47 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:48.296475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f16184dc-fb61-4147-b837-f135da9c3a3e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:48.319962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f16184dc-fb61-4147-b837-f135da9c3a3e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:48.320659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f16184dc-fb61-4147-b837-f135da9c3a3e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:48.392651 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f16184dc-fb61-4147-b837-f135da9c3a3e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] HTTP exception thrown: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 is locked Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f16184dc-fb61-4147-b837-f135da9c3a3e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Request method failure captured: Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action HTTP/1.1 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 15 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszjVKMte_ts7Jv-cDXMyjEhSnWz4wS387Uwsvp-vYY217jOuWA3zd3eYQwA0Rdq-dIzXtVGejeSrtv9BFzN-ilT4kjM3B3cvV2_OtGIFVGLYEr3XxTz7dW8aIY0qr29FrYLv9cAbipRXnW_Yk7WImY61dlPvgqjsTiGaAS2IAYFNw4 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb942eeb3788403687ba800c070babd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb942eeb3788403687ba800c070babd5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: adf336817b04429b930e1f80ea25b1f7 Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: {"os-stop": {}} Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: exception: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 is locked Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c4d5f7e5-c239-4d67-8350-35e6cc070a68', 'body': {'os-stop': {}}} Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 is locked Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 is locked Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 is locked Jul 01 10:35:48.399185 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:35:48.405089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f16184dc-fb61-4147-b837-f135da9c3a3e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Returning 409 to user: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 is locked {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:48.412993 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f16184dc-fb61-4147-b837-f135da9c3a3e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 409 len: 107 microversion: 2.1 time: 0.117796 Jul 01 10:35:48.416692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:48.416855 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1146/2283] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:48 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 107 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:35:48.417764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:48.426488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:48.429772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:48.430896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:48.433744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:48.799503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Unlocking {{(pid=119764) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 01 10:35:48.863624 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:48.916294 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:48.917717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:48.935985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:48.936693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:48.937727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:48.938454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:48.991926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:35:49.123719 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d39daf92-352e-4ef8-8ccc-40ab4d943374 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.712237 Jul 01 10:35:49.137006 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1138/2284] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:48 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:35:49.150283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45c33a01-7370-4a49-8c14-9c2b298d206f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:49.183602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45c33a01-7370-4a49-8c14-9c2b298d206f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:49.184224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45c33a01-7370-4a49-8c14-9c2b298d206f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:49.427013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45c33a01-7370-4a49-8c14-9c2b298d206f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Going to try to stop instance {{(pid=119764) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:35:49.474272 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a1c2e980-74c9-463f-8c40-31646fbe44d3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 204 len: 0 microversion: 2.1 time: 0.567088 Jul 01 10:35:49.475184 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1147/2285] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:35:48 2022] DELETE /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:35:49.480888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8727addf-7f1e-41e8-a0ce-ee44ab033535 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91426af0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:49.657966 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8727addf-7f1e-41e8-a0ce-ee44ab033535 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.181487 Jul 01 10:35:49.658711 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1148/2286] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:49 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:49.667252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:49.667748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:49.725632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:49.726467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:49.729360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:49.730008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:49.791094 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:35:49.835297 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45c33a01-7370-4a49-8c14-9c2b298d206f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.696682 Jul 01 10:35:49.844340 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1139/2287] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:35:49 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:35:49.865710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:49.868188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:49.887159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:49.890999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:49.893104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:49.894597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:50.166553 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef4c8b4f-a735-4a54-9378-6a711324eb0c tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "DELETE /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 204 len: 0 microversion: 2.25 time: 0.506000 Jul 01 10:35:50.166676 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1149/2288] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:35:49 2022] DELETE /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:35:50.175897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:50.180592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:50.201843 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:50.206591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:50.209755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:50.213117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:50.704214 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:50.724600 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd84c24d-fdea-489e-8905-b6c2a12b2a93 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1554 microversion: 2.1 time: 0.886622 Jul 01 10:35:50.725993 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1140/2289] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:49 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1554 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:50.738679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:50.741058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:50.774092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:50.774817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:50.776511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:50.777110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:50.997880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:51.006983 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a99174d-6514-47c7-89d5-9d7b4761b13a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.838995 Jul 01 10:35:51.010959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1150/2290] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:50 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:51.020457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-226cfa57-bc9b-480f-a2fe-e899c00cc1f4 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f912c5e50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:51.114262 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-226cfa57-bc9b-480f-a2fe-e899c00cc1f4 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.098826 Jul 01 10:35:51.118620 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1151/2291] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:51 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:51.366729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:51.432504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:51.432504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:51.432504 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-287af557-2ab3-4c7d-a83f-9adfc886ba83 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1730 microversion: 2.25 time: 0.656417 Jul 01 10:35:51.432504 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1141/2292] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:50 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1730 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:51.745843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:51.746743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:51.755188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:51.757090 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:51.757914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:51.758412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:51.777790 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:35:52.028503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:52.029120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:52.040874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:52.048477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:52.049345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:52.049956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:52.207709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:52.221334 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72951387-77e5-4ed5-b4d1-999fbae1835f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1554 microversion: 2.1 time: 0.478405 Jul 01 10:35:52.225674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1152/2293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:51 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1554 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:52.233347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8da50810-54ad-427a-9cc2-c0196e6d3a88 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9145a550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:52.329401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8da50810-54ad-427a-9cc2-c0196e6d3a88 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.100890 Jul 01 10:35:52.330045 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1153/2294] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:52 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:52.409428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:52.410386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:52.432362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:52.438048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:52.438048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:52.438048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:52.573441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:52.591493 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b31ca1f5-33ae-4090-a0a8-83c56d622702 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.563325 Jul 01 10:35:52.597321 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1142/2295] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:52 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:52.608054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f4667a59-7a26-4950-9687-0ddc5c327762 req-09369ff4-420c-45bf-9412-a1c93a6dcea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e04ea24-b9fd-4851-bc55-68c32ab78300", "name": "network-vif-deleted", "tag": "d7c43a44-58ec-469d-896d-2157bf976c84"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:52.630478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f4667a59-7a26-4950-9687-0ddc5c327762 req-09369ff4-420c-45bf-9412-a1c93a6dcea6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:52.638946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f4667a59-7a26-4950-9687-0ddc5c327762 req-09369ff4-420c-45bf-9412-a1c93a6dcea6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:52.668479 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f4667a59-7a26-4950-9687-0ddc5c327762 req-09369ff4-420c-45bf-9412-a1c93a6dcea6 service nova] Creating event network-vif-deleted:d7c43a44-58ec-469d-896d-2157bf976c84 for instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 on n-h2-master-1 Jul 01 10:35:52.683634 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f4667a59-7a26-4950-9687-0ddc5c327762 req-09369ff4-420c-45bf-9412-a1c93a6dcea6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080862 Jul 01 10:35:52.685297 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1143/2296] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:52.734917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:52.745246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:52.746876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:52.754820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-170eea6e-4cf4-4bda-a25b-e037949cae9f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1730 microversion: 2.25 time: 0.351883 Jul 01 10:35:52.759086 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1154/2297] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:52 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1730 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:53.260677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:53.265968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:53.281566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:53.293814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:53.296646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:53.297384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:53.343046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-23489d3e-07ea-40b7-8cdb-fb2ea8c63dc0 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91170c10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:53.470630 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-23489d3e-07ea-40b7-8cdb-fb2ea8c63dc0 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.125837 Jul 01 10:35:53.471801 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1155/2298] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:53 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:53.527502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:53.542673 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9bd37ee3-fcdd-47dd-b506-bfbc98fadd6a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1346 microversion: 2.1 time: 0.297905 Jul 01 10:35:53.555740 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1144/2299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:53 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1346 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:53.607622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:53.608243 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:53.622182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:53.627887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:53.631433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:53.634863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:53.782046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:53.782933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:53.798761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:53.801584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:53.805159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:53.807728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:53.971260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:53.984744 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad7f83b3-e357-4c35-942c-43e1daa4e414 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.377020 Jul 01 10:35:53.989629 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1156/2300] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:53 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:54.094369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:54.120818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:54.121121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e8e05b3b-d505-4bbe-9058-9c554c7d0fe6 req-8e7c2ddd-8f49-41ae-b65e-e03010cdd2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730", "name": "network-vif-deleted", "tag": "b53fda29-dab0-4898-920d-4dd9caf3daae"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:54.133864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:54.139345 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e3525978-098a-44cc-bb1a-0cb9cc30864f tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1663 microversion: 2.25 time: 0.365432 Jul 01 10:35:54.148127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e8e05b3b-d505-4bbe-9058-9c554c7d0fe6 req-8e7c2ddd-8f49-41ae-b65e-e03010cdd2ee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:54.148499 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1145/2301] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:53 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1663 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:54.152154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e8e05b3b-d505-4bbe-9058-9c554c7d0fe6 req-8e7c2ddd-8f49-41ae-b65e-e03010cdd2ee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:54.226756 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e8e05b3b-d505-4bbe-9058-9c554c7d0fe6 req-8e7c2ddd-8f49-41ae-b65e-e03010cdd2ee service nova] Creating event network-vif-deleted:b53fda29-dab0-4898-920d-4dd9caf3daae for instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 on n-h2-master-1 Jul 01 10:35:54.256807 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e8e05b3b-d505-4bbe-9058-9c554c7d0fe6 req-8e7c2ddd-8f49-41ae-b65e-e03010cdd2ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141524 Jul 01 10:35:54.258261 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1157/2302] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:35:54.484907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-225028fb-879f-423f-9475-5980637008d5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970dd430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:54.548771 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-225028fb-879f-423f-9475-5980637008d5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.067667 Jul 01 10:35:54.566172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:54.572045 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1146/2303] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:54 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:54.575509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:54.587650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:54.588507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:54.589610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:54.590260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:54.783409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:54.795938 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d40139f-afe0-4a7e-a20e-903389ee1395 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1346 microversion: 2.1 time: 0.237074 Jul 01 10:35:54.810815 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1158/2304] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:54 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:55.006759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:55.007638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:55.029632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:55.035408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:55.038982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:55.042606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:55.164649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:55.165371 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:55.179687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:55.184384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:55.186059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:55.187824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:55.258284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:55.260635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:55.261364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lazy-loading 'fault' on Instance uuid 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:35:55.468527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:55.480411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:55.491963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:55.500284 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-579222d3-36ed-43d3-84f9-c8702a736528 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 200 len: 1375 microversion: 2.25 time: 0.340888 Jul 01 10:35:55.501587 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1159/2305] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:55 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 1375 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:35:55.652236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:55.663514 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-506e0181-16fc-4e88-af1b-bc0aeb58d2be tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.661443 Jul 01 10:35:55.667128 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1147/2306] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:55 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:55.680256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-139fe5be-741f-4f47-84c2-6a77661b2cf2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f92426430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:55.805330 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-139fe5be-741f-4f47-84c2-6a77661b2cf2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.135184 Jul 01 10:35:55.809230 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1148/2307] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:55 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:55.819980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:55.832514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:55.858127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:55.858737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:55.859661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:55.865883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1742551259", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:35:55.872802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:56.006483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:35:56.041922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:56.056367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0141fda-93b3-454c-a6a6-0bad73dba3ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1346 microversion: 2.1 time: 0.240981 Jul 01 10:35:56.059613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1149/2308] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:55 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:56.351420 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:35:56.352034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:35:56.359323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:35:56.359323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:35:56.359323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:35:56.367891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:56.370619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:56.371699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:56.373548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:56.409042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Getting quotas for project faaf7e2113fc497f887b69928eea7fe2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:35:56.416791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Getting quotas for user 61a6df97de4244c1babbcec634b2cc12 and project faaf7e2113fc497f887b69928eea7fe2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:35:56.450023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:35:56.460936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:35:56.519878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:56.520495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:56.563272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:56.564312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:56.565136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:56.565606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:56.614320 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] HTTP exception thrown: Instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 could not be found. Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Request method failure captured: Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 HTTP/1.1 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivsxQWZMioDH35YUWt_zW1cgAwhpfbogmairFdHzUZZcaQoexYROJrbGYaflFCQKeLVLLF6JLpxOcPLaxGdf6FueBXxxtYUsg-tCK0tZRmglhNWSndcTTb6aVVRY3D2zhwSo53Sn7Z64hrqpwkrB5wgyQtM4t4RJzUjqW4H5E2XL2cSI Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.25 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1c22e4753be4dd8a7d262df2fedd7c1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cd7034799f014e95bbe8ed18fdc424a6 Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 could not be found. Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730'} Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 could not be found. Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 could not be found. Jul 01 10:35:56.616337 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 could not be found. Jul 01 10:35:56.620463 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:35:56.625249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Returning 404 to user: Instance 375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:35:56.627005 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec050eb0-9a26-4d15-bd3e-d212a131533b tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730" status: 404 len: 111 microversion: 2.25 time: 0.111064 Jul 01 10:35:56.637933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1150/2309] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:56 2022] GET /compute/v2.1/servers/375ea64a-b7fe-4f89-b1bb-f3d6ef7c6730 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:35:56.649484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8155311a-6b3b-44c2-b9bd-1cde97d4d759 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '.version_select at 0x7f6f9219f4c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:56.696920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-54b68e1f-05d7-496d-bf50-5bf7ca071a30 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161074 Jul 01 10:35:56.703914 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1160/2310] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:35:56.753267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:56.754650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:56.785000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:56.787072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:56.793697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:56.794353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:56.806545 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8155311a-6b3b-44c2-b9bd-1cde97d4d759 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580804816" status: 204 len: 0 microversion: 2.25 time: 0.164172 Jul 01 10:35:56.807532 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1151/2311] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:35:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580804816 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 10:35:56.823322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d2b7a84f-3428-4a4f-987f-1bc51889416c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:56.827183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d2b7a84f-3428-4a4f-987f-1bc51889416c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:56.964150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2b7a84f-3428-4a4f-987f-1bc51889416c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:56.975925 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d2b7a84f-3428-4a4f-987f-1bc51889416c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1222 microversion: 2.1 time: 0.164162 Jul 01 10:35:56.977202 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1152/2312] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:56 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:56.988879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-323bfa3a-c298-4357-bf27-9775d95e7b02 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9709e160>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:57.089771 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-323bfa3a-c298-4357-bf27-9775d95e7b02 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.111094 Jul 01 10:35:57.092809 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1153/2313] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:56 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:57.100368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:57.101604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:57.117221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:57.118034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:57.119074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:57.124829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:57.318107 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:57.339000 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-019217d0-d01f-4822-bd38-e7c91fcd2d7c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1346 microversion: 2.1 time: 0.244800 Jul 01 10:35:57.342530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1154/2314] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:57 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1346 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:57.366296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:57.375067 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e794e8d7-7ed0-4215-b24c-b442d1b8ab3d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.654176 Jul 01 10:35:57.376108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1161/2315] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:56 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:57.998743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4bebfc1-9ab9-49eb-8d41-86567f3e4637 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:57.999513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4bebfc1-9ab9-49eb-8d41-86567f3e4637 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:58.106888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93716770-bbc6-49fd-abf2-11b8a7c2ac09 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9146c3a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:58.148971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d4bebfc1-9ab9-49eb-8d41-86567f3e4637 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:58.156371 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4bebfc1-9ab9-49eb-8d41-86567f3e4637 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1222 microversion: 2.1 time: 0.161458 Jul 01 10:35:58.158698 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1155/2316] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:57 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:58.203472 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93716770-bbc6-49fd-abf2-11b8a7c2ac09 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.101607 Jul 01 10:35:58.204250 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1162/2317] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:58 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:58.254144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:58.254928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:58.273985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.273985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:58.273985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.273985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:58.302081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:35:58.356353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:58.357325 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:58.372889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.379469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:58.381050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.392834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:58.518033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:58.528864 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dd8468e0-0773-4561-96c8-4a9e51c92d2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1346 microversion: 2.1 time: 0.176289 Jul 01 10:35:58.533497 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1163/2318] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:58 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:58.543281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:58.543944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:58.558931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.561844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:58.562843 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.564953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:58.806169 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-72e012e9-0cd0-4fa6-944d-d0c18778b874 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 204 len: 0 microversion: 2.25 time: 0.555317 Jul 01 10:35:58.807127 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1156/2319] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:35:58 2022] DELETE /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:35:58.815742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:58.816668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:58.827396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.828432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:58.829551 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:58.830249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:59.098938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:59.100276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:59.113403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:59.115549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02755268-2c0a-4e6f-b655-fa7be1afc58c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.579618 Jul 01 10:35:59.116897 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1164/2320] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:58 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:59.117639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:59.122020 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea484db5-4486-4da6-bd46-409638b8579d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1549 microversion: 2.25 time: 0.310398 Jul 01 10:35:59.125219 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1157/2321] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:35:58 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1549 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:35:59.175924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:59.176537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:59.186705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:59.187724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:59.188809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:59.189435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:59.218522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-30d62830-affd-41e7-856a-95b44bb4b37e tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91ad59d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:59.289408 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-30d62830-affd-41e7-856a-95b44bb4b37e tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.060713 Jul 01 10:35:59.289408 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1158/2322] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:35:59 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:35:59.289810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:35:59.292348 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-497bd43a-16f7-4a5c-99c4-eb31ac414d32 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1226 microversion: 2.1 time: 0.121295 Jul 01 10:35:59.293112 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1165/2323] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:59 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:35:59.557406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:35:59.562514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:35:59.593717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:59.594187 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:35:59.594987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:35:59.597400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:00.146378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:00.147697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:00.158679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:00.164155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:00.165245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:00.165899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:00.376062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:00.397328 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b08cf998-1927-4cee-80b6-941f7c7803b8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1346 microversion: 2.1 time: 0.851356 Jul 01 10:36:00.407191 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1159/2324] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:35:59 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1346 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:00.584404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:00.586177 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:00.595984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:00.602012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:00.603353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:00.603866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:00.635508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:00.654684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:00.656667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:00.658153 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02078770-a803-4dec-bdd2-406636ae3a4d tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1549 microversion: 2.25 time: 0.517735 Jul 01 10:36:00.671442 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1166/2325] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:00 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1549 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:00.678843 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:00.711632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-466f3d3a-5a31-4880-8c1d-8d0694cd1760 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f914faca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:00.830502 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-466f3d3a-5a31-4880-8c1d-8d0694cd1760 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1454 microversion: 2.1 time: 0.157544 Jul 01 10:36:00.839195 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1167/2326] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:36:00 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:00.848537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:00.848537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:00.852717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:00.853929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:00.854869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:00.855405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:00.972831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:01.002630 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-851339a9-ad83-40f4-9406-0b95582c6414 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1282 microversion: 2.1 time: 0.161552 Jul 01 10:36:01.003439 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1168/2327] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:00 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:01.067374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:01.075572 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-284d5c21-9ad4-4e83-91e3-a804ea79a690 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.666896 Jul 01 10:36:01.076145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1160/2328] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:00 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:01.288374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7e121c00-23d9-4f34-8078-6bdf8b373d58 req-a3d54a86-a7f4-4666-9659-1910111553e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7ba1c8-0f5a-4f84-9378-d4ab844795e0", "name": "network-vif-deleted", "tag": "959de9bf-4dd5-436d-bc7b-c7385ccfdaa0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:01.323636 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7e121c00-23d9-4f34-8078-6bdf8b373d58 req-a3d54a86-a7f4-4666-9659-1910111553e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:01.325030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7e121c00-23d9-4f34-8078-6bdf8b373d58 req-a3d54a86-a7f4-4666-9659-1910111553e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:01.369061 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7e121c00-23d9-4f34-8078-6bdf8b373d58 req-a3d54a86-a7f4-4666-9659-1910111553e3 service nova] Creating event network-vif-deleted:959de9bf-4dd5-436d-bc7b-c7385ccfdaa0 for instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 on n-h1-master-1 Jul 01 10:36:01.379482 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7e121c00-23d9-4f34-8078-6bdf8b373d58 req-a3d54a86-a7f4-4666-9659-1910111553e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094780 Jul 01 10:36:01.380103 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1169/2329] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:36:01.419875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:01.423334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:01.438422 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:01.447817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:01.453321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:01.457911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:01.459141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:01.508401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:01.508853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:01.509340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lazy-loading 'fault' on Instance uuid 4e04ea24-b9fd-4851-bc55-68c32ab78300 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:36:01.612989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:01.632432 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28ec7f5b-638a-4163-9a74-faa53afb624b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 200 len: 1351 microversion: 2.1 time: 0.221143 Jul 01 10:36:01.650318 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1161/2330] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:01 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 1351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:01.677962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:01.682954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:01.693060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:01.693544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:01.696113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:01.696644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:01.739325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:01.740227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:01.740922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lazy-loading 'fault' on Instance uuid 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:36:01.805872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:01.822302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:01.823910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:01.825910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87c4a5ba-3ae7-42b6-8a6e-6de32899e244 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 200 len: 1351 microversion: 2.25 time: 0.151607 Jul 01 10:36:01.838438 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1170/2331] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:01 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 1351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:01.844252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff136673-7749-41a5-be69-66402143fbef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970fe670>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:01.900938 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ff136673-7749-41a5-be69-66402143fbef tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1463 microversion: 2.1 time: 0.060836 Jul 01 10:36:01.901885 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1162/2332] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:36:01 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1463 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:01.914242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f895ad5-c96e-4eb0-834d-0563f16ad700 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9129d040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.020063 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f895ad5-c96e-4eb0-834d-0563f16ad700 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 200 len: 1463 microversion: 2.1 time: 0.110560 Jul 01 10:36:02.027773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1171/2333] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:36:01 2022] GET /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 1463 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:02.028130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.028130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:02.034105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.034393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.034752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.034968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:02.035543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.035998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.044399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.045319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.046394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.047105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.417383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:02.434131 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73a64119-c2f1-4237-a728-84e8eb9eb1b2 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 1466 microversion: 2.1 time: 0.397755 Jul 01 10:36:02.435455 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1172/2334] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 1466 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:02.449290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.449926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:02.461218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.462781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.462781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.462971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.541697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:02.552777 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8a66fd4a-f5d6-4862-b4db-90b035987d12 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.535944 Jul 01 10:36:02.553751 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1163/2335] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:02.565267 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-856ab8e4-2bfc-4381-888a-ef814f2bf461 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91e26310>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.688697 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-856ab8e4-2bfc-4381-888a-ef814f2bf461 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-07-01T10%3A33%3A49Z" status: 200 len: 1901 microversion: 2.1 time: 0.130889 Jul 01 10:36:02.688697 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1164/2336] 10.222.0.23 () {58 vars in 1198 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/images?changes-since=2022-07-01T10%3A33%3A49Z => generated 1901 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:02.691302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.693742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:02.699201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.699938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.700927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.701588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.718690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 HTTP/1.1 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '4e04ea24-b9fd-4851-bc55-68c32ab78300'} Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:02.720709 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.726451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:02.726451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:02.726451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:02.726451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:02.726451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:02.726451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:02.726451 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.728240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:02.729351 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea21ba28-f3d5-4038-bf0c-4779c7ca60b0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 404 len: 111 microversion: 2.1 time: 0.041706 Jul 01 10:36:02.730852 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1165/2337] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:36:02.737313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-897fdf60-1073-433e-8e70-9b869e8254dd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9249d1f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.805863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:02.837091 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6088b317-7bda-4eed-b11b-4d3fe18c0dc5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1658 microversion: 2.1 time: 0.386987 Jul 01 10:36:02.838166 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1173/2338] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1658 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:02.854827 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-897fdf60-1073-433e-8e70-9b869e8254dd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1468342496" status: 200 len: 485 microversion: 2.1 time: 0.121215 Jul 01 10:36:02.860716 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1166/2339] 10.222.0.23 () {58 vars in 1230 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1468342496 => generated 485 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:02.860845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:02.860845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:02.863638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-16042be5-fb0d-4823-bd53-65a162849421 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:02.871369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16042be5-fb0d-4823-bd53-65a162849421 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.872126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16042be5-fb0d-4823-bd53-65a162849421 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.874044 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:02.875717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.876165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.878666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:02.879711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:02.903631 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] HTTP exception thrown: Instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 could not be found. Jul 01 10:36:02.904076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-16042be5-fb0d-4823-bd53-65a162849421 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Going to try to start instance {{(pid=119764) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Request method failure captured: Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 HTTP/1.1 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxQWZMioDH35YUWt_zW1cgAwhpfbogmairFdHzUZZcaQoexYROJrbGYaflFCQKeLVLLF6JLpxOcPLaxGdf6FueBXxxtYUsg-tCK0tZRmglhNWSndcTTb6aVVRY3D2zhwSo53Sn7Z64hrqpwkrB5wgyQtM4t4RJzUjqW4H5E2XL2cSI Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.25 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1c22e4753be4dd8a7d262df2fedd7c1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cd7034799f014e95bbe8ed18fdc424a6 Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 could not be found. Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1b7ba1c8-0f5a-4f84-9378-d4ab844795e0'} Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 could not be found. Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 could not be found. Jul 01 10:36:02.907457 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 could not be found. Jul 01 10:36:02.911333 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:02.915204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Returning 404 to user: Instance 1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:02.918984 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f23c0ff8-2704-473c-903b-3a2b73c269bf tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0" status: 404 len: 111 microversion: 2.25 time: 0.068081 Jul 01 10:36:02.920079 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1174/2340] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/servers/1b7ba1c8-0f5a-4f84-9378-d4ab844795e0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:36:02.934633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c072fa9-fdf1-456b-af86-351672935f48 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91c0ba60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:03.072710 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c072fa9-fdf1-456b-af86-351672935f48 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?server=2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 956 microversion: 2.1 time: 0.151305 Jul 01 10:36:03.073308 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1175/2341] 10.222.0.23 () {58 vars in 1208 bytes} [Fri Jul 1 10:36:02 2022] GET /compute/v2.1/images?server=2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 956 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:03.079027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:03.079870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:03.093031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.093522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.094387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.095018 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.129389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:36:03.154056 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:03.162352 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-16042be5-fb0d-4823-bd53-65a162849421 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.305194 Jul 01 10:36:03.166696 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1167/2342] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:02 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:03.172103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:03.177851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:03.193587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.194521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.195612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.196202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.216207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300/os-volume_attachments HTTP/1.1 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': '4e04ea24-b9fd-4851-bc55-68c32ab78300'} Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:03.227357 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:36:03.231446 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:03.233427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:03.234460 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-85865942-5bbb-4ef1-aa3d-a55601e7c2ef tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.069818 Jul 01 10:36:03.236437 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1168/2343] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:36:03 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300/os-volume_attachments => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:36:03.256469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa970de4-ee20-4794-ad94-3493cf9dfa68 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97018af0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:03.356295 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa970de4-ee20-4794-ad94-3493cf9dfa68 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 484 microversion: 2.1 time: 0.118525 Jul 01 10:36:03.356867 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1169/2344] 10.222.0.23 () {58 vars in 1316 bytes} [Fri Jul 1 10:36:03 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 484 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:03.369046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:03.373655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:03.377876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.378843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.379962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.381506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.519937 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1acb1671-9db1-40fe-b2ae-91c891517002 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 204 len: 0 microversion: 2.25 time: 0.445114 Jul 01 10:36:03.525594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1176/2345] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:36:03 2022] DELETE /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:36:03.533273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-497b4183-638e-43bf-88b0-3915e9830628 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96efc430>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:03.607443 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-497b4183-638e-43bf-88b0-3915e9830628 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 484 microversion: 2.1 time: 0.080004 Jul 01 10:36:03.608231 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1177/2346] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Jul 1 10:36:03 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 484 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:03.618692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:03.619622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:03.626385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.629797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.631585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:03.633747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:03.888419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:03.903087 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-189f397a-d100-4ed9-8a24-050b63ff9ac6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1667 microversion: 2.1 time: 0.535654 Jul 01 10:36:03.903087 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1170/2347] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:03 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1667 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:03.905810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1797439480", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ce42240f-1f36-4657-993c-cfa415e6f19d"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:04.012378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] validate_networks() for [('ce42240f-1f36-4657-993c-cfa415e6f19d', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:36:04.150666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:04.169708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:04.177805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:04.183269 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-417189f6-a011-40ca-9a06-b1e36bac0c43 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1564 microversion: 2.25 time: 0.573528 Jul 01 10:36:04.188113 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1178/2348] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:03 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1564 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:04.198115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:04.199055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:04.207391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:04.208151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:04.209859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:04.210487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.039692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:05.056486 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-84b7ff8d-a309-4a5b-9960-5c36e9ee5587 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.862726 Jul 01 10:36:05.059855 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1179/2349] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:04 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:05.074918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07ae46a0-38b1-43a2-8703-0bf9d9c6fc12 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f911dda60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:05.312427 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07ae46a0-38b1-43a2-8703-0bf9d9c6fc12 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.250161 Jul 01 10:36:05.321189 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1180/2350] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:36:05 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:05.329611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3bbf2b21-a8e2-4bf4-95af-1586cd92c0db req-783a87e1-a1d3-4ab4-850b-05d610a1db1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba55d6c-e17b-4175-832b-048bfa530c81", "name": "network-vif-unplugged", "status": "completed", "tag": "c2e325b6-bdbf-4cd7-b5af-f6a08f267996"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:05.343314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3bbf2b21-a8e2-4bf4-95af-1586cd92c0db req-783a87e1-a1d3-4ab4-850b-05d610a1db1a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.343768 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3bbf2b21-a8e2-4bf4-95af-1586cd92c0db req-783a87e1-a1d3-4ab4-850b-05d610a1db1a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.355907 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3bbf2b21-a8e2-4bf4-95af-1586cd92c0db req-783a87e1-a1d3-4ab4-850b-05d610a1db1a service nova] Creating event network-vif-unplugged:c2e325b6-bdbf-4cd7-b5af-f6a08f267996 for instance 2ba55d6c-e17b-4175-832b-048bfa530c81 on n-h2-master-1 Jul 01 10:36:05.366097 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3bbf2b21-a8e2-4bf4-95af-1586cd92c0db req-783a87e1-a1d3-4ab4-850b-05d610a1db1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051400 Jul 01 10:36:05.366733 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1181/2351] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:05.372877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-8b3c6930-9f4f-416b-b0ec-57ceb0c7123c req-3119dca6-dfb6-47de-8cb7-b4d7e1cff929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a79111-091f-4906-8420-10b798ad5511", "tag": "20f19590-4ff3-4bb9-a899-4b12bd1e8237"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:05.384809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8b3c6930-9f4f-416b-b0ec-57ceb0c7123c req-3119dca6-dfb6-47de-8cb7-b4d7e1cff929 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.385294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8b3c6930-9f4f-416b-b0ec-57ceb0c7123c req-3119dca6-dfb6-47de-8cb7-b4d7e1cff929 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.397661 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-8b3c6930-9f4f-416b-b0ec-57ceb0c7123c req-3119dca6-dfb6-47de-8cb7-b4d7e1cff929 service nova] Creating event network-changed:20f19590-4ff3-4bb9-a899-4b12bd1e8237 for instance 21a79111-091f-4906-8420-10b798ad5511 on n-h1-master-1 Jul 01 10:36:05.403365 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-8b3c6930-9f4f-416b-b0ec-57ceb0c7123c req-3119dca6-dfb6-47de-8cb7-b4d7e1cff929 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034897 Jul 01 10:36:05.404476 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1182/2352] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:05.416523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:05.416523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:05.422261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.423061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.424351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.425023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.485572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:36:05.485572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:36:05.485572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:36:05.485572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:36:05.485572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:36:05.497223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.500936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.502017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.503191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.544342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:05.556507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for user cc8012fcb48840f1b778ab759457e66c and project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:05.621538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:36:05.624102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d50de6c5-56b4-4ae5-863f-26679db7901e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:36:05.792269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:05.805607 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bdc6594f-9c05-4b45-8194-9bdf4c70aa8e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.903173 Jul 01 10:36:05.806290 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1171/2353] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:36:05.818636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b582868d-b145-46bc-a2a8-b5e7a60242f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1667 microversion: 2.1 time: 0.412658 Jul 01 10:36:05.821494 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1183/2354] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:05 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1667 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:05.826555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e001cee4-11a5-42c1-a6bc-b75f869dd220 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91ab3f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:05.832930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:05.833615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:05.871541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.874617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.875676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:05.883102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:05.945472 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e001cee4-11a5-42c1-a6bc-b75f869dd220 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.122497 Jul 01 10:36:05.948534 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1184/2355] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:36:05 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:05.958188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4bead289-048d-475c-8441-4b7b34f1804b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:05.959644 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4bead289-048d-475c-8441-4b7b34f1804b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d50de6c5-56b4-4ae5-863f-26679db7901e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:06.390179 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:06.438449 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:06.520609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4bead289-048d-475c-8441-4b7b34f1804b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:06.540551 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4bead289-048d-475c-8441-4b7b34f1804b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e" status: 200 len: 1215 microversion: 2.1 time: 0.591640 Jul 01 10:36:06.551154 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1185/2356] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:05 2022] GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e => generated 1215 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:06.551154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-43c2d4c6-4ea4-42a1-adcc-bf28be28167a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f09160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:06.648286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-43c2d4c6-4ea4-42a1-adcc-bf28be28167a tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.105560 Jul 01 10:36:06.657213 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1186/2357] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:36:06 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:06.664284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:06.664284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:06.670556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:06.671017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:06.671814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:06.672261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:06.672612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:06.685077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:06.686914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:06.688287 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23f7e81f-bf49-4e26-8a83-db17b5b882b6 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1564 microversion: 2.25 time: 0.875751 Jul 01 10:36:06.689075 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1172/2358] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:05 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1564 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:06.803746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1062815483", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:06.892183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:06.896703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] validate_networks() for [('c74dedf9-7399-4056-a3b0-fd927e80434d', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:36:06.903189 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-88c75963-ca2f-4b14-bb6a-bd3e1525474a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.244792 Jul 01 10:36:06.923392 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1187/2359] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:06 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:06.924930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47a19203-2762-4948-bf06-6225a716664c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:06.925538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47a19203-2762-4948-bf06-6225a716664c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d50de6c5-56b4-4ae5-863f-26679db7901e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:06.949569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47a19203-2762-4948-bf06-6225a716664c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d50de6c5-56b4-4ae5-863f-26679db7901e] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:36:07.690849 n-d-master-1 devstack@n-api.service[119765]: INFO nova.scheduler.client.report [None req-47a19203-2762-4948-bf06-6225a716664c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Deleted allocations for instance d50de6c5-56b4-4ae5-863f-26679db7901e Jul 01 10:36:07.728357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:36:07.728865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:36:07.729472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:36:07.729945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:36:07.730420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:36:07.741913 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:07.745232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:07.747326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:07.749885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:07.776600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Getting quotas for project 989e652e691c49a09855f4d97afd5df1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:07.789001 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47a19203-2762-4948-bf06-6225a716664c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e" status: 204 len: 0 microversion: 2.1 time: 0.877451 Jul 01 10:36:07.790019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Getting quotas for user 98112fef9f2940848a3ca13bcc63049b and project 989e652e691c49a09855f4d97afd5df1. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:07.790639 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1188/2360] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:36:06 2022] DELETE /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e => generated 0 bytes in 879 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:07.821667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:36:07.832746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:36:07.908876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2aa427a4-59ef-482f-b901-75f8d3286ecd req-57431c4e-9ce6-414b-97b6-9c8a96edd8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5569f4-0626-402c-a3c4-ed62cb8af25c", "name": "network-vif-deleted", "tag": "dfca3548-598e-4e5d-abba-a6283102320c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:07.928988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2aa427a4-59ef-482f-b901-75f8d3286ecd req-57431c4e-9ce6-414b-97b6-9c8a96edd8ed service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:07.930756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2aa427a4-59ef-482f-b901-75f8d3286ecd req-57431c4e-9ce6-414b-97b6-9c8a96edd8ed service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:07.956239 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2aa427a4-59ef-482f-b901-75f8d3286ecd req-57431c4e-9ce6-414b-97b6-9c8a96edd8ed service nova] Creating event network-vif-deleted:dfca3548-598e-4e5d-abba-a6283102320c for instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c on n-h1-master-1 Jul 01 10:36:07.964791 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2aa427a4-59ef-482f-b901-75f8d3286ecd req-57431c4e-9ce6-414b-97b6-9c8a96edd8ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172359 Jul 01 10:36:07.966432 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1189/2361] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:07.972894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df7bcedf-0521-4d07-8ba4-81dbf560d776 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97105280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:07.986569 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a8e8720-261a-4526-8149-e20299fd9013 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.296034 Jul 01 10:36:07.989062 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1173/2362] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:36:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:36:08.013023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:08.013776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:08.030178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.030762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.031716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.032165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.222847 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-df7bcedf-0521-4d07-8ba4-81dbf560d776 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-07-01T10%3A33%3A43Z" status: 200 len: 6333 microversion: 2.1 time: 0.254601 Jul 01 10:36:08.223532 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1190/2363] 10.222.0.23 () {58 vars in 1219 bytes} [Fri Jul 1 10:36:07 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-01T10%3A33%3A43Z => generated 6333 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:08.229241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:08.230418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:08.244392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.245187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.246671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.247125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.293229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.293690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.294302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lazy-loading 'fault' on Instance uuid 4d5569f4-0626-402c-a3c4-ed62cb8af25c {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:36:08.388587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:08.403515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:08.405311 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7034799f014e95bbe8ed18fdc424a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c22e4753be4dd8a7d262df2fedd7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:08.406671 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2adb223-cf61-4d24-b999-91136fe5f7b7 tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 200 len: 1351 microversion: 2.25 time: 0.181800 Jul 01 10:36:08.407735 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1191/2364] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:08 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 1351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:08.414932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:08.415558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d50de6c5-56b4-4ae5-863f-26679db7901e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:08.428327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.428780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.435759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.435759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.484878 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e HTTP/1.1 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: exception: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'd50de6c5-56b4-4ae5-863f-26679db7901e'} Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:08.487495 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:08.492120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:08.492120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:08.492120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:08.492120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:08.492120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:08.492120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:36:08.492120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:08.495619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:08.502771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cc6e03f1-0bdf-4b85-8ffa-9f2d8ad9d6e6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e" status: 404 len: 111 microversion: 2.1 time: 0.088968 Jul 01 10:36:08.503704 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1192/2365] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:08 2022] GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:36:08.514142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:08.514789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:08.526164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.532282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.534520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.536397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:08.693626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:08.703327 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be29b78a-107d-4c9c-93a8-392991ee5688 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.705764 Jul 01 10:36:08.704659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1174/2366] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:07 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:08.712084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-987dbe31-734d-4fa2-973d-7334900d8f81 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:08.713029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-987dbe31-734d-4fa2-973d-7334900d8f81 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:08.804058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-987dbe31-734d-4fa2-973d-7334900d8f81 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:08.815916 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-987dbe31-734d-4fa2-973d-7334900d8f81 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1223 microversion: 2.1 time: 0.109267 Jul 01 10:36:08.818289 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1175/2367] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:08 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:08.835151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01a8fad2-ea74-401a-ac45-9bb72a0975a9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97082d30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:08.908245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:08.921869 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51bf68f4-a13a-4bc3-9ffb-9c800197e72b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.416668 Jul 01 10:36:08.922701 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1193/2368] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:08 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:08.929544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-978985145", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ce42240f-1f36-4657-993c-cfa415e6f19d"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:08.969597 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01a8fad2-ea74-401a-ac45-9bb72a0975a9 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1468342496" status: 200 len: 665 microversion: 2.1 time: 0.150056 Jul 01 10:36:08.970377 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1176/2369] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Jul 1 10:36:08 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1468342496 => generated 665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:08.989211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:08.990308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:08.998871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:08.999659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.000649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:09.001584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.028968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] validate_networks() for [('ce42240f-1f36-4657-993c-cfa415e6f19d', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:36:09.319278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:09.331832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b944d13-3f9d-4e8a-912a-48c7c5b38eea tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.359597 Jul 01 10:36:09.334039 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1177/2370] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:08 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:09.354685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-077d518f-025d-4488-a9e5-69635db56f89 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f970181f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:09.452661 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-077d518f-025d-4488-a9e5-69635db56f89 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1466 microversion: 2.1 time: 0.115347 Jul 01 10:36:09.452661 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1178/2371] 10.222.0.23 () {58 vars in 1337 bytes} [Fri Jul 1 10:36:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1466 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:09.472986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:09.473827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:09.482234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:09.482683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.483457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:09.484048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.735101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:36:09.735503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:36:09.735980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:36:09.736421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:36:09.736799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:36:09.746653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:09.747104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.748093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:09.748535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.765814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:09.771425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for user cc8012fcb48840f1b778ab759457e66c and project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:09.775939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Unlocking {{(pid=119764) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 01 10:36:09.785710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:36:09.788573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:36:09.932521 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d132aa7-5ab6-4aac-8586-3f94444d4d5e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008301 Jul 01 10:36:09.934495 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1194/2372] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:36:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:36:09.940506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:09.941451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] [instance: 4d5569f4-0626-402c-a3c4-ed62cb8af25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:09.959082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:09.960057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.963917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:09.964580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:09.999915 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87505793-a9fd-4ad7-b250-20b471155562 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.546936 Jul 01 10:36:10.000524 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1179/2373] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:09 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:10.006272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-203d0b2e-2721-43a4-98e8-c7a35a5eb10e tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9484a820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.022810 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] HTTP exception thrown: Instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c could not be found. Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Request method failure captured: Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c HTTP/1.1 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivsxQWZMioDH35YUWt_zW1cgAwhpfbogmairFdHzUZZcaQoexYROJrbGYaflFCQKeLVLLF6JLpxOcPLaxGdf6FueBXxxtYUsg-tCK0tZRmglhNWSndcTTb6aVVRY3D2zhwSo53Sn7Z64hrqpwkrB5wgyQtM4t4RJzUjqW4H5E2XL2cSI Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.25 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1c22e4753be4dd8a7d262df2fedd7c1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c22e4753be4dd8a7d262df2fedd7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c1c22e4753be4dd8a7d262df2fedd7c1 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cd7034799f014e95bbe8ed18fdc424a6 Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1704266445-project Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c could not be found. Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '4d5569f4-0626-402c-a3c4-ed62cb8af25c'} Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c could not be found. Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c could not be found. Jul 01 10:36:10.030389 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c could not be found. Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:10.034315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] Returning 404 to user: Instance 4d5569f4-0626-402c-a3c4-ed62cb8af25c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:10.039902 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-172045e9-56dd-425c-9562-0a76e6b665bb tempest-LiveAutoBlockMigrationV225Test-1704266445 tempest-LiveAutoBlockMigrationV225Test-1704266445-project] 10.222.0.23 "GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c" status: 404 len: 111 microversion: 2.25 time: 0.103985 Jul 01 10:36:10.040499 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1195/2374] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:09 2022] GET /compute/v2.1/servers/4d5569f4-0626-402c-a3c4-ed62cb8af25c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:36:10.063394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.074536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:10.087608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.092567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.093873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.094509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.129089 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-203d0b2e-2721-43a4-98e8-c7a35a5eb10e tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1466 microversion: 2.1 time: 0.126836 Jul 01 10:36:10.131649 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1180/2375] 10.222.0.23 () {58 vars in 1323 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1466 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:10.158519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.164953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:10.189665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.190624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.195885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.201576 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.233323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:10.268836 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5a910ca-a84d-4e34-8bdf-da7c242cc465 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1219 microversion: 2.1 time: 0.226874 Jul 01 10:36:10.269467 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1196/2376] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:10.288522 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fac6d335-e260-4e87-9449-323e882e69cb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.315466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fac6d335-e260-4e87-9449-323e882e69cb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:10.426539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fac6d335-e260-4e87-9449-323e882e69cb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:10.447347 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fac6d335-e260-4e87-9449-323e882e69cb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1214 microversion: 2.1 time: 0.172745 Jul 01 10:36:10.448922 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1197/2377] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:10.465905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.466994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:10.486180 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.487193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.488963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.490807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.508891 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:10.519260 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5eef6f9e-d90e-4446-933f-c4fcab12f14a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.384727 Jul 01 10:36:10.520657 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1181/2378] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:10.533038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f4691ce-38c7-4163-b06b-af00e24f7521 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Action: 'create', calling method: .version_select at 0x7f6f9253c550>, body: {"keypair": {"name": "tempest-keypair-334252367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQLxWIGN6XfAWUdtCnhg7OZcypjQu2EaJQCYu6OQReDhvOis1o8Bfn93NZKZpiT8fBeqVbf3it92+WRZXwkl8h8+XOejFqHekwK5k8KJ24XF78J4EQrZvSUuJ0o6sKXEw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:10.549275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-4f4691ce-38c7-4163-b06b-af00e24f7521 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Getting quotas for project d1fcaf85c309407abc034a0c937fb49e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:10.557743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-4f4691ce-38c7-4163-b06b-af00e24f7521 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Getting quotas for user 9b9e074fc3d5413eb57dbff4066ba93b and project d1fcaf85c309407abc034a0c937fb49e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:10.696098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:10.704423 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f4691ce-38c7-4163-b06b-af00e24f7521 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.181749 Jul 01 10:36:10.705549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1182/2379] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:36:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:36:10.712262 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3dcd769e-b793-431f-8417-e5cf24d5e4a0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.256174 Jul 01 10:36:10.712262 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1198/2380] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:10.716368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c0731fe-c252-4e59-ab26-adfcc419f1e0 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91170310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.726749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.727832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:10.734856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.735663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.736997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:10.737713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:10.890013 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c0731fe-c252-4e59-ab26-adfcc419f1e0 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.178674 Jul 01 10:36:10.903284 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1199/2381] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:10.911053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dd74c90f-0041-4c51-bca9-bb0204b9268f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f96f32ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:10.975676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:10.990054 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-67e90cc8-c02a-4054-9864-c9deb4935af2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.268664 Jul 01 10:36:10.996630 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1183/2382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:11.006887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:11.009070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:11.016841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.017661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:11.018647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.019379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:11.046724 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dd74c90f-0041-4c51-bca9-bb0204b9268f tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.140336 Jul 01 10:36:11.054974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1200/2383] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Jul 1 10:36:10 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:11.068105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-908eccd8-60bf-424c-964e-940e984e94c1 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9142eca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:11.120252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-908eccd8-60bf-424c-964e-940e984e94c1 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/f784d1ed-9670-424c-abfe-e98e973ecb0e" status: 200 len: 784 microversion: 2.1 time: 0.055672 Jul 01 10:36:11.121323 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1201/2384] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:36:11 2022] GET /compute/v2.1/images/f784d1ed-9670-424c-abfe-e98e973ecb0e => generated 784 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:36:11.137427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b538aaf9-4850-4888-9782-4ab7d37e8583 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f914fa160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:11.196074 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b538aaf9-4850-4888-9782-4ab7d37e8583 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.062986 Jul 01 10:36:11.210467 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1202/2385] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:36:11 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:11.220962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b6bc4ee-fc3f-4eca-9897-4964e97e5dce tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f97105d30>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:11.313907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:11.320604 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:11.331273 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af5d4fbf-87f5-4ee1-892e-53b738982728 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.324950 Jul 01 10:36:11.331273 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1184/2386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:11 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:11.339137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:11.339788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:11.356408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.357244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:11.358062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.358510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:11.539483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:11.565936 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab8d7474-74e2-4fdb-b52c-2dc99e7bb474 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1293 microversion: 2.1 time: 0.232553 Jul 01 10:36:11.566590 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1185/2387] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:11 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1293 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:11.595572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a474f501-e516-4f13-8972-1865cf2db9e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:11.598530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a474f501-e516-4f13-8972-1865cf2db9e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:11.616871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a474f501-e516-4f13-8972-1865cf2db9e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.618630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a474f501-e516-4f13-8972-1865cf2db9e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:11.620088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a474f501-e516-4f13-8972-1865cf2db9e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.620839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a474f501-e516-4f13-8972-1865cf2db9e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:11.918278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a474f501-e516-4f13-8972-1865cf2db9e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.348064 Jul 01 10:36:11.923935 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1186/2388] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:11 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:11.934359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:11.935115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:11.944903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.945385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:11.946814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:11.947442 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:12.019508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:12.035234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a90a342-e60a-4c3f-a364-bebc8faa44f6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1210 microversion: 2.1 time: 0.107608 Jul 01 10:36:12.036794 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1187/2389] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:11 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:12.050858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:12.052559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:12.071850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:12.071850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:12.074747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:12.075195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:12.331547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:12.352678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2452c90-0bc1-473e-9761-8645bba90303 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.314546 Jul 01 10:36:12.354743 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1188/2390] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:12 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:12.371540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:12.372630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:12.380224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:12.380983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:12.382010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:12.382548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:12.683350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:12.691769 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c0ed187e-70bf-4fd2-a401-1ac637bf54fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1676 microversion: 2.1 time: 0.335539 Jul 01 10:36:12.692384 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1189/2391] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:12 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1676 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:12.712809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:12.715969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:12.727794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:12.728913 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:12.729969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:12.730520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:13.037158 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b6bc4ee-fc3f-4eca-9897-4964e97e5dce tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0" status: 204 len: 0 microversion: 2.1 time: 1.825353 Jul 01 10:36:13.037158 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1203/2392] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:11 2022] DELETE /compute/v2.1/images/8c91177c-42c6-413c-85bf-5a36614267a0 => generated 0 bytes in 1827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:13.050317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-dbf0dd33-806e-49f1-aa4c-bfb26ac8b685 req-9c1e1541-55c7-40db-840e-fb7bb4d5c143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a79111-091f-4906-8420-10b798ad5511", "name": "network-vif-plugged", "status": "completed", "tag": "20f19590-4ff3-4bb9-a899-4b12bd1e8237"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:13.072256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dbf0dd33-806e-49f1-aa4c-bfb26ac8b685 req-9c1e1541-55c7-40db-840e-fb7bb4d5c143 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:13.073893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dbf0dd33-806e-49f1-aa4c-bfb26ac8b685 req-9c1e1541-55c7-40db-840e-fb7bb4d5c143 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:13.091834 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-dbf0dd33-806e-49f1-aa4c-bfb26ac8b685 req-9c1e1541-55c7-40db-840e-fb7bb4d5c143 service nova] Creating event network-vif-plugged:20f19590-4ff3-4bb9-a899-4b12bd1e8237 for instance 21a79111-091f-4906-8420-10b798ad5511 on n-h1-master-1 Jul 01 10:36:13.096966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:13.100428 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-dbf0dd33-806e-49f1-aa4c-bfb26ac8b685 req-9c1e1541-55c7-40db-840e-fb7bb4d5c143 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057790 Jul 01 10:36:13.105709 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1204/2393] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:13.106884 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4bfab348-316d-4e05-8200-6000d89d642b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1323 microversion: 2.1 time: 0.408561 Jul 01 10:36:13.109284 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1190/2394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:12 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:13.115168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:13.125684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:13.128487 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b1def7c7-5928-4946-afe3-e824eb53d5f5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f9145a820>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:13.143236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:13.143702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:13.144586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:13.145022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:13.327454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:13.337377 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-de03ffe0-b423-408c-a7ce-9778ac002f66 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1284 microversion: 2.1 time: 0.226550 Jul 01 10:36:13.338297 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1191/2395] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:13 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:13.371466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:13.372434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:13.379114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:13.379568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:13.380857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:13.381333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:13.918394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:13.948675 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3a21286-2a61-44de-b709-9f6ae32b5c05 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.582079 Jul 01 10:36:13.952034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1192/2396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:13 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:13.966037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:13.966910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:13.973660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:13.974938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:13.975893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:13.976490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.356580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:14.375460 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-54038ad0-d1de-43de-b90d-9544a9a850f2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1656 microversion: 2.1 time: 0.420908 Jul 01 10:36:14.377174 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1193/2397] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:13 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1656 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:14.383658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:14.384596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:14.394572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.396142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.398514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.399466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.548500 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b1def7c7-5928-4946-afe3-e824eb53d5f5 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927" status: 204 len: 0 microversion: 2.1 time: 1.440566 Jul 01 10:36:14.561119 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1205/2398] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:13 2022] DELETE /compute/v2.1/images/af5ea508-d7b7-416e-a09e-8a30ec36a927 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:14.566716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:14.568253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:14.578235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.578845 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.579916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.580594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.692952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:14.702495 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35e70c13-00cb-45d7-bfc9-92e8aae45691 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1272 microversion: 2.1 time: 0.144274 Jul 01 10:36:14.703268 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1206/2399] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:14 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:14.708984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-64672cab-ca77-40cf-8e3a-bf033604e9fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:14.709824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64672cab-ca77-40cf-8e3a-bf033604e9fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:14.716411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64672cab-ca77-40cf-8e3a-bf033604e9fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.718016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64672cab-ca77-40cf-8e3a-bf033604e9fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.718016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64672cab-ca77-40cf-8e3a-bf033604e9fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.718202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64672cab-ca77-40cf-8e3a-bf033604e9fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.746208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:14.759576 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d408b7d-0673-479d-bcdf-918d59d6f1f2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1323 microversion: 2.1 time: 0.380624 Jul 01 10:36:14.761575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1194/2400] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:14 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:14.774066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d995d7e0-df8a-4355-a286-82b06c7e6bce tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f91e1ef70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:14.924587 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-64672cab-ca77-40cf-8e3a-bf033604e9fc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.219894 Jul 01 10:36:14.926187 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1207/2401] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:14 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:14.947523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:14.950396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:14.968362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.970708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:14.975681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:14.976761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:15.240929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:15.253401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b11a0c2d-5d1d-4ea2-a228-a6bc665bed92 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1663 microversion: 2.1 time: 0.322152 Jul 01 10:36:15.256824 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1208/2402] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:14 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1663 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:15.267241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:15.267862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:15.277939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:15.278618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:15.279602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:15.280227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:15.356393 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:15.678515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:15.688015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6f81a76-68a4-40f4-9a4d-4dfa031ec95b tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1322 microversion: 2.1 time: 0.429780 Jul 01 10:36:15.712421 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1209/2403] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:15 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:15.712421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-cfe623b8-0047-4155-827f-fbc46419d31e req-9bbd6b95-cea2-455d-be49-bb05c1c41e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f644d5-098c-4811-9a18-10b650654a68", "tag": "95362d8a-e8af-4793-9cd3-f74c8e43658e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:15.723465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cfe623b8-0047-4155-827f-fbc46419d31e req-9bbd6b95-cea2-455d-be49-bb05c1c41e49 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:15.724686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cfe623b8-0047-4155-827f-fbc46419d31e req-9bbd6b95-cea2-455d-be49-bb05c1c41e49 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:15.738866 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-cfe623b8-0047-4155-827f-fbc46419d31e req-9bbd6b95-cea2-455d-be49-bb05c1c41e49 service nova] Creating event network-changed:95362d8a-e8af-4793-9cd3-f74c8e43658e for instance a1f644d5-098c-4811-9a18-10b650654a68 on n-h2-master-1 Jul 01 10:36:15.745733 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-cfe623b8-0047-4155-827f-fbc46419d31e req-9bbd6b95-cea2-455d-be49-bb05c1c41e49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041438 Jul 01 10:36:15.747525 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1210/2404] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:15.766433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:15.767248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:15.783130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:15.783887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:15.785164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:15.801627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:16.120670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:16.131070 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-29f4ad98-b7e0-4be8-9faa-bc87fa11c376 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1314 microversion: 2.1 time: 0.381493 Jul 01 10:36:16.146032 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1211/2405] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:15 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:16.154964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:16.155626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:16.173621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:16.174082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:16.176071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:16.177265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:16.483557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:16.487503 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-05824eda-49a1-4ecb-86a3-b9831a60a02c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1323 microversion: 2.1 time: 0.342231 Jul 01 10:36:16.488089 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1212/2406] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:16 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:16.501484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-301297686", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b5da4d01-0386-4d37-9605-bbec09a7abec"}, {"port": "85806425-2835-431f-a010-e9e78b034c83", "tag": "port-1"}, {"port": "d278eadc-ca53-49cb-8272-d4d973d93099", "tag": "port-2"}, {"uuid": "dcfad9bc-0e09-40ca-a9df-408e3acd4ea5", "tag": "net-1"}, {"uuid": "dcfad9bc-0e09-40ca-a9df-408e3acd4ea5"}, {"uuid": "2674e3f9-86ac-463b-944e-9d04088ca496", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2674e3f9-86ac-463b-944e-9d04088ca496", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3e29c504-2333-4c8d-b2f8-8d45497c8873", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "384526c2-ff4c-41e4-9bf7-0f1a28f9998c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2606ccc4-729c-4ba1-a949-03fadfb8571d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1504264660"}], "key_name": "tempest-keypair-334252367", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:16.508354 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d995d7e0-df8a-4355-a286-82b06c7e6bce tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7" status: 204 len: 0 microversion: 2.1 time: 1.745181 Jul 01 10:36:16.514566 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1195/2407] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:14 2022] DELETE /compute/v2.1/images/2e42e58b-6e1f-4023-ac44-ee0f3075c6e7 => generated 0 bytes in 1747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:16.514870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:16.515295 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:16.522934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:16.523616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:16.524582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:16.525375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:16.734197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] validate_networks() for [('b5da4d01-0386-4d37-9605-bbec09a7abec', None, None, None, None, None), (None, None, '85806425-2835-431f-a010-e9e78b034c83', None, None, None), (None, None, 'd278eadc-ca53-49cb-8272-d4d973d93099', None, None, None), ('dcfad9bc-0e09-40ca-a9df-408e3acd4ea5', None, None, None, None, None), ('dcfad9bc-0e09-40ca-a9df-408e3acd4ea5', None, None, None, None, None), ('2674e3f9-86ac-463b-944e-9d04088ca496', '10.2.2.100', None, None, None, None), ('2674e3f9-86ac-463b-944e-9d04088ca496', '10.2.2.200', None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:36:16.815367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:16.825828 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17bdbd71-7596-4b88-ac25-302838c4ea06 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.315404 Jul 01 10:36:16.826596 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1196/2408] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:16 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:16.831319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:16.833658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:16.840930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:16.841601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:16.843042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:16.843702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:16.875673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:36:17.086721 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:17.161853 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e144289-1b2d-4e48-8290-a261a6679504 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 204 len: 0 microversion: 2.1 time: 0.333794 Jul 01 10:36:17.165981 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1197/2409] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:36:16 2022] DELETE /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:17.171830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:17.172619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:17.179138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:17.179716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:17.180603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:17.181193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:17.539325 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:17.547306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4bfd7915-9705-42f6-9950-b7ab7ae357e5 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1471 microversion: 2.1 time: 0.379990 Jul 01 10:36:17.547971 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1198/2410] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:17 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:17.552919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:17.553616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:17.560382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:17.560931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:17.561888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:17.562327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:17.763891 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:17.865473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:17.868993 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:17.873504 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-246c95f0-b770-42a1-82e4-626d6ae31f24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.324172 Jul 01 10:36:17.874076 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1199/2411] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:17 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:17.890448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:17.891067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:17.898078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:17.898526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:17.899292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:17.899726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:18.529815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:18.539022 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b2ce4dd-f083-4dde-900d-54a4c9e89e01 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1314 microversion: 2.1 time: 0.651957 Jul 01 10:36:18.540075 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1200/2412] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:17 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:18.545622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e96f85f6-aa89-4db3-bc9e-74e02a598262 req-81786c4a-a428-4b86-8ba6-0d0eddc5a16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e846ba7-bb0b-4f03-92d9-7084538531c5", "tag": "ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:18.555450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e96f85f6-aa89-4db3-bc9e-74e02a598262 req-81786c4a-a428-4b86-8ba6-0d0eddc5a16d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:18.555890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e96f85f6-aa89-4db3-bc9e-74e02a598262 req-81786c4a-a428-4b86-8ba6-0d0eddc5a16d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:18.567041 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e96f85f6-aa89-4db3-bc9e-74e02a598262 req-81786c4a-a428-4b86-8ba6-0d0eddc5a16d service nova] Creating event network-changed:ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3 for instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 on n-h2-master-1 Jul 01 10:36:18.572823 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e96f85f6-aa89-4db3-bc9e-74e02a598262 req-81786c4a-a428-4b86-8ba6-0d0eddc5a16d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031325 Jul 01 10:36:18.573454 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1201/2413] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:18.578342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:18.579100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:18.585718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:18.586162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:18.586924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:18.587354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:18.957057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:18.965433 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-702b05f0-f6c7-4d54-a263-e0f4387d6857 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 200 len: 1474 microversion: 2.1 time: 0.390800 Jul 01 10:36:18.966456 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1202/2414] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:18 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 1474 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:18.971369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:18.972062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:18.978582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:18.979251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:18.980088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:18.980587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:19.504581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:19.521495 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-143aba64-f8b6-472d-bf04-eebd0c2c9c10 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1323 microversion: 2.1 time: 0.553107 Jul 01 10:36:19.522092 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1203/2415] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:18 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:19.623322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed43805-57e6-441a-b791-1f49fc6150b0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:19.624150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ed43805-57e6-441a-b791-1f49fc6150b0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] [instance: 290705f7-fc31-4753-9b93-51a70ede45bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:19.631767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-2ed43805-57e6-441a-b791-1f49fc6150b0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] HTTP exception thrown: Instance 290705f7-fc31-4753-9b93-51a70ede45bf could not be found. Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed43805-57e6-441a-b791-1f49fc6150b0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Request method failure captured: Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/290705f7-fc31-4753-9b93-51a70ede45bf/action HTTP/1.1 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 15 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs4K6CZpQJqIGAC460Q2p89wMHU8Thm6KH8arzs6xdPpuIDqMnpUE2kQVAJ34fOOiOJ2D1OvqtTsts0A3vbRUaBza_nZpzKukQgehXQujze-9WuWT70tCeFqCE0MoJZz5lazqnltSI2j_CPdDek_xOPAFqFUtnAZSM2m9L0SCJ5R6BQ Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52a9c74d6bcd43c5aeb3f7c1f6cd75d7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 3ef4a32bbcb545599abd69443c1bd2d1 Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: {"migrate": {}} Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 290705f7-fc31-4753-9b93-51a70ede45bf could not be found. Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '290705f7-fc31-4753-9b93-51a70ede45bf', 'body': {'migrate': {}}} Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290705f7-fc31-4753-9b93-51a70ede45bf could not be found. Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290705f7-fc31-4753-9b93-51a70ede45bf could not be found. Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:19.634262 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290705f7-fc31-4753-9b93-51a70ede45bf could not be found. Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed43805-57e6-441a-b791-1f49fc6150b0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Returning 404 to user: Instance 290705f7-fc31-4753-9b93-51a70ede45bf could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:19.644097 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ed43805-57e6-441a-b791-1f49fc6150b0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/290705f7-fc31-4753-9b93-51a70ede45bf/action" status: 404 len: 111 microversion: 2.1 time: 0.112769 Jul 01 10:36:19.664205 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1204/2416] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:19 2022] POST /compute/v2.1/servers/290705f7-fc31-4753-9b93-51a70ede45bf/action => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:36:19.671421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:19.672295 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:19.683345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:19.683955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:19.694543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:19.696283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:19.756016 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:20.180100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:20.211541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-389754af-3af7-437a-afdc-3a4a1e6bb3c5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.537464 Jul 01 10:36:20.212237 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1205/2417] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:19 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:20.227368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:20.227987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:20.239801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:20.240263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:20.241944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:20.242392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:20.435873 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:20.568147 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=22 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:20.664795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:20.673138 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e3f89306-4fd0-491a-8d65-547c0d7af62c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1314 microversion: 2.1 time: 0.459642 Jul 01 10:36:20.673998 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1206/2418] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:20 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:20.679751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d24c7ad4-ff72-4df2-baf1-a405d312bfc6 req-ffc8a8a1-7712-42c9-921c-d4aa08fe99e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8d36e5-c3e7-4311-a5ad-e1abdf184f41", "name": "network-vif-deleted", "tag": "d01e6bd9-dd9d-4cc7-817a-6f65329276f9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:20.689396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d24c7ad4-ff72-4df2-baf1-a405d312bfc6 req-ffc8a8a1-7712-42c9-921c-d4aa08fe99e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:20.690057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d24c7ad4-ff72-4df2-baf1-a405d312bfc6 req-ffc8a8a1-7712-42c9-921c-d4aa08fe99e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:20.702768 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d24c7ad4-ff72-4df2-baf1-a405d312bfc6 req-ffc8a8a1-7712-42c9-921c-d4aa08fe99e9 service nova] Creating event network-vif-deleted:d01e6bd9-dd9d-4cc7-817a-6f65329276f9 for instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 on n-h2-master-1 Jul 01 10:36:20.708934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d24c7ad4-ff72-4df2-baf1-a405d312bfc6 req-ffc8a8a1-7712-42c9-921c-d4aa08fe99e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Jul 01 10:36:20.709860 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1207/2419] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:20.715603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-624602699", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:20.769236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:36:21.597062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:36:21.597543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:36:21.598016 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:36:21.598958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:36:21.599373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:36:21.608288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:21.608737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:21.609589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:21.610028 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:21.628355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Getting quotas for project faaf7e2113fc497f887b69928eea7fe2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:21.634441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Getting quotas for user 61a6df97de4244c1babbcec634b2cc12 and project faaf7e2113fc497f887b69928eea7fe2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:21.648804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:36:21.651260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:36:21.784121 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5a9f49e-7d43-4a62-a6db-b05b1d8493e3 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072988 Jul 01 10:36:21.785134 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1208/2420] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:36:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:36:21.790622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:21.791313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:21.817922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:21.821442 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:21.822413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:21.824665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:21.845099 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] HTTP exception thrown: Instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 could not be found. Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Request method failure captured: Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 HTTP/1.1 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2HYBYv30qOFNh0-7SYED3ZV3pqhc4la5TgBnAQ91nvUfFeaYgEt1C3dh4lzZaW9ORNescAFoPP6tn-AB_3fR3hGBTvvK78_ykmZsx85WIU5CNG9Z-mdsUu8yvqXpAM-IzUhYIwFe-F3uOZsTFIWvJAj7paaQAkqquTTLEfVAuxnX4 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 31881aca19fe4da29fd3acf404dbdc1b Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ListImageFiltersTestJSON-1196055204 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31881aca19fe4da29fd3acf404dbdc1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31881aca19fe4da29fd3acf404dbdc1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31881aca19fe4da29fd3acf404dbdc1b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31881aca19fe4da29fd3acf404dbdc1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ListImageFiltersTestJSON-1196055204 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 31881aca19fe4da29fd3acf404dbdc1b Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1196055204 Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ListImageFiltersTestJSON-1196055204-project Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 8a322a37fe40476d86cf3f473752088a Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ListImageFiltersTestJSON-1196055204-project Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 could not be found. Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '7f8d36e5-c3e7-4311-a5ad-e1abdf184f41'} Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 could not be found. Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 could not be found. Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:21.847007 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:21.851836 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:21.851836 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:21.851836 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:21.851836 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:21.851836 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:21.851836 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 could not be found. Jul 01 10:36:21.851836 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:21.853432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Returning 404 to user: Instance 7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:21.855056 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51ce3b4c-f9e0-487b-80b3-e7ba3f70eafd tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41" status: 404 len: 111 microversion: 2.1 time: 0.068797 Jul 01 10:36:21.858831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1209/2421] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:21 2022] GET /compute/v2.1/servers/7f8d36e5-c3e7-4311-a5ad-e1abdf184f41 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:36:21.865093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:21.865963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:21.872465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:21.873050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:21.873946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:21.875393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.230545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:22.247510 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b4a5908-d865-477f-992b-8807f94b3005 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.387421 Jul 01 10:36:22.259189 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1210/2422] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:21 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:22.259189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1b1fa7be-ae67-46b8-a296-325b8538333b req-17a5a05e-0159-4c55-87bd-4ffbedd7022e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f644d5-098c-4811-9a18-10b650654a68", "name": "network-vif-plugged", "status": "completed", "tag": "95362d8a-e8af-4793-9cd3-f74c8e43658e"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:22.266317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1b1fa7be-ae67-46b8-a296-325b8538333b req-17a5a05e-0159-4c55-87bd-4ffbedd7022e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.266910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1b1fa7be-ae67-46b8-a296-325b8538333b req-17a5a05e-0159-4c55-87bd-4ffbedd7022e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.282396 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1b1fa7be-ae67-46b8-a296-325b8538333b req-17a5a05e-0159-4c55-87bd-4ffbedd7022e service nova] Creating event network-vif-plugged:95362d8a-e8af-4793-9cd3-f74c8e43658e for instance a1f644d5-098c-4811-9a18-10b650654a68 on n-h2-master-1 Jul 01 10:36:22.288283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1b1fa7be-ae67-46b8-a296-325b8538333b req-17a5a05e-0159-4c55-87bd-4ffbedd7022e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038060 Jul 01 10:36:22.289243 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1211/2423] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:22.294357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:22.295076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:22.302588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.303196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.303812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.304925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.504486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:36:22.505000 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:36:22.505363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:36:22.506102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:36:22.507766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:36:22.522322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.522837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.523745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.527247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.540024 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:22.546201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Getting quotas for project d1fcaf85c309407abc034a0c937fb49e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:22.552334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Getting quotas for user 9b9e074fc3d5413eb57dbff4066ba93b and project d1fcaf85c309407abc034a0c937fb49e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:22.655091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:22.670448 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50fad420-e60e-4ce0-8e39-bdff0edc1b1c tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1323 microversion: 2.1 time: 0.380155 Jul 01 10:36:22.673389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1212/2424] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:22 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1323 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:22.686256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:22.686981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:22.696876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.696876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.698245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.698359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.788536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:36:22.791743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3e29c504-2333-4c8d-b2f8-8d45497c8873',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='384526c2-ff4c-41e4-9bf7-0f1a28f9998c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2606ccc4-729c-4ba1-a949-03fadfb8571d',volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:36:22.931633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:22.940454 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0d60613-6db0-4a26-899d-5eb74dfee316 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1314 microversion: 2.1 time: 0.258748 Jul 01 10:36:22.941020 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1213/2425] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:22 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:22.945939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:22.946714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:22.954237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.954687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:22.955455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:22.955930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.029113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:23.037581 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-848c9132-7bfe-4776-999a-f75c4c58136d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1225 microversion: 2.1 time: 0.095366 Jul 01 10:36:23.038187 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1214/2426] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:22 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:23.042844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:23.043342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:23.049392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.049848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.052618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.052618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.076497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:36:23.359457 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9ab9c3c-9acf-48f9-adf3-30cd26207853 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 204 len: 0 microversion: 2.1 time: 0.319750 Jul 01 10:36:23.360607 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1215/2427] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:36:23 2022] DELETE /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:23.367591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:23.368257 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:23.378999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.379470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.380341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.381037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.541232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:23.549052 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cccfc138-d43b-46cd-abf8-939efd2dd2cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.187082 Jul 01 10:36:23.561344 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1216/2428] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:23 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:23.568444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:23.569211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:23.576157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.576680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.577611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.578252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.747385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:23.756031 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5739b50-a57c-415a-ab79-a2d361137070 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 1472 microversion: 2.1 time: 0.191750 Jul 01 10:36:23.756842 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1217/2429] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:23 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:23.762917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:23.763526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:23.769943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.770428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.771887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.772328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.910081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:23.924653 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b01c37bf-02d0-4169-9101-a760e17022f1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.166635 Jul 01 10:36:23.925594 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1218/2430] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:23 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:23.934313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:23.936595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:23.948532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.948984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.949795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:23.953686 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:23.959430 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:24.093104 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c392d80-d2c2-44ae-a8a4-af2c3969fc16 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.601696 Jul 01 10:36:24.096113 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1213/2431] 10.222.0.23 () {62 vars in 1188 bytes} [Fri Jul 1 10:36:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 7607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:36:24.107756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:24.109850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:24.117280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:24.117721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:24.118666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:24.119098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:24.342494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:24.369801 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-403ca62e-4fde-48e8-9be2-3fbfb7c3f2cc tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1323 microversion: 2.1 time: 0.439674 Jul 01 10:36:24.373535 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1219/2432] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:23 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:24.383254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:24.385034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:24.391793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:24.392253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:24.393753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:24.404929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:24.549812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:24.563589 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c4e7f5c-7eed-4771-809a-3770d8b1cd3d tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1291 microversion: 2.1 time: 0.188728 Jul 01 10:36:24.564873 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1220/2433] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:24 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1291 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:24.569742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e6d300ff-460d-4977-b18f-7c5c7ce5192c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:24.571140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e6d300ff-460d-4977-b18f-7c5c7ce5192c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:24.640972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:24.649728 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02d747d9-61de-4b10-aaaa-a373d59ed39f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1314 microversion: 2.1 time: 0.551142 Jul 01 10:36:24.650727 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1214/2434] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:24 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:24.690933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6d300ff-460d-4977-b18f-7c5c7ce5192c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:24.700176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6d300ff-460d-4977-b18f-7c5c7ce5192c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:24.701680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6d300ff-460d-4977-b18f-7c5c7ce5192c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:24.702906 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e6d300ff-460d-4977-b18f-7c5c7ce5192c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1284 microversion: 2.42 time: 0.136825 Jul 01 10:36:24.717286 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1221/2435] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:24 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:24.720890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b68851ca-3b94-4d22-b30a-48d2a5aadd89 req-9b1f882e-27f7-4c4b-8ff2-2b3d5a818de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e846ba7-bb0b-4f03-92d9-7084538531c5", "name": "network-vif-plugged", "status": "completed", "tag": "ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:24.729457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b68851ca-3b94-4d22-b30a-48d2a5aadd89 req-9b1f882e-27f7-4c4b-8ff2-2b3d5a818de3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:24.729910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b68851ca-3b94-4d22-b30a-48d2a5aadd89 req-9b1f882e-27f7-4c4b-8ff2-2b3d5a818de3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:24.741093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b68851ca-3b94-4d22-b30a-48d2a5aadd89 req-9b1f882e-27f7-4c4b-8ff2-2b3d5a818de3 service nova] Creating event network-vif-plugged:ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3 for instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 on n-h2-master-1 Jul 01 10:36:24.746172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b68851ca-3b94-4d22-b30a-48d2a5aadd89 req-9b1f882e-27f7-4c4b-8ff2-2b3d5a818de3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093980 Jul 01 10:36:24.746776 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1215/2436] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:24.774500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:24.780058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:24.784928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:24.785843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:24.787242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:24.787702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.298429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:25.306064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3873a82d-56c1-4eb8-bb0e-140ea281b2cc tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 1472 microversion: 2.1 time: 0.536359 Jul 01 10:36:25.311209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1222/2437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:24 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:25.388267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:25.388975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:25.396971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.397634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.398586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.399021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.587329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:25.589138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:25.602011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.602471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.603288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.603726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.760978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:25.769262 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b2c5cca5-1a6d-457b-96c4-12749ff4a80a tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1279 microversion: 2.1 time: 0.186458 Jul 01 10:36:25.769854 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1223/2438] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:25 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:25.783898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:25.784521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:25.790864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.791332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.792116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.792557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.840729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:25.848793 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c484bac6-0c07-4ec8-bda0-1ce9851ceb13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1517 microversion: 2.1 time: 0.465765 Jul 01 10:36:25.849474 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1216/2439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:25 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1517 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:25.854253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:25.855079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:25.862901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.863682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:25.865365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:25.865884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.047836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:26.058007 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:26.059523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:26.061050 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-75464ab7-5cbc-40fb-892d-0fee084d0604 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1526 microversion: 2.42 time: 0.210396 Jul 01 10:36:26.072361 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1217/2440] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:25 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1526 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:26.072361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:26.072361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:26.074741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.075200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.075989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.076432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.102146 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lazy-loading 'flavor' on Instance uuid a1f644d5-098c-4811-9a18-10b650654a68 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:36:26.182550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:26.190608 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6cf44d99-7169-4c1c-aec6-072ccd8dda32 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1314 microversion: 2.1 time: 0.419432 Jul 01 10:36:26.191137 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1224/2441] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:25 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:26.324386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:26.325005 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:26.336152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.336599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.337417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.337857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.613288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:26.635032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3194e52f-40cd-4f84-9471-ab97eb436723 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action" status: 200 len: 32 microversion: 2.1 time: 0.571263 Jul 01 10:36:26.650524 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1218/2442] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:26 2022] POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action => generated 32 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:36:26.667186 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2355ccb-49b1-4a79-b8da-b3e2a20d2729 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 1472 microversion: 2.1 time: 0.347318 Jul 01 10:36:26.668024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:26.668753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:26.670039 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1225/2443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:26 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:26.684703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.685353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.686264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.686688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.697628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4981567f-0b31-4f3c-b886-92b58ea18b7e req-e2f7e11c-dbec-46e1-adea-80866866c948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba55d6c-e17b-4175-832b-048bfa530c81", "name": "network-vif-deleted", "tag": "c2e325b6-bdbf-4cd7-b5af-f6a08f267996"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:26.706970 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4981567f-0b31-4f3c-b886-92b58ea18b7e req-e2f7e11c-dbec-46e1-adea-80866866c948 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.707362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4981567f-0b31-4f3c-b886-92b58ea18b7e req-e2f7e11c-dbec-46e1-adea-80866866c948 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.739881 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4981567f-0b31-4f3c-b886-92b58ea18b7e req-e2f7e11c-dbec-46e1-adea-80866866c948 service nova] Creating event network-vif-deleted:c2e325b6-bdbf-4cd7-b5af-f6a08f267996 for instance 2ba55d6c-e17b-4175-832b-048bfa530c81 on n-h2-master-1 Jul 01 10:36:26.745032 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4981567f-0b31-4f3c-b886-92b58ea18b7e req-e2f7e11c-dbec-46e1-adea-80866866c948 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050973 Jul 01 10:36:26.746613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1226/2444] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:36:26.787567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:26.788386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:26.796320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.796784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:26.797697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:26.798519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.001357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:27.002670 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46ebd097-5ffb-48fc-8640-9cafcea66c3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.348211 Jul 01 10:36:27.015265 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1219/2445] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:26 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:27.080554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:27.081181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:27.088178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.088624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.089414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.092355 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.174532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:27.189506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a5d5789-2864-47f5-b131-d5eaaec8f69f tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1321 microversion: 2.1 time: 0.407243 Jul 01 10:36:27.190279 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1227/2446] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:26 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:27.211363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:27.212280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:27.212430 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:27.218808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.219272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.221950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:27.223016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.223913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:27.224506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.225072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ddc6b292-3412-4343-9e2b-7b5bcf41da63 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1574 microversion: 2.42 time: 0.149006 Jul 01 10:36:27.242224 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1220/2447] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:27 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:27.419966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:27.429120 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3f45885-95af-4840-866e-83cdaaa498d4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1502 microversion: 2.1 time: 0.224301 Jul 01 10:36:27.437869 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1228/2448] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:27 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:27.455836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-daa587df-06c7-4557-a71c-5935e97aa686 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:27.456729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-daa587df-06c7-4557-a71c-5935e97aa686 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:27.471170 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa587df-06c7-4557-a71c-5935e97aa686 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.473967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa587df-06c7-4557-a71c-5935e97aa686 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.473967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa587df-06c7-4557-a71c-5935e97aa686 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.473967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa587df-06c7-4557-a71c-5935e97aa686 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.676072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-daa587df-06c7-4557-a71c-5935e97aa686 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5/action" status: 202 len: 0 microversion: 2.1 time: 0.224571 Jul 01 10:36:27.679682 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1221/2449] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:27 2022] POST /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:27.697728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:27.700766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:27.718503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.718956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.720020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:27.722136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:27.724136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.724791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.737854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.739867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.743472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.746699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.812695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.813183 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.813656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lazy-loading 'fault' on Instance uuid 2ba55d6c-e17b-4175-832b-048bfa530c81 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a322a37fe40476d86cf3f473752088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31881aca19fe4da29fd3acf404dbdc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ca08c08-ef59-4514-abae-b7b10f587091 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 200 len: 1307 microversion: 2.1 time: 0.279943 Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1229/2450] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:27 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 1307 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:27.986240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.025588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:36:28.117552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:28.126554 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-09a2d350-0258-4998-9b04-8568dedcd6ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1507 microversion: 2.1 time: 0.424778 Jul 01 10:36:28.127459 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1222/2451] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:27 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:28.141972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:28.146268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:28.154250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.155092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.156081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.156747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.441656 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:28.502732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:28.508207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-72f1357f-1e8a-48f9-a6e8-be39cf721a8e tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 204 len: 0 microversion: 2.1 time: 0.543938 Jul 01 10:36:28.509020 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1230/2452] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:36:27 2022] DELETE /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:28.520739 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:28.526444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:28.531131 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a11d451-3eaf-431a-aff2-2f95af568ccf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.402356 Jul 01 10:36:28.539996 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1223/2453] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:28 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:28.546193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.552093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.554749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:28.559416 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.560248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.561210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:28.579413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.584172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.585118 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.591148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.770691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:28.791202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:28.793219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:28.794758 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-84cf9596-8737-401b-ad6f-777f6decc243 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1592 microversion: 2.42 time: 0.252700 Jul 01 10:36:28.796005 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1224/2454] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:28 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1592 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:28.803068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:28.803980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:28.811934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.812451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.813186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:28.813799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:28.820779 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:28.930775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:28.946344 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f9a3e02-b891-4148-9b81-8cdb7629c504 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1321 microversion: 2.1 time: 0.435810 Jul 01 10:36:28.951128 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1231/2455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:28 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:28.996136 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:28.996780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] [instance: 2ba55d6c-e17b-4175-832b-048bfa530c81] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:29.008077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.011157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.011157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.011437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.028166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] HTTP exception thrown: Instance 2ba55d6c-e17b-4175-832b-048bfa530c81 could not be found. Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Request method failure captured: Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 HTTP/1.1 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2HYBYv30qOFNh0-7SYED3ZV3pqhc4la5TgBnAQ91nvUfFeaYgEt1C3dh4lzZaW9ORNescAFoPP6tn-AB_3fR3hGBTvvK78_ykmZsx85WIU5CNG9Z-mdsUu8yvqXpAM-IzUhYIwFe-F3uOZsTFIWvJAj7paaQAkqquTTLEfVAuxnX4 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 31881aca19fe4da29fd3acf404dbdc1b Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ListImageFiltersTestJSON-1196055204 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31881aca19fe4da29fd3acf404dbdc1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31881aca19fe4da29fd3acf404dbdc1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31881aca19fe4da29fd3acf404dbdc1b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31881aca19fe4da29fd3acf404dbdc1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ListImageFiltersTestJSON-1196055204 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 31881aca19fe4da29fd3acf404dbdc1b Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1196055204 Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ListImageFiltersTestJSON-1196055204-project Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 8a322a37fe40476d86cf3f473752088a Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ListImageFiltersTestJSON-1196055204-project Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 2ba55d6c-e17b-4175-832b-048bfa530c81 could not be found. Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '2ba55d6c-e17b-4175-832b-048bfa530c81'} Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba55d6c-e17b-4175-832b-048bfa530c81 could not be found. Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba55d6c-e17b-4175-832b-048bfa530c81 could not be found. Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:29.030054 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba55d6c-e17b-4175-832b-048bfa530c81 could not be found. Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Returning 404 to user: Instance 2ba55d6c-e17b-4175-832b-048bfa530c81 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-605557f5-1d1d-4505-96ad-9a275a9fa6d8 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81" status: 404 len: 111 microversion: 2.1 time: 0.039559 Jul 01 10:36:29.041520 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1232/2456] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:28 2022] GET /compute/v2.1/servers/2ba55d6c-e17b-4175-832b-048bfa530c81 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:36:29.042466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-03610d98-b720-406e-a694-bcf422e45017 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f920bbd30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:29.084537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:29.093602 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47ce8ff5-9db9-44a9-b7a1-08860d0d58d4 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1665 microversion: 2.1 time: 0.296342 Jul 01 10:36:29.094698 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1225/2457] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:28 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1665 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:29.144192 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:29.144819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:29.165022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.167106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.167310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.167688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.611604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:29.622103 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72689d17-64b7-4e66-9c58-98e837ca06a0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1487 microversion: 2.1 time: 0.482040 Jul 01 10:36:29.625818 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1226/2458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:29 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1487 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:29.634121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c8e31748-4145-4e1e-abb1-6e52af6a7b03 req-89debc27-f012-401d-8f05-b8ebd6298ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2911ba-0f47-4839-b640-dea5d2f4b10c", "tag": "16672ddf-b7d0-4b85-9b38-8916365e1be5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:29.652658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c8e31748-4145-4e1e-abb1-6e52af6a7b03 req-89debc27-f012-401d-8f05-b8ebd6298ee0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.658086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c8e31748-4145-4e1e-abb1-6e52af6a7b03 req-89debc27-f012-401d-8f05-b8ebd6298ee0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.673853 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c8e31748-4145-4e1e-abb1-6e52af6a7b03 req-89debc27-f012-401d-8f05-b8ebd6298ee0 service nova] Creating event network-changed:16672ddf-b7d0-4b85-9b38-8916365e1be5 for instance cd2911ba-0f47-4839-b640-dea5d2f4b10c on n-h1-master-1 Jul 01 10:36:29.678781 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c8e31748-4145-4e1e-abb1-6e52af6a7b03 req-89debc27-f012-401d-8f05-b8ebd6298ee0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051481 Jul 01 10:36:29.683666 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1227/2459] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:29.689163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:29.689935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:29.701549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.701549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.702504 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.703453 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.941111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:29.958638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e45c334e-e64c-48ad-95c6-234600ebaa93 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.272977 Jul 01 10:36:29.959626 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1228/2460] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:29 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:29.965961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:29.972023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:29.974559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-03610d98-b720-406e-a694-bcf422e45017 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/images/12d02cc6-eb90-47b6-b831-5959f82db7b0" status: 204 len: 0 microversion: 2.1 time: 0.936888 Jul 01 10:36:29.976160 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1233/2461] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:29 2022] DELETE /compute/v2.1/images/12d02cc6-eb90-47b6-b831-5959f82db7b0 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:36:29.982364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:29.983274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:29.984620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.995270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:29.996381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:29.996975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:30.002386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:30.008321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:30.008321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:30.008321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:30.046418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:36:30.383677 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17c10df9-62ba-475d-8a63-dd2c701b87fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 204 len: 0 microversion: 2.1 time: 0.422599 Jul 01 10:36:30.384316 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1229/2462] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:36:29 2022] DELETE /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:30.394085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:30.394807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:30.404681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:30.405176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:30.405960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:30.406402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:30.786836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:30.800337 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-643f07f6-89ad-43b6-aca1-86a8d523f211 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1321 microversion: 2.1 time: 0.412853 Jul 01 10:36:30.801790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1230/2463] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:30 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:30.814984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f92beb4-049d-4bcf-9691-5d34f4882302 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f920a8f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:30.821650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:30.834536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:30.838386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:30.839768 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b8ca677-35df-49b0-8d5c-f9dfddb1ed4a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1660 microversion: 2.42 time: 0.862306 Jul 01 10:36:30.842608 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1234/2464] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:29 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1660 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:30.847474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:30.855905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:30.870743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:30.871192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:30.871977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:30.872413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:31.110875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:31.121531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7fee0c15-15ca-4f5f-8ad3-42de34565594 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1665 microversion: 2.1 time: 0.277642 Jul 01 10:36:31.122384 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1235/2465] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:30 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1665 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:31.127557 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:31.128167 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:31.142154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:31.144344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:31.147475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:31.150374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:31.434366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:31.446549 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1381edd-1c71-4a5f-b509-d20caa1c0746 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1493 microversion: 2.1 time: 0.323106 Jul 01 10:36:31.453284 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1236/2466] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:31 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1493 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:31.453470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:31.454456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:31.460865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:31.461366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:31.462231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:31.462675 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:31.466854 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:31.618109 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:31.720623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:31.731802 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ac4d023-2659-499f-aa1c-53a008305920 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.282505 Jul 01 10:36:31.732927 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1237/2467] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:31 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:31.749506 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f92beb4-049d-4bcf-9691-5d34f4882302 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/images/dfbf1d01-f27d-4286-898c-8cf7f01dc817" status: 204 len: 0 microversion: 2.1 time: 0.945472 Jul 01 10:36:31.754708 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1231/2468] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:30 2022] DELETE /compute/v2.1/images/dfbf1d01-f27d-4286-898c-8cf7f01dc817 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:31.761504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a9b7067-ebbf-433f-8644-b88e3e895d51 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] Calling method '.version_select at 0x7f6f920bbdc0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:31.818416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:31.818618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:31.828736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:31.831015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:31.835077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:31.835690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.495350 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a9b7067-ebbf-433f-8644-b88e3e895d51 tempest-ListImageFiltersTestJSON-1196055204 tempest-ListImageFiltersTestJSON-1196055204-project] 10.222.0.23 "DELETE /compute/v2.1/images/9f8ca204-477d-4f38-8821-f29617381eec" status: 204 len: 0 microversion: 2.1 time: 0.737818 Jul 01 10:36:32.503055 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1238/2469] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:31 2022] DELETE /compute/v2.1/images/9f8ca204-477d-4f38-8821-f29617381eec => generated 0 bytes in 740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:32.510650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:32.514430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:32.530962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:32.533080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.534319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:32.536677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:32.537528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.546022 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:32.553074 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fcb867b6-0233-4586-bbde-a2d296da028c tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1321 microversion: 2.1 time: 0.738861 Jul 01 10:36:32.568709 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1232/2470] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:31 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1321 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:32.568709 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:32.576861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:32.581093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:32.601918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:32.604678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.605812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:32.609590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.729218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9638c88215d041858456bc3bb63c6df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f3add500e4f4ca9c4d01b7045c82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:32.741640 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14614a27-e527-44ed-9637-293c83c4aac1 tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 200 len: 1310 microversion: 2.1 time: 0.175645 Jul 01 10:36:32.751332 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1233/2471] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:32 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:32.761123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4ca3da21-ff46-4f52-bfb2-2a386221514e req-043dc0f9-149a-43e6-a2ec-06aff8fff795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a032d2-5ef0-4bf8-a282-fce29edda700", "name": "network-vif-deleted", "tag": "4fc6b77c-2b84-434e-b42d-a07d1f87688f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:32.789465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4ca3da21-ff46-4f52-bfb2-2a386221514e req-043dc0f9-149a-43e6-a2ec-06aff8fff795 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:32.790483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4ca3da21-ff46-4f52-bfb2-2a386221514e req-043dc0f9-149a-43e6-a2ec-06aff8fff795 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.840854 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4ca3da21-ff46-4f52-bfb2-2a386221514e req-043dc0f9-149a-43e6-a2ec-06aff8fff795 service nova] Creating event network-vif-deleted:4fc6b77c-2b84-434e-b42d-a07d1f87688f for instance b2a032d2-5ef0-4bf8-a282-fce29edda700 on n-h2-master-1 Jul 01 10:36:32.866472 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4ca3da21-ff46-4f52-bfb2-2a386221514e req-043dc0f9-149a-43e6-a2ec-06aff8fff795 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113150 Jul 01 10:36:32.874700 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1234/2472] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:32.885783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:32.887039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:32.902588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:32.902588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.902588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:32.902588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:32.940520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:32.956874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:32.967910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:32.970764 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a4380c75-ff34-487e-953c-3b88048a72d9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1707 microversion: 2.42 time: 0.464051 Jul 01 10:36:32.971345 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1239/2473] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:32 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1707 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:32.988179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-306a1477-aa63-4503-a261-385135b649ac req-c0434f08-3d70-419e-b6b9-eeed54b9b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e846ba7-bb0b-4f03-92d9-7084538531c5", "name": "network-vif-unplugged", "status": "completed", "tag": "ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:33.019868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-306a1477-aa63-4503-a261-385135b649ac req-c0434f08-3d70-419e-b6b9-eeed54b9b0d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:33.020865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-306a1477-aa63-4503-a261-385135b649ac req-c0434f08-3d70-419e-b6b9-eeed54b9b0d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:33.048810 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-306a1477-aa63-4503-a261-385135b649ac req-c0434f08-3d70-419e-b6b9-eeed54b9b0d8 service nova] Creating event network-vif-unplugged:ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3 for instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 on n-h2-master-1 Jul 01 10:36:33.073867 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-306a1477-aa63-4503-a261-385135b649ac req-c0434f08-3d70-419e-b6b9-eeed54b9b0d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089246 Jul 01 10:36:33.074794 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1240/2474] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:33.092480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:33.093222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:33.127626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:33.127874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:33.128677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:33.129120 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:33.567116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:33.581798 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d4309bdc-36df-440b-b52a-cafe78c262f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1493 microversion: 2.1 time: 0.701365 Jul 01 10:36:33.583470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1235/2475] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:32 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1493 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:33.620350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:33.628627 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:33.655476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:33.656038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:33.657085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:33.657715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:33.662493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:33.674319 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f98f0b2a-c58a-4cd8-a37a-bbeee96b0ef8 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.598297 Jul 01 10:36:33.677842 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1241/2476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:33 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:33.759236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:33.759875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] [instance: b2a032d2-5ef0-4bf8-a282-fce29edda700] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:33.781692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:33.782156 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:33.788620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:33.789095 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:33.831818 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] HTTP exception thrown: Instance b2a032d2-5ef0-4bf8-a282-fce29edda700 could not be found. Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Request method failure captured: Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 HTTP/1.1 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3aXYlNc3uJmctHHTWgk7sNtdGIUM5Bro6YdzHXYZOFEiSeDJyvTW5x0FFhBdAP28Uto3Fa18YJZ8JGJR_XWMWXErelFihpVqEollHefdLoGRlYjY6MoEF6inc8dGdNQ9nLCeUEvQN0OaQw0Tr_XgIqEiBTB9N8CF0y6MraoHoa-K0 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 360f3add500e4f4ca9c4d01b7045c82f Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestFqdnHostnames-2131260382 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/360f3add500e4f4ca9c4d01b7045c82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/360f3add500e4f4ca9c4d01b7045c82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_360f3add500e4f4ca9c4d01b7045c82f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/360f3add500e4f4ca9c4d01b7045c82f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestFqdnHostnames-2131260382 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 360f3add500e4f4ca9c4d01b7045c82f Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2131260382 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestFqdnHostnames-2131260382-project Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9638c88215d041858456bc3bb63c6df3 Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestFqdnHostnames-2131260382-project Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: exception: Instance b2a032d2-5ef0-4bf8-a282-fce29edda700 could not be found. Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'b2a032d2-5ef0-4bf8-a282-fce29edda700'} Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a032d2-5ef0-4bf8-a282-fce29edda700 could not be found. Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a032d2-5ef0-4bf8-a282-fce29edda700 could not be found. Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:33.834180 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a032d2-5ef0-4bf8-a282-fce29edda700 could not be found. Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Returning 404 to user: Instance b2a032d2-5ef0-4bf8-a282-fce29edda700 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:33.839139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6dcb00ce-7e2a-4dae-98ca-a46d5c53667b tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700" status: 404 len: 111 microversion: 2.1 time: 0.080273 Jul 01 10:36:33.853358 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1242/2477] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:33 2022] GET /compute/v2.1/servers/b2a032d2-5ef0-4bf8-a282-fce29edda700 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:36:33.862258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7b62f6f-9201-4a38-a4f0-a889a150334f tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] Calling method '.version_select at 0x7f6f91e57700>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:33.966546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7b62f6f-9201-4a38-a4f0-a889a150334f tempest-ServersTestFqdnHostnames-2131260382 tempest-ServersTestFqdnHostnames-2131260382-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292551823" status: 202 len: 0 microversion: 2.1 time: 0.111676 Jul 01 10:36:33.967136 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1243/2478] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:36:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292551823 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:33.991079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:33.991718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:34.011669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:34.012147 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:34.012949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:34.021643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:34.357899 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:34.368509 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb2c0a80-2f5a-4bf1-9a97-b231442f7a02 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1321 microversion: 2.1 time: 0.768758 Jul 01 10:36:34.380567 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1236/2479] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:33 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1321 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:34.599440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:34.600078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:34.622639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:34.623402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:34.624315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:34.624859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:34.699045 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:34.769351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:34.782894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:34.787861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:34.789101 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7410d5bb-add9-4000-8fd4-e1d1bf43069f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1754 microversion: 2.42 time: 0.804393 Jul 01 10:36:34.793942 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1244/2480] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:33 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1754 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:36:34.811162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:34.812203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:34.826740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:34.827603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:34.828711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:34.829357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:35.002465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:35.017549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6552a5c8-6e30-47c8-92e0-bd3005724302 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1451 microversion: 2.1 time: 0.422794 Jul 01 10:36:35.018151 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1237/2481] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:34 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1451 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:35.077749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0707a9c9-a473-471f-8f57-30c50eb2610c req-16f9f735-2298-4a68-a15c-f70a59956539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e846ba7-bb0b-4f03-92d9-7084538531c5", "name": "network-vif-deleted", "tag": "ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:35.106631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0707a9c9-a473-471f-8f57-30c50eb2610c req-16f9f735-2298-4a68-a15c-f70a59956539 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:35.107427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0707a9c9-a473-471f-8f57-30c50eb2610c req-16f9f735-2298-4a68-a15c-f70a59956539 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:35.128392 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0707a9c9-a473-471f-8f57-30c50eb2610c req-16f9f735-2298-4a68-a15c-f70a59956539 service nova] Creating event network-vif-deleted:ffa9011a-fe9a-48ce-b35d-2dd2ab7a67f3 for instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 on n-h2-master-1 Jul 01 10:36:35.138303 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0707a9c9-a473-471f-8f57-30c50eb2610c req-16f9f735-2298-4a68-a15c-f70a59956539 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069696 Jul 01 10:36:35.144297 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1238/2482] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:35.185888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:35.203808 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11fbd5fc-e2bf-4964-b12d-39f3e83c364e tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.401345 Jul 01 10:36:35.205225 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1245/2483] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:34 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:35.337246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-33fc3383-ea63-46ed-ae4f-85af9cb22534 req-f77dc912-f1a1-4df3-854f-bb52bf081bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2911ba-0f47-4839-b640-dea5d2f4b10c", "name": "network-vif-plugged", "status": "completed", "tag": "16672ddf-b7d0-4b85-9b38-8916365e1be5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:35.370904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-33fc3383-ea63-46ed-ae4f-85af9cb22534 req-f77dc912-f1a1-4df3-854f-bb52bf081bf3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:35.372591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-33fc3383-ea63-46ed-ae4f-85af9cb22534 req-f77dc912-f1a1-4df3-854f-bb52bf081bf3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:35.384869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:35.387600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:35.402143 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:35.402595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:35.402761 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-33fc3383-ea63-46ed-ae4f-85af9cb22534 req-f77dc912-f1a1-4df3-854f-bb52bf081bf3 service nova] Creating event network-vif-plugged:16672ddf-b7d0-4b85-9b38-8916365e1be5 for instance cd2911ba-0f47-4839-b640-dea5d2f4b10c on n-h1-master-1 Jul 01 10:36:35.408017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:35.408750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:35.416866 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-33fc3383-ea63-46ed-ae4f-85af9cb22534 req-f77dc912-f1a1-4df3-854f-bb52bf081bf3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114019 Jul 01 10:36:35.418381 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1239/2484] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:35.810079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:35.812663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:35.813399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:35.824798 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a64a7e3d-10fe-4638-a8cf-47d3acca17ff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1321 microversion: 2.1 time: 0.443684 Jul 01 10:36:35.825947 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1246/2485] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:35 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:35.841657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:35.866717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:35.866717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:35.866717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:36.034030 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:36.034650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:36.058089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:36.058548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:36.059334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:36.059776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:36.152892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:36.156955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:36.157728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lazy-loading 'fault' on Instance uuid 3e846ba7-bb0b-4f03-92d9-7084538531c5 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:36:36.159078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:36.174179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:36.175781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:36.177986 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6c4a83f-3749-41e5-906c-bf737a433c51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1754 microversion: 2.42 time: 0.369663 Jul 01 10:36:36.188481 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1240/2486] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:35 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1754 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:36:36.224342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:36.226008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:36.234109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:36.234568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:36.235347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:36.236138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:36.236316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:36.248356 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-475118f9-a826-4cb9-bed7-a44a9c490f80 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 200 len: 1304 microversion: 2.1 time: 0.218184 Jul 01 10:36:36.252342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1247/2487] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:36 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 1304 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:36.448319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:36.457820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5715be41-b989-4a7b-ac00-977a56f0ef31 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.239229 Jul 01 10:36:36.459023 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1241/2488] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:36 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:36:36.842110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:36.843520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:36.850567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:36.851016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:36.851787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:36.852225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:37.044990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:37.051695 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e2230e36-e00d-4eee-a9c2-2292ad01e672 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1321 microversion: 2.1 time: 0.212963 Jul 01 10:36:37.052266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1248/2489] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:36 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:37.209503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:37.210265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:37.229469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:37.233092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:37.236012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:37.237372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:37.268691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:37.269738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:37.281392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:37.285840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:37.287264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:37.287870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:37.305191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 HTTP/1.1 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3e846ba7-bb0b-4f03-92d9-7084538531c5'} Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:37.320649 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:37.325488 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c0d18bd1-b545-45fc-8915-b99aa7e83659 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 404 len: 111 microversion: 2.1 time: 0.044310 Jul 01 10:36:37.336853 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1249/2490] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:37 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:36:37.485524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:37.486220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:37.511883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:37.513627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:37.515985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:37.522117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:37.853953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:37.871465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:37.876524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:37.880404 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98684d61-07ef-43e6-8158-81f9bc47b6bc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1801 microversion: 2.42 time: 0.678070 Jul 01 10:36:37.885364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1242/2491] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:37 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1801 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:37.896393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-787615698", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ce42240f-1f36-4657-993c-cfa415e6f19d"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:37.998303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] validate_networks() for [('ce42240f-1f36-4657-993c-cfa415e6f19d', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:36:38.212693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:38.228680 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-793f552c-f9c0-4987-99f5-692d2772bd68 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.753126 Jul 01 10:36:38.239191 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1250/2492] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:37 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:38.244921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:38.245768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:38.252123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:38.252776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:38.253933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:38.255125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:38.990864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:39.021249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96eb5aea-2d99-4031-b0a2-bda617c8a7e8 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1471 microversion: 2.1 time: 0.780502 Jul 01 10:36:39.022862 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1251/2493] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:38 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1471 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:39.041359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:39.042355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:39.055248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:39.057682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:39.061919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:39.062718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:39.896348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:39.914225 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:39.923111 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:39.924991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1ca8a0e-bffc-4335-9090-326347ea7771 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1848 microversion: 2.42 time: 0.898009 Jul 01 10:36:39.926119 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1252/2494] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:39 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1848 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:39.939975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:39.946879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:39.948327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:39.949073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:39.950360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:39.950800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:40.019262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:36:40.020333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lazy-loading 'flavor' on Instance uuid cd2911ba-0f47-4839-b640-dea5d2f4b10c {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:36:40.020481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:36:40.021012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:36:40.021698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:36:40.022168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:36:40.060024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:40.060536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:40.068839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:40.069496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:40.119065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:40.138293 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for user cc8012fcb48840f1b778ab759457e66c and project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:40.185642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:36:40.189104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:36:40.323035 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0025c616-12e5-4410-aaf4-1b22bf461731 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.435912 Jul 01 10:36:40.323702 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1243/2495] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:36:40.329171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:40.337293 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:40.341990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:40.342683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:40.343665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:40.344248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:40.382936 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:40.392039 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1bb63a4d-7eb4-4448-ab04-5fa39db96d79 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c/action" status: 202 len: 0 microversion: 2.1 time: 0.464432 Jul 01 10:36:40.392680 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1253/2496] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:39 2022] POST /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:40.402915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-262c8368-2d5b-4c35-a55e-be47a7961d73 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:40.405995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-262c8368-2d5b-4c35-a55e-be47a7961d73 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:40.706302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-262c8368-2d5b-4c35-a55e-be47a7961d73 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:40.722323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-262c8368-2d5b-4c35-a55e-be47a7961d73 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1214 microversion: 2.1 time: 0.327918 Jul 01 10:36:40.727689 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1254/2497] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:40 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1214 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:40.737666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-147cb2fd-1a34-4be5-84c1-f6fae5518f1c tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:40.746709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-147cb2fd-1a34-4be5-84c1-f6fae5518f1c tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:40.766831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147cb2fd-1a34-4be5-84c1-f6fae5518f1c tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:40.768434 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147cb2fd-1a34-4be5-84c1-f6fae5518f1c tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:40.769444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147cb2fd-1a34-4be5-84c1-f6fae5518f1c tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:40.771942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147cb2fd-1a34-4be5-84c1-f6fae5518f1c tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:41.045769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:41.060314 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76be8c90-6add-450a-966b-ad0630dd30cd tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.734992 Jul 01 10:36:41.060773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1244/2498] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:40 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:41.070524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:41.074948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:41.089253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:41.090053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:41.093400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:41.094072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:41.613509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:41.636223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:41.649080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:41.651836 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6552491-5ddb-488d-8c12-e8611276952f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1848 microversion: 2.42 time: 0.588191 Jul 01 10:36:41.652639 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1245/2499] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:41 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1848 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:41.754762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:41.758773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:41.774025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:41.777248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:41.790986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:41.791532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:42.166929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:42.195721 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0561570d-8f6a-45e8-ad7b-d943ac6bad6c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1218 microversion: 2.1 time: 0.457527 Jul 01 10:36:42.208426 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1246/2500] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:41 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1218 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:42.636588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-681a2f1b-b4de-4034-a80e-59d310a09e80 req-57e6f0e3-ae9d-4660-9074-94a1b1a1951f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "fcb9df67-3668-4e82-bce6-cff941b7bead"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:42.657884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-681a2f1b-b4de-4034-a80e-59d310a09e80 req-57e6f0e3-ae9d-4660-9074-94a1b1a1951f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:42.658372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-681a2f1b-b4de-4034-a80e-59d310a09e80 req-57e6f0e3-ae9d-4660-9074-94a1b1a1951f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:42.693239 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-681a2f1b-b4de-4034-a80e-59d310a09e80 req-57e6f0e3-ae9d-4660-9074-94a1b1a1951f service nova] Creating event network-changed:fcb9df67-3668-4e82-bce6-cff941b7bead for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:36:42.709183 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-681a2f1b-b4de-4034-a80e-59d310a09e80 req-57e6f0e3-ae9d-4660-9074-94a1b1a1951f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.499024 Jul 01 10:36:42.711856 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1247/2501] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:42.724672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:42.729449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:42.761539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:42.770151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:42.772233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:42.772685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:43.144071 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-147cb2fd-1a34-4be5-84c1-f6fae5518f1c tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1630 microversion: 2.1 time: 2.415046 Jul 01 10:36:43.146734 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1255/2502] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:40 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1630 bytes in 2418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:43.159474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:43.167626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:43.182541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:43.183360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:43.194765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:43.195853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:45.076980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:45.094281 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-30c477a8-9070-435a-a405-1efff52e0bbf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 2.378503 Jul 01 10:36:45.095413 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1248/2503] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:42 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 2381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:45.106393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:45.110074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:45.121843 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:45.132318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:45.133629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:45.134548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:45.136712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:45.397734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:45.405560 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:45.414050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:45.419580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:45.423983 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae908163-7f4c-4dd4-8f48-ee10b84743a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1869 microversion: 2.42 time: 2.275243 Jul 01 10:36:45.425100 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1256/2504] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:43 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1869 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:45.434136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:45.434898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d481d98-6ab1-42e0-8e44-59990ca2ecc0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:45.435540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d481d98-6ab1-42e0-8e44-59990ca2ecc0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:45.448150 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d3c1730-18fa-4943-b5cc-8c84f54f24cc tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1272 microversion: 2.1 time: 0.350983 Jul 01 10:36:45.450123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1249/2505] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:45 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:45.461779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d481d98-6ab1-42e0-8e44-59990ca2ecc0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:45.462244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d481d98-6ab1-42e0-8e44-59990ca2ecc0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:45.466762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ac24a2be-dc11-446c-bf5d-9968d35312ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:45.467604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d481d98-6ab1-42e0-8e44-59990ca2ecc0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:45.468327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d481d98-6ab1-42e0-8e44-59990ca2ecc0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:45.469238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ac24a2be-dc11-446c-bf5d-9968d35312ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:45.490500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac24a2be-dc11-446c-bf5d-9968d35312ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:45.490961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac24a2be-dc11-446c-bf5d-9968d35312ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:45.491943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac24a2be-dc11-446c-bf5d-9968d35312ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:45.492548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac24a2be-dc11-446c-bf5d-9968d35312ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:45.836219 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ac24a2be-dc11-446c-bf5d-9968d35312ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.381457 Jul 01 10:36:45.837139 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1250/2506] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:45 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:36:45.899428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-152c9916-25fa-4c30-ad38-deaf92b81be8 req-1908360c-65a4-4f69-8503-65def4f3d315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "85806425-2835-431f-a010-e9e78b034c83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:46.001991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-152c9916-25fa-4c30-ad38-deaf92b81be8 req-1908360c-65a4-4f69-8503-65def4f3d315 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:46.002455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-152c9916-25fa-4c30-ad38-deaf92b81be8 req-1908360c-65a4-4f69-8503-65def4f3d315 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:46.078810 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-152c9916-25fa-4c30-ad38-deaf92b81be8 req-1908360c-65a4-4f69-8503-65def4f3d315 service nova] Creating event network-changed:85806425-2835-431f-a010-e9e78b034c83 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:36:46.094869 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-152c9916-25fa-4c30-ad38-deaf92b81be8 req-1908360c-65a4-4f69-8503-65def4f3d315 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240434 Jul 01 10:36:46.098436 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1251/2507] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:46.148566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:46.152305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:46.201443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:46.204140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:46.205939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:46.209274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:47.036038 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d481d98-6ab1-42e0-8e44-59990ca2ecc0 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1613 microversion: 2.1 time: 1.606071 Jul 01 10:36:47.037577 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1257/2508] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:45 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1613 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:47.049080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:47.053381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:47.070222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:47.071149 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:47.075634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:47.076255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:47.159045 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:47.172048 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47cea5fd-c0f8-4172-86a1-e33e76853302 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1673 microversion: 2.1 time: 1.070373 Jul 01 10:36:47.172930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1252/2509] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:46 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1673 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:47.187936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:47.188868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:47.206776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:47.208934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:47.211753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:47.212471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:47.894161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:47.910748 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77e537cc-5839-4636-858c-0235de1c0bcf tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.871829 Jul 01 10:36:47.914604 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1258/2510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:47 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:47.924957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:47.925875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:47.986910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:47.987449 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:47.988334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:47.988780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:49.318973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:49.335829 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-41b29532-262b-48c6-a6e6-7d1a939397e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1272 microversion: 2.1 time: 1.419149 Jul 01 10:36:49.337136 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1259/2511] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:47 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1272 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:49.343512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:49.345237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:49.362396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:49.365651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:49.366768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:49.367460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:49.455018 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] HTTP exception thrown: Cannot 'migrate' instance cd2911ba-0f47-4839-b640-dea5d2f4b10c while it is in vm_state suspended Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Request method failure captured: Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c/action HTTP/1.1 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 15 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs4K6CZpQJqIGAC460Q2p89wMHU8Thm6KH8arzs6xdPpuIDqMnpUE2kQVAJ34fOOiOJ2D1OvqtTsts0A3vbRUaBza_nZpzKukQgehXQujze-9WuWT70tCeFqCE0MoJZz5lazqnltSI2j_CPdDek_xOPAFqFUtnAZSM2m9L0SCJ5R6BQ Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52a9c74d6bcd43c5aeb3f7c1f6cd75d7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 3ef4a32bbcb545599abd69443c1bd2d1 Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: {"migrate": {}} Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: exception: Cannot 'migrate' instance cd2911ba-0f47-4839-b640-dea5d2f4b10c while it is in vm_state suspended Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'cd2911ba-0f47-4839-b640-dea5d2f4b10c', 'body': {'migrate': {}}} Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd2911ba-0f47-4839-b640-dea5d2f4b10c in vm_state suspended. Cannot resize while the instance is in this state. Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:49.458266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance cd2911ba-0f47-4839-b640-dea5d2f4b10c while it is in vm_state suspended Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance cd2911ba-0f47-4839-b640-dea5d2f4b10c while it is in vm_state suspended Jul 01 10:36:49.462645 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:49.465358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Returning 409 to user: Cannot 'migrate' instance cd2911ba-0f47-4839-b640-dea5d2f4b10c while it is in vm_state suspended {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:49.466608 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e991c5bf-781f-4817-b3ac-4c05212e3348 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c/action" status: 409 len: 148 microversion: 2.1 time: 0.128188 Jul 01 10:36:49.473561 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1260/2512] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:49 2022] POST /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c/action => generated 148 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:36:49.480114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2f25446c-896d-4558-87ed-f02fded29a12 req-fd69dd38-1d1d-4fd6-8f42-ae9c38dddb0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "d278eadc-ca53-49cb-8272-d4d973d93099"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:49.493469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2f25446c-896d-4558-87ed-f02fded29a12 req-fd69dd38-1d1d-4fd6-8f42-ae9c38dddb0e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:49.494193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2f25446c-896d-4558-87ed-f02fded29a12 req-fd69dd38-1d1d-4fd6-8f42-ae9c38dddb0e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:49.511345 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2f25446c-896d-4558-87ed-f02fded29a12 req-fd69dd38-1d1d-4fd6-8f42-ae9c38dddb0e service nova] Creating event network-changed:d278eadc-ca53-49cb-8272-d4d973d93099 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:36:49.518114 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2f25446c-896d-4558-87ed-f02fded29a12 req-fd69dd38-1d1d-4fd6-8f42-ae9c38dddb0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042242 Jul 01 10:36:49.520481 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1261/2513] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:49.528426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:49.529336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:49.539658 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:49.540321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:49.541313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:49.541896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:49.763404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:49.793635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:49.798957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:49.802880 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-83ab143b-820d-4078-9c9f-f21751cb15c9 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1890 microversion: 2.42 time: 2.626647 Jul 01 10:36:49.824371 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1253/2514] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:47 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1890 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:49.844179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:49.845996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:49.873883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:49.874345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:49.875734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:49.875734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:50.079238 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:50.174377 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:50.720996 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:50.809268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:50.823848 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3c8e6ad4-05ee-406e-8ddf-4c51c9833007 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1673 microversion: 2.1 time: 1.301648 Jul 01 10:36:50.825478 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1262/2515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:49 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1673 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:50.862394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e12574e-a984-4b99-9674-78018740bbe3 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e12574e-a984-4b99-9674-78018740bbe3 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Request method failure captured: Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511/action HTTP/1.1 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 39 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs4K6CZpQJqIGAC460Q2p89wMHU8Thm6KH8arzs6xdPpuIDqMnpUE2kQVAJ34fOOiOJ2D1OvqtTsts0A3vbRUaBza_nZpzKukQgehXQujze-9WuWT70tCeFqCE0MoJZz5lazqnltSI2j_CPdDek_xOPAFqFUtnAZSM2m9L0SCJ5R6BQ Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52a9c74d6bcd43c5aeb3f7c1f6cd75d7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 3ef4a32bbcb545599abd69443c1bd2d1 Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: {"os-resetState": {"state": "invalid"}} Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '21a79111-091f-4906-8420-10b798ad5511', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'invalid' Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:36:50.863769 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 01 10:36:50.867768 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:36:50.870640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e12574e-a984-4b99-9674-78018740bbe3 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:50.874177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e12574e-a984-4b99-9674-78018740bbe3 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511/action" status: 400 len: 144 microversion: 2.1 time: 0.033148 Jul 01 10:36:50.881646 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1263/2516] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:50 2022] POST /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511/action => generated 144 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:36:50.887636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:50.891246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:50.901514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:50.902130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:50.904364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:50.905240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:51.132456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:51.148744 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-53dfaa4a-bfd7-47eb-b333-593218616416 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 1.317899 Jul 01 10:36:51.151186 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1254/2517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:49 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:51.177642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:51.178311 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:51.195296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:51.196175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:51.198158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:51.198809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:51.878074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:51.895016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:51.899833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:51.902571 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f5e90e2-6259-44fd-aa7d-1c2807697f6d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1890 microversion: 2.42 time: 0.750135 Jul 01 10:36:51.905261 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1255/2518] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:51 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1890 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:51.919511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ebdd7c0-b7de-4e6f-9af3-a86c8479b938 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ebdd7c0-b7de-4e6f-9af3-a86c8479b938 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Request method failure captured: Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511/action HTTP/1.1 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 31 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs4K6CZpQJqIGAC460Q2p89wMHU8Thm6KH8arzs6xdPpuIDqMnpUE2kQVAJ34fOOiOJ2D1OvqtTsts0A3vbRUaBza_nZpzKukQgehXQujze-9WuWT70tCeFqCE0MoJZz5lazqnltSI2j_CPdDek_xOPAFqFUtnAZSM2m9L0SCJ5R6BQ Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52a9c74d6bcd43c5aeb3f7c1f6cd75d7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 3ef4a32bbcb545599abd69443c1bd2d1 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: {"os-resetState": {"state": 1}} Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '21a79111-091f-4906-8420-10b798ad5511', 'body': {'os-resetState': {'state': 1}}} Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 1 Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 01 10:36:51.926896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 01 10:36:51.931244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:51.934130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ebdd7c0-b7de-4e6f-9af3-a86c8479b938 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:51.936332 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ebdd7c0-b7de-4e6f-9af3-a86c8479b938 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511/action" status: 400 len: 120 microversion: 2.1 time: 0.029955 Jul 01 10:36:51.936520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:51.942115 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1256/2519] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:36:51 2022] POST /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511/action => generated 120 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:36:51.950519 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ecae3af2-ce4f-4573-9f60-dfccb77ca9ca tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1314 microversion: 2.1 time: 1.066916 Jul 01 10:36:51.951279 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1264/2520] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:50 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:51.961319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6b958918-9507-4c43-8a21-cbaac99ca4b7 req-738e7219-b25d-4df0-b0fe-025302847b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "e2f849d1-280e-494f-9238-6812479d0556"}, {"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "c25a26fa-0f48-4280-aafb-da9333b6647c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:51.964272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:51.966646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:51.981669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:51.982681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:51.983639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:51.984353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b958918-9507-4c43-8a21-cbaac99ca4b7 req-738e7219-b25d-4df0-b0fe-025302847b26 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:51.984977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b958918-9507-4c43-8a21-cbaac99ca4b7 req-738e7219-b25d-4df0-b0fe-025302847b26 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:51.985652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:52.006933 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6b958918-9507-4c43-8a21-cbaac99ca4b7 req-738e7219-b25d-4df0-b0fe-025302847b26 service nova] Creating event network-changed:e2f849d1-280e-494f-9238-6812479d0556 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:36:52.012505 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6b958918-9507-4c43-8a21-cbaac99ca4b7 req-738e7219-b25d-4df0-b0fe-025302847b26 service nova] Creating event network-changed:c25a26fa-0f48-4280-aafb-da9333b6647c for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:36:52.020425 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6b958918-9507-4c43-8a21-cbaac99ca4b7 req-738e7219-b25d-4df0-b0fe-025302847b26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079493 Jul 01 10:36:52.025485 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1257/2521] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:52.034923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f05aff88-c993-4a09-81ed-2de7afbd5565 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:52.038144 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f05aff88-c993-4a09-81ed-2de7afbd5565 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Failed to fetch instance by id 999 {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 01 10:36:52.040432 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f05aff88-c993-4a09-81ed-2de7afbd5565 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f05aff88-c993-4a09-81ed-2de7afbd5565 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Request method failure captured: Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 37 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs4K6CZpQJqIGAC460Q2p89wMHU8Thm6KH8arzs6xdPpuIDqMnpUE2kQVAJ34fOOiOJ2D1OvqtTsts0A3vbRUaBza_nZpzKukQgehXQujze-9WuWT70tCeFqCE0MoJZz5lazqnltSI2j_CPdDek_xOPAFqFUtnAZSM2m9L0SCJ5R6BQ Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52a9c74d6bcd43c5aeb3f7c1f6cd75d7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52a9c74d6bcd43c5aeb3f7c1f6cd75d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 52a9c74d6bcd43c5aeb3f7c1f6cd75d7 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1747077587 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 3ef4a32bbcb545599abd69443c1bd2d1 Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1747077587-project-admin Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: {"os-resetState": {"state": "error"}} Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 999 could not be found. Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:36:52.047455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:36:52.052593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:36:52.052593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 01 10:36:52.052593 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:36:52.054233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f05aff88-c993-4a09-81ed-2de7afbd5565 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:36:52.056380 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f05aff88-c993-4a09-81ed-2de7afbd5565 tempest-ServersAdminNegativeTestJSON-1747077587 tempest-ServersAdminNegativeTestJSON-1747077587-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.028449 Jul 01 10:36:52.060252 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1258/2522] 10.222.0.23 () {60 vars in 1178 bytes} [Fri Jul 1 10:36:52 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:36:52.075323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:52.075960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:52.091214 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:52.094718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:52.095730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:52.098235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:52.154216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:36:52.629516 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f2049337-10e3-4070-980e-4290b2489ad7 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 204 len: 0 microversion: 2.1 time: 0.564233 Jul 01 10:36:52.631472 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1259/2523] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:36:52 2022] DELETE /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:36:52.642529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:52.645839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:52.663883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:52.665476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:52.666304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:52.666740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:53.013013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:53.028702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-449c099e-9bb0-4195-ab3b-1b6056d85d5e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1673 microversion: 2.1 time: 1.071876 Jul 01 10:36:53.041599 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1265/2524] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:51 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1673 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:53.054665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:53.057472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:53.074638 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:53.075305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:53.076300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:53.078479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:53.913140 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:53.928485 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-246c3c1b-b18c-4667-aeb7-82826bdcb659 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 1.290349 Jul 01 10:36:53.928485 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1260/2525] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:52 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:53.939489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:53.940550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:53.954772 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:53.956395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:53.959559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:53.960182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:54.458368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:54.467531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-350a4152-d077-45fb-af99-041c2c33fbff tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1468 microversion: 2.1 time: 1.424339 Jul 01 10:36:54.475494 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1266/2526] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:53 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1468 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:54.491758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:54.492997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:54.518323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:54.526687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:54.527747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:54.537578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:55.378368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:55.388416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:55.389973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:55.401988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-682053c8-87aa-425b-aa92-6b3e557ee29c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1890 microversion: 2.42 time: 1.473256 Jul 01 10:36:55.403211 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1261/2527] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:53 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1890 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:55.417864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:55.418748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:55.433445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:55.434292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:55.442016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:55.443984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:55.491472 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:55.712390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:55.724885 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c082595f-92de-4685-84b0-175c5b37cd58 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1314 microversion: 2.1 time: 1.248191 Jul 01 10:36:55.728347 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1267/2528] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:54 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1314 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:55.740214 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-cba0d31c-eaf1-490f-a588-3ffaaa9f7fcb req-424f5034-db17-4842-b06c-43fd98278c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "b1283c20-2b14-4147-b47c-03424c3b0288"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:55.762384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cba0d31c-eaf1-490f-a588-3ffaaa9f7fcb req-424f5034-db17-4842-b06c-43fd98278c04 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:55.763150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cba0d31c-eaf1-490f-a588-3ffaaa9f7fcb req-424f5034-db17-4842-b06c-43fd98278c04 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:55.792957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-cba0d31c-eaf1-490f-a588-3ffaaa9f7fcb req-424f5034-db17-4842-b06c-43fd98278c04 service nova] Creating event network-changed:b1283c20-2b14-4147-b47c-03424c3b0288 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:36:55.802633 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-cba0d31c-eaf1-490f-a588-3ffaaa9f7fcb req-424f5034-db17-4842-b06c-43fd98278c04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071776 Jul 01 10:36:55.803746 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1268/2529] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:55.822483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:55.824471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:55.835559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:55.838316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:55.842258 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:55.843013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:55.845886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:55.858266 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e3004b8-633f-428e-ac55-fa6c9eec17b2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1678 microversion: 2.1 time: 0.453806 Jul 01 10:36:55.871263 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1262/2530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:55 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1678 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:56.107683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-661614339", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "e95a279c-448a-4371-a9e0-60c5b05d38a7"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:56.227822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] validate_networks() for [('e95a279c-448a-4371-a9e0-60c5b05d38a7', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:36:56.322330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:56.331298 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b95addc-4238-4b9e-85e4-1d84e2d02565 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1523 microversion: 2.1 time: 0.526138 Jul 01 10:36:56.334106 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1269/2531] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:55 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1523 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:56.342209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:56.344179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:56.372860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:56.374470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:56.375305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:56.375743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:56.794034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:56.808849 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3c3e04fd-5d08-46b9-92f8-1dd084ca3bba tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1468 microversion: 2.1 time: 0.472092 Jul 01 10:36:56.812606 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1270/2532] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:56 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1468 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:56.832649 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4deb79e7-ddc7-4a8d-8e43-ba099ac0a3dc req-7de18e10-0a57-4574-a5e6-98cffe560402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4afc470-5045-4a5c-b6a9-f83ca6ef7815", "tag": "fb797876-06c8-41bf-8676-0cf94fe5eeb8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:56.864291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4deb79e7-ddc7-4a8d-8e43-ba099ac0a3dc req-7de18e10-0a57-4574-a5e6-98cffe560402 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:56.864739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4deb79e7-ddc7-4a8d-8e43-ba099ac0a3dc req-7de18e10-0a57-4574-a5e6-98cffe560402 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:56.905618 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4deb79e7-ddc7-4a8d-8e43-ba099ac0a3dc req-7de18e10-0a57-4574-a5e6-98cffe560402 service nova] Creating event network-changed:fb797876-06c8-41bf-8676-0cf94fe5eeb8 for instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 on n-h2-master-1 Jul 01 10:36:56.923289 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4deb79e7-ddc7-4a8d-8e43-ba099ac0a3dc req-7de18e10-0a57-4574-a5e6-98cffe560402 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109336 Jul 01 10:36:56.923924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1271/2533] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:36:56.943697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:56.953003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:56.965334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:56.965790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:56.966588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:56.967046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:57.515311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:57.544051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:57.551244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:36:57.552428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:57.555342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:36:57.555342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:36:57.555342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:36:57.555342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:36:57.557671 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1ec2eb5f-9f02-4aab-8c99-8804e07cba5d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1890 microversion: 2.42 time: 0.625441 Jul 01 10:36:57.570612 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1272/2534] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:56 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1890 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:57.573455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:57.574282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:57.579638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:57.580867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:57.582653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:57.583294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:57.588690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:57.590303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:57.593830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:57.596260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:57.606578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:36:57.613699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for user e3ce54f4c29540dc8f7077c2717f6451 and project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:36:57.628772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:36:57.631341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:36:57.763853 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39d61daa-eae8-4daa-95be-a4b66ba1c7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.891149 Jul 01 10:36:57.765094 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1263/2535] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:36:57.782927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:57.783570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:57.795161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:57.795953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:57.797395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:57.798008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:58.092100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:58.101491 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9dbb2203-ba68-4c23-a19b-efab2ca33d88 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1314 microversion: 2.1 time: 0.540073 Jul 01 10:36:58.102088 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1273/2536] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:57 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:58.112662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:58.123430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:58.143989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:58.145969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:58.154154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:58.155414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:58.216108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:58.229604 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-38337c02-1e37-4832-b2e5-debe7617faf8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.460215 Jul 01 10:36:58.230223 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1264/2537] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:57 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:58.242424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d56225c3-7e2a-4448-a5ca-ff931dcbabb7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:58.243048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d56225c3-7e2a-4448-a5ca-ff931dcbabb7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:58.327701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d56225c3-7e2a-4448-a5ca-ff931dcbabb7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:58.339244 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d56225c3-7e2a-4448-a5ca-ff931dcbabb7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1210 microversion: 2.1 time: 0.103127 Jul 01 10:36:58.339868 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1265/2538] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:58 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:58.348481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:58.349899 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:58.366985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:58.370107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:58.372715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:58.374800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:58.608716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:58.626994 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-97d02744-ed61-4560-8bab-0d24e4b3b3d2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1503 microversion: 2.1 time: 0.523744 Jul 01 10:36:58.642453 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1274/2539] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:58 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1503 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:58.658573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:58.658573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:58.674611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:58.675939 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:58.677346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:58.678527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:59.590603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:59.613331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91ec1a45-6b49-4640-b0f8-dbe16eb51757 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1468 microversion: 2.1 time: 1.271940 Jul 01 10:36:59.633617 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1266/2540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:58 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1468 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:36:59.641888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2bde8036-80ad-45a9-9ea7-66e6e4c27b3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'create', calling method: .version_select at 0x7f6f91b2bca0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-483759752", "description": "tempest-description-1397411296"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:36:59.903173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:59.918771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:59.928282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:36:59.928282 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba61618e-807d-431d-ae05-4bcbd200dfdd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1890 microversion: 2.42 time: 1.279631 Jul 01 10:36:59.928282 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1275/2541] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:36:58 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1890 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:36:59.938410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:36:59.939204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:36:59.951857 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:36:59.958550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:59.959195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:36:59.960198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:36:59.960656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:02.027064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:02.032572 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:02.048379 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa87c973-cdfa-45e2-9a96-43794394d2bb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1314 microversion: 2.1 time: 2.123410 Jul 01 10:37:02.051772 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1276/2542] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:36:59 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1314 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:02.061489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:02.063113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:02.080450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:02.081258 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:02.082437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:02.083239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:02.511462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:02.519888 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-44b4d36c-5558-4713-9070-ecc0d2c1b5a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1268 microversion: 2.1 time: 0.466874 Jul 01 10:37:02.522175 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1277/2543] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:02 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1268 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:02.540696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:02.541835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:02.551519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:02.552391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:02.554573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:02.556149 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:02.670509 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2bde8036-80ad-45a9-9ea7-66e6e4c27b3b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 3.035918 Jul 01 10:37:02.672065 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1267/2544] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:36:59 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 3038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:02.677647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:02.683503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:02.697346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:02.697810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:02.702294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:02.702765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:03.636503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:03.653079 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ad5bd35-ed29-4e10-941c-2a9f05f9c0c1 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 200 len: 1468 microversion: 2.1 time: 1.129438 Jul 01 10:37:03.665538 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1278/2545] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:02 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 1468 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:03.673720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0cc79bc3-8661-4138-844e-12021faceeb0 req-b3fa4a8c-56df-47de-85a8-71ff7b7046f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "2c8619a3-cc50-4ef2-b76b-3af83b3d15d0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:03.729321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0cc79bc3-8661-4138-844e-12021faceeb0 req-b3fa4a8c-56df-47de-85a8-71ff7b7046f0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:03.730281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0cc79bc3-8661-4138-844e-12021faceeb0 req-b3fa4a8c-56df-47de-85a8-71ff7b7046f0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:03.771579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0cc79bc3-8661-4138-844e-12021faceeb0 req-b3fa4a8c-56df-47de-85a8-71ff7b7046f0 service nova] Creating event network-changed:2c8619a3-cc50-4ef2-b76b-3af83b3d15d0 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:03.779890 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0cc79bc3-8661-4138-844e-12021faceeb0 req-b3fa4a8c-56df-47de-85a8-71ff7b7046f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112437 Jul 01 10:37:03.782680 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1279/2546] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:03.790670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-483759752"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:03.791715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:03.800944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:03.802519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:03.805776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:03.806452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:03.924149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:03.942600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:03.949338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:03.953111 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e82febd8-a8fa-4b01-bfca-5b43c7a4c033 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 1.279714 Jul 01 10:37:03.954488 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1268/2547] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:02 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:03.972602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:03.973581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:04.010844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:04.010844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:04.010844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:04.010844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:04.159364 n-d-master-1 devstack@n-api.service[119764]: INFO nova.network.security_group_api [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Adding security group 68193f8a-4a55-471e-9aef-a1c6d835d252 to port 95362d8a-e8af-4793-9cd3-f74c8e43658e Jul 01 10:37:04.566510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:04.579530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fca54b2-6fb3-4314-a437-e4364fc08cd3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1314 microversion: 2.1 time: 0.621841 Jul 01 10:37:04.590359 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1269/2548] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:03 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:04.598793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:04.599441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:04.607607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:04.608082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:04.608870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:04.609340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.013281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:05.036833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-04733b83-949f-4f62-bff9-c7354c166a13 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1310 microversion: 2.1 time: 0.443932 Jul 01 10:37:05.048794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1270/2549] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:04 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1310 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:05.055582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-affba5b2-2783-423e-8c1a-155a760c8eeb req-ef44929d-4698-42dc-94f2-f33f358cca6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2911ba-0f47-4839-b640-dea5d2f4b10c", "name": "network-vif-deleted", "tag": "16672ddf-b7d0-4b85-9b38-8916365e1be5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:05.084499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-affba5b2-2783-423e-8c1a-155a760c8eeb req-ef44929d-4698-42dc-94f2-f33f358cca6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:05.085189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-affba5b2-2783-423e-8c1a-155a760c8eeb req-ef44929d-4698-42dc-94f2-f33f358cca6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.108665 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-affba5b2-2783-423e-8c1a-155a760c8eeb req-ef44929d-4698-42dc-94f2-f33f358cca6d service nova] Creating event network-vif-deleted:16672ddf-b7d0-4b85-9b38-8916365e1be5 for instance cd2911ba-0f47-4839-b640-dea5d2f4b10c on n-h1-master-1 Jul 01 10:37:05.123839 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-affba5b2-2783-423e-8c1a-155a760c8eeb req-ef44929d-4698-42dc-94f2-f33f358cca6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082029 Jul 01 10:37:05.126876 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1271/2550] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:05.133982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:05.135607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: cd2911ba-0f47-4839-b640-dea5d2f4b10c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:05.145294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:05.145950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.147059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:05.147650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] HTTP exception thrown: Instance cd2911ba-0f47-4839-b640-dea5d2f4b10c could not be found. Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Request method failure captured: Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c HTTP/1.1 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs4J-l1G6_R0rag0CvjbbY5Rfiui9uK-mrRw2OvQKe_Dp7PAOeNzpoAHNOQOz_MLqr8mzHtOek6bnNf4VUN7zMVaxGnl-mNR7MKW43AXt1aiJX9hRx1mE8zpMdwa0uUvjct3p0QQlIVGFNFwmxc7eGLFk1UxDVELLd0pItsxah9zcH4 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: faaf7e2113fc497f887b69928eea7fe2 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2139803625 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faaf7e2113fc497f887b69928eea7fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/faaf7e2113fc497f887b69928eea7fe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_faaf7e2113fc497f887b69928eea7fe2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faaf7e2113fc497f887b69928eea7fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2139803625 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: faaf7e2113fc497f887b69928eea7fe2 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2139803625 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdminNegativeTestJSON-2139803625-project Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 61a6df97de4244c1babbcec634b2cc12 Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2139803625-project Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: exception: Instance cd2911ba-0f47-4839-b640-dea5d2f4b10c could not be found. Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'cd2911ba-0f47-4839-b640-dea5d2f4b10c'} Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2911ba-0f47-4839-b640-dea5d2f4b10c could not be found. Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:37:05.177237 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2911ba-0f47-4839-b640-dea5d2f4b10c could not be found. Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2911ba-0f47-4839-b640-dea5d2f4b10c could not be found. Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Returning 404 to user: Instance cd2911ba-0f47-4839-b640-dea5d2f4b10c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f062912c-363d-4db4-8292-7669ab72de78 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c" status: 404 len: 111 microversion: 2.1 time: 0.048476 Jul 01 10:37:05.182180 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1272/2551] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:05 2022] GET /compute/v2.1/servers/cd2911ba-0f47-4839-b640-dea5d2f4b10c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:37:05.187070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:05.187745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:05.197274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:05.197779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.198572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:05.199066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.592508 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bd696226-ed17-4e68-9655-e9c65693cfea tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action" status: 202 len: 0 microversion: 2.1 time: 1.804277 Jul 01 10:37:05.598139 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1280/2552] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:37:03 2022] POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action => generated 0 bytes in 1814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:05.605252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:05.606331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:05.614447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:05.616238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.617464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:05.618775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:05.672224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:37:05.811949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:05.829450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:05.836433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:05.839108 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5e6c4a06-0971-455f-8cf9-deb13187524f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.659976 Jul 01 10:37:05.840849 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1273/2553] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:05 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:06.035485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a8ea6fa-c5e6-435e-9be5-19fe530de361 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "DELETE /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 204 len: 0 microversion: 2.1 time: 0.435182 Jul 01 10:37:06.036447 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1281/2554] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:37:05 2022] DELETE /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:37:06.042510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:06.043772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:06.054069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:06.054544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:06.055553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:06.060279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:06.094707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1823055712", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "b420296f-3c97-4204-9d7d-30b586628815"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:06.167803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] validate_networks() for [('b420296f-3c97-4204-9d7d-30b586628815', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:37:06.664004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:06.673501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f110add3-7756-4897-b3eb-b525898013e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1314 microversion: 2.1 time: 0.635704 Jul 01 10:37:06.674733 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1282/2555] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:06 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:06.681064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-483759752"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:06.682414 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:06.693278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:06.693915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:06.700419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:06.700419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:06.910216 n-d-master-1 devstack@n-api.service[119764]: INFO nova.network.security_group_api [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Removing security group 68193f8a-4a55-471e-9aef-a1c6d835d252 from port 95362d8a-e8af-4793-9cd3-f74c8e43658e Jul 01 10:37:07.187246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:37:07.188606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:37:07.189346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:37:07.191813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:37:07.192513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:37:07.219695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:07.220156 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:07.221354 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:07.222659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:07.250461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Getting quotas for project 2a951f035ec74e2690d9a28934035056. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:37:07.261118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Getting quotas for user 538b08000bbf48eb98640127bea8036f and project 2a951f035ec74e2690d9a28934035056. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:37:07.277592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:37:07.281357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:37:07.486963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-845ab6f5-99bf-4cb9-998a-7106c4b2ce5b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640401 Jul 01 10:37:07.488895 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1274/2556] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:37:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:37:07.494159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-1c3752df-11f9-4acf-b0e6-d06599ba3efb req-6be29bd7-e82e-42bb-afec-967ab4eab4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7936ef-c268-4341-9600-35a8ae142d02", "tag": "294f2323-eac6-4183-8f01-0a4b656c265f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:07.516758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1c3752df-11f9-4acf-b0e6-d06599ba3efb req-6be29bd7-e82e-42bb-afec-967ab4eab4b7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:07.518266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1c3752df-11f9-4acf-b0e6-d06599ba3efb req-6be29bd7-e82e-42bb-afec-967ab4eab4b7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:07.574586 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-1c3752df-11f9-4acf-b0e6-d06599ba3efb req-6be29bd7-e82e-42bb-afec-967ab4eab4b7 service nova] Creating event network-changed:294f2323-eac6-4183-8f01-0a4b656c265f for instance 8b7936ef-c268-4341-9600-35a8ae142d02 on n-h1-master-1 Jul 01 10:37:07.596364 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-1c3752df-11f9-4acf-b0e6-d06599ba3efb req-6be29bd7-e82e-42bb-afec-967ab4eab4b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101613 Jul 01 10:37:07.609967 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1275/2557] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:07.636267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:07.637102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:07.659866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:07.660418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:07.661219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:07.661654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:08.047774 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd724681-b276-4c23-a3bd-74f74109daa4 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action" status: 202 len: 0 microversion: 2.1 time: 1.370738 Jul 01 10:37:08.053416 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1283/2558] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:37:06 2022] POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:08.068490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:08.070084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:08.078732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:08.080265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:08.082402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:08.082809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:08.403564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a6df97de4244c1babbcec634b2cc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faaf7e2113fc497f887b69928eea7fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:08.412375 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1118823d-3bd7-4622-9ef2-89aaa74e9418 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 200 len: 1477 microversion: 2.1 time: 0.797720 Jul 01 10:37:08.417783 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1276/2559] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:07 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 1477 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:08.427313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2041998534", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "819d2546-efd1-47ae-b263-cd165c5e714a"}, {"uuid": "bb7ffdbe-c48f-41d1-be32-7c1a3c86e2a8"}, {"uuid": "819d2546-efd1-47ae-b263-cd165c5e714a"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:08.511418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] validate_networks() for [('819d2546-efd1-47ae-b263-cd165c5e714a', None, None, None, None, None), ('bb7ffdbe-c48f-41d1-be32-7c1a3c86e2a8', None, None, None, None, None), ('819d2546-efd1-47ae-b263-cd165c5e714a', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:37:08.857749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:08.871555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-091f72cf-9694-480a-8d1c-a125eee5612a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1310 microversion: 2.1 time: 0.806385 Jul 01 10:37:08.873325 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1284/2560] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:08 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1310 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:08.880469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:08.881764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:08.889029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:08.889810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:08.891048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:08.891739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:09.376610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:09.392787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:09.399469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:09.402993 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bba136be-81db-40b2-8978-278ada1b1e51 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.528360 Jul 01 10:37:09.406446 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1285/2561] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:08 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:09.421278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-45a4bd05-8d3c-4a1f-9004-1dbbe9f62cdf req-1210e1e5-a092-453c-84ce-fc32c4b57b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f644d5-098c-4811-9a18-10b650654a68", "tag": "95362d8a-e8af-4793-9cd3-f74c8e43658e"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:09.449292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-45a4bd05-8d3c-4a1f-9004-1dbbe9f62cdf req-1210e1e5-a092-453c-84ce-fc32c4b57b5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:09.449292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-45a4bd05-8d3c-4a1f-9004-1dbbe9f62cdf req-1210e1e5-a092-453c-84ce-fc32c4b57b5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:09.481842 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-45a4bd05-8d3c-4a1f-9004-1dbbe9f62cdf req-1210e1e5-a092-453c-84ce-fc32c4b57b5f service nova] Creating event network-changed:95362d8a-e8af-4793-9cd3-f74c8e43658e for instance a1f644d5-098c-4811-9a18-10b650654a68 on n-h2-master-1 Jul 01 10:37:09.494454 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-45a4bd05-8d3c-4a1f-9004-1dbbe9f62cdf req-1210e1e5-a092-453c-84ce-fc32c4b57b5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082678 Jul 01 10:37:09.501595 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1286/2562] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:09.510284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-45eeb3e9-79aa-4ffb-9da4-b804ef2acc18 req-315847d1-21f8-4d03-8b84-2dfbad04ac79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4afc470-5045-4a5c-b6a9-f83ca6ef7815", "name": "network-vif-plugged", "status": "completed", "tag": "fb797876-06c8-41bf-8676-0cf94fe5eeb8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:09.537494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-45eeb3e9-79aa-4ffb-9da4-b804ef2acc18 req-315847d1-21f8-4d03-8b84-2dfbad04ac79 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:09.538843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-45eeb3e9-79aa-4ffb-9da4-b804ef2acc18 req-315847d1-21f8-4d03-8b84-2dfbad04ac79 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:09.563064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-45eeb3e9-79aa-4ffb-9da4-b804ef2acc18 req-315847d1-21f8-4d03-8b84-2dfbad04ac79 service nova] Creating event network-vif-plugged:fb797876-06c8-41bf-8676-0cf94fe5eeb8 for instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 on n-h2-master-1 Jul 01 10:37:09.575348 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-45eeb3e9-79aa-4ffb-9da4-b804ef2acc18 req-315847d1-21f8-4d03-8b84-2dfbad04ac79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071775 Jul 01 10:37:09.590095 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1287/2563] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:09.596320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1045058388", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "b420296f-3c97-4204-9d7d-30b586628815"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:09.711238 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] validate_networks() for [('b420296f-3c97-4204-9d7d-30b586628815', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:37:11.865952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:37:11.866633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:37:11.866817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:37:11.867397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:37:11.868353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:37:11.878227 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:11.878836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:11.879796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:11.880412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:11.882265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:37:11.882787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:37:11.884112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:37:11.884818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:37:11.885815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:37:11.900155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:11.900792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:11.902379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:11.902929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:11.903536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Getting quotas for project 2a951f035ec74e2690d9a28934035056. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:37:11.910357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Getting quotas for user 538b08000bbf48eb98640127bea8036f and project 2a951f035ec74e2690d9a28934035056. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:37:11.926290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:37:11.928656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:37:11.934237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Getting quotas for project 013f61b227894e55b2659e17a5cd5edc. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:37:11.941433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Getting quotas for user b750345ec443427c98a5cc52ef2194ea and project 013f61b227894e55b2659e17a5cd5edc. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:37:11.958506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:37:11.961949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:37:11.988685 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:12.076944 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-37fa00d2-e020-4b4c-9e95-7f6550f5851a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.657721 Jul 01 10:37:12.083410 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1277/2564] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:37:12.086953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a02240d-1094-4e62-81d3-7124977cd366 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.494971 Jul 01 10:37:12.090724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:12.092064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:12.092509 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1288/2565] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:37:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:37:12.099039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:12.099796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:12.100066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-282b7ac3-7d80-416b-8447-f39dcb470eb2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'create', calling method: .version_select at 0x7f6f92419d30>, body: {"pool": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:12.100911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:12.101533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:12.621496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:12.633538 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3de18bbd-fb7d-4285-8582-8cb500e5fdeb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1502 microversion: 2.1 time: 0.548430 Jul 01 10:37:12.644961 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1278/2566] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:12 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1502 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:12.667720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:12.671112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] [instance: 21a79111-091f-4906-8420-10b798ad5511] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:12.686253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:12.686716 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:12.689378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:12.689834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:12.724487 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] HTTP exception thrown: Instance 21a79111-091f-4906-8420-10b798ad5511 could not be found. Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Request method failure captured: Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 HTTP/1.1 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs4J-l1G6_R0rag0CvjbbY5Rfiui9uK-mrRw2OvQKe_Dp7PAOeNzpoAHNOQOz_MLqr8mzHtOek6bnNf4VUN7zMVaxGnl-mNR7MKW43AXt1aiJX9hRx1mE8zpMdwa0uUvjct3p0QQlIVGFNFwmxc7eGLFk1UxDVELLd0pItsxah9zcH4 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: faaf7e2113fc497f887b69928eea7fe2 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2139803625 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faaf7e2113fc497f887b69928eea7fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/faaf7e2113fc497f887b69928eea7fe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_faaf7e2113fc497f887b69928eea7fe2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/faaf7e2113fc497f887b69928eea7fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2139803625 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: faaf7e2113fc497f887b69928eea7fe2 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2139803625 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdminNegativeTestJSON-2139803625-project Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 61a6df97de4244c1babbcec634b2cc12 Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2139803625-project Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 21a79111-091f-4906-8420-10b798ad5511 could not be found. Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '21a79111-091f-4906-8420-10b798ad5511'} Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a79111-091f-4906-8420-10b798ad5511 could not be found. Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a79111-091f-4906-8420-10b798ad5511 could not be found. Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:12.726374 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a79111-091f-4906-8420-10b798ad5511 could not be found. Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] Returning 404 to user: Instance 21a79111-091f-4906-8420-10b798ad5511 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-75135fb5-2ee1-499f-a1db-e560e6f2f295 tempest-ServersAdminNegativeTestJSON-2139803625 tempest-ServersAdminNegativeTestJSON-2139803625-project] 10.222.0.23 "GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511" status: 404 len: 111 microversion: 2.1 time: 0.081582 Jul 01 10:37:12.734887 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1279/2567] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:12 2022] GET /compute/v2.1/servers/21a79111-091f-4906-8420-10b798ad5511 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:37:12.744541 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:12.745562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:12.758426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:12.758883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:12.759731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:12.760117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:13.150176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:13.160073 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-540891b6-6dc7-4c28-a6e1-63a07ecaf488 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1310 microversion: 2.1 time: 0.429765 Jul 01 10:37:13.161331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1280/2568] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:12 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1310 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:13.168550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:13.169724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:13.180261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:13.181322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:13.183853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:13.185010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:13.645358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:13.658127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:13.661396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:13.662620 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c7597b96-07a7-4424-ae48-1545f724e354 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.499892 Jul 01 10:37:13.675463 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1281/2569] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:13 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:13.685025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-68ef78d3-0b15-4165-abf6-6d49ff6640a7 req-a2ff8310-ec52-4644-bdd4-73c1db13800d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f644d5-098c-4811-9a18-10b650654a68", "tag": "95362d8a-e8af-4793-9cd3-f74c8e43658e"}, {"server_uuid": "21a79111-091f-4906-8420-10b798ad5511", "name": "network-vif-deleted", "tag": "20f19590-4ff3-4bb9-a899-4b12bd1e8237"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:13.695471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-68ef78d3-0b15-4165-abf6-6d49ff6640a7 req-a2ff8310-ec52-4644-bdd4-73c1db13800d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:13.696431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-68ef78d3-0b15-4165-abf6-6d49ff6640a7 req-a2ff8310-ec52-4644-bdd4-73c1db13800d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:13.714714 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-68ef78d3-0b15-4165-abf6-6d49ff6640a7 req-a2ff8310-ec52-4644-bdd4-73c1db13800d service nova] Creating event network-changed:95362d8a-e8af-4793-9cd3-f74c8e43658e for instance a1f644d5-098c-4811-9a18-10b650654a68 on n-h2-master-1 Jul 01 10:37:13.715611 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-68ef78d3-0b15-4165-abf6-6d49ff6640a7 req-a2ff8310-ec52-4644-bdd4-73c1db13800d service nova] Creating event network-vif-deleted:20f19590-4ff3-4bb9-a899-4b12bd1e8237 for instance 21a79111-091f-4906-8420-10b798ad5511 on n-h1-master-1 Jul 01 10:37:13.727066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-68ef78d3-0b15-4165-abf6-6d49ff6640a7 req-a2ff8310-ec52-4644-bdd4-73c1db13800d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049952 Jul 01 10:37:13.728265 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1282/2570] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:13.733964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:13.734779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:13.741169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:13.741631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:13.742403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:13.742920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:13.834863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:13.843828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f61cc8cc-efe9-4052-9abc-64de6a81fa41 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1217 microversion: 2.1 time: 0.114178 Jul 01 10:37:13.847405 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1283/2571] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:13 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:13.849676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-362914925", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "451", "networks": [{"uuid": "b420296f-3c97-4204-9d7d-30b586628815"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:13.902178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] validate_networks() for [('b420296f-3c97-4204-9d7d-30b586628815', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:37:14.483664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:37:14.484230 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:37:14.484981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:37:14.485410 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:37:14.485817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:37:14.501886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:14.502871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:14.505082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:14.505923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:14.527953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Getting quotas for project 2a951f035ec74e2690d9a28934035056. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:37:14.530168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Getting quotas for user 538b08000bbf48eb98640127bea8036f and project 2a951f035ec74e2690d9a28934035056. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:37:14.542840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:37:14.545120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:37:14.686755 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-06170128-c94e-4b1c-a46a-f687a406625e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841040 Jul 01 10:37:14.694373 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1284/2572] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:37:14.701851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:14.702653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:14.712746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:14.714476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:14.715975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:14.717402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:14.754892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lazy-loading 'flavor' on Instance uuid e4afc470-5045-4a5c-b6a9-f83ca6ef7815 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:37:14.880986 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:15.466041 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-024faa09-c313-40bf-ae2a-96816a0bedc1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815/action" status: 202 len: 0 microversion: 2.1 time: 0.769708 Jul 01 10:37:15.467175 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1285/2573] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:37:14 2022] POST /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:15.484057 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-44e94ad4-9798-492f-b67c-7077d6648a14 req-b0e946fb-054b-4334-b7c4-5c9112babfaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b8a143-8738-4973-92b9-988cfd643c2c", "tag": "d39cd4d9-2e9d-419b-8cf1-30f2257a458d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:15.494397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-44e94ad4-9798-492f-b67c-7077d6648a14 req-b0e946fb-054b-4334-b7c4-5c9112babfaf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:15.495182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-44e94ad4-9798-492f-b67c-7077d6648a14 req-b0e946fb-054b-4334-b7c4-5c9112babfaf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:15.508844 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-44e94ad4-9798-492f-b67c-7077d6648a14 req-b0e946fb-054b-4334-b7c4-5c9112babfaf service nova] Creating event network-changed:d39cd4d9-2e9d-419b-8cf1-30f2257a458d for instance 26b8a143-8738-4973-92b9-988cfd643c2c on n-h2-master-1 Jul 01 10:37:15.513356 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-282b7ac3-7d80-416b-8447-f39dcb470eb2 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.418930 Jul 01 10:37:15.523730 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1289/2574] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:37:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:15.530515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-25fe1712-9ba2-495a-abc5-4fd31641d2dc req-21a4edbc-8394-4bfd-bec3-626c375e3236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7936ef-c268-4341-9600-35a8ae142d02", "name": "network-vif-plugged", "status": "completed", "tag": "294f2323-eac6-4183-8f01-0a4b656c265f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:15.538556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-44e94ad4-9798-492f-b67c-7077d6648a14 req-b0e946fb-054b-4334-b7c4-5c9112babfaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069079 Jul 01 10:37:15.540609 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1286/2575] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:15.545359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-25fe1712-9ba2-495a-abc5-4fd31641d2dc req-21a4edbc-8394-4bfd-bec3-626c375e3236 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:15.548897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-25fe1712-9ba2-495a-abc5-4fd31641d2dc req-21a4edbc-8394-4bfd-bec3-626c375e3236 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:15.554432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:15.558101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:15.563362 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-25fe1712-9ba2-495a-abc5-4fd31641d2dc req-21a4edbc-8394-4bfd-bec3-626c375e3236 service nova] Creating event network-vif-plugged:294f2323-eac6-4183-8f01-0a4b656c265f for instance 8b7936ef-c268-4341-9600-35a8ae142d02 on n-h1-master-1 Jul 01 10:37:15.569606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:15.573691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:15.573854 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-25fe1712-9ba2-495a-abc5-4fd31641d2dc req-21a4edbc-8394-4bfd-bec3-626c375e3236 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045671 Jul 01 10:37:15.576820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:15.581328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:15.581430 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1290/2576] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:15.596066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:15.597956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:15.605068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:15.606557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:15.607322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:15.608112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.150291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:16.158430 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f365be2-51bc-43b1-97f4-a05ae368beb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1310 microversion: 2.1 time: 0.614377 Jul 01 10:37:16.158974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1287/2577] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:15 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1310 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:16.168261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:16.182895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:16.184766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:16.186654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:16.188307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:16.192000 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d62a01e-8cd9-493f-89e1-df91767d7844 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.611491 Jul 01 10:37:16.194544 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1291/2578] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:15 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:16.202665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.203113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.203878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.204309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.207164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:16.208013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:16.223682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.224418 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.225404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.225990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.327059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:16.343487 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a235437-fde6-4f81-8d92-749355c61aa9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1224 microversion: 2.1 time: 0.177945 Jul 01 10:37:16.344275 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1288/2579] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:16 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1224 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:16.353591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:16.354613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:16.372170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:16.375598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.376456 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.377567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.378333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.380821 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-972e077c-aa4e-4850-b96a-8d45585905d2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1283 microversion: 2.1 time: 0.185037 Jul 01 10:37:16.381560 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1292/2580] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:16 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:16.396071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.122"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:16.397748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:16.413993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.414884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.416275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:16.417138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:16.449371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Acquired lock "refresh_cache-a1f644d5-098c-4811-9a18-10b650654a68" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:37:16.905557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:16.914905 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1964f08-bcb5-4b5b-bf85-529bd152452d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.569118 Jul 01 10:37:16.915502 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1289/2581] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:16 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:17.178017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:17.183231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:17.200826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:17.201572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:17.202685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:17.204432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:17.685938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:17.695417 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c80082cf-208a-45a9-a9ba-b0e206cd489a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1310 microversion: 2.1 time: 0.523879 Jul 01 10:37:17.697469 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1290/2582] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:17 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1310 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:37:17.702857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:17.703775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:17.710989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:17.711433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:17.712429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:17.712868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:18.093952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:18.103677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:18.105212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:18.106386 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42533232-7d44-453f-bb5b-0ce0a3c9e318 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.407776 Jul 01 10:37:18.107202 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1291/2583] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:17 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:18.111552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:18.112214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:18.118804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:18.119252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:18.120021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:18.120973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:18.234950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:18.244520 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e7ba7a2-5d36-412b-8bb8-3be2909949e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1278 microversion: 2.1 time: 0.136522 Jul 01 10:37:18.247258 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1292/2584] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:18 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:18.251400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:18.252174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:18.260705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:18.261446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:18.263494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:18.264338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:18.968891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:18.991682 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5132f9d7-db6b-4164-a3c4-0a0f14d6cbe9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1313 microversion: 2.1 time: 0.744371 Jul 01 10:37:18.992876 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1293/2585] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:18 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1313 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:19.002362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:19.003565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:19.042574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.043994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:19.045381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.046050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:19.398093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:19.405845 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed6acc37-7c78-4655-b043-7f7a80035ee6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.411742 Jul 01 10:37:19.419062 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1294/2586] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:18 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:19.428473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:19.429542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:19.439693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.441073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:19.442122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.442563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:19.504022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Building network info cache for instance {{(pid=119764) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:37:19.758369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:19.767205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f2b6114e-29df-498e-a569-b801ba6b7d6c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1493 microversion: 2.1 time: 0.347517 Jul 01 10:37:19.779936 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1295/2587] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:19 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1493 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:19.786977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f3e28875-64e4-41d6-97a0-a55569e15e5e req-6cf12fac-edfc-4677-8aca-f305ef07cb40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b8a143-8738-4973-92b9-988cfd643c2c", "name": "network-vif-plugged", "status": "completed", "tag": "d39cd4d9-2e9d-419b-8cf1-30f2257a458d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:19.798977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f3e28875-64e4-41d6-97a0-a55569e15e5e req-6cf12fac-edfc-4677-8aca-f305ef07cb40 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.800323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f3e28875-64e4-41d6-97a0-a55569e15e5e req-6cf12fac-edfc-4677-8aca-f305ef07cb40 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:19.813186 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f3e28875-64e4-41d6-97a0-a55569e15e5e req-6cf12fac-edfc-4677-8aca-f305ef07cb40 service nova] Creating event network-vif-plugged:d39cd4d9-2e9d-419b-8cf1-30f2257a458d for instance 26b8a143-8738-4973-92b9-988cfd643c2c on n-h2-master-1 Jul 01 10:37:19.819795 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f3e28875-64e4-41d6-97a0-a55569e15e5e req-6cf12fac-edfc-4677-8aca-f305ef07cb40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038158 Jul 01 10:37:19.820942 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1296/2588] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:19.826369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-57005f93-23ec-4239-9065-a1ca43c21446 req-f0d62b4f-157e-48a6-9066-54ea96a69310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b2fc1f-8a21-401c-9d4a-523c44f2ccf7", "tag": "16f28481-6c31-4ee9-b510-e5bc91ae2cd7"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:19.836679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-57005f93-23ec-4239-9065-a1ca43c21446 req-f0d62b4f-157e-48a6-9066-54ea96a69310 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.837475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-57005f93-23ec-4239-9065-a1ca43c21446 req-f0d62b4f-157e-48a6-9066-54ea96a69310 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:19.867512 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-57005f93-23ec-4239-9065-a1ca43c21446 req-f0d62b4f-157e-48a6-9066-54ea96a69310 service nova] Creating event network-changed:16f28481-6c31-4ee9-b510-e5bc91ae2cd7 for instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 on n-h1-master-1 Jul 01 10:37:19.875528 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-57005f93-23ec-4239-9065-a1ca43c21446 req-f0d62b4f-157e-48a6-9066-54ea96a69310 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052033 Jul 01 10:37:19.876385 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1297/2589] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:19.885176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:19.886182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:19.895826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.896666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:19.898242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:19.899031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:20.375028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:20.385438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:20.387231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:20.389083 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-424fcbf5-73a3-487d-a13c-322bdb0e5020 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.509935 Jul 01 10:37:20.390244 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1298/2590] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:19 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:20.396403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:20.397301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:20.404071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:20.405293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:20.406528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:20.407210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:20.827799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:20.840412 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62a5faf5-65f7-4125-ad60-ec1e61bafbdd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1320 microversion: 2.1 time: 0.447740 Jul 01 10:37:20.843205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1299/2591] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:20 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1320 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:20.850258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3ac13fde-7827-4316-8a01-8fc4568508b4 req-e5e49ef3-5a1c-493c-894c-00ceb71e4957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f644d5-098c-4811-9a18-10b650654a68", "tag": "95362d8a-e8af-4793-9cd3-f74c8e43658e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:20.859757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ac13fde-7827-4316-8a01-8fc4568508b4 req-e5e49ef3-5a1c-493c-894c-00ceb71e4957 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:20.860503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ac13fde-7827-4316-8a01-8fc4568508b4 req-e5e49ef3-5a1c-493c-894c-00ceb71e4957 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:20.865591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Updating instance_info_cache with network_info: [{"id": "95362d8a-e8af-4793-9cd3-f74c8e43658e", "address": "fa:16:3e:16:10:91", "network": {"id": "c74dedf9-7399-4056-a3b0-fd927e80434d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-439415917-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "989e652e691c49a09855f4d97afd5df1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap95362d8a-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119764) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:37:20.876963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3ac13fde-7827-4316-8a01-8fc4568508b4 req-e5e49ef3-5a1c-493c-894c-00ceb71e4957 service nova] Creating event network-changed:95362d8a-e8af-4793-9cd3-f74c8e43658e for instance a1f644d5-098c-4811-9a18-10b650654a68 on n-h2-master-1 Jul 01 10:37:20.883029 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3ac13fde-7827-4316-8a01-8fc4568508b4 req-e5e49ef3-5a1c-493c-894c-00ceb71e4957 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038611 Jul 01 10:37:20.886334 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1300/2592] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:20.951300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Releasing lock "refresh_cache-a1f644d5-098c-4811-9a18-10b650654a68" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:37:20.957252 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d49ea65f-1238-4119-bc24-d6e368e19857 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action" status: 202 len: 0 microversion: 2.1 time: 4.570969 Jul 01 10:37:20.961228 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1293/2593] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:37:16 2022] POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action => generated 0 bytes in 4579 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:37:21.002409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:21.003955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:21.031108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:21.033097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:21.039130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:21.039992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:21.316219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6883fd89-c195-4bf7-8296-4c2591e51d5d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:21.317267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6883fd89-c195-4bf7-8296-4c2591e51d5d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:21.325793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6883fd89-c195-4bf7-8296-4c2591e51d5d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:21.327384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6883fd89-c195-4bf7-8296-4c2591e51d5d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:21.330303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6883fd89-c195-4bf7-8296-4c2591e51d5d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:21.331481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6883fd89-c195-4bf7-8296-4c2591e51d5d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:21.877248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6883fd89-c195-4bf7-8296-4c2591e51d5d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1644 microversion: 2.1 time: 0.989436 Jul 01 10:37:21.884475 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1301/2594] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:20 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1644 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:21.884475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:21.884475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:21.892802 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:21.915647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:21.916706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:21.917979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:21.918655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:21.920723 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:21.950793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:21.975612 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-afe87de5-e6b0-49ef-9453-be3895b9878b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1334 microversion: 2.1 time: 1.003714 Jul 01 10:37:21.976590 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1294/2595] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:20 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1334 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:21.996935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.122"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:22.349826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:22.356557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:22.357408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:22.358900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:22.359567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:22.386978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:22.395431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de3f165d-265b-4c5b-9247-351011e87ead tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.516395 Jul 01 10:37:22.401516 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1302/2596] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:21 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:22.406388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:22.407010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:22.425398 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:22.427406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:22.438309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:22.439173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:22.832389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:22.856152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:22.858302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:22.860934 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c189aa4-3616-47f4-8474-59b1b1e37c15 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.458349 Jul 01 10:37:22.875123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1303/2597] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:22 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:22.884264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:22.887018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:22.897476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:22.898146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:22.899572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:22.899572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:22.922347 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:22.982456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Acquired lock "refresh_cache-a1f644d5-098c-4811-9a18-10b650654a68" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 10:37:23.563031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:23.574234 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8299f38c-d515-4bd4-ab2d-dc201bbc17f0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1320 microversion: 2.1 time: 0.695708 Jul 01 10:37:23.574234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1304/2598] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:22 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1320 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:23.582220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dd3249c5-9406-4052-89a8-888a0ca1aeb7 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:23.583082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dd3249c5-9406-4052-89a8-888a0ca1aeb7 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:23.589731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3249c5-9406-4052-89a8-888a0ca1aeb7 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:23.590185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3249c5-9406-4052-89a8-888a0ca1aeb7 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:23.591168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3249c5-9406-4052-89a8-888a0ca1aeb7 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:23.591633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3249c5-9406-4052-89a8-888a0ca1aeb7 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:23.925038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dd3249c5-9406-4052-89a8-888a0ca1aeb7 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1644 microversion: 2.1 time: 0.348862 Jul 01 10:37:23.925852 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1305/2599] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:23 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1644 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:23.945627 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f098794b-02a2-4b78-9e77-6ce68c69a529 req-f770a7aa-16de-4378-85a4-05dc63736e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6993fc-6b40-4870-afef-31522ba6f3e9", "tag": "073890cc-fed6-49c8-b5ac-479d02037645"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:23.958032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f098794b-02a2-4b78-9e77-6ce68c69a529 req-f770a7aa-16de-4378-85a4-05dc63736e3b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:23.959325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f098794b-02a2-4b78-9e77-6ce68c69a529 req-f770a7aa-16de-4378-85a4-05dc63736e3b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:23.977675 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f098794b-02a2-4b78-9e77-6ce68c69a529 req-f770a7aa-16de-4378-85a4-05dc63736e3b service nova] Creating event network-changed:073890cc-fed6-49c8-b5ac-479d02037645 for instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 on n-h2-master-1 Jul 01 10:37:23.983033 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f098794b-02a2-4b78-9e77-6ce68c69a529 req-f770a7aa-16de-4378-85a4-05dc63736e3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044023 Jul 01 10:37:23.988503 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1306/2600] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:23.990939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:23.992026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:24.003549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:24.004095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:24.005129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:24.005801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:24.419110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:24.433733 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67c4c62a-dc6f-4089-9303-12056eb1710e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.446143 Jul 01 10:37:24.441925 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1307/2601] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:23 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:24.441925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:24.441925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:24.449535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:24.450434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:24.451636 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:24.452417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:24.515651 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:24.538736 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=26 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:24.865411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:24.886716 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6bd329c-4a1c-4b51-b686-25b1c0b03c9c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.450510 Jul 01 10:37:24.897829 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1308/2602] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:24 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:24.930781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:24.933237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:24.941958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:24.942672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:24.944267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:24.944866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:24.962751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Building network info cache for instance {{(pid=119764) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 01 10:37:25.484510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:25.499657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:25.503943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:25.505294 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-389a6d29-7b0f-4839-a013-d8eba35bb0cc tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.615001 Jul 01 10:37:25.510246 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1309/2603] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:24 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:25.534986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8bbd1c5e-ab40-4ccf-a507-6a8ac44cdd35 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:25.538735 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:37:25.538735 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:37:25.545679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bbd1c5e-ab40-4ccf-a507-6a8ac44cdd35 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:25.547773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bbd1c5e-ab40-4ccf-a507-6a8ac44cdd35 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:25.548855 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bbd1c5e-ab40-4ccf-a507-6a8ac44cdd35 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:25.550204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8bbd1c5e-ab40-4ccf-a507-6a8ac44cdd35 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:25.597310 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8bbd1c5e-ab40-4ccf-a507-6a8ac44cdd35 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.078749 Jul 01 10:37:25.604841 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1310/2604] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:37:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:25.610630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:25.611499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:25.627476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:25.628017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:25.629199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:25.629876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.040365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:26.051999 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f960075f-e2a1-4e80-9f94-dc58391ab81f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1320 microversion: 2.1 time: 0.445444 Jul 01 10:37:26.052531 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1311/2605] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:25 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1320 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:26.070789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-19bcb931-cf3e-4499-83ac-3500f311a77b req-d0192c61-32bc-4330-81b5-f3a04545bafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f644d5-098c-4811-9a18-10b650654a68", "tag": "95362d8a-e8af-4793-9cd3-f74c8e43658e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:26.091593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-19bcb931-cf3e-4499-83ac-3500f311a77b req-d0192c61-32bc-4330-81b5-f3a04545bafa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.092783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-19bcb931-cf3e-4499-83ac-3500f311a77b req-d0192c61-32bc-4330-81b5-f3a04545bafa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.116603 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-19bcb931-cf3e-4499-83ac-3500f311a77b req-d0192c61-32bc-4330-81b5-f3a04545bafa service nova] Creating event network-changed:95362d8a-e8af-4793-9cd3-f74c8e43658e for instance a1f644d5-098c-4811-9a18-10b650654a68 on n-h2-master-1 Jul 01 10:37:26.126423 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-19bcb931-cf3e-4499-83ac-3500f311a77b req-d0192c61-32bc-4330-81b5-f3a04545bafa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068302 Jul 01 10:37:26.129319 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1312/2606] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:26.135260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:26.138334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:26.153163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.153804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.154915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.155575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.406787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:26.428441 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9bcae7c5-5677-432d-9424-520b3bc74ce2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.297593 Jul 01 10:37:26.429042 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1313/2607] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:26 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:26.439101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:26.451771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:26.472848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.473676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.474745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.475464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.568955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lazy-loading 'flavor' on Instance uuid 8b7936ef-c268-4341-9600-35a8ae142d02 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:37:26.603337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Going to try to live migrate instance to n-h2-master-1 {{(pid=119765) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:37:26.727103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Updating instance_info_cache with network_info: [{"id": "95362d8a-e8af-4793-9cd3-f74c8e43658e", "address": "fa:16:3e:16:10:91", "network": {"id": "c74dedf9-7399-4056-a3b0-fd927e80434d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-439415917-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "989e652e691c49a09855f4d97afd5df1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap95362d8a-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119764) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:37:26.735368 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:26.866597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Releasing lock "refresh_cache-a1f644d5-098c-4811-9a18-10b650654a68" {{(pid=119764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 10:37:26.868619 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d0690853-eafb-44c6-a1e9-8765670fb31a tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action" status: 202 len: 0 microversion: 2.1 time: 4.882284 Jul 01 10:37:26.878365 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1295/2608] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:37:21 2022] POST /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68/action => generated 0 bytes in 4896 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 01 10:37:26.882630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d4f22b46-e5e1-45df-89a1-5151b3a320bc req-61f6300d-a038-4ce5-9aaa-eb61d998f6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b2fc1f-8a21-401c-9d4a-523c44f2ccf7", "name": "network-vif-plugged", "status": "completed", "tag": "16f28481-6c31-4ee9-b510-e5bc91ae2cd7"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:26.903684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d4f22b46-e5e1-45df-89a1-5151b3a320bc req-61f6300d-a038-4ce5-9aaa-eb61d998f6d5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.904947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d4f22b46-e5e1-45df-89a1-5151b3a320bc req-61f6300d-a038-4ce5-9aaa-eb61d998f6d5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.934458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d4f22b46-e5e1-45df-89a1-5151b3a320bc req-61f6300d-a038-4ce5-9aaa-eb61d998f6d5 service nova] Creating event network-vif-plugged:16f28481-6c31-4ee9-b510-e5bc91ae2cd7 for instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 on n-h1-master-1 Jul 01 10:37:26.941952 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d4f22b46-e5e1-45df-89a1-5151b3a320bc req-61f6300d-a038-4ce5-9aaa-eb61d998f6d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066430 Jul 01 10:37:26.943125 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1296/2609] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:26.950857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:26.952109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:26.959918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.960904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:26.962180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:26.962840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:27.425519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:27.433791 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38c0a335-4b3b-4532-be7e-1eac9d8e410e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.488358 Jul 01 10:37:27.434231 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1297/2610] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:26 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:27.461183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:27.463934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:27.479034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:27.481629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:27.482732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:27.485229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:27.824300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:27.836121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:27.838088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:27.839640 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc9c893b-c88a-41d1-85a6-97228a0045ad tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.387036 Jul 01 10:37:27.841182 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1298/2611] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:27 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:27.846040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31287fef-d924-4342-bd98-dbe24d8cbd13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '.version_select at 0x7f6f92291d30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:29.143683 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31287fef-d924-4342-bd98-dbe24d8cbd13 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/a981c9f3-6bf1-4c65-81be-9add877621ad" status: 202 len: 0 microversion: 2.1 time: 1.300683 Jul 01 10:37:29.150301 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1299/2612] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:37:27 2022] DELETE /compute/v2.1/os-floating-ips/a981c9f3-6bf1-4c65-81be-9add877621ad => generated 0 bytes in 1303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:29.151021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:29.151648 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:29.159618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:29.160074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:29.161064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:29.161577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:29.405533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:29.413278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79919b82-a233-462a-82e3-ede57e6a325f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1320 microversion: 2.1 time: 0.267031 Jul 01 10:37:29.413853 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1300/2613] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:29 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:29.418584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:29.419279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:29.432338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:29.432338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:29.432338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:29.432338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:29.903536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:29.903536 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-797ee8e7-17e7-4825-ae4d-53c66da80f14 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.316617 Jul 01 10:37:29.903536 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1301/2614] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:29 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:29.903536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b9ca5c1-f7a6-4674-ae5c-230f37fc0af9 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Action: 'create', calling method: .version_select at 0x7f6f913a09d0>, body: {"pool": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:30.430905 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b79a2d73-f29f-4800-91c1-7f4bdbba4452 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02/action" status: 202 len: 0 microversion: 2.1 time: 3.995604 Jul 01 10:37:30.435983 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1314/2615] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:37:26 2022] POST /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02/action => generated 0 bytes in 3998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:30.437988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f231a9d6-c0d3-4a70-bed6-5065a374e1be req-d0979784-67e0-4094-936f-716c18e533cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "tag": "021dc11d-b6e8-46fe-be69-422cb8a4b797"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:30.450743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f231a9d6-c0d3-4a70-bed6-5065a374e1be req-d0979784-67e0-4094-936f-716c18e533cd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:30.451267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f231a9d6-c0d3-4a70-bed6-5065a374e1be req-d0979784-67e0-4094-936f-716c18e533cd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:30.464042 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f231a9d6-c0d3-4a70-bed6-5065a374e1be req-d0979784-67e0-4094-936f-716c18e533cd service nova] Creating event network-changed:021dc11d-b6e8-46fe-be69-422cb8a4b797 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:37:30.470544 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f231a9d6-c0d3-4a70-bed6-5065a374e1be req-d0979784-67e0-4094-936f-716c18e533cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036481 Jul 01 10:37:30.471579 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1315/2616] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:30.478445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:30.479538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:30.489511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:30.493372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:30.493372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:30.493372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:30.926546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:30.934689 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9db127f4-cbf2-4156-930e-d3ae640bbc3f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.461083 Jul 01 10:37:30.935608 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1316/2617] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:30 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:30.940733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:30.941973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:30.949548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:30.951511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:30.952554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:30.953255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:31.241099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:31.254515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:31.256056 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:31.260385 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a4d3c380-7f91-49ac-aa1f-785b67e5556c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.323506 Jul 01 10:37:31.269766 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1317/2618] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:30 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:31.269766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-98836aa7-f353-49b0-bbd8-1261569a4567 req-c2676766-4540-4a41-aec6-98a278660923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6993fc-6b40-4870-afef-31522ba6f3e9", "name": "network-vif-plugged", "status": "completed", "tag": "073890cc-fed6-49c8-b5ac-479d02037645"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:31.274369 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:31.276608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-98836aa7-f353-49b0-bbd8-1261569a4567 req-c2676766-4540-4a41-aec6-98a278660923 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:31.277056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-98836aa7-f353-49b0-bbd8-1261569a4567 req-c2676766-4540-4a41-aec6-98a278660923 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:31.289103 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-98836aa7-f353-49b0-bbd8-1261569a4567 req-c2676766-4540-4a41-aec6-98a278660923 service nova] Creating event network-vif-plugged:073890cc-fed6-49c8-b5ac-479d02037645 for instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 on n-h2-master-1 Jul 01 10:37:31.294339 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-98836aa7-f353-49b0-bbd8-1261569a4567 req-c2676766-4540-4a41-aec6-98a278660923 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 Jul 01 10:37:31.295273 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1318/2619] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:31.301245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cdfdb52-5370-448f-9aa6-f3f0abf53161 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '.version_select at 0x7f6f91fa2e50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:31.797781 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2cdfdb52-5370-448f-9aa6-f3f0abf53161 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/68193f8a-4a55-471e-9aef-a1c6d835d252" status: 202 len: 0 microversion: 2.1 time: 0.500651 Jul 01 10:37:31.799046 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1319/2620] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:37:31 2022] DELETE /compute/v2.1/os-security-groups/68193f8a-4a55-471e-9aef-a1c6d835d252 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:31.803585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:31.804398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:31.811783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:31.812231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:31.813008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:31.813465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.056117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:32.064661 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d3af251d-8e37-459c-968e-3114ddd2f1d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.265066 Jul 01 10:37:32.077223 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1320/2621] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:31 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:32.077223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:32.077223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:32.077223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.077937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.078540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.079215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.290398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:32.298396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-637c4a86-6c9c-454d-ab95-5a553e0e52b9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1320 microversion: 2.1 time: 0.231646 Jul 01 10:37:32.299300 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1321/2622] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:32 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:32.304816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:32.305447 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:32.311880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.312521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.313526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.314110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.615165 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4b9ca5c1-f7a6-4674-ae5c-230f37fc0af9 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.881950 Jul 01 10:37:32.615758 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1302/2623] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:37:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:32.629776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:32.630400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:32.633603 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:32.648505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:32.650118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.650475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.655009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.655471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.658401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf6c7039-5d7f-46be-8b00-387ba00a7d89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.358060 Jul 01 10:37:32.669541 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1322/2624] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:32 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:32.689265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:32.689961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:32.700954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.701441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.702225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.702659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.722586 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:32.737736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:37:32.854692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:32.870749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f976a032-353d-4b63-94ad-dbf5ace07cac tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.251120 Jul 01 10:37:32.872771 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1303/2625] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:32 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:32.879421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:32.880814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:32.892812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.893311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:32.894450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:32.906332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.052142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:33.060664 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2cc92f0-e8a5-4f5e-82b0-d2b48e2d361c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.186749 Jul 01 10:37:33.071396 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1304/2626] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:32 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:33.076944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:33.077727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:33.085614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.086130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.087049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.087722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.095634 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99206fad-9a5a-4362-8583-461f4ad7bf92 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 204 len: 0 microversion: 2.1 time: 0.424607 Jul 01 10:37:33.103671 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1323/2627] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:37:32 2022] DELETE /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:37:33.107406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:33.108799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:33.117493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.119949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.121976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.122710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.372978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:33.383734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e73d9129-232e-4070-b5dc-05a7e42396e8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.310743 Jul 01 10:37:33.384372 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1305/2628] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:33 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:33.388616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fa672667-2315-4b8a-af39-0821d466e8ff req-3789978e-f788-4ba6-9bc0-09bf3acaa5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7936ef-c268-4341-9600-35a8ae142d02", "name": "network-vif-unplugged", "status": "completed", "tag": "294f2323-eac6-4183-8f01-0a4b656c265f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:33.405450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fa672667-2315-4b8a-af39-0821d466e8ff req-3789978e-f788-4ba6-9bc0-09bf3acaa5c9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.405892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fa672667-2315-4b8a-af39-0821d466e8ff req-3789978e-f788-4ba6-9bc0-09bf3acaa5c9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.420723 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fa672667-2315-4b8a-af39-0821d466e8ff req-3789978e-f788-4ba6-9bc0-09bf3acaa5c9 service nova] Creating event network-vif-unplugged:294f2323-eac6-4183-8f01-0a4b656c265f for instance 8b7936ef-c268-4341-9600-35a8ae142d02 on n-h1-master-1 Jul 01 10:37:33.426746 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fa672667-2315-4b8a-af39-0821d466e8ff req-3789978e-f788-4ba6-9bc0-09bf3acaa5c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041394 Jul 01 10:37:33.428051 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1306/2629] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:33.430758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:33.439604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a824e0f9-086c-4669-8906-625e49327a89 req-0f3df02d-e5ee-4af7-b302-cd17ff9ba9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "tag": "f8cf4ea9-7795-4f8e-a331-d31fa4de3249"}, {"name": "network-changed", "server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "tag": "dff58844-fe66-4af5-80b4-fb4f384736e7"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:33.445472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:33.446709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a824e0f9-086c-4669-8906-625e49327a89 req-0f3df02d-e5ee-4af7-b302-cd17ff9ba9a2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.447008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:33.447705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a824e0f9-086c-4669-8906-625e49327a89 req-0f3df02d-e5ee-4af7-b302-cd17ff9ba9a2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.448390 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea65f2b7-792e-4994-9446-cfb695abc1b4 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.348531 Jul 01 10:37:33.449695 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1324/2630] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:33 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:33.455773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76c8aef0-dcd1-47f6-a89b-35b16628c32c tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Action: 'create', calling method: .version_select at 0x7f6f912611f0>, body: {"pool": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:33.460462 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a824e0f9-086c-4669-8906-625e49327a89 req-0f3df02d-e5ee-4af7-b302-cd17ff9ba9a2 service nova] Creating event network-changed:f8cf4ea9-7795-4f8e-a331-d31fa4de3249 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:37:33.461219 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a824e0f9-086c-4669-8906-625e49327a89 req-0f3df02d-e5ee-4af7-b302-cd17ff9ba9a2 service nova] Creating event network-changed:dff58844-fe66-4af5-80b4-fb4f384736e7 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:37:33.466728 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a824e0f9-086c-4669-8906-625e49327a89 req-0f3df02d-e5ee-4af7-b302-cd17ff9ba9a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037174 Jul 01 10:37:33.469549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1307/2631] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:33.475354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:33.476254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:33.483023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.483856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.484633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.485069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.699629 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:33.708980 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0478f342-a817-446c-bcb7-3019412db51b tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1509 microversion: 2.1 time: 0.238079 Jul 01 10:37:33.718772 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1308/2632] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:33 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:33.723819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:33.725138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:33.731545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.737532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.737532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.737532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.965918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:33.974306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e95454d-5814-4629-9fbf-7b54190d8e3b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1511 microversion: 2.1 time: 0.254439 Jul 01 10:37:33.975105 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1309/2633] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:33 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:33.989369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:33.989369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:33.989369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.989369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:33.989369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:33.989369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.201670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:34.211200 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a58967ac-83a7-49d2-b796-c8fb99640309 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.235064 Jul 01 10:37:34.212029 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1310/2634] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:33 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:34.218068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:34.219751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:34.226006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.226510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.227296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.227739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.401530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:34.411767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c583df72-5470-44fb-a17a-f15b4ae1376a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.198327 Jul 01 10:37:34.413262 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1311/2635] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:34 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:34.425282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:34.426093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:34.434411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.435053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.436038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.436833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.617223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:34.632335 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80f13405-5a3a-465e-987e-62c1d5c0d4d6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.217434 Jul 01 10:37:34.632923 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1312/2636] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:34 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:34.637675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:34.641799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:34.650519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.651363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.652920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.653559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.868055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:34.876471 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5cb0e1ac-37a4-4dd9-af9d-ddfcd876e082 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1513 microversion: 2.1 time: 0.242349 Jul 01 10:37:34.877140 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1313/2637] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:34 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:34.882691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:34.883372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:34.890431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.890966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:34.891821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:34.892325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.102837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.111781 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8482ade-0736-49ad-b60e-c90d1bd7619d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.233384 Jul 01 10:37:35.112677 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1314/2638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:34 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:35.118566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:35.118566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:35.126988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.127519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.128937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.129536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.378417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.391562 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:35.407198 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef4ff803-e250-42aa-a829-22fc6e31e2e7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.290116 Jul 01 10:37:35.412257 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76c8aef0-dcd1-47f6-a89b-35b16628c32c tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.961396 Jul 01 10:37:35.412919 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1325/2639] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:37:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:35.417616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:35.418501 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1315/2640] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:35 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:35.418660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:35.426886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:35.434878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:35.435033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.435396 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.436657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.437364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.454144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.454909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.455713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.456687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.571650 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:35.705965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98112fef9f2940848a3ca13bcc63049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989e652e691c49a09855f4d97afd5df1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.711704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.714560 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77f9d906-0646-488b-a3f0-42855c0bd3a0 tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 200 len: 1509 microversion: 2.1 time: 0.294683 Jul 01 10:37:35.715321 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1316/2641] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:35 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:35.720495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:35.721296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:35.729299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.729732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.730102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.730497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.730926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.732016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.733293 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e79721f-f485-4b0c-b309-b913f4e344f5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.319350 Jul 01 10:37:35.734696 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1326/2642] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:35 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:35.739921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:35.741024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:35.748917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.749651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.750663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.751256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.930768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.938938 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-02bfe811-0704-41ea-aa59-0ab28047ec21 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 200 len: 1512 microversion: 2.1 time: 0.222289 Jul 01 10:37:35.939831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1317/2643] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:35 2022] GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:35.945132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d560450d-4e6e-4a73-abb4-9c8a95474af2 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Action: 'create', calling method: .version_select at 0x7f6f91e49700>, body: {"pool": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:35.948100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:35.960237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e617c2f9-1e76-48df-b3fb-86afd90850dc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.224118 Jul 01 10:37:35.960974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1327/2644] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:35 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:35.965745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a0f8f55d-072c-430c-bee6-d1dcbab88bd3 req-4a45fbc2-da43-4572-8c09-96352646c6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7936ef-c268-4341-9600-35a8ae142d02", "tag": "294f2323-eac6-4183-8f01-0a4b656c265f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:35.975336 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a0f8f55d-072c-430c-bee6-d1dcbab88bd3 req-4a45fbc2-da43-4572-8c09-96352646c6e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:35.975932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a0f8f55d-072c-430c-bee6-d1dcbab88bd3 req-4a45fbc2-da43-4572-8c09-96352646c6e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:35.987697 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a0f8f55d-072c-430c-bee6-d1dcbab88bd3 req-4a45fbc2-da43-4572-8c09-96352646c6e9 service nova] Creating event network-changed:294f2323-eac6-4183-8f01-0a4b656c265f for instance 8b7936ef-c268-4341-9600-35a8ae142d02 on n-h1-master-1 Jul 01 10:37:35.993391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a0f8f55d-072c-430c-bee6-d1dcbab88bd3 req-4a45fbc2-da43-4572-8c09-96352646c6e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030959 Jul 01 10:37:35.994079 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1328/2645] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:35.999529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1332845851", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "04eeb7f2-cad2-4f5d-96c5-202b3781e660"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:36.066927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] validate_networks() for [('04eeb7f2-cad2-4f5d-96c5-202b3781e660', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:37:37.354504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:37:37.355734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:37:37.356210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:37:37.356655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:37:37.357061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:37:37.367449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:37.367886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:37.368889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:37.369381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:37.388018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:37:37.393768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for user adf336817b04429b930e1f80ea25b1f7 and project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:37:37.407837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:37:37.410815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:37:37.526857 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71a827b0-768b-4e53-9619-73dd5f8b35aa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531342 Jul 01 10:37:37.527649 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1329/2646] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:37:37.532244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:37.532939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:37.542251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:37.543131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:37.543970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:37.544404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:37.797103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:37.805582 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-284d77a1-57c3-43c0-9871-2a8c2f995685 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.276829 Jul 01 10:37:37.806163 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1330/2647] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:37 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:37.818640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:37.818640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:37.818640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:37.828499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:37.828950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:37.829824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:37.830263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:37.925586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:37.998713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:38.005892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.006364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.196741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-97edcb92-ada6-4a8d-a3b7-f06360c5c7bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.389470 Jul 01 10:37:38.197407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1331/2648] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Jul 1 10:37:37 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:38.203817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:38.204701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:38.211679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.212163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.212992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.213454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.434836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:38.444757 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f56fb45-29a1-4935-b6d9-735370c135e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.246331 Jul 01 10:37:38.445438 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1332/2649] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:38 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:38.450863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:38.451467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] [instance: a1f644d5-098c-4811-9a18-10b650654a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:38.459942 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.460392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.461190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.461631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.475776 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] HTTP exception thrown: Instance a1f644d5-098c-4811-9a18-10b650654a68 could not be found. Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Request method failure captured: Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 HTTP/1.1 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs4WC-absjfx0_JGpnaJFgyH-p9iedW9QiRDjndfmcQEqxvUnFTVRfrSQL84S0tB1wO90tbOIZKKkOh34I2DcZ5qHzsNGobo_Ia0XBrlVpl_cC8-iq-qY7oowphPsjY41RdIGhm2ylRUX7kYQnd7_4qUt-Lf5JaTGc_mGrUOd_0szCA Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 989e652e691c49a09855f4d97afd5df1 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1459020619 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/989e652e691c49a09855f4d97afd5df1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/989e652e691c49a09855f4d97afd5df1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_989e652e691c49a09855f4d97afd5df1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/989e652e691c49a09855f4d97afd5df1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1459020619 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 989e652e691c49a09855f4d97afd5df1 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1459020619 Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerRescueTestJSONUnderV235-1459020619-project Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 98112fef9f2940848a3ca13bcc63049b Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1459020619-project Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: exception: Instance a1f644d5-098c-4811-9a18-10b650654a68 could not be found. Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'a1f644d5-098c-4811-9a18-10b650654a68'} Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f644d5-098c-4811-9a18-10b650654a68 could not be found. Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f644d5-098c-4811-9a18-10b650654a68 could not be found. Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:38.477531 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f644d5-098c-4811-9a18-10b650654a68 could not be found. Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] Returning 404 to user: Instance a1f644d5-098c-4811-9a18-10b650654a68 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc289920-879c-4755-be6a-1fac2483ddfa tempest-ServerRescueTestJSONUnderV235-1459020619 tempest-ServerRescueTestJSONUnderV235-1459020619-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68" status: 404 len: 111 microversion: 2.1 time: 0.032448 Jul 01 10:37:38.483155 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1333/2650] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:38 2022] GET /compute/v2.1/servers/a1f644d5-098c-4811-9a18-10b650654a68 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:37:38.492438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:38.493187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:38.499729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.500183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.501792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.501792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.810598 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d560450d-4e6e-4a73-abb4-9c8a95474af2 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.869580 Jul 01 10:37:38.812260 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1318/2651] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:37:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:38.819240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:38.820242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:38.825588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:38.828867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.829640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.830707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.831931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.836660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:38.838205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:38.839380 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1b1f69f9-b024-46c8-86ac-ce1d245c3e6e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.358930 Jul 01 10:37:38.845826 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1334/2652] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:38 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:38.854969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:38.857126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:38.867026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.867909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.869513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:38.870005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:38.991646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:39.000562 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d707335e-05f5-40ad-b0b7-036ff70d81c4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1219 microversion: 2.1 time: 0.152769 Jul 01 10:37:39.005698 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1335/2653] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:38 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:39.024978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9f42dda0-a9fe-4fad-835c-32f9aeeb2d53 req-71e760a3-a32a-4bd9-8ba9-9b361a14e23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f644d5-098c-4811-9a18-10b650654a68", "name": "network-vif-deleted", "tag": "95362d8a-e8af-4793-9cd3-f74c8e43658e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:39.035514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9f42dda0-a9fe-4fad-835c-32f9aeeb2d53 req-71e760a3-a32a-4bd9-8ba9-9b361a14e23d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.036818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9f42dda0-a9fe-4fad-835c-32f9aeeb2d53 req-71e760a3-a32a-4bd9-8ba9-9b361a14e23d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.050865 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9f42dda0-a9fe-4fad-835c-32f9aeeb2d53 req-71e760a3-a32a-4bd9-8ba9-9b361a14e23d service nova] Creating event network-vif-deleted:95362d8a-e8af-4793-9cd3-f74c8e43658e for instance a1f644d5-098c-4811-9a18-10b650654a68 on n-h2-master-1 Jul 01 10:37:39.056333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9f42dda0-a9fe-4fad-835c-32f9aeeb2d53 req-71e760a3-a32a-4bd9-8ba9-9b361a14e23d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049202 Jul 01 10:37:39.058200 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1336/2654] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:39.063275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:39.067013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:39.069676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:39.070615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1823055712', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:39.074978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0fdf0de5-a66e-4ff3-af7c-0e3dd77756cf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.261218 Jul 01 10:37:39.075794 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1319/2655] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:38 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:39.076026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.076558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.077360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.077826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.082376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:39.086940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:39.091709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.092236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.093345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.093862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.171165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:39.254993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:39.265995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.267548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.282661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:39.293763 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f16c0ec-4220-49ea-a496-b6d9729520f9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.216168 Jul 01 10:37:39.304173 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1320/2656] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:39 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:39.304173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93d022c0-c478-4d8f-891b-0b58ea447179 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Action: 'create', calling method: .version_select at 0x7f6f91c228b0>, body: {"pool": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:39.479419 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e84bf46-c699-46dc-a538-6c76bd9a31a3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1823055712" status: 200 len: 1516 microversion: 2.1 time: 0.419950 Jul 01 10:37:39.480018 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1337/2657] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:37:39 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1823055712 => generated 1516 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:39.497055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b82ce5b9-833a-4347-bc32-5467ed6f7f25 req-801a53a2-a3ad-4786-9e7f-92e356545e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-plugged", "status": "completed", "tag": "c25a26fa-0f48-4280-aafb-da9333b6647c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:39.507201 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b82ce5b9-833a-4347-bc32-5467ed6f7f25 req-801a53a2-a3ad-4786-9e7f-92e356545e16 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.507668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b82ce5b9-833a-4347-bc32-5467ed6f7f25 req-801a53a2-a3ad-4786-9e7f-92e356545e16 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.524763 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b82ce5b9-833a-4347-bc32-5467ed6f7f25 req-801a53a2-a3ad-4786-9e7f-92e356545e16 service nova] Creating event network-vif-plugged:c25a26fa-0f48-4280-aafb-da9333b6647c for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:39.530394 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b82ce5b9-833a-4347-bc32-5467ed6f7f25 req-801a53a2-a3ad-4786-9e7f-92e356545e16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040107 Jul 01 10:37:39.531181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1338/2658] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:39.536965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:39.537682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:39.544432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.544911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.545699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.546394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.778696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:39.791486 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2507e00-6af3-4bf4-9969-d0aed6d9aac3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.259311 Jul 01 10:37:39.800774 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1339/2659] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:39 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:39.805048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:39.808642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:39.814324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:39.824573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.825820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.827038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:39.827752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:39.956759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:40.066074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:40.078338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:40.078786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:40.088628 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:40.406179 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a4f2f7ba-6228-4428-b39c-61790f1723c4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.612958 Jul 01 10:37:40.407340 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1340/2660] 10.222.0.23 () {58 vars in 1172 bytes} [Fri Jul 1 10:37:39 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:40.412641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:40.413498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:40.431740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:40.432664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:40.433652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:40.435955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:40.885489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:40.897626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:40.899423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:40.900758 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87c7e979-1a3d-4a52-8027-c79bf66828a8 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.492234 Jul 01 10:37:40.901569 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1341/2661] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:40 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:40.907349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:40.908203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:40.916635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:40.917094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:40.918075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:40.918725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:41.017923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:41.028903 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6988340b-c545-4a19-ae4c-679ff46b86b5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1273 microversion: 2.1 time: 0.125972 Jul 01 10:37:41.030469 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1342/2662] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:40 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:41.037044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:41.038072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:41.047420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:41.057533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:41.057533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:41.057533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:41.484742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:41.497919 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-146e9bd1-617a-4c58-9852-96661dd8ef8b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.463931 Jul 01 10:37:41.497919 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1343/2663] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:41 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:41.502596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:41.504373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:41.511316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:41.511761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:41.512674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:41.513113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:41.808701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:41.816703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1bd4dab6-35a5-4fcc-ba60-af491f08a075 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.318764 Jul 01 10:37:41.817320 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1344/2664] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:41 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:41.822942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:41.826847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:41.827993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.compute.servers [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Removing options 'limit' from query {{(pid=119765) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 01 10:37:41.829967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:41.837535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:41.838260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:41.844314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:41.844314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:41.878515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:41.887561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:41.888817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:42.538414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93d022c0-c478-4d8f-891b-0b58ea447179 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.242356 Jul 01 10:37:42.539546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1321/2665] 10.222.0.23 () {60 vars in 1169 bytes} [Fri Jul 1 10:37:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:42.548134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:42.550394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:42.560390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:42.561181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:42.565799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:42.565799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:42.606428 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48461123-1c9c-48d9-8e3b-eda053edca67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.777048 Jul 01 10:37:42.610689 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1345/2666] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 10:37:41 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:42.621137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-72edab9a-e18e-4f3a-a355-3bff1e49ed83 req-86586e64-18a2-4666-bf58-fc84c2e304ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-plugged", "status": "completed", "tag": "d278eadc-ca53-49cb-8272-d4d973d93099"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:42.634240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-72edab9a-e18e-4f3a-a355-3bff1e49ed83 req-86586e64-18a2-4666-bf58-fc84c2e304ae service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:42.634682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-72edab9a-e18e-4f3a-a355-3bff1e49ed83 req-86586e64-18a2-4666-bf58-fc84c2e304ae service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:42.671407 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-72edab9a-e18e-4f3a-a355-3bff1e49ed83 req-86586e64-18a2-4666-bf58-fc84c2e304ae service nova] Creating event network-vif-plugged:d278eadc-ca53-49cb-8272-d4d973d93099 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:42.680828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-72edab9a-e18e-4f3a-a355-3bff1e49ed83 req-86586e64-18a2-4666-bf58-fc84c2e304ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068763 Jul 01 10:37:42.686273 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1346/2667] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:42.687333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:42.688079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:42.695136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:42.695629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:42.696488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:42.696919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.005294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.016098 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b7e53b3-d6de-4521-a2f8-5dfcc73238de tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.474492 Jul 01 10:37:43.026138 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1322/2668] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:42 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:43.032082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:43.032618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:43.039461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.043359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.043359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.043359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.046109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.060999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.063540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.067353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bcc29ce6-a4ab-48aa-b6e9-8a3867fec2c1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.384162 Jul 01 10:37:43.068503 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1347/2669] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:42 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:43.077938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:43.083236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:43.095027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.095782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.096869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.097549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.339529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.339769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.343462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c87d0318-8b2a-4279-8328-0c4624ed37a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.273662 Jul 01 10:37:43.344045 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1348/2670] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:43 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:43.349489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-913e132e-bb46-4cd4-94d4-05ac18950197 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Calling method '.version_select at 0x7f6f912b4670>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:43.354234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec51749e-15b6-4816-af9d-260fb1fb822c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.326138 Jul 01 10:37:43.355129 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1323/2671] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:43 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:43.362812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:43.367195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.368327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:43.376316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.376316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.377206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.377924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.489424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:43.591913 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1bfa683a-113a-4115-abdb-be2cdf8d7077 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.235208 Jul 01 10:37:43.593608 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1324/2672] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:37:43 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:43.599422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:43.600407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:43.607303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.617841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.620168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.622239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.841116 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-913e132e-bb46-4cd4-94d4-05ac18950197 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/436ba4d3-6510-40e6-bf6c-cfae37d8c788" status: 200 len: 141 microversion: 2.1 time: 0.495967 Jul 01 10:37:43.841861 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1349/2673] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:37:43 2022] GET /compute/v2.1/os-floating-ips/436ba4d3-6510-40e6-bf6c-cfae37d8c788 => generated 141 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:43.848427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b737d91c-cf8c-43e4-87d7-e642bf77ee98 req-02460902-3145-4b99-90af-437fcb13d2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7936ef-c268-4341-9600-35a8ae142d02", "name": "network-vif-unplugged", "status": "completed", "tag": "294f2323-eac6-4183-8f01-0a4b656c265f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:43.877514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b737d91c-cf8c-43e4-87d7-e642bf77ee98 req-02460902-3145-4b99-90af-437fcb13d2fa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.879757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b737d91c-cf8c-43e4-87d7-e642bf77ee98 req-02460902-3145-4b99-90af-437fcb13d2fa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.895464 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b737d91c-cf8c-43e4-87d7-e642bf77ee98 req-02460902-3145-4b99-90af-437fcb13d2fa service nova] Creating event network-vif-unplugged:294f2323-eac6-4183-8f01-0a4b656c265f for instance 8b7936ef-c268-4341-9600-35a8ae142d02 on n-h1-master-1 Jul 01 10:37:43.900857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.910101 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b737d91c-cf8c-43e4-87d7-e642bf77ee98 req-02460902-3145-4b99-90af-437fcb13d2fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066295 Jul 01 10:37:43.911389 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1350/2674] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:43.911952 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2f3da7f8-b839-4a30-ab22-1ace4992c40d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.316844 Jul 01 10:37:43.912983 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1325/2675] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:43 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:43.916849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-979c7ed3-d7bf-4ac4-b956-b5068eadc932 req-ac52ea07-f9c1-426a-b41b-58da14f55093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4ce907-5b6b-4be2-acf0-53b68de91bb8", "tag": "d99125af-b8e0-4479-bcac-52cca801f513"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:43.922679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:43.927438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-979c7ed3-d7bf-4ac4-b956-b5068eadc932 req-ac52ea07-f9c1-426a-b41b-58da14f55093 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.928048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-979c7ed3-d7bf-4ac4-b956-b5068eadc932 req-ac52ea07-f9c1-426a-b41b-58da14f55093 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.928964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:43.930671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.servers [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Removing options 'limit' from query {{(pid=119764) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 01 10:37:43.931358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:43.938305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.938982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.940045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:43.941091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:43.951886 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-979c7ed3-d7bf-4ac4-b956-b5068eadc932 req-ac52ea07-f9c1-426a-b41b-58da14f55093 service nova] Creating event network-changed:d99125af-b8e0-4479-bcac-52cca801f513 for instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 on n-h2-master-1 Jul 01 10:37:43.958132 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-979c7ed3-d7bf-4ac4-b956-b5068eadc932 req-ac52ea07-f9c1-426a-b41b-58da14f55093 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044575 Jul 01 10:37:43.958975 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1351/2676] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:43.965224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c87173a7-2085-4b38-bdf5-370c6af91bf2 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Calling method '.version_select at 0x7f6f9127b4c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:43.976963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:44.025100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80543564-3e22-426f-8aa8-92f59695df5e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.109287 Jul 01 10:37:44.026788 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1326/2677] 10.222.0.23 () {58 vars in 1149 bytes} [Fri Jul 1 10:37:43 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:44.040873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:44.060704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:44.063891 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:44.077898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.080370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.081884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.082523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.126496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:44.161001 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3da8f6d-c541-4a4c-ba18-9f4495277613 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.126950 Jul 01 10:37:44.161789 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1327/2678] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:37:44 2022] GET /compute/v2.1/servers => generated 1011 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:44.168070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:44.168938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:44.175584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.179981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.179981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.179981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.479724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:44.488961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a48a684-4354-4416-893a-3e428dcf281f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.325955 Jul 01 10:37:44.498424 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1328/2679] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:44 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:44.503128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:44.507349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:44.509613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.510508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.510814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.511239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.790496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:44.809036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:44.811207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:44.812892 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c03ef087-6a15-4d08-a64e-863a75870efd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.313545 Jul 01 10:37:44.825889 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1329/2680] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:44 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:44.833221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:44.837726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:44.838519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:44.851751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.852580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.853594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:44.854080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:44.940190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:44.999251 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a74fa73-2d15-436d-a492-bacdb62d1992 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.175098 Jul 01 10:37:45.006647 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1330/2681] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:37:44 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:45.011277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:45.011899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:45.018014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.018519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.019341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.019818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.154185 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c87173a7-2085-4b38-bdf5-370c6af91bf2 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/436ba4d3-6510-40e6-bf6c-cfae37d8c788" status: 202 len: 0 microversion: 2.1 time: 1.193191 Jul 01 10:37:45.155265 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1352/2682] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:37:43 2022] DELETE /compute/v2.1/os-floating-ips/436ba4d3-6510-40e6-bf6c-cfae37d8c788 => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:45.161039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:45.162064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:45.181058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.181058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.181058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.181058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.207174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:45.214980 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-178a26ce-d077-492f-aa7f-e709a8eb9580 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.207495 Jul 01 10:37:45.215631 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1331/2683] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:45.229188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f434064c-a741-4dd3-af3b-a90d61fd1520 req-5f618933-a90e-4337-9830-e453a84c561c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-plugged", "status": "completed", "tag": "2c8619a3-cc50-4ef2-b76b-3af83b3d15d0"}, {"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-plugged", "status": "completed", "tag": "e2f849d1-280e-494f-9238-6812479d0556"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:45.238054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f434064c-a741-4dd3-af3b-a90d61fd1520 req-5f618933-a90e-4337-9830-e453a84c561c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.238054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f434064c-a741-4dd3-af3b-a90d61fd1520 req-5f618933-a90e-4337-9830-e453a84c561c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.249780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f434064c-a741-4dd3-af3b-a90d61fd1520 req-5f618933-a90e-4337-9830-e453a84c561c service nova] Creating event network-vif-plugged:2c8619a3-cc50-4ef2-b76b-3af83b3d15d0 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:45.250297 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f434064c-a741-4dd3-af3b-a90d61fd1520 req-5f618933-a90e-4337-9830-e453a84c561c service nova] Creating event network-vif-plugged:e2f849d1-280e-494f-9238-6812479d0556 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:45.255857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f434064c-a741-4dd3-af3b-a90d61fd1520 req-5f618933-a90e-4337-9830-e453a84c561c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038688 Jul 01 10:37:45.256797 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1332/2684] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:45.261931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:45.262637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:45.269609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.270062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.270843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.271281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.325029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:45.333636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00e6ac71-e115-4d8f-86d4-97d09735b950 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.177108 Jul 01 10:37:45.334513 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1353/2685] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:45.340612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:45.344244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:45.344867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.compute.servers [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Removing options 'limit' from query {{(pid=119765) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 01 10:37:45.345810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:45.351935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.352460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.353367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.353875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.378014 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eb5a601d-70eb-4e6e-b18b-11e093680f25 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.042131 Jul 01 10:37:45.378846 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1354/2686] 10.222.0.23 () {58 vars in 1139 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:45.382929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a55853f-f396-4fd0-80ad-5f0ef6f2be8c tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Calling method '.version_select at 0x7f6f90ebba60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:45.622801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:45.628681 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:45.633437 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37426c44-c789-4ab7-8789-416cda368f4b tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.375585 Jul 01 10:37:45.634426 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1333/2687] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:45.640105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:45.645380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:45.647181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1823055712', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:37:45.662061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.665020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.668142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.668645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.771253 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a55853f-f396-4fd0-80ad-5f0ef6f2be8c tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.391539 Jul 01 10:37:45.772144 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1355/2688] 10.222.0.23 () {58 vars in 1163 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:37:45.782491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:45.783182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:45.789007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:37:45.796244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.796795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.797680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:45.798189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:45.886321 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37b6dcf9-17b0-45b2-9410-c4c42c37946b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1823055712" status: 200 len: 346 microversion: 2.1 time: 0.250578 Jul 01 10:37:45.900462 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1334/2689] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1823055712 => generated 346 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:45.903324 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1b176b0-84cd-4303-8830-13ccdd0e0073 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Calling method '.version_select at 0x7f6f913a09d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:46.247285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:46.255463 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc809ed5-222e-42e4-87d7-2b14536d880d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1508 microversion: 2.1 time: 0.482298 Jul 01 10:37:46.258251 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1356/2690] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:46.271316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:46.271944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:46.278255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:46.278704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:46.279476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:46.280160 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:46.314135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1b176b0-84cd-4303-8830-13ccdd0e0073 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.426142 Jul 01 10:37:46.314907 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1335/2691] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:37:45 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:46.322375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f18cb95-1d11-4a5a-b6fe-a17ba15b2fc4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:46.338682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f18cb95-1d11-4a5a-b6fe-a17ba15b2fc4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:46.339251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f18cb95-1d11-4a5a-b6fe-a17ba15b2fc4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:46.369251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f18cb95-1d11-4a5a-b6fe-a17ba15b2fc4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Going to try to stop instance {{(pid=119764) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:37:46.511280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f18cb95-1d11-4a5a-b6fe-a17ba15b2fc4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "POST /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c/action" status: 202 len: 0 microversion: 2.1 time: 0.193922 Jul 01 10:37:46.512622 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1336/2692] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:37:46 2022] POST /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:46.537975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:46.539048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:46.551814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:46.553465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:46.555054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:46.555726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:46.586729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:46.606714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:46.608980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:46.611449 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2cf5d7b2-7283-4f86-be8d-1e71c1ed9d99 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.350995 Jul 01 10:37:46.613384 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1357/2693] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:46 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:46.621484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c83e120-7a86-4e85-9e4b-55eb2bd297be tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Calling method '.version_select at 0x7f6f90ebb550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:46.941527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:46.949332 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f64ad2ba-b127-4a58-9484-b475e62ce52d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1503 microversion: 2.1 time: 0.418858 Jul 01 10:37:46.950169 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1337/2694] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:46 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:46.955135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:46.956370 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:46.964150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:46.965042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:46.965950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:46.966483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:47.625269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:47.638200 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c73c5709-a806-429e-a3db-29a00dc3b404 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.683285 Jul 01 10:37:47.638200 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1338/2695] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:46 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:47.642899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:47.653465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:47.664816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:47.664816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:47.668819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:47.670850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.001958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:48.016320 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1eba5ba9-f551-473a-93d3-75100b604e71 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1523 microversion: 2.1 time: 0.376735 Jul 01 10:37:48.018642 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1339/2696] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:47 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:48.028253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:48.030725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:48.047010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.048026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.049015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.050263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.328996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:48.348329 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-382bca9d-49b4-4de0-9d0c-8f33e87930c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.322138 Jul 01 10:37:48.349403 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1340/2697] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:48 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:48.354993 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c83e120-7a86-4e85-9e4b-55eb2bd297be tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/988e898e-23b4-4b10-8397-4ced25cd21cf" status: 202 len: 0 microversion: 2.1 time: 1.740098 Jul 01 10:37:48.358914 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1358/2698] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:37:46 2022] DELETE /compute/v2.1/os-floating-ips/988e898e-23b4-4b10-8397-4ced25cd21cf => generated 0 bytes in 1743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:48.363232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-77fce002-3da9-489b-8804-edd503175f3f req-4a81b626-b006-49bb-83d8-a2d3535c8457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-plugged", "status": "completed", "tag": "fcb9df67-3668-4e82-bce6-cff941b7bead"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:48.365314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:48.365944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:48.370476 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:48.381581 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.382454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.383188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.383950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.392837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-77fce002-3da9-489b-8804-edd503175f3f req-4a81b626-b006-49bb-83d8-a2d3535c8457 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.395094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-77fce002-3da9-489b-8804-edd503175f3f req-4a81b626-b006-49bb-83d8-a2d3535c8457 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.413683 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-77fce002-3da9-489b-8804-edd503175f3f req-4a81b626-b006-49bb-83d8-a2d3535c8457 service nova] Creating event network-vif-plugged:fcb9df67-3668-4e82-bce6-cff941b7bead for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:48.420389 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-77fce002-3da9-489b-8804-edd503175f3f req-4a81b626-b006-49bb-83d8-a2d3535c8457 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068671 Jul 01 10:37:48.420994 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1341/2699] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:48.426503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:48.427268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:48.434931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.435383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.437780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.438294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.660836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:48.671043 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d0672f5-171e-408f-971c-12bfecc25f57 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1529 microversion: 2.1 time: 0.312349 Jul 01 10:37:48.671867 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1359/2700] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:48 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1529 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:48.681332 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:48.681950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:48.694074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.697247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.701495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:48.702401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:48.760663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:48.773177 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:48.778983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:48.780168 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d13d2c38-2721-4d68-98d6-a3c033a59970 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 0.358070 Jul 01 10:37:48.780935 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1342/2701] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:48 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:48.789436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fe9b37db-42d9-41bd-8a1d-da7480ac3552 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Calling method '.version_select at 0x7f6f91160e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:48.994741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:49.010261 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0ea2a59-cfc4-48dd-ae42-3846e5588000 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1493 microversion: 2.1 time: 0.332603 Jul 01 10:37:49.012279 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1360/2702] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:48 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1493 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:49.047319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:49.053095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:49.059332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:49.060014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:49.061732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:49.062622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:49.548801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:49.558450 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a8ddf5c4-c25e-47e7-bc6e-64baf3d39b4d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.544672 Jul 01 10:37:49.572181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1361/2703] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:49 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:49.577244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7094fe8f-09e2-4ac8-b9e7-efe4efd17414 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '.version_select at 0x7f6f90ee0790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:49.579988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7094fe8f-09e2-4ac8-b9e7-efe4efd17414 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:49.581313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7094fe8f-09e2-4ac8-b9e7-efe4efd17414 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:49.594164 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7094fe8f-09e2-4ac8-b9e7-efe4efd17414 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.020502 Jul 01 10:37:49.596729 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1362/2704] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:37:49 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:49.608775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:49.609614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:49.625952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:49.626808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:49.628475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:49.629138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:49.919395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:49.930808 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c006efdc-1a71-4c00-aa0f-1561e33011ee tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1523 microversion: 2.1 time: 0.332734 Jul 01 10:37:49.933318 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1363/2705] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:49 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:49.941877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:49.946102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:49.956150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:49.956870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:49.957863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:49.958479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:50.507350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:50.516666 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:50.523731 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e09c572-80d5-448c-aa05-2f89e269611a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.589144 Jul 01 10:37:50.526810 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1364/2706] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:49 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:50.542170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c926a1e1-b66a-403b-b137-cea1aa255dd5 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:50.543165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c926a1e1-b66a-403b-b137-cea1aa255dd5 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:50.584037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fe9b37db-42d9-41bd-8a1d-da7480ac3552 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/5e266174-cdb6-47d1-8d8a-8301406371b2" status: 202 len: 0 microversion: 2.1 time: 1.797857 Jul 01 10:37:50.585014 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1343/2707] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:37:48 2022] DELETE /compute/v2.1/os-floating-ips/5e266174-cdb6-47d1-8d8a-8301406371b2 => generated 0 bytes in 1804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:50.589827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:50.590742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:50.598901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c926a1e1-b66a-403b-b137-cea1aa255dd5 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:50.602614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c926a1e1-b66a-403b-b137-cea1aa255dd5 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:50.606083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c926a1e1-b66a-403b-b137-cea1aa255dd5 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:50.606939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c926a1e1-b66a-403b-b137-cea1aa255dd5 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:50.642928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:50.643978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:50.644883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:50.645363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:51.146803 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c926a1e1-b66a-403b-b137-cea1aa255dd5 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1644 microversion: 2.1 time: 0.617600 Jul 01 10:37:51.149725 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1365/2708] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:50 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1644 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:51.160498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:51.169201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:51.207782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:51.213826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:51.214677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:51.215134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:51.307818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:51.319586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20873ac8-2574-45c9-b700-f6bb7ae28d28 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.730172 Jul 01 10:37:51.320922 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1344/2709] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:50 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:51.340589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-48d66a01-d6e2-40ed-970e-9c05d602c02e req-143ebd41-05d5-45a3-9433-b3244048e805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-plugged", "status": "completed", "tag": "85806425-2835-431f-a010-e9e78b034c83"}, {"server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "name": "network-vif-plugged", "status": "completed", "tag": "021dc11d-b6e8-46fe-be69-422cb8a4b797"}, {"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-plugged", "status": "completed", "tag": "b1283c20-2b14-4147-b47c-03424c3b0288"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:51.383782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-48d66a01-d6e2-40ed-970e-9c05d602c02e req-143ebd41-05d5-45a3-9433-b3244048e805 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:51.388770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-48d66a01-d6e2-40ed-970e-9c05d602c02e req-143ebd41-05d5-45a3-9433-b3244048e805 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:51.418741 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-48d66a01-d6e2-40ed-970e-9c05d602c02e req-143ebd41-05d5-45a3-9433-b3244048e805 service nova] Creating event network-vif-plugged:85806425-2835-431f-a010-e9e78b034c83 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:51.419141 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-48d66a01-d6e2-40ed-970e-9c05d602c02e req-143ebd41-05d5-45a3-9433-b3244048e805 service nova] Creating event network-vif-plugged:021dc11d-b6e8-46fe-be69-422cb8a4b797 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:37:51.419649 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-48d66a01-d6e2-40ed-970e-9c05d602c02e req-143ebd41-05d5-45a3-9433-b3244048e805 service nova] Creating event network-vif-plugged:b1283c20-2b14-4147-b47c-03424c3b0288 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:37:51.436529 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-48d66a01-d6e2-40ed-970e-9c05d602c02e req-143ebd41-05d5-45a3-9433-b3244048e805 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.109399 Jul 01 10:37:51.437233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1345/2710] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:51.461838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:51.462925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:51.469881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:51.470505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:51.472058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:51.472661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:51.875167 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=14 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:52.156215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:52.170449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:52.177973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:52.179382 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-587b4c90-ccaa-4882-a256-10ecde575998 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1878 microversion: 2.42 time: 1.027777 Jul 01 10:37:52.198100 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1366/2711] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:51 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1878 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:52.209237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec0aa49d-b733-4ddd-91f9-f26f236cbbb2 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] Calling method '.version_select at 0x7f6f90e8b8b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:52.414071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:52.425639 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e30ae18a-80ee-4d67-bd27-e07b13eb0790 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.985805 Jul 01 10:37:52.427083 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1346/2712] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:51 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:52.437859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:52.439001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:52.453920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:52.461926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:52.461926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:52.461926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:52.752624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:52.766953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95d8de50-fbab-442f-ad62-f27d24ff5156 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1523 microversion: 2.1 time: 0.334089 Jul 01 10:37:52.788261 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1347/2713] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:52 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:52.794080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-708854395", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "e95a279c-448a-4371-a9e0-60c5b05d38a7"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:52.928777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] validate_networks() for [('e95a279c-448a-4371-a9e0-60c5b05d38a7', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:37:54.385363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:37:54.386608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:37:54.388009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:37:54.388697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:37:54.389413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:37:54.411019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:54.411847 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:54.413121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:54.414169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:54.468838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:37:54.476338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for user e3ce54f4c29540dc8f7077c2717f6451 and project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:37:54.496708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:37:54.499605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:37:54.641289 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-308c18c1-7b61-401a-8617-4cb86e9ad50d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.850661 Jul 01 10:37:54.651477 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1348/2714] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:37:54.660344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:54.661708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:54.677071 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:54.684003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:54.690664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:54.690664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:54.690664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:54.715914 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec0aa49d-b733-4ddd-91f9-f26f236cbbb2 tempest-FloatingIPDetailsTestJSON-948914589 tempest-FloatingIPDetailsTestJSON-948914589-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/82fa92e6-4879-4269-9f15-c9e0baa96887" status: 202 len: 0 microversion: 2.1 time: 2.519873 Jul 01 10:37:54.717469 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1367/2715] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 10:37:52 2022] DELETE /compute/v2.1/os-floating-ips/82fa92e6-4879-4269-9f15-c9e0baa96887 => generated 0 bytes in 2522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:37:54.728963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:54.729998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:54.746238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:54.750003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:54.756914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:54.761270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.006028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:55.023147 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25ed8819-e445-419c-af86-c4b22b39742a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.364187 Jul 01 10:37:55.023147 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1349/2716] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:54 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:55.033741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:55.034799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:55.043633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:55.044445 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.046387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:55.047914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.091792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:55.095139 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f900a92-394d-4716-a597-8085055d0011 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.376477 Jul 01 10:37:55.095738 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1368/2717] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:54 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:55.100464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:55.101363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:55.107594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:55.108046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.108810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:55.110401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.360442 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:55.458916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:55.473670 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ea3f16f-ea72-42c5-a308-df2dcf948c2c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.372590 Jul 01 10:37:55.476634 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1369/2718] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:55 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:55.494565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5aec5744-0b1b-4dc4-88d6-727081ad9344 req-9ea61825-ff1f-4401-a7fb-560f68f08396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "name": "network-vif-plugged", "status": "completed", "tag": "f8cf4ea9-7795-4f8e-a331-d31fa4de3249"}, {"server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "name": "network-vif-plugged", "status": "completed", "tag": "dff58844-fe66-4af5-80b4-fb4f384736e7"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:55.521388 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:55.522852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5aec5744-0b1b-4dc4-88d6-727081ad9344 req-9ea61825-ff1f-4401-a7fb-560f68f08396 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:55.523788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5aec5744-0b1b-4dc4-88d6-727081ad9344 req-9ea61825-ff1f-4401-a7fb-560f68f08396 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.536149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:55.542675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:55.542675 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d6f0d7f-e4c7-4725-bcc8-4890b66b93ca tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2834 microversion: 2.42 time: 0.519378 Jul 01 10:37:55.542675 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1350/2719] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:37:55 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2834 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:55.545934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:55.546702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:55.553422 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5aec5744-0b1b-4dc4-88d6-727081ad9344 req-9ea61825-ff1f-4401-a7fb-560f68f08396 service nova] Creating event network-vif-plugged:f8cf4ea9-7795-4f8e-a331-d31fa4de3249 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:37:55.554738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5aec5744-0b1b-4dc4-88d6-727081ad9344 req-9ea61825-ff1f-4401-a7fb-560f68f08396 service nova] Creating event network-vif-plugged:dff58844-fe66-4af5-80b4-fb4f384736e7 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:37:55.558817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:55.559479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.560423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:55.561761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:55.567714 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5aec5744-0b1b-4dc4-88d6-727081ad9344 req-9ea61825-ff1f-4401-a7fb-560f68f08396 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085323 Jul 01 10:37:55.568268 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1370/2720] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:55.904397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-462206778", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:55.977023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] validate_networks() for [('5cc96019-7f9a-4fe6-a8e5-4beaea1229fb', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:37:55.988776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:55.999458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45f49226-febf-4528-8549-05e37c1183a1 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1523 microversion: 2.1 time: 0.454306 Jul 01 10:37:56.000168 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1351/2721] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:55 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1523 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:56.012189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:56.012998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:56.029891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:56.030270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:56.031057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:56.031497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:56.161445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:56.172507 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c40b1a6-3773-4751-a9dc-e260965e4d4a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1214 microversion: 2.1 time: 0.171225 Jul 01 10:37:56.186721 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1352/2722] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:56 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:56.193868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da6be82c-854c-4095-9c30-6e8775ac95f6 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:56.195257 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da6be82c-854c-4095-9c30-6e8775ac95f6 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:56.202959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da6be82c-854c-4095-9c30-6e8775ac95f6 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:56.204098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da6be82c-854c-4095-9c30-6e8775ac95f6 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:56.205331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da6be82c-854c-4095-9c30-6e8775ac95f6 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:56.206729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da6be82c-854c-4095-9c30-6e8775ac95f6 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:56.212188 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:37:56.395145 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da6be82c-854c-4095-9c30-6e8775ac95f6 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.205993 Jul 01 10:37:56.395829 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1353/2723] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Jul 1 10:37:56 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad/os-interface => generated 1830 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:37:56.400640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:56.401610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:56.412298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:56.412765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:56.422193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:56.422664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.129545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:57.140664 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5fb73389-6678-459b-aaaa-bce403b631c9 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1355 microversion: 2.1 time: 0.743587 Jul 01 10:37:57.144971 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1354/2724] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:56 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1355 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:57.155047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:57.156868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:57.170891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.180968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.182266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.183031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.186327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:37:57.186850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:37:57.187222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:37:57.187632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:37:57.188554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:37:57.215548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.217114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.218049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.223933 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.327208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Getting quotas for project 450b024145714e4a88443e0a6d1d9a49. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:37:57.340656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Getting quotas for user a03374f49b3444ffabc5a22d82c07854 and project 450b024145714e4a88443e0a6d1d9a49. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:37:57.376387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:37:57.381336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:37:57.577973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:57.587204 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a6f83267-cacf-4052-9708-f6851d6df97f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.440984 Jul 01 10:37:57.587796 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1355/2725] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:57 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:57.594004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:57.594758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:57.601477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.602014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.602945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.603791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.890201 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-317f53a4-eb89-4fff-8f1a-7d37bb79aa7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.320689 Jul 01 10:37:57.896935 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1371/2726] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:37:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:37:57.904721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:57.905781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:57.914035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.914812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:57.915808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:57.916407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:58.072579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:58.081804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8ad7051-2ae9-4267-8aed-b298ef0f81cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.492546 Jul 01 10:37:58.093857 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1356/2727] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:57 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:58.098991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:58.100431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:58.115916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:58.116485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:58.132185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:58.133493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:58.969822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:58.980251 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d13dd29a-0997-42b4-9ce3-4505196ed525 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1270 microversion: 2.1 time: 0.884922 Jul 01 10:37:58.981124 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1357/2728] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:58 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1270 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:59.012178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b4afac36-f681-46be-b408-765d21dc1a2e req-feb65bac-d147-46e6-951a-7560deef236c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4afc470-5045-4a5c-b6a9-f83ca6ef7815", "name": "network-vif-plugged", "status": "completed", "tag": "fb797876-06c8-41bf-8676-0cf94fe5eeb8"}, {"server_uuid": "2e4ce907-5b6b-4be2-acf0-53b68de91bb8", "name": "network-vif-plugged", "status": "completed", "tag": "d99125af-b8e0-4479-bcac-52cca801f513"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:37:59.032558 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b4afac36-f681-46be-b408-765d21dc1a2e req-feb65bac-d147-46e6-951a-7560deef236c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:59.033595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b4afac36-f681-46be-b408-765d21dc1a2e req-feb65bac-d147-46e6-951a-7560deef236c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:59.048422 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b4afac36-f681-46be-b408-765d21dc1a2e req-feb65bac-d147-46e6-951a-7560deef236c service nova] Creating event network-vif-plugged:fb797876-06c8-41bf-8676-0cf94fe5eeb8 for instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 on n-h2-master-1 Jul 01 10:37:59.049525 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b4afac36-f681-46be-b408-765d21dc1a2e req-feb65bac-d147-46e6-951a-7560deef236c service nova] Creating event network-vif-plugged:d99125af-b8e0-4479-bcac-52cca801f513 for instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 on n-h2-master-1 Jul 01 10:37:59.084439 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b4afac36-f681-46be-b408-765d21dc1a2e req-feb65bac-d147-46e6-951a-7560deef236c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099809 Jul 01 10:37:59.097873 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1358/2729] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:37:59.139827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7c1a665-7aae-402f-99ba-7d5cda385d8f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:59.141993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7c1a665-7aae-402f-99ba-7d5cda385d8f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:59.350572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f7c1a665-7aae-402f-99ba-7d5cda385d8f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:59.379163 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7c1a665-7aae-402f-99ba-7d5cda385d8f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1216 microversion: 2.1 time: 0.252360 Jul 01 10:37:59.379756 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1359/2730] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:59 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1216 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:59.400764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:59.401413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:59.409646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:37:59.417964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:59.418412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:59.419189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:59.419688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:59.424557 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-060d1b2e-0e8d-4ddf-925d-f5c17858ff0c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1500 microversion: 2.1 time: 1.524121 Jul 01 10:37:59.431119 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1372/2731] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:57 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1500 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:37:59.452104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:37:59.457232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:37:59.483843 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:59.490587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:59.498412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:37:59.499878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:37:59.992669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:00.008141 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-715e762f-e981-4168-877b-a6ee13409f56 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1805 microversion: 2.1 time: 0.627204 Jul 01 10:38:00.009184 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1360/2732] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:59 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1805 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:00.015133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:00.020279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:00.043508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.044097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.047787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.047787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.235168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:00.266329 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78890770-ad94-46b9-bf48-ab507b81c3ee tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.819857 Jul 01 10:38:00.266329 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1373/2733] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:37:59 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:00.275724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:00.286806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:00.291067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:00.311593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.312160 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.313047 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.313577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.405114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:00.470341 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-022d845b-608d-44b4-8f8c-d56ddb5765c9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.202484 Jul 01 10:38:00.476822 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1374/2734] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Jul 1 10:38:00 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:00.497176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:00.500671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:00.521264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.521938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.525548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.526101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.535626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:00.557667 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c64d2619-c41b-42c3-a864-077f07cc8114 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1315 microversion: 2.1 time: 0.546921 Jul 01 10:38:00.567208 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1361/2735] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:00 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:00.585995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3334831a-b031-4e3e-99d6-94f66d4181da tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:00.586500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3334831a-b031-4e3e-99d6-94f66d4181da tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:00.614333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3334831a-b031-4e3e-99d6-94f66d4181da tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.614333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3334831a-b031-4e3e-99d6-94f66d4181da tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.616039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3334831a-b031-4e3e-99d6-94f66d4181da tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.617806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3334831a-b031-4e3e-99d6-94f66d4181da tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.676676 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3334831a-b031-4e3e-99d6-94f66d4181da tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143/ips" status: 200 len: 218 microversion: 2.1 time: 0.107726 Jul 01 10:38:00.687928 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1362/2736] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:38:00 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143/ips => generated 218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:00.707962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:00.708689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:00.724571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.725127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.726646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.727205 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.757495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:00.771370 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7e5aa9ac-29e8-4bea-b802-0c7fb54b5356 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1268 microversion: 2.1 time: 0.290110 Jul 01 10:38:00.771961 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1375/2737] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:00 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:00.800312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-365a0450-e0e5-48e5-a5a1-5feadd2b7c61 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:00.832063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-365a0450-e0e5-48e5-a5a1-5feadd2b7c61 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:00.853019 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-365a0450-e0e5-48e5-a5a1-5feadd2b7c61 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:00.890801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-365a0450-e0e5-48e5-a5a1-5feadd2b7c61 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Going to try to start instance {{(pid=119765) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 10:38:00.940071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:00.955895 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6193ab62-605f-4128-be78-de976060e9d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1212 microversion: 2.1 time: 0.266034 Jul 01 10:38:00.958277 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1363/2738] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:00 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1212 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:00.977112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:00.980346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:01.012637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.013979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:01.019548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.020266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:01.098650 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-365a0450-e0e5-48e5-a5a1-5feadd2b7c61 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "POST /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c/action" status: 202 len: 0 microversion: 2.1 time: 0.300144 Jul 01 10:38:01.102681 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1376/2739] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:38:00 2022] POST /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:38:01.117702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:38:01.122598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:01.124840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:01.144172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.146040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:01.154265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.155096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:01.631540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:01.632334 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-901363ac-6085-4b35-aa96-188468c3bf70 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 204 len: 0 microversion: 2.1 time: 0.669147 Jul 01 10:38:01.633776 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1364/2740] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:38:00 2022] DELETE /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:01.641675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:01.644456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:01.648961 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-830da5dc-f164-4db5-932a-3ce3445371f6 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1509 microversion: 2.1 time: 0.544703 Jul 01 10:38:01.661695 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1377/2741] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:01 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1509 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:01.662570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:01.665750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:01.674098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.674562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:01.675377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.678367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:01.679054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.679521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:01.680305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:01.684172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:02.155404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:02.166357 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-39715995-6fa7-4fa1-b974-b294b7f181b3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.529331 Jul 01 10:38:02.176740 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1365/2742] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:01 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:02.188203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:02.193895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:02.206156 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:02.208801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:02.211634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:02.213399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:02.521515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:02.535280 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aaf7ecb8-9aa4-43f6-89fd-f3ce6f94ce59 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1502 microversion: 2.1 time: 0.877078 Jul 01 10:38:02.538339 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1378/2743] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:01 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1502 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:02.543332 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4386f770-fc54-4ba2-9c59-f8c2b1a18a95 req-03e7f793-b58b-43b8-9749-46bac3b3b4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "tag": "fcb9df67-3668-4e82-bce6-cff941b7bead"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:02.565900 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4386f770-fc54-4ba2-9c59-f8c2b1a18a95 req-03e7f793-b58b-43b8-9749-46bac3b3b4c6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:02.569820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4386f770-fc54-4ba2-9c59-f8c2b1a18a95 req-03e7f793-b58b-43b8-9749-46bac3b3b4c6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:02.597230 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4386f770-fc54-4ba2-9c59-f8c2b1a18a95 req-03e7f793-b58b-43b8-9749-46bac3b3b4c6 service nova] Creating event network-changed:fcb9df67-3668-4e82-bce6-cff941b7bead for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:38:02.612066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4386f770-fc54-4ba2-9c59-f8c2b1a18a95 req-03e7f793-b58b-43b8-9749-46bac3b3b4c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071958 Jul 01 10:38:02.613070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1379/2744] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:02.631427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:02.636509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:02.654926 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:02.655389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:02.656400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:02.656836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:02.934477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:02.943165 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51b64dc1-f6ac-4377-9c15-d0d7965dda60 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1811 microversion: 2.1 time: 0.764950 Jul 01 10:38:02.949909 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1366/2745] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:02 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1811 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:02.974865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:02.976784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:02.991603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:02.996800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:03.005267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:03.013068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:03.128907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:03.141404 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43ceee54-9559-4fd9-af84-e93a7ab4d773 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1274 microversion: 2.1 time: 0.176388 Jul 01 10:38:03.145364 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1367/2746] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:02 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:03.155938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:03.156752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:03.175713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:03.176455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:03.179684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:03.180323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:03.248092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:03.260420 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17b843f8-9298-4251-a123-4b8600532838 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.639791 Jul 01 10:38:03.277504 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1380/2747] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:02 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:03.279427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:03.280259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:03.288996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:03.289838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:03.291300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:03.292059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:04.441846 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:04.472750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:04.488233 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a5a49f4-f1c7-45f5-9aa2-62588660a755 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1509 microversion: 2.1 time: 1.212806 Jul 01 10:38:04.501410 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1381/2748] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:03 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1509 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:04.507593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:04.508215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:04.526507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:04.527102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:04.528010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:04.528555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:04.599506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.network.security_group_api [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Removing security group bbdbf4c6-e3ce-4cd4-affa-d91f4239c7fa from port d99125af-b8e0-4479-bcac-52cca801f513 Jul 01 10:38:05.298071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:05.319824 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3780d093-aa82-4397-8d38-5a1d88e1b9e1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.815994 Jul 01 10:38:05.329571 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1382/2749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:04 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:05.341139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:05.347764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:05.357709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:05.363911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:05.365711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:05.366723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:05.371190 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:05.867485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6940f860-e252-4f8a-8cd9-4ea4d8a041d8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8/action" status: 202 len: 0 microversion: 2.1 time: 2.720824 Jul 01 10:38:05.869894 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1368/2750] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:38:03 2022] POST /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8/action => generated 0 bytes in 2724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:38:05.878391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:05.879111 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:05.894969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:05.897104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:05.898149 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:05.900205 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:06.177135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:06.196672 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbfef3d3-9460-4b12-972e-4efaf0442638 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1274 microversion: 2.1 time: 0.325458 Jul 01 10:38:06.200853 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1369/2751] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:05 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1274 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:06.208723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:06.213554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:06.217760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:06.236601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:06.240239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:06.241185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:06.306269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:06.331514 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7438376-2bcb-4066-b76d-cb5cf4080456 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 200 len: 1769 microversion: 2.1 time: 0.989324 Jul 01 10:38:06.343052 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1383/2752] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:05 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 1769 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:06.372236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b7c710a9-e35f-47f2-b58e-2573d1653300 req-77119d7e-3281-4922-9622-eee7aed17c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "name": "network-vif-deleted", "tag": "dff58844-fe66-4af5-80b4-fb4f384736e7"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:06.406751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b7c710a9-e35f-47f2-b58e-2573d1653300 req-77119d7e-3281-4922-9622-eee7aed17c9a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:06.408949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b7c710a9-e35f-47f2-b58e-2573d1653300 req-77119d7e-3281-4922-9622-eee7aed17c9a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:06.428280 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b7c710a9-e35f-47f2-b58e-2573d1653300 req-77119d7e-3281-4922-9622-eee7aed17c9a service nova] Creating event network-vif-deleted:dff58844-fe66-4af5-80b4-fb4f384736e7 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:38:06.435924 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b7c710a9-e35f-47f2-b58e-2573d1653300 req-77119d7e-3281-4922-9622-eee7aed17c9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102428 Jul 01 10:38:06.437799 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1384/2753] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:06.695651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:06.700225 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:06.711347 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a596674-1894-4ae4-99a3-2f5dfac45799 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.506828 Jul 01 10:38:06.712566 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1370/2754] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:06 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:06.720203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74952815-6c18-44d5-a9f4-e95039f79fb4 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Calling method '.version_select at 0x7f6f90e8b280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:06.725338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:06.726055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:06.745695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:06.749381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:06.750746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:06.751367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:06.755420 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-74952815-6c18-44d5-a9f4-e95039f79fb4 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] HTTP exception thrown: Image not found. Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74952815-6c18-44d5-a9f4-e95039f79fb4 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Request method failure captured: Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/e3495f4b-2ccc-45e7-b688-ed34e6e36c34/metadata/os_distro HTTP/1.1 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6Nmuzj2B8DEbZC1QrnRQZrbrJYqCF85ey2aRBjc0kfiXEM6cjK1VFeWfD7qbZQCr0pfH1lQlAhj5_4r5VgrTkOPtlYXBN7yQeevWfAaxEczxn6CYJ5OPopWeFb5rSlHj__u5oBaXqd6-chgnLmwqNXE3mRsxvOqqKRYRN6BoLBnzg Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c0bd5fde97c4fd98a97a05f891a2e27", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9ad7dc2658384bf999b791f69c989b13 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: action_args: {'image_id': 'e3495f4b-2ccc-45e7-b688-ed34e6e36c34', 'id': 'os_distro'} Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e3495f4b-2ccc-45e7-b688-ed34e6e36c34 Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:38:06.767154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e3495f4b-2ccc-45e7-b688-ed34e6e36c34 could not be found. Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:06.771810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74952815-6c18-44d5-a9f4-e95039f79fb4 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:06.787895 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74952815-6c18-44d5-a9f4-e95039f79fb4 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] 10.222.0.23 "DELETE /compute/v2.1/images/e3495f4b-2ccc-45e7-b688-ed34e6e36c34/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.330220 Jul 01 10:38:06.790281 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1385/2755] 10.222.0.23 () {58 vars in 1292 bytes} [Fri Jul 1 10:38:06 2022] DELETE /compute/v2.1/images/e3495f4b-2ccc-45e7-b688-ed34e6e36c34/metadata/os_distro => generated 62 bytes in 352 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:38:06.829319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:06.832335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:06.867102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:06.867925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:06.868903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:06.869965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:07.111914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:07.125336 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7fd2918-b3f2-41de-9048-607cb1b91af1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1460 microversion: 2.1 time: 0.331468 Jul 01 10:38:07.142273 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1386/2756] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:06 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1460 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:07.145395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e5608782-3d47-4b83-8265-14a62d7a8d21 req-22c18030-59c4-443a-aefc-b32195bd1bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4ce907-5b6b-4be2-acf0-53b68de91bb8", "tag": "d99125af-b8e0-4479-bcac-52cca801f513"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:07.156467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e5608782-3d47-4b83-8265-14a62d7a8d21 req-22c18030-59c4-443a-aefc-b32195bd1bc9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:07.157804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e5608782-3d47-4b83-8265-14a62d7a8d21 req-22c18030-59c4-443a-aefc-b32195bd1bc9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:07.176754 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e5608782-3d47-4b83-8265-14a62d7a8d21 req-22c18030-59c4-443a-aefc-b32195bd1bc9 service nova] Creating event network-changed:d99125af-b8e0-4479-bcac-52cca801f513 for instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 on n-h2-master-1 Jul 01 10:38:07.187125 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e5608782-3d47-4b83-8265-14a62d7a8d21 req-22c18030-59c4-443a-aefc-b32195bd1bc9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045562 Jul 01 10:38:07.188018 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1387/2757] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:07.200806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:07.202765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:07.215007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:07.216126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:07.217334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:07.218158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:07.283242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:07.300306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cca28e1e-4742-41e3-bed8-8f16d3a42e67 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1513 microversion: 2.1 time: 0.586573 Jul 01 10:38:07.300902 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1371/2758] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:06 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1513 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:07.307686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8b9e86e-b010-40ee-ad82-53f748bd2ada tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Calling method '.version_select at 0x7f6f91afdaf0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:07.354501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-c8b9e86e-b010-40ee-ad82-53f748bd2ada tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] HTTP exception thrown: Image not found. Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8b9e86e-b010-40ee-ad82-53f748bd2ada tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Request method failure captured: Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/images/1dfcda0d-c0cc-4ad5-9528-cfac9d84da36/metadata/os_version HTTP/1.1 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6Nmuzj2B8DEbZC1QrnRQZrbrJYqCF85ey2aRBjc0kfiXEM6cjK1VFeWfD7qbZQCr0pfH1lQlAhj5_4r5VgrTkOPtlYXBN7yQeevWfAaxEczxn6CYJ5OPopWeFb5rSlHj__u5oBaXqd6-chgnLmwqNXE3mRsxvOqqKRYRN6BoLBnzg Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c0bd5fde97c4fd98a97a05f891a2e27", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9ad7dc2658384bf999b791f69c989b13 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: action_args: {'image_id': '1dfcda0d-c0cc-4ad5-9528-cfac9d84da36', 'id': 'os_version'} Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1dfcda0d-c0cc-4ad5-9528-cfac9d84da36 Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:38:07.357593 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1dfcda0d-c0cc-4ad5-9528-cfac9d84da36 could not be found. Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:07.370654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8b9e86e-b010-40ee-ad82-53f748bd2ada tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:07.373690 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:07.374160 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8b9e86e-b010-40ee-ad82-53f748bd2ada tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] 10.222.0.23 "GET /compute/v2.1/images/1dfcda0d-c0cc-4ad5-9528-cfac9d84da36/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.059219 Jul 01 10:38:07.374160 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1372/2759] 10.222.0.23 () {58 vars in 1292 bytes} [Fri Jul 1 10:38:07 2022] GET /compute/v2.1/images/1dfcda0d-c0cc-4ad5-9528-cfac9d84da36/metadata/os_version => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:38:07.375848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:07.378145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:07.398744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:07.398744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:07.398744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:07.398744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.133006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:08.144833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-43cf9a50-c8b5-4e95-88ec-df322b4ec3d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.955204 Jul 01 10:38:08.145773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1388/2760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:07 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:08.167092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:08.168138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:08.176792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.177375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.178426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.179465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.187597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:08.196938 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-41106a85-347b-45ee-bb57-6d9df9bea116 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.832577 Jul 01 10:38:08.198308 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1373/2761] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:07 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:08.204216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:08.233794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:08.238117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.servers [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Removing options 'limit' from query {{(pid=119764) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 01 10:38:08.242519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:08.244244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.244917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.259037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.259820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.261736 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b17b8cd6-1fad-4e85-8418-e6308b14de2b tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.062208 Jul 01 10:38:08.262909 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1374/2762] 10.222.0.23 () {58 vars in 1139 bytes} [Fri Jul 1 10:38:08 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:38:08.271091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:08.295679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:08.312993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.313711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.314706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.315297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.333131 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] HTTP exception thrown: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Request method failure captured: Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 HTTP/1.1 Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs5MXopNkjLoiQFWlg6KYZEpx-HPM0a9lvQPsTB10hZ9JEQv0R-U_jMiGxTGRicCMV12osRQX9T3hCjDrrziPfoUh4qwNhYA-Z6pDhMeowe1B0SmJ8QNfIx-Mo7rWJJStctzh1AjQUnMpIzktdP2LOCE3rx9ctLYGmKNtDcOiHOA5iM Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_013f61b227894e55b2659e17a5cd5edc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestMultiNic-1004232783 Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b750345ec443427c98a5cc52ef2194ea Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '03cd4975-6716-45ae-92c9-bc2e611d4143'} Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:08.337114 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.341113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:08.341113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:08.341113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:08.341113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:08.341113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:08.341113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:38:08.341113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.343264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Returning 404 to user: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:08.349960 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8cf92d48-6bd9-4346-81ee-f65c538bab93 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 404 len: 111 microversion: 2.1 time: 0.081054 Jul 01 10:38:08.349960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1375/2763] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:08 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:38:08.381642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a86f6d90-8d51-4ab9-a57f-1de299167e58 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Calling method '.version_select at 0x7f6f91109820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:08.426286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-a86f6d90-8d51-4ab9-a57f-1de299167e58 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] HTTP exception thrown: Image not found. Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a86f6d90-8d51-4ab9-a57f-1de299167e58 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Request method failure captured: Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/images/38b7d5f7-064c-4bb4-9f51-3993db7a3d8a/metadata HTTP/1.1 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6Nmuzj2B8DEbZC1QrnRQZrbrJYqCF85ey2aRBjc0kfiXEM6cjK1VFeWfD7qbZQCr0pfH1lQlAhj5_4r5VgrTkOPtlYXBN7yQeevWfAaxEczxn6CYJ5OPopWeFb5rSlHj__u5oBaXqd6-chgnLmwqNXE3mRsxvOqqKRYRN6BoLBnzg Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c0bd5fde97c4fd98a97a05f891a2e27", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9ad7dc2658384bf999b791f69c989b13 Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: action_args: {'image_id': '38b7d5f7-064c-4bb4-9f51-3993db7a3d8a'} Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 38b7d5f7-064c-4bb4-9f51-3993db7a3d8a Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:38:08.426917 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 38b7d5f7-064c-4bb4-9f51-3993db7a3d8a could not be found. Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a86f6d90-8d51-4ab9-a57f-1de299167e58 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a86f6d90-8d51-4ab9-a57f-1de299167e58 tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] 10.222.0.23 "GET /compute/v2.1/images/38b7d5f7-064c-4bb4-9f51-3993db7a3d8a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080816 Jul 01 10:38:08.430561 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1376/2764] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 10:38:08 2022] GET /compute/v2.1/images/38b7d5f7-064c-4bb4-9f51-3993db7a3d8a/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:38:08.441761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:08.442642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:08.462898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.463365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.464219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.464662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.560059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:08.574219 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1cb55059-b1b0-4c15-b927-ae5f2de4fc81 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.425083 Jul 01 10:38:08.584552 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1389/2765] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:08 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:08.587776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:08.588399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:08.600647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.601106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.601923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.602363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.938070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:08.949388 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4e3f2b1-40a0-407f-83bf-e3af41bc2959 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.516389 Jul 01 10:38:08.949999 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1377/2766] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:08 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:08.969753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:08.970286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:08.976853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.977334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:08.978118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:08.978558 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.028464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:09.037967 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9316e104-ffe3-4a51-9f4c-89314543432e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.462085 Jul 01 10:38:09.038790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1390/2767] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:08 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:09.044985 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67bc3a78-087b-4409-ae09-29104f17dc2d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Action: 'update_all', calling method: .version_select at 0x7f6f9118c670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:09.076825 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-67bc3a78-087b-4409-ae09-29104f17dc2d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] HTTP exception thrown: Image not found. Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67bc3a78-087b-4409-ae09-29104f17dc2d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Request method failure captured: Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/images/61667419-691e-497d-bc52-574dc9bde0f2/metadata HTTP/1.1 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 57 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6Nmuzj2B8DEbZC1QrnRQZrbrJYqCF85ey2aRBjc0kfiXEM6cjK1VFeWfD7qbZQCr0pfH1lQlAhj5_4r5VgrTkOPtlYXBN7yQeevWfAaxEczxn6CYJ5OPopWeFb5rSlHj__u5oBaXqd6-chgnLmwqNXE3mRsxvOqqKRYRN6BoLBnzg Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c0bd5fde97c4fd98a97a05f891a2e27", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9ad7dc2658384bf999b791f69c989b13 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: action_args: {'image_id': '61667419-691e-497d-bc52-574dc9bde0f2', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 61667419-691e-497d-bc52-574dc9bde0f2 Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:38:09.079065 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61667419-691e-497d-bc52-574dc9bde0f2 could not be found. Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67bc3a78-087b-4409-ae09-29104f17dc2d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:09.083868 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67bc3a78-087b-4409-ae09-29104f17dc2d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] 10.222.0.23 "PUT /compute/v2.1/images/61667419-691e-497d-bc52-574dc9bde0f2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041040 Jul 01 10:38:09.088993 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1391/2768] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:38:09 2022] PUT /compute/v2.1/images/61667419-691e-497d-bc52-574dc9bde0f2/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:38:09.101359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b4b3270f-923f-4edb-b426-6994f695eb45 req-4ad1a846-c863-437f-bbed-37b2acfc89d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "name": "network-vif-deleted", "tag": "021dc11d-b6e8-46fe-be69-422cb8a4b797"}, {"server_uuid": "03cd4975-6716-45ae-92c9-bc2e611d4143", "name": "network-vif-deleted", "tag": "f8cf4ea9-7795-4f8e-a331-d31fa4de3249"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:09.149088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b4b3270f-923f-4edb-b426-6994f695eb45 req-4ad1a846-c863-437f-bbed-37b2acfc89d2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.149764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b4b3270f-923f-4edb-b426-6994f695eb45 req-4ad1a846-c863-437f-bbed-37b2acfc89d2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.177202 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b4b3270f-923f-4edb-b426-6994f695eb45 req-4ad1a846-c863-437f-bbed-37b2acfc89d2 service nova] Creating event network-vif-deleted:021dc11d-b6e8-46fe-be69-422cb8a4b797 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:38:09.179883 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b4b3270f-923f-4edb-b426-6994f695eb45 req-4ad1a846-c863-437f-bbed-37b2acfc89d2 service nova] Creating event network-vif-deleted:f8cf4ea9-7795-4f8e-a331-d31fa4de3249 for instance 03cd4975-6716-45ae-92c9-bc2e611d4143 on n-h1-master-1 Jul 01 10:38:09.184798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:09.194521 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b4b3270f-923f-4edb-b426-6994f695eb45 req-4ad1a846-c863-437f-bbed-37b2acfc89d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107868 Jul 01 10:38:09.194699 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9a427fb-f794-4fed-95e6-563c02c31a0a tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1513 microversion: 2.1 time: 0.234125 Jul 01 10:38:09.195616 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1392/2769] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:09.196035 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1378/2770] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:08 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:09.201173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e03b0979-5330-4357-98f6-1b009ee4158d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Action: 'update', calling method: .version_select at 0x7f6f9111df70>, body: {"meta": {"os_distro": "alt"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:09.211160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:09.216787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:09.233562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.233978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.237429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.241401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.241750 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e03b0979-5330-4357-98f6-1b009ee4158d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] HTTP exception thrown: Image not found. Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e03b0979-5330-4357-98f6-1b009ee4158d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Request method failure captured: Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/images/15a84a27-8f63-4f81-b2c5-7f4702feb51c/metadata/os_distro HTTP/1.1 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 30 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6Nmuzj2B8DEbZC1QrnRQZrbrJYqCF85ey2aRBjc0kfiXEM6cjK1VFeWfD7qbZQCr0pfH1lQlAhj5_4r5VgrTkOPtlYXBN7yQeevWfAaxEczxn6CYJ5OPopWeFb5rSlHj__u5oBaXqd6-chgnLmwqNXE3mRsxvOqqKRYRN6BoLBnzg Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c0bd5fde97c4fd98a97a05f891a2e27", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9ad7dc2658384bf999b791f69c989b13 Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: {"meta": {"os_distro": "alt"}} Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: action_args: {'image_id': '15a84a27-8f63-4f81-b2c5-7f4702feb51c', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 15a84a27-8f63-4f81-b2c5-7f4702feb51c Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:38:09.244075 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15a84a27-8f63-4f81-b2c5-7f4702feb51c could not be found. Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:38:09.250399 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.255321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e03b0979-5330-4357-98f6-1b009ee4158d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:09.256472 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e03b0979-5330-4357-98f6-1b009ee4158d tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] 10.222.0.23 "PUT /compute/v2.1/images/15a84a27-8f63-4f81-b2c5-7f4702feb51c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.056301 Jul 01 10:38:09.270667 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1379/2771] 10.222.0.23 () {60 vars in 1309 bytes} [Fri Jul 1 10:38:09 2022] PUT /compute/v2.1/images/15a84a27-8f63-4f81-b2c5-7f4702feb51c/metadata/os_distro => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:38:09.282431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:09.283831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:09.300526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.301322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.305552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.309026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.378124 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:09.821188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:09.829946 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ddbb545-d798-4fed-9444-3205529ba15d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.630260 Jul 01 10:38:09.834574 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1393/2772] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:09 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:09.844996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:09.852387 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:09.872987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:09.873166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ff90c80-bcc5-4ecc-82c4-6e81ae5cf437 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.589196 Jul 01 10:38:09.873166 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1380/2773] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:09 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:09.873166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae030df0-685b-4883-a69e-db523331c0db tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Action: 'create', calling method: .version_select at 0x7f6f911445e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:09.880307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.880307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.900423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.904680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.927262 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ae030df0-685b-4883-a69e-db523331c0db tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] HTTP exception thrown: Image not found. Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae030df0-685b-4883-a69e-db523331c0db tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Request method failure captured: Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/images/fb40f2ab-3a24-4223-8813-8446aa03b61f/metadata HTTP/1.1 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 57 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6Nmuzj2B8DEbZC1QrnRQZrbrJYqCF85ey2aRBjc0kfiXEM6cjK1VFeWfD7qbZQCr0pfH1lQlAhj5_4r5VgrTkOPtlYXBN7yQeevWfAaxEczxn6CYJ5OPopWeFb5rSlHj__u5oBaXqd6-chgnLmwqNXE3mRsxvOqqKRYRN6BoLBnzg Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c0bd5fde97c4fd98a97a05f891a2e27", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c0bd5fde97c4fd98a97a05f891a2e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 5c0bd5fde97c4fd98a97a05f891a2e27 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-227363293 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9ad7dc2658384bf999b791f69c989b13 Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-227363293-project Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: action_args: {'image_id': 'fb40f2ab-3a24-4223-8813-8446aa03b61f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fb40f2ab-3a24-4223-8813-8446aa03b61f Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:38:09.929552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb40f2ab-3a24-4223-8813-8446aa03b61f could not be found. Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae030df0-685b-4883-a69e-db523331c0db tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:09.933791 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae030df0-685b-4883-a69e-db523331c0db tempest-ImagesMetadataNegativeTestJSON-227363293 tempest-ImagesMetadataNegativeTestJSON-227363293-project] 10.222.0.23 "POST /compute/v2.1/images/fb40f2ab-3a24-4223-8813-8446aa03b61f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.063660 Jul 01 10:38:09.937784 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1381/2774] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Jul 1 10:38:09 2022] POST /compute/v2.1/images/fb40f2ab-3a24-4223-8813-8446aa03b61f/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:38:09.942213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d803b9e9-6481-47cd-b01a-6b4ead3587b1 req-a9c597a9-8f5a-401a-9db8-55143cedab6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6beb1734-a4f4-42f6-a108-197964bde936", "tag": "08309fee-bc21-46d1-9d77-48c1be296251"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:09.964121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d803b9e9-6481-47cd-b01a-6b4ead3587b1 req-a9c597a9-8f5a-401a-9db8-55143cedab6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:09.964594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d803b9e9-6481-47cd-b01a-6b4ead3587b1 req-a9c597a9-8f5a-401a-9db8-55143cedab6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:09.993298 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d803b9e9-6481-47cd-b01a-6b4ead3587b1 req-a9c597a9-8f5a-401a-9db8-55143cedab6d service nova] Creating event network-changed:08309fee-bc21-46d1-9d77-48c1be296251 for instance 6beb1734-a4f4-42f6-a108-197964bde936 on n-h2-master-1 Jul 01 10:38:09.999365 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d803b9e9-6481-47cd-b01a-6b4ead3587b1 req-a9c597a9-8f5a-401a-9db8-55143cedab6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060585 Jul 01 10:38:10.000760 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1382/2775] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:10.010571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:10.011272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:10.017921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.018381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:10.019167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.019605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:10.354715 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:10.386451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:10.394286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d00970b9-7c1b-4b91-a3e2-1a53e176b2be tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 200 len: 1512 microversion: 2.1 time: 0.558346 Jul 01 10:38:10.395470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1394/2776] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:09 2022] GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:10.404788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:10.410260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:10.428105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.429287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:10.434331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.435057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:10.508860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:10.530488 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d87e9c5-f7f0-424a-b6e2-12e22b5f76ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.528892 Jul 01 10:38:10.531005 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1383/2777] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:10 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:10.554817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:10.558615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:10.566486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.567160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:10.568564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.569859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:10.863176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:10.876745 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86e9a3e3-2b12-4d4b-ba07-b06cb80c032a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.479947 Jul 01 10:38:10.877439 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1395/2778] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:10 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:10.882421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:10.887936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:10.895216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.903018 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:10.905742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:10.906354 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:11.099092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:11.113489 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb5699e0-aa88-47f0-b47f-eab374813d14 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.560345 Jul 01 10:38:11.121442 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1384/2779] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:10 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:11.126342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:11.127511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:11.149078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:11.149623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:11.150764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:11.151370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:11.526731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:11.542547 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-75870a89-dc1f-4950-a32a-720d22658ce9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1511 microversion: 2.1 time: 0.663838 Jul 01 10:38:11.543610 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1396/2780] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:10 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1511 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:11.549413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-640487288", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "04eeb7f2-cad2-4f5d-96c5-202b3781e660"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:11.627260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] validate_networks() for [('04eeb7f2-cad2-4f5d-96c5-202b3781e660', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:38:11.981749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:11.991561 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0565f51c-8f7a-46a4-a644-e9786c95278f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1524 microversion: 2.1 time: 0.868962 Jul 01 10:38:11.995421 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1385/2781] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:11 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1524 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:12.001781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:12.002726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:12.008890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.009369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.010126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.010551 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.478281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:12.488226 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25f0e1fc-1d30-4ac0-bf7a-cff339dd8342 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.491779 Jul 01 10:38:12.498958 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1386/2782] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:11 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:12.507774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:12.523787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:12.527608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:12.742094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.742616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.743518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.744020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.828364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:12.887666 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45d0de94-7c89-4cf5-a2a4-ede289d82124 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.387254 Jul 01 10:38:12.888797 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1387/2783] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Jul 1 10:38:12 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:12.894441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-74e7da26-8f49-4dd1-9375-683ce2c642ea req-bc646683-c71d-4b50-bc06-bcf81ce8ecd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90661f1e-ecda-4ea8-99c9-ca7fe1434b86", "tag": "800ffdd2-a08c-47ca-9832-cd3ac49ad796"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:12.903026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-74e7da26-8f49-4dd1-9375-683ce2c642ea req-bc646683-c71d-4b50-bc06-bcf81ce8ecd8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.903870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-74e7da26-8f49-4dd1-9375-683ce2c642ea req-bc646683-c71d-4b50-bc06-bcf81ce8ecd8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.917758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-74e7da26-8f49-4dd1-9375-683ce2c642ea req-bc646683-c71d-4b50-bc06-bcf81ce8ecd8 service nova] Creating event network-changed:800ffdd2-a08c-47ca-9832-cd3ac49ad796 for instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 on n-h2-master-1 Jul 01 10:38:12.930733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-74e7da26-8f49-4dd1-9375-683ce2c642ea req-bc646683-c71d-4b50-bc06-bcf81ce8ecd8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040223 Jul 01 10:38:12.932436 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1388/2784] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:12.937115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:38:12.937667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:38:12.938218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:38:12.938648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:38:12.939065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:38:12.939224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:12.940596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:12.948709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.949186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.950557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.951010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.959019 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.959477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:12.966015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:12.966513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.012492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:13.023428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Getting quotas for user adf336817b04429b930e1f80ea25b1f7 and project cb942eeb3788403687ba800c070babd5. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:13.042703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:38:13.045651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:38:13.167357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:13.187831 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f41527c-3798-4a03-b5d3-94cc568742b8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.243319 Jul 01 10:38:13.187831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1389/2785] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:12 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:13.187831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:13.187831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:13.192218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.192744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.193831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.194573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.248421 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9247cc83-161a-4b07-a427-cbf85ec7570f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703068 Jul 01 10:38:13.249463 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1397/2786] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:38:13.257661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:13.262440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:13.280770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.284895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.286724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.287879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.483393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:13.493124 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e9473cc-1eff-40fd-85ab-60dbf602338e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1513 microversion: 2.1 time: 0.313706 Jul 01 10:38:13.494295 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1390/2787] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:13 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:13.502539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc9004c7-a479-439f-aaa2-14cdc968704f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:13.503282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc9004c7-a479-439f-aaa2-14cdc968704f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:13.576543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc9004c7-a479-439f-aaa2-14cdc968704f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:13.582248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:13.584247 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc9004c7-a479-439f-aaa2-14cdc968704f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1214 microversion: 2.1 time: 0.088830 Jul 01 10:38:13.593855 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1391/2788] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:13 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:13.593855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:13.593855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:13.594108 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-60c99934-b65c-4367-a6ea-d0215f5e1b61 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1506 microversion: 2.1 time: 0.341371 Jul 01 10:38:13.594108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1398/2789] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:13 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:13.598124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.598680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:13.599448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.600393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.601099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.604308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:13.607362 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:13.610823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.611849 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.612713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.613189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.872757 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:13.881172 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-070accfc-7ce9-409b-8fc3-2187c40dadba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.295241 Jul 01 10:38:13.886832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1392/2790] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:13 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:13.899060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:13.916100 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c0731fb-26b9-4fd0-8a7e-996f799e4ab9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 200 len: 1512 microversion: 2.1 time: 0.322669 Jul 01 10:38:13.917712 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1399/2791] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:13 2022] GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:13.935240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:13.935959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:13.942959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.944035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:13.945765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:13.946255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:14.125346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72cc5cd1-ca30-4152-817f-158828d392dc tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f9118c160>, body: {"keypair": {"name": "tempest-keypair-1147816017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXNZMpabLtNHBRdHcln1OeEM502AGFMH9VSWLp+wu02Bwg3zQvnjYzgEIskFrHkpmcq+m//vqo/7Lvq07Kg5znF1I2+6CcufZbxvvGf0/oVFIfXMW91cdLbG09bcBEF3g=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:14.156304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-72cc5cd1-ca30-4152-817f-158828d392dc tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:14.169978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-72cc5cd1-ca30-4152-817f-158828d392dc tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:14.268832 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72cc5cd1-ca30-4152-817f-158828d392dc tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.310564 Jul 01 10:38:14.274811 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1400/2792] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Jul 1 10:38:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 317 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:38:14.279833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:14.280442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:14.286722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:14.287168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:14.287908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:14.288331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:14.384745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:14.393165 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-712cbfc4-36fc-48d3-ac1a-3e82f6769582 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1511 microversion: 2.1 time: 0.462413 Jul 01 10:38:14.393939 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1393/2793] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:13 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:14.399849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-742c452b-a3d8-4279-a7c0-ecbcedae9c72 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f913a09d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:14.412143 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-742c452b-a3d8-4279-a7c0-ecbcedae9c72 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1147816017" status: 200 len: 513 microversion: 2.2 time: 0.016441 Jul 01 10:38:14.412867 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1394/2794] 10.222.0.23 () {60 vars in 1257 bytes} [Fri Jul 1 10:38:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1147816017 => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:14.428043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:14.436712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:14.436712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:14.443929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:14.444697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:14.445784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:14.446440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:14.483386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:14.507742 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:14.521951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:14.530360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:14.530808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.115635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:15.125318 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a43c546-63d0-4df3-b50a-c28df3635ba8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.848977 Jul 01 10:38:15.134848 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1401/2795] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:14 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:15.141103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c9184c2-6ecc-4d56-abdd-063644d64377 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f90ecbc10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:15.241845 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c9184c2-6ecc-4d56-abdd-063644d64377 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147816017" status: 204 len: 0 microversion: 2.2 time: 0.114077 Jul 01 10:38:15.254670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1402/2796] 10.222.0.23 () {60 vars in 1260 bytes} [Fri Jul 1 10:38:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147816017 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:15.266335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:15.269313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:15.281429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:15.282323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.284093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:15.285876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.347018 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0614f3a0-1075-4454-aa57-cf749c68996e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.926794 Jul 01 10:38:15.347932 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1395/2797] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:38:14 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:15.354508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:15.355426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:15.374094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:15.374094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.374094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:15.374455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.522665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:15.538134 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00cccde3-ec91-4a40-9cd2-e581e68f3069 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1266 microversion: 2.1 time: 0.278606 Jul 01 10:38:15.549321 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1403/2798] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:15 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:15.559921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:15.560550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:15.567770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:15.568225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.569601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:15.570047 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.921349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:15.930969 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-350cb0f0-11d0-44e3-9389-af42862acf17 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1506 microversion: 2.1 time: 0.581309 Jul 01 10:38:15.932521 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1396/2799] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:15 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:15.945987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a17fd911-bb0c-4b5d-aded-2d4020650ac8 req-f1313459-53a6-4f8d-9702-ce8ac9003cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beb1734-a4f4-42f6-a108-197964bde936", "name": "network-vif-plugged", "status": "completed", "tag": "08309fee-bc21-46d1-9d77-48c1be296251"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:15.955995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a17fd911-bb0c-4b5d-aded-2d4020650ac8 req-f1313459-53a6-4f8d-9702-ce8ac9003cc4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:15.956924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a17fd911-bb0c-4b5d-aded-2d4020650ac8 req-f1313459-53a6-4f8d-9702-ce8ac9003cc4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:15.968585 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a17fd911-bb0c-4b5d-aded-2d4020650ac8 req-f1313459-53a6-4f8d-9702-ce8ac9003cc4 service nova] Creating event network-vif-plugged:08309fee-bc21-46d1-9d77-48c1be296251 for instance 6beb1734-a4f4-42f6-a108-197964bde936 on n-h2-master-1 Jul 01 10:38:15.977072 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a17fd911-bb0c-4b5d-aded-2d4020650ac8 req-f1313459-53a6-4f8d-9702-ce8ac9003cc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042859 Jul 01 10:38:15.978891 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1397/2800] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:15.987714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d691ce11-6c98-4902-8d96-693c199f9e7d tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f910f4af0>, body: {"keypair": {"name": "tempest-keypair-566803190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOhNNsaB+/57PvRGnZiv7FXWGm9m8yPvDDYlpO82uRxIV/hdiLZcVIYzDDaCVw8+pD9QXUpTyET4pid7P0+8QxHLTDXJJfuo2FLz+AhH+Ks7SayUJuo3/tvFMQMUWh1PQ=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:16.003527 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:16.009381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d691ce11-6c98-4902-8d96-693c199f9e7d tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:16.016300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d691ce11-6c98-4902-8d96-693c199f9e7d tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:16.039959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:16.062737 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d27ec83-db09-4ddc-8168-dbe08a374dcd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.522680 Jul 01 10:38:16.069269 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1404/2801] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:15 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:16.083600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:16.094008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:16.094861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:16.120376 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d691ce11-6c98-4902-8d96-693c199f9e7d tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.139693 Jul 01 10:38:16.121659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1398/2802] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Jul 1 10:38:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:38:16.132637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ca47782-497d-47d5-82f4-e69df0e0e5c2 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f91017e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:16.207582 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.209487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.210314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.212716 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.277286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ca47782-497d-47d5-82f4-e69df0e0e5c2 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-566803190" status: 204 len: 0 microversion: 2.2 time: 0.148943 Jul 01 10:38:16.278157 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1399/2803] 10.222.0.23 () {60 vars in 1257 bytes} [Fri Jul 1 10:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-566803190 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:38:16.287927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:16.288873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:16.297978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.305368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.305368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.305368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.316569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:16.415446 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f75d3a22-0e7e-4d50-9dcc-0a453aaa46e4 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.336597 Jul 01 10:38:16.416653 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1405/2804] 10.222.0.23 () {58 vars in 1149 bytes} [Fri Jul 1 10:38:16 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:16.474260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8bb7d8d3-e8ac-4013-a981-7b90d5979ec3 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f90ecb280>, body: {"keypair": {"name": "tempest-keypair-1985435825", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:16.474260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8bb7d8d3-e8ac-4013-a981-7b90d5979ec3 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:16.474260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8bb7d8d3-e8ac-4013-a981-7b90d5979ec3 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:16.500306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:16.509390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51cfc20f-e643-4161-b952-e48b72e3d9cc tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.225354 Jul 01 10:38:16.519632 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1400/2805] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:16 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:16.525907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:16.531698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:16.533466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:16.539178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.539899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.540893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.541543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.615603 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8bb7d8d3-e8ac-4013-a981-7b90d5979ec3 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.197635 Jul 01 10:38:16.616942 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1406/2806] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Jul 1 10:38:16 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:38:16.622888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:16.623794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:16.632441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.633311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.634347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:16.635006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:16.664069 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:16.713708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:16.723607 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-436a4e8b-314f-4304-8db9-3330856e7263 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1272 microversion: 2.1 time: 0.105159 Jul 01 10:38:16.734087 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1407/2807] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:16 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:16.739597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae5501b1-c71e-4f5a-822c-20890e7ef010 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f90e8b940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:16.827838 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae5501b1-c71e-4f5a-822c-20890e7ef010 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985435825" status: 204 len: 0 microversion: 2.2 time: 0.092062 Jul 01 10:38:16.829500 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1408/2808] 10.222.0.23 () {60 vars in 1260 bytes} [Fri Jul 1 10:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985435825 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:16.842933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99af0066-a6d7-436f-8c30-69b5562e6588 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f90ecb040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1247116030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPT6xZMdQBpuEJiiYfqJW1w3+rTcoxDMXWXbOxdq0cNzGrM/gAfQ4BuOBUgNjo7sz/YlKOI+mXRAx5JxVH3w/bC4qhSrQtc24G9kuJ+BeT8njggQef3aBztfxdvC5p/WeA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:16.865685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-99af0066-a6d7-436f-8c30-69b5562e6588 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:16.872758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-99af0066-a6d7-436f-8c30-69b5562e6588 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:16.931610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:16.984581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99af0066-a6d7-436f-8c30-69b5562e6588 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.145696 Jul 01 10:38:16.985568 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1409/2809] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Jul 1 10:38:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 01 10:38:16.999394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:17.003375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:17.013590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:17.014064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:17.014851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:17.015339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:17.024461 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8aae3906-4088-4908-b839-b38faa71e0bb tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.503350 Jul 01 10:38:17.025748 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1401/2810] 10.222.0.23 () {58 vars in 1211 bytes} [Fri Jul 1 10:38:16 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:17.034834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-682523285", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "88227793-1323-4d14-8e93-87e660d13bef"}, {"uuid": "94109f72-b5b8-4061-9981-83bfaad079fb"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:17.116634 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] validate_networks() for [('88227793-1323-4d14-8e93-87e660d13bef', None, None, None, None, None), ('94109f72-b5b8-4061-9981-83bfaad079fb', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:38:17.232562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:17.241252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b9ef2ba5-7e30-457f-8212-2d2d751fe08f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1506 microversion: 2.1 time: 0.253191 Jul 01 10:38:17.250813 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1410/2811] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:16 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:17.261133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f66b6448-7ee7-4f60-893b-6fbfff71657f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f90ebb5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-465284859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+SaPwHdnR5pNy6L3k4nwMvv8/5mWCxJ2Fpy5WTbjW+aAztR8PlP0OT7XUCVbdmvrkCmklXwPvC2VApNpNT2JAL+7QIjoPBgBRnJ8f/j1KPVYlyHsKZ+I2A3KlePOZN2w=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:17.276241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f66b6448-7ee7-4f60-893b-6fbfff71657f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:17.281724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f66b6448-7ee7-4f60-893b-6fbfff71657f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:17.393983 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f66b6448-7ee7-4f60-893b-6fbfff71657f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.147640 Jul 01 10:38:17.402025 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1411/2812] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Jul 1 10:38:17 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:38:17.407214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:17.411869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:17.414583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:17.418594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:17.419238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:17.420192 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:17.420813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:17.514042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:17.591368 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8fc92f11-6fa1-42c8-ad23-90924437f42c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.187883 Jul 01 10:38:17.592667 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1412/2813] 10.222.0.23 () {58 vars in 1195 bytes} [Fri Jul 1 10:38:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:17.598731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:17.599712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:17.606101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:17.606706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:17.607572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:17.608188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:17.952931 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:17.966241 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c6757b1-0386-4f86-a1e6-298b3c11ecf9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.372233 Jul 01 10:38:17.967064 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1413/2814] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:17 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:17.984901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3868aab0-cc7c-450a-9832-7c4b2c4c099f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f90e8b940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-757249966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAx7eekkG8vPdRpzCt9EdNxLwp/UnF/ROyQ5baOoO4ZE6k89WdjDzkJRZDYu1D3+m1e8KZv2i83pz49I5PSw9fbHGiN6QgaTaC4PZMkopvxk9Mr5eqiYBko9oOvKoLUPuQ=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:18.002978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3868aab0-cc7c-450a-9832-7c4b2c4c099f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:18.010122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3868aab0-cc7c-450a-9832-7c4b2c4c099f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:18.021173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:38:18.021678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:38:18.022048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:38:18.022463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:38:18.023038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:38:18.042074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.042074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.042074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.042074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.058792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Getting quotas for project 013f61b227894e55b2659e17a5cd5edc. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:18.065679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Getting quotas for user b750345ec443427c98a5cc52ef2194ea and project 013f61b227894e55b2659e17a5cd5edc. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:18.089051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:38:18.092427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:38:18.114329 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3868aab0-cc7c-450a-9832-7c4b2c4c099f tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.146336 Jul 01 10:38:18.115441 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1414/2815] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Jul 1 10:38:17 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:38:18.125282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:18.125900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:18.134616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.135387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.136277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.136813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.340534 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc8eb45e-ef8f-424d-ae84-60d241c39005 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.312512 Jul 01 10:38:18.342090 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1402/2816] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:38:18.344459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:18.350265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:18.357084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:18.358116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'name': '1823055712', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:18.358386 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7fe65cec-25a2-4a19-8dde-c594b2b6157f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1310 microversion: 2.1 time: 0.239441 Jul 01 10:38:18.360549 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1415/2817] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:18 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1310 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:18.372064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:18.377804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.378312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.379453 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.380085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.404512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:18.420934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.421628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.422578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.423169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.577438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:18.652497 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c97c3073-bae0-4897-a7a5-84bd2a8d6646 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?name=1823055712" status: 200 len: 346 microversion: 2.1 time: 0.306686 Jul 01 10:38:18.652497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1403/2818] 10.222.0.23 () {58 vars in 1155 bytes} [Fri Jul 1 10:38:18 2022] GET /compute/v2.1/servers?name=1823055712 => generated 346 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:18.657356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ef8b5950-f1bc-4559-86e0-49e17d96ef95 req-cc774356-0cf1-4e3f-a972-4d389e78c131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4afc470-5045-4a5c-b6a9-f83ca6ef7815", "name": "network-vif-unplugged", "status": "completed", "tag": "fb797876-06c8-41bf-8676-0cf94fe5eeb8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:18.667174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ef8b5950-f1bc-4559-86e0-49e17d96ef95 req-cc774356-0cf1-4e3f-a972-4d389e78c131 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.667859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ef8b5950-f1bc-4559-86e0-49e17d96ef95 req-cc774356-0cf1-4e3f-a972-4d389e78c131 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.678639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:18.683748 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ef8b5950-f1bc-4559-86e0-49e17d96ef95 req-cc774356-0cf1-4e3f-a972-4d389e78c131 service nova] Creating event network-vif-unplugged:fb797876-06c8-41bf-8676-0cf94fe5eeb8 for instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 on n-h2-master-1 Jul 01 10:38:18.691333 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ef8b5950-f1bc-4559-86e0-49e17d96ef95 req-cc774356-0cf1-4e3f-a972-4d389e78c131 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038839 Jul 01 10:38:18.692449 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1404/2819] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:18.696719 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1c90ceb2-7ada-412d-a6e1-b2d6ad6737ca tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1314 microversion: 2.1 time: 0.333655 Jul 01 10:38:18.698364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1416/2820] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:18 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:18.700730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af069145-5700-465a-89e1-af1125a4f344 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f9111ab80>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:18.704217 n-d-master-1 devstack@n-api.service[119764]: WARNING oslo_db.sqlalchemy.utils [None req-af069145-5700-465a-89e1-af1125a4f344 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 01 10:38:18.714453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-903b2ae7-f33b-479c-bd25-e027135c476e req-fd0770e6-89bb-43d9-8a9b-345f937bba3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebcfc56f-d6db-4c21-b1df-bb7fa078d352", "tag": "9ed0e231-ab89-424a-bbba-a8d260b6e617"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:18.719934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af069145-5700-465a-89e1-af1125a4f344 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.025201 Jul 01 10:38:18.724581 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1405/2821] 10.222.0.23 () {60 vars in 1176 bytes} [Fri Jul 1 10:38:18 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:18.729899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:18.731108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:18.739046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-903b2ae7-f33b-479c-bd25-e027135c476e req-fd0770e6-89bb-43d9-8a9b-345f937bba3a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.739502 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-903b2ae7-f33b-479c-bd25-e027135c476e req-fd0770e6-89bb-43d9-8a9b-345f937bba3a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.741396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.745360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.747589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.748051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.753766 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-903b2ae7-f33b-479c-bd25-e027135c476e req-fd0770e6-89bb-43d9-8a9b-345f937bba3a service nova] Creating event network-changed:9ed0e231-ab89-424a-bbba-a8d260b6e617 for instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 on n-h1-master-1 Jul 01 10:38:18.761349 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-903b2ae7-f33b-479c-bd25-e027135c476e req-fd0770e6-89bb-43d9-8a9b-345f937bba3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050083 Jul 01 10:38:18.766495 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1417/2822] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:18.775596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea86a1d4-950c-4c5c-86e2-edcbfdb864c5 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:18.776579 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea86a1d4-950c-4c5c-86e2-edcbfdb864c5 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:18.908605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea86a1d4-950c-4c5c-86e2-edcbfdb864c5 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:18.920605 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea86a1d4-950c-4c5c-86e2-edcbfdb864c5 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1212 microversion: 2.1 time: 0.149482 Jul 01 10:38:18.921815 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1418/2823] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:18 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1212 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:18.926948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:18.936466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:18.938870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:18.948557 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.949460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:18.950618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:18.951793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.038221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:19.052698 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d1657990-b83a-4d80-a56a-5264a63d9194 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 200 len: 1509 microversion: 2.1 time: 0.325542 Jul 01 10:38:19.054622 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1406/2824] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:18 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:19.059943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-75c6fa5c-13ef-4d73-b2c5-bd7825088fc0 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f91109430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:19.141953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-75c6fa5c-13ef-4d73-b2c5-bd7825088fc0 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-757249966" status: 204 len: 0 microversion: 2.2 time: 0.085959 Jul 01 10:38:19.143935 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1407/2825] 10.222.0.23 () {60 vars in 1317 bytes} [Fri Jul 1 10:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-757249966 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:19.149694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:19.150319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:19.163986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:19.175263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.176087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.177402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.178099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.258530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1bf64bcc-c36e-400d-91df-67aff8f1d7d8 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.335527 Jul 01 10:38:19.265222 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1419/2826] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Jul 1 10:38:18 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:19.265222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:19.265222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:19.271679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.272125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.272895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.273363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.300713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:38:19.306648 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.api [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Working on deleting snapshot 917fb14a-f397-4a7b-8aea-1557eef6a54b from shelved instance... Jul 01 10:38:19.345207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:19.354652 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f8d4aca-5aca-4e25-ac48-614bedcab3cb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.207445 Jul 01 10:38:19.354652 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1408/2827] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:19 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:19.359082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-49d62a98-e17b-4836-8f67-051af9163552 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f910e2040>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:19.530541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-49d62a98-e17b-4836-8f67-051af9163552 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-465284859" status: 204 len: 0 microversion: 2.2 time: 0.175667 Jul 01 10:38:19.538598 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1409/2828] 10.222.0.23 () {60 vars in 1317 bytes} [Fri Jul 1 10:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-465284859 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:19.538598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:19.539991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:19.540771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-182305571', 'deleted': False, 'project_id': '2a951f035ec74e2690d9a28934035056'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:38:19.551092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.551543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.552339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.552773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.648946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:38:19.725008 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa42bf37-bd8f-4626-800e-d669b514b00e tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-182305571" status: 200 len: 346 microversion: 2.1 time: 0.192527 Jul 01 10:38:19.726389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1410/2829] 10.222.0.23 () {58 vars in 1227 bytes} [Fri Jul 1 10:38:19 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-182305571 => generated 346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:19.735537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:19.736273 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:19.744644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.745091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.752163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:19.752163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:19.901545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:19.911907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e20b1eca-1f42-42bc-837f-8c25ed8e9109 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1492 microversion: 2.1 time: 0.184384 Jul 01 10:38:19.921858 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1411/2830] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:19 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1492 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:19.928373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-641b0026-8603-4387-bf41-410b985b40f6 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f9111aca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:20.056338 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-641b0026-8603-4387-bf41-410b985b40f6 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1247116030" status: 204 len: 0 microversion: 2.2 time: 0.142379 Jul 01 10:38:20.057004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1412/2831] 10.222.0.23 () {60 vars in 1320 bytes} [Fri Jul 1 10:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1247116030 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:20.068278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:20.069017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:20.077419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.078282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.079212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.080656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.235644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:20.245593 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c465112-d297-4a41-83b7-95355fe97b10 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1314 microversion: 2.1 time: 0.186736 Jul 01 10:38:20.246512 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1413/2832] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:20 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:20.251747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:20.252443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:20.259271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.259743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.260515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.261132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.293329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:38:20.620750 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a540c807-bfc1-4e33-85cf-48b0102045d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 204 len: 0 microversion: 2.1 time: 0.372748 Jul 01 10:38:20.621394 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1414/2833] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:38:20 2022] DELETE /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:20.629832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e8cb51f-97f4-4b34-bbe6-2aba5ed22949 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:20.630794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e8cb51f-97f4-4b34-bbe6-2aba5ed22949 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:20.637252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e8cb51f-97f4-4b34-bbe6-2aba5ed22949 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.637940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e8cb51f-97f4-4b34-bbe6-2aba5ed22949 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.639032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e8cb51f-97f4-4b34-bbe6-2aba5ed22949 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.639616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e8cb51f-97f4-4b34-bbe6-2aba5ed22949 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.798657 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e8cb51f-97f4-4b34-bbe6-2aba5ed22949 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1643 microversion: 2.1 time: 0.174426 Jul 01 10:38:20.799331 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1415/2834] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:20 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1643 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:20.803946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:20.804767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:20.811041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.811488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.812292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.812895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.869468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Doing local delete in cell dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=119765) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 01 10:38:20.870888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:20.871493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:20.872103 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.api [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 01 10:38:20.877111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] deallocate_for_instance() {{(pid=119765) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 01 10:38:20.888466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:20.897526 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3524ee0e-fd20-4e52-8127-a25ed39acb1a tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1208 microversion: 2.1 time: 0.096938 Jul 01 10:38:20.898711 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1416/2835] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:20 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:20.903675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-447899bc-c0fc-44c2-99a7-830246b972ce tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f9124b9d0>, body: {"keypair": {"name": "tempest-keypair-1877010903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpyemwk8WeC8zEi1fMcwmSNH4vJU89v5efmxHwKcBwCg6RR7yQxhwxXh9wLjGU44RyH35G0uc8gd2/Rq9NkmD1g13BC5zQ7J4dtMRL8NXYEaKvu4WPM9TtzPCl4MwgAUw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:20.921941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-447899bc-c0fc-44c2-99a7-830246b972ce tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:20.925653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-447899bc-c0fc-44c2-99a7-830246b972ce tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:21.005049 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-447899bc-c0fc-44c2-99a7-830246b972ce tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.105106 Jul 01 10:38:21.005701 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1417/2836] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Jul 1 10:38:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:38:21.010876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:21.011707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:21.018021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.018473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.019273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.019705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.041824 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:21.273487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:21.281047 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-084164bc-86a1-4169-ade0-7ac8a094c2a1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.274339 Jul 01 10:38:21.281675 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1418/2837] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:21 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:21.286807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:21.287662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:21.293859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.294310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.295169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.295571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.498132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:21.507905 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4357ab5a-bdab-4dce-93a2-bc0fd292c86f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1517 microversion: 2.1 time: 0.225159 Jul 01 10:38:21.508513 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1419/2838] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:21 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:21.513773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5c0c811b-18ea-4a98-9ef5-cb7fcae2cd1a req-a8b986fc-8652-4620-bb27-89d6d05992d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90661f1e-ecda-4ea8-99c9-ca7fe1434b86", "name": "network-vif-plugged", "status": "completed", "tag": "800ffdd2-a08c-47ca-9832-cd3ac49ad796"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:21.522470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5c0c811b-18ea-4a98-9ef5-cb7fcae2cd1a req-a8b986fc-8652-4620-bb27-89d6d05992d6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.522890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5c0c811b-18ea-4a98-9ef5-cb7fcae2cd1a req-a8b986fc-8652-4620-bb27-89d6d05992d6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.534478 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5c0c811b-18ea-4a98-9ef5-cb7fcae2cd1a req-a8b986fc-8652-4620-bb27-89d6d05992d6 service nova] Creating event network-vif-plugged:800ffdd2-a08c-47ca-9832-cd3ac49ad796 for instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 on n-h2-master-1 Jul 01 10:38:21.539337 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5c0c811b-18ea-4a98-9ef5-cb7fcae2cd1a req-a8b986fc-8652-4620-bb27-89d6d05992d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029688 Jul 01 10:38:21.539926 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1420/2839] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:21.544910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d6b0e06-7978-4dd7-bbc5-f676c641d180 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:21.545876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d6b0e06-7978-4dd7-bbc5-f676c641d180 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:21.552909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d6b0e06-7978-4dd7-bbc5-f676c641d180 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.553413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d6b0e06-7978-4dd7-bbc5-f676c641d180 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.554182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d6b0e06-7978-4dd7-bbc5-f676c641d180 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.554608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d6b0e06-7978-4dd7-bbc5-f676c641d180 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.792953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d6b0e06-7978-4dd7-bbc5-f676c641d180 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1643 microversion: 2.1 time: 0.251640 Jul 01 10:38:21.793595 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1421/2840] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:21 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1643 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:21.798594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e21a7ad9-f206-4ee1-9455-73876439e363 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f970ec280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:21.817017 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e21a7ad9-f206-4ee1-9455-73876439e363 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1877010903" status: 200 len: 513 microversion: 2.2 time: 0.022127 Jul 01 10:38:21.818218 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1422/2841] 10.222.0.23 () {60 vars in 1257 bytes} [Fri Jul 1 10:38:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1877010903 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:21.823522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:21.824341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:21.831522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.831861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.833100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:21.839863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:21.865428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Updating instance_info_cache with network_info: [] {{(pid=119765) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:38:21.998192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:22.007456 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f228205-8035-47b6-bc41-197ff4704c73 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1314 microversion: 2.1 time: 0.188028 Jul 01 10:38:22.011233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1423/2842] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:21 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:22.018531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3e289f2f-1e5a-43d6-bbc9-9f2a3469e560 req-d8af48a3-d266-4743-bbd5-cd693a61dcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4afc470-5045-4a5c-b6a9-f83ca6ef7815", "name": "network-vif-deleted", "tag": "fb797876-06c8-41bf-8676-0cf94fe5eeb8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:22.024520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3e289f2f-1e5a-43d6-bbc9-9f2a3469e560 req-d8af48a3-d266-4743-bbd5-cd693a61dcc4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.025091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3e289f2f-1e5a-43d6-bbc9-9f2a3469e560 req-d8af48a3-d266-4743-bbd5-cd693a61dcc4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.041829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.server_external_events [req-3e289f2f-1e5a-43d6-bbc9-9f2a3469e560 req-d8af48a3-d266-4743-bbd5-cd693a61dcc4 service nova] Unable to find a host for instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815. Dropping event network-vif-deleted {{(pid=119764) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 10:38:22.041829 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3e289f2f-1e5a-43d6-bbc9-9f2a3469e560 req-d8af48a3-d266-4743-bbd5-cd693a61dcc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024592 Jul 01 10:38:22.041829 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1424/2843] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 10:38:22.042535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6817ed60-74a7-452b-a1eb-687fc28cc02a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:22.043179 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:38:22.043179 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:38:22.044382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6817ed60-74a7-452b-a1eb-687fc28cc02a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.044831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6817ed60-74a7-452b-a1eb-687fc28cc02a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.045739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6817ed60-74a7-452b-a1eb-687fc28cc02a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.046174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6817ed60-74a7-452b-a1eb-687fc28cc02a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.058392 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:22.071685 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6817ed60-74a7-452b-a1eb-687fc28cc02a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033142 Jul 01 10:38:22.072303 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1425/2844] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:38:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:22.076682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4debb049-389c-4075-acda-0a5028472dd2 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f9111ab80>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:22.079363 n-d-master-1 devstack@n-api.service[119764]: WARNING oslo_db.sqlalchemy.utils [None req-4debb049-389c-4075-acda-0a5028472dd2 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 01 10:38:22.084721 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4debb049-389c-4075-acda-0a5028472dd2 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.011454 Jul 01 10:38:22.091226 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1426/2845] 10.222.0.23 () {60 vars in 1176 bytes} [Fri Jul 1 10:38:22 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:22.092233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:22.092233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:22.098556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.099008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.099784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.100216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.183179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:22.192555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5085c75a-ffdd-40b0-a41c-d82c559c2b42 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1270 microversion: 2.1 time: 0.106122 Jul 01 10:38:22.193244 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1427/2846] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:22 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:22.198517 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a9b3147e-feeb-48c5-846e-57566113994a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:22.199055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a9b3147e-feeb-48c5-846e-57566113994a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:22.206048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b3147e-feeb-48c5-846e-57566113994a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.206501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b3147e-feeb-48c5-846e-57566113994a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.207302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b3147e-feeb-48c5-846e-57566113994a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.207743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b3147e-feeb-48c5-846e-57566113994a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.255886 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:22.464873 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a9b3147e-feeb-48c5-846e-57566113994a tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936/action" status: 202 len: 0 microversion: 2.1 time: 0.270199 Jul 01 10:38:22.469758 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1428/2847] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:38:22 2022] POST /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:38:22.493076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ffd989e-b54c-4134-ba7a-10c69e803dfb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f970ec430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:22.650833 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ffd989e-b54c-4134-ba7a-10c69e803dfb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877010903" status: 204 len: 0 microversion: 2.2 time: 0.179431 Jul 01 10:38:22.651666 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1429/2848] 10.222.0.23 () {60 vars in 1260 bytes} [Fri Jul 1 10:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877010903 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:22.659224 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3aadb4d-8811-4f59-ad74-8ccb194ab295 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 204 len: 0 microversion: 2.1 time: 3.398995 Jul 01 10:38:22.659650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:22.660453 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1420/2849] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:38:19 2022] DELETE /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 0 bytes in 3401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:22.660592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:22.666499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa83989a-f3d6-4c3b-a71d-0118867035c4 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:22.667227 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.667470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa83989a-f3d6-4c3b-a71d-0118867035c4 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:22.667679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.668456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.668889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.674321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa83989a-f3d6-4c3b-a71d-0118867035c4 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.676972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa83989a-f3d6-4c3b-a71d-0118867035c4 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.676972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa83989a-f3d6-4c3b-a71d-0118867035c4 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.676972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa83989a-f3d6-4c3b-a71d-0118867035c4 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.929907 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa83989a-f3d6-4c3b-a71d-0118867035c4 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1648 microversion: 2.1 time: 0.268045 Jul 01 10:38:22.931097 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1421/2850] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:22 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1648 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:22.941313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:22.947234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:22.948127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:22.949744 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a45aed3-5bda-4116-b214-148542125a3a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1316 microversion: 2.1 time: 0.296869 Jul 01 10:38:22.950363 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1430/2851] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:22 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:22.956490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Action: 'create', calling method: .version_select at 0x7f6f9124bdc0>, body: {"keypair": {"name": "tempest-keypair-195912299", "type": "x509"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:22.969549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.970002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.971974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:22.972418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:22.991293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:22.997460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:23.004075 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:23.024178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.processutils [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpudwz9lg5/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpudwz9lg5/temp.key -subj /CN=7f99d6ad6b1043b8be576bf8b29f4bf7 -extensions v3_req_client {{(pid=119764) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 01 10:38:23.272363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:23.297958 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ee209db-49e2-4aac-968e-e71abbba8ddd tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 200 len: 1517 microversion: 2.1 time: 0.355135 Jul 01 10:38:23.301657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1422/2852] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:22 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:23.310172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:23.311091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:23.318600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:23.319255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:23.320260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:23.320871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:23.592530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.processutils [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpudwz9lg5/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpudwz9lg5/temp.key -subj /CN=7f99d6ad6b1043b8be576bf8b29f4bf7 -extensions v3_req_client" returned: 0 in 0.567s {{(pid=119764) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 01 10:38:23.598178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.processutils [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpudwz9lg5/temp.key -password pass: {{(pid=119764) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 01 10:38:23.635284 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 HTTP/1.1 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e4afc470-5045-4a5c-b6a9-f83ca6ef7815'} Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:23.637253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:23.646674 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72b1b02e-d1f0-41c5-b8f8-049f59fcaca6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 404 len: 111 microversion: 2.1 time: 0.336106 Jul 01 10:38:23.648414 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1423/2853] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:23 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 111 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:38:23.658757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:23.659587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:23.666122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:23.666881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:23.667854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:23.668485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:23.695996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.processutils [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpudwz9lg5/temp.key -password pass:" returned: 0 in 0.098s {{(pid=119764) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 01 10:38:23.871342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:23.873918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:23.880481 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed7a0833-6439-4e9a-824f-6dd171023495 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1314 microversion: 2.1 time: 0.230642 Jul 01 10:38:23.890012 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1424/2854] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:23 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:23.890012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:23.890012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:23.892954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Getting quotas for user 7f99d6ad6b1043b8be576bf8b29f4bf7 and project 71e03ce168504b5399d4606d1702b7d2. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:23.899056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:23.899514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:23.900310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:23.900750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:23.922502 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-202c2bf1-4c41-45ba-a231-4fe2e6fda1cb tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.969411 Jul 01 10:38:23.925632 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1431/2855] 10.222.0.23 () {62 vars in 1197 bytes} [Fri Jul 1 10:38:22 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 973 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:23.932359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-102008564", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ce42240f-1f36-4657-993c-cfa415e6f19d"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:24.011938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] validate_networks() for [('ce42240f-1f36-4657-993c-cfa415e6f19d', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:38:24.151569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:24.160409 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-009b13b9-368b-4b5f-bba7-9ab113170b51 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1312 microversion: 2.1 time: 0.278168 Jul 01 10:38:24.161558 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1425/2856] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:23 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:24.166603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5927b2c2-4421-482a-94ac-b0b1254df6ca tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f90ec69d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:24.182858 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5927b2c2-4421-482a-94ac-b0b1254df6ca tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-195912299" status: 200 len: 1533 microversion: 2.2 time: 0.013489 Jul 01 10:38:24.182858 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1426/2857] 10.222.0.23 () {60 vars in 1254 bytes} [Fri Jul 1 10:38:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-195912299 => generated 1533 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:24.183987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-04b1ec6c-8ad7-4000-bf9b-e3fefefa80ec tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:24.184534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-04b1ec6c-8ad7-4000-bf9b-e3fefefa80ec tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:24.191727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04b1ec6c-8ad7-4000-bf9b-e3fefefa80ec tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.192168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04b1ec6c-8ad7-4000-bf9b-e3fefefa80ec tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.192954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04b1ec6c-8ad7-4000-bf9b-e3fefefa80ec tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.193471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04b1ec6c-8ad7-4000-bf9b-e3fefefa80ec tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.444618 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-04b1ec6c-8ad7-4000-bf9b-e3fefefa80ec tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1628 microversion: 2.1 time: 0.266595 Jul 01 10:38:24.445407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1427/2858] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:24 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1628 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:24.450496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:24.451235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:24.457986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.458998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.460034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.460573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.647941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:38:24.648606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:38:24.649195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:38:24.649924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:38:24.651110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:38:24.664242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.664819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.665753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.666270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.687771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:24.691432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:24.699386 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb4cc8a8-d06a-4690-b6e6-87505bb18486 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.252632 Jul 01 10:38:24.700566 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1428/2859] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:24 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:24.700905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for user cc8012fcb48840f1b778ab759457e66c and project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:24.705973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-bc1dde58-a449-4bda-939a-c576c32dec26 req-4cc871af-27dc-4f16-ae2b-f71c50bc213b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6993fc-6b40-4870-afef-31522ba6f3e9", "name": "network-vif-deleted", "tag": "073890cc-fed6-49c8-b5ac-479d02037645"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:24.714190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bc1dde58-a449-4bda-939a-c576c32dec26 req-4cc871af-27dc-4f16-ae2b-f71c50bc213b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.714890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bc1dde58-a449-4bda-939a-c576c32dec26 req-4cc871af-27dc-4f16-ae2b-f71c50bc213b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.718598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:38:24.721630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:38:24.728132 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-bc1dde58-a449-4bda-939a-c576c32dec26 req-4cc871af-27dc-4f16-ae2b-f71c50bc213b service nova] Creating event network-vif-deleted:073890cc-fed6-49c8-b5ac-479d02037645 for instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 on n-h2-master-1 Jul 01 10:38:24.733333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-bc1dde58-a449-4bda-939a-c576c32dec26 req-4cc871af-27dc-4f16-ae2b-f71c50bc213b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Jul 01 10:38:24.734249 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1429/2860] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:24.739996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-43081193-f810-4bff-a5a0-ab15496eb7e7 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f90c2fc10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:24.742733 n-d-master-1 devstack@n-api.service[119765]: WARNING oslo_db.sqlalchemy.utils [None req-43081193-f810-4bff-a5a0-ab15496eb7e7 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 01 10:38:24.747877 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-43081193-f810-4bff-a5a0-ab15496eb7e7 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.012500 Jul 01 10:38:24.753365 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1430/2861] 10.222.0.23 () {60 vars in 1176 bytes} [Fri Jul 1 10:38:24 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:24.756953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:24.757729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 1b6993fc-6b40-4870-afef-31522ba6f3e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:24.765387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.765387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.765601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.765984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.783480 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] HTTP exception thrown: Instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 could not be found. Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Request method failure captured: Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 HTTP/1.1 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs5RlVeS8q_nCieuEzxjwTP9kfzV5AsOy6eCJUegJwtmGlNb0DStpV5pqiLAduDa4NNKTGeG-WlPfP3_58KxXrhjucGRolgnIS-6kvMFI0cJskzLlRNcdT7ftmG6Qem9DqWjgQUOMBZlR9SUTTRBgZGGiDZvxXjk8PMKRwUYNj3vJM4 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2a951f035ec74e2690d9a28934035056 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a951f035ec74e2690d9a28934035056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2a951f035ec74e2690d9a28934035056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2a951f035ec74e2690d9a28934035056", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a951f035ec74e2690d9a28934035056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2a951f035ec74e2690d9a28934035056 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListServerFiltersTestJSON-981306574-project Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 538b08000bbf48eb98640127bea8036f Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListServerFiltersTestJSON-981306574-project Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 could not be found. Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '1b6993fc-6b40-4870-afef-31522ba6f3e9'} Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 could not be found. Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 could not be found. Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:24.785689 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 could not be found. Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Returning 404 to user: Instance 1b6993fc-6b40-4870-afef-31522ba6f3e9 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d8cbd51a-c43f-460b-a76b-a5bb1d6b2543 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9" status: 404 len: 111 microversion: 2.1 time: 0.037519 Jul 01 10:38:24.794984 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1431/2862] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:24 2022] GET /compute/v2.1/servers/1b6993fc-6b40-4870-afef-31522ba6f3e9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:38:24.795979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:24.797187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:24.804996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.805600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.806375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:24.806809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:24.841402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lazy-loading 'flavor' on Instance uuid 6beb1734-a4f4-42f6-a108-197964bde936 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:38:24.857342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Going to try to live migrate instance to n-h1-master-1 {{(pid=119765) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:38:24.874340 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ff3d169-ae60-4d8b-a189-c025450a2c7b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947379 Jul 01 10:38:24.879989 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1432/2863] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:38:24.885960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-305562be-37a0-45df-b57a-2fabc9e919f3 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] Calling method '.version_select at 0x7f6f9111a700>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:24.993455 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-305562be-37a0-45df-b57a-2fabc9e919f3 tempest-KeyPairsV22TestJSON-1285141554 tempest-KeyPairsV22TestJSON-1285141554-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-195912299" status: 204 len: 0 microversion: 2.2 time: 0.116753 Jul 01 10:38:24.994362 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1433/2864] 10.222.0.23 () {60 vars in 1257 bytes} [Fri Jul 1 10:38:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-195912299 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:25.016143 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:25.018632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:25.033565 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:25.036519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:25.037367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:25.038820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:25.085789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:38:25.520124 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99969f61-225a-4046-b636-00dc0a1e4f00 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "DELETE /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 204 len: 0 microversion: 2.1 time: 0.524180 Jul 01 10:38:25.520757 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1434/2865] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:38:24 2022] DELETE /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:25.526573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2025039102", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:25.590069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] validate_networks() for [('5cc96019-7f9a-4fe6-a8e5-4beaea1229fb', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:38:26.139438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:38:26.140192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:38:26.140894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:38:26.141489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:38:26.142093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:38:26.155164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.155875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.159399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.160968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.190094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Getting quotas for project 450b024145714e4a88443e0a6d1d9a49. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:26.198553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Getting quotas for user a03374f49b3444ffabc5a22d82c07854 and project 450b024145714e4a88443e0a6d1d9a49. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:26.223109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:38:26.225800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:38:26.483638 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b376ae35-978d-43ed-a75a-b1b34db90c7a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961468 Jul 01 10:38:26.487130 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1435/2866] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:38:26.492171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:26.496874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:26.504182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.504723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.505610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.506112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.594218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:26.604565 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4782b320-a0ef-4ade-bd68-982ce8ba5c1e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1218 microversion: 2.1 time: 0.116117 Jul 01 10:38:26.613672 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1436/2867] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:26 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:26.617495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:26.618994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:26.634515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.635050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.646092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.650477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.812026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:26.820511 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ff568c92-bfa8-44d2-94d3-101e62e60137 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1314 microversion: 2.1 time: 0.210935 Jul 01 10:38:26.821300 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1437/2868] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:26 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:26.825990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-df93397a-89f6-4a1e-bfaf-6d4ef9230d8e req-9ba39e57-7b4c-4c2c-9ab5-5ae8e20d1151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147e6456-18f8-4966-83d1-c27c09d75939", "tag": "f84c6603-163c-4144-8d04-acd128a6b696"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:26.834937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-df93397a-89f6-4a1e-bfaf-6d4ef9230d8e req-9ba39e57-7b4c-4c2c-9ab5-5ae8e20d1151 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.835391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-df93397a-89f6-4a1e-bfaf-6d4ef9230d8e req-9ba39e57-7b4c-4c2c-9ab5-5ae8e20d1151 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.847195 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-df93397a-89f6-4a1e-bfaf-6d4ef9230d8e req-9ba39e57-7b4c-4c2c-9ab5-5ae8e20d1151 service nova] Creating event network-changed:f84c6603-163c-4144-8d04-acd128a6b696 for instance 147e6456-18f8-4966-83d1-c27c09d75939 on n-h1-master-1 Jul 01 10:38:26.860461 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-df93397a-89f6-4a1e-bfaf-6d4ef9230d8e req-9ba39e57-7b4c-4c2c-9ab5-5ae8e20d1151 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030183 Jul 01 10:38:26.862880 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1438/2869] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:26.871023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:26.871740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:26.880116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.881036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:26.882610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:26.883062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:27.068711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:27.077279 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a800b101-f2d2-4816-bfbd-9e6edf0852c7 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.210553 Jul 01 10:38:27.078273 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1439/2870] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:26 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:27.084047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:27.085060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:27.092260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:27.095726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:27.095726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:27.099977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:27.256166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:27.265359 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2fbdb7bc-5264-4857-8e6a-b43c8a8815f3 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 200 len: 1518 microversion: 2.1 time: 0.185712 Jul 01 10:38:27.271659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1440/2871] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:27 2022] GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:27.271786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c9aad014-af58-4668-935b-6c669885f3f9 req-dae3fa9a-2957-43dd-8d3e-1b73bd5b5de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcfc56f-d6db-4c21-b1df-bb7fa078d352", "name": "network-vif-plugged", "status": "completed", "tag": "9ed0e231-ab89-424a-bbba-a8d260b6e617"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:27.280334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c9aad014-af58-4668-935b-6c669885f3f9 req-dae3fa9a-2957-43dd-8d3e-1b73bd5b5de9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:27.280799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c9aad014-af58-4668-935b-6c669885f3f9 req-dae3fa9a-2957-43dd-8d3e-1b73bd5b5de9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:27.295611 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c9aad014-af58-4668-935b-6c669885f3f9 req-dae3fa9a-2957-43dd-8d3e-1b73bd5b5de9 service nova] Creating event network-vif-plugged:9ed0e231-ab89-424a-bbba-a8d260b6e617 for instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 on n-h1-master-1 Jul 01 10:38:27.301994 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c9aad014-af58-4668-935b-6c669885f3f9 req-dae3fa9a-2957-43dd-8d3e-1b73bd5b5de9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Jul 01 10:38:27.302622 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1441/2872] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:27.310077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc7111a6-2e04-416e-9ef9-750e4d02a74a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:27.311485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc7111a6-2e04-416e-9ef9-750e4d02a74a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:27.388480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc7111a6-2e04-416e-9ef9-750e4d02a74a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:27.404915 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc7111a6-2e04-416e-9ef9-750e4d02a74a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1217 microversion: 2.1 time: 0.100038 Jul 01 10:38:27.406824 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1442/2873] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:27 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:27.630513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:27.631140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:27.642511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:27.649949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:27.650917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:27.651605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:27.657337 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:27.755234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:27.777761 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4d5d4db7-f110-4a73-9f7e-3c3526240140 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1274 microversion: 2.1 time: 0.150633 Jul 01 10:38:27.789892 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1443/2874] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:27 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:27.841187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:27.842176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:27.844358 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:27.851606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:27.852459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:27.853554 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:27.854270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.063760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:28.072773 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-612fb810-74ed-4c61-8ccf-df0ee748e0cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1314 microversion: 2.1 time: 0.237895 Jul 01 10:38:28.074585 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1444/2875] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:27 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:28.096974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:28.098937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:28.107076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.107822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.108959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.109709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.379778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:28.388761 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a6632f9e-834b-4e81-9b0b-110921998feb tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.296766 Jul 01 10:38:28.389529 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1445/2876] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:28 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:28.395174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7b9cafd7-aa7b-48c9-8283-a19128641546 req-f17cbb73-92d3-482d-94f7-0f4bafe24bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b2fc1f-8a21-401c-9d4a-523c44f2ccf7", "name": "network-vif-deleted", "tag": "16f28481-6c31-4ee9-b510-e5bc91ae2cd7"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:28.404210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7b9cafd7-aa7b-48c9-8283-a19128641546 req-f17cbb73-92d3-482d-94f7-0f4bafe24bc2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.404718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7b9cafd7-aa7b-48c9-8283-a19128641546 req-f17cbb73-92d3-482d-94f7-0f4bafe24bc2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.416076 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7b9cafd7-aa7b-48c9-8283-a19128641546 req-f17cbb73-92d3-482d-94f7-0f4bafe24bc2 service nova] Creating event network-vif-deleted:16f28481-6c31-4ee9-b510-e5bc91ae2cd7 for instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 on n-h1-master-1 Jul 01 10:38:28.421358 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7b9cafd7-aa7b-48c9-8283-a19128641546 req-f17cbb73-92d3-482d-94f7-0f4bafe24bc2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030280 Jul 01 10:38:28.422059 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1446/2877] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:28.428893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:28.428893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:28.434865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.435380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.436247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.436772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.519531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:28.546730 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-916cb298-65e9-44a1-8e1d-efbe75eef97f tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 200 len: 1476 microversion: 2.1 time: 0.122357 Jul 01 10:38:28.547954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1447/2878] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:28 2022] GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 1476 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:28.561808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:28.562807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:28.570630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.571586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.572597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.573429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.672168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:28.682603 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fd2c9c75-ac73-4cc1-9a88-9238fdf8d04b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1269 microversion: 2.1 time: 0.131376 Jul 01 10:38:28.683929 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1448/2879] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:28 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:28.799026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:28.799026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:28.810714 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46b7caa8-24d2-43c2-80ab-e992badce169 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936/action" status: 202 len: 0 microversion: 2.1 time: 4.021692 Jul 01 10:38:28.811877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.815959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1432/2880] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:38:24 2022] POST /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936/action => generated 0 bytes in 4024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:38:28.817609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.818707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.819489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.820799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:28.821436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:28.839158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.842466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.844186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:28.844793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:28.914423 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=28 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:29.096588 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:29.200380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:29.200870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:29.215507 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d0bfd74-867b-4120-9ea7-5666dfc5fa5a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.399301 Jul 01 10:38:29.218926 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1da9ef8d-113e-4910-af66-7c49219ea769 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.424683 Jul 01 10:38:29.221296 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1449/2881] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:28 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:29.224030 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1433/2882] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:28 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:29.229638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:29.234658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-05a5c68f-de84-47b9-90ee-5d90c29be3d4 req-569f2693-cbfa-4940-824e-ca9c8d8364f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147e6456-18f8-4966-83d1-c27c09d75939", "tag": "dd076adb-dbb6-49c3-8cb2-6b9ff4246709"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:29.236553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:29.249966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.250654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.251684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.252749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.256716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-05a5c68f-de84-47b9-90ee-5d90c29be3d4 req-569f2693-cbfa-4940-824e-ca9c8d8364f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.257213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-05a5c68f-de84-47b9-90ee-5d90c29be3d4 req-569f2693-cbfa-4940-824e-ca9c8d8364f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.278502 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-05a5c68f-de84-47b9-90ee-5d90c29be3d4 req-569f2693-cbfa-4940-824e-ca9c8d8364f4 service nova] Creating event network-changed:dd076adb-dbb6-49c3-8cb2-6b9ff4246709 for instance 147e6456-18f8-4966-83d1-c27c09d75939 on n-h1-master-1 Jul 01 10:38:29.285017 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-05a5c68f-de84-47b9-90ee-5d90c29be3d4 req-569f2693-cbfa-4940-824e-ca9c8d8364f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062348 Jul 01 10:38:29.286268 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1450/2883] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:29.412302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:29.416079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:29.431505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.432540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.435087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.440477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.520457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:29.528127 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b8ee5a3b-f7d7-4e2e-a129-e8187dd6d8f4 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1502 microversion: 2.1 time: 0.302752 Jul 01 10:38:29.540710 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1434/2884] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:29 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:29.546656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4cd5b860-d41d-40b4-b268-954bce385375 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:29.547193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4cd5b860-d41d-40b4-b268-954bce385375 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:29.553664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd5b860-d41d-40b4-b268-954bce385375 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.554114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd5b860-d41d-40b4-b268-954bce385375 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.555092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd5b860-d41d-40b4-b268-954bce385375 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.555694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd5b860-d41d-40b4-b268-954bce385375 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.742771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:29.752427 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-689428d2-5466-407b-84a8-9b5d9f415767 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.349005 Jul 01 10:38:29.753415 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1451/2885] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:29 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:29.766052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:29.767366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:29.775139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.775730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.776968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.777492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.810903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.811350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.811865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lazy-loading 'fault' on Instance uuid 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:38:29.822055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4cd5b860-d41d-40b4-b268-954bce385375 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352/action" status: 202 len: 0 microversion: 2.1 time: 0.279665 Jul 01 10:38:29.823205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1435/2886] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:38:29 2022] POST /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:38:29.834969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:29.836166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:29.846594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.847782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:29.853585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:29.854366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:30.135503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:30.144646 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-34122ad1-a9de-4d95-8870-d85372e1f41c tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 200 len: 1311 microversion: 2.1 time: 0.389864 Jul 01 10:38:30.145262 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1452/2887] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:29 2022] GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 1311 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:30.150695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:30.151457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:30.162181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:30.162909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:30.163995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:30.164598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:30.176128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:30.185636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d4564eb-f6b2-40a2-ba47-cee78ab1678a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1275 microversion: 2.1 time: 0.361070 Jul 01 10:38:30.197930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1436/2888] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:29 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1275 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:30.248791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:30.249766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:30.273099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:30.276513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:30.278632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:30.281993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:30.502781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:30.517623 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f1a5717-3c6f-4a85-a7a7-360d663bc50c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1507 microversion: 2.1 time: 0.368539 Jul 01 10:38:30.518678 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1453/2889] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:30 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:30.532869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:30.536567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:30.554389 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:30.557033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:30.559541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:30.561204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:30.943267 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:30.951105 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2fc88e4f-712c-4e11-9e6c-30ddcac9ccc2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.429695 Jul 01 10:38:30.961494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:30.970478 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e09a27a-1c30-4873-b0ed-e5396837e6c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.736535 Jul 01 10:38:30.970730 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1454/2890] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:30 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:30.980354 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1437/2891] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:30 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:30.991501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:30.995587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:31.003611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.011961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.011961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.011961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.163334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:31.164088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:31.175075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.175848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.177277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.177968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.195887 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] HTTP exception thrown: Instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 could not be found. Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Request method failure captured: Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 HTTP/1.1 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs5RlVeS8q_nCieuEzxjwTP9kfzV5AsOy6eCJUegJwtmGlNb0DStpV5pqiLAduDa4NNKTGeG-WlPfP3_58KxXrhjucGRolgnIS-6kvMFI0cJskzLlRNcdT7ftmG6Qem9DqWjgQUOMBZlR9SUTTRBgZGGiDZvxXjk8PMKRwUYNj3vJM4 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2a951f035ec74e2690d9a28934035056 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a951f035ec74e2690d9a28934035056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2a951f035ec74e2690d9a28934035056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2a951f035ec74e2690d9a28934035056", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a951f035ec74e2690d9a28934035056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2a951f035ec74e2690d9a28934035056 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListServerFiltersTestJSON-981306574-project Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 538b08000bbf48eb98640127bea8036f Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListServerFiltersTestJSON-981306574-project Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 could not be found. Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '78b2fc1f-8a21-401c-9d4a-523c44f2ccf7'} Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 could not be found. Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 could not be found. Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:31.197813 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:31.202640 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:31.202640 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:31.202640 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:31.202640 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:31.202640 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:31.202640 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 could not be found. Jul 01 10:38:31.202640 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:31.203726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Returning 404 to user: Instance 78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:31.205290 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-abfdaaf2-30c5-48f0-8f2d-20f4d0d7b541 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7" status: 404 len: 111 microversion: 2.1 time: 0.047206 Jul 01 10:38:31.212106 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1438/2892] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:31 2022] GET /compute/v2.1/servers/78b2fc1f-8a21-401c-9d4a-523c44f2ccf7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:38:31.212106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:31.212106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:31.218470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.219057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.221261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.221800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.462795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:31.474986 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-90f0a134-b5c7-4925-b731-f5b114794a5e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.502829 Jul 01 10:38:31.486219 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1455/2893] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:30 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:31.494011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:31.494875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:31.503659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.505398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.507863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.508657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.549023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:38:31.697834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:31.712449 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ebeae6d9-1b43-49e2-a733-5c6f0396ff87 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 0.504868 Jul 01 10:38:31.713605 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1439/2894] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:31 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:31.726751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:31.727645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:31.741936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.741936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.741936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:31.741936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:31.998104 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e64f5ed-8e95-45bf-b3bd-4543e85e46df tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 204 len: 0 microversion: 2.1 time: 0.509145 Jul 01 10:38:32.002433 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1456/2895] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:38:31 2022] DELETE /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:32.006336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3379fa15-b1ce-4fa8-8211-af0899d63ce9 req-f4ba0d54-a135-4411-a2ee-06467715a75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47387c27-7fd3-476a-bdfb-040bbfd8e06d", "tag": "ef87defb-9443-4408-87be-fad540a0feab"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:32.015847 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3379fa15-b1ce-4fa8-8211-af0899d63ce9 req-f4ba0d54-a135-4411-a2ee-06467715a75e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.016563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3379fa15-b1ce-4fa8-8211-af0899d63ce9 req-f4ba0d54-a135-4411-a2ee-06467715a75e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.031261 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3379fa15-b1ce-4fa8-8211-af0899d63ce9 req-f4ba0d54-a135-4411-a2ee-06467715a75e service nova] Creating event network-changed:ef87defb-9443-4408-87be-fad540a0feab for instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d on n-h2-master-1 Jul 01 10:38:32.038064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3379fa15-b1ce-4fa8-8211-af0899d63ce9 req-f4ba0d54-a135-4411-a2ee-06467715a75e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037710 Jul 01 10:38:32.038807 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1457/2896] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:32.044627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:32.051441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:32.060340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:32.066114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.066706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.067608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.072219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.073492 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:32.083578 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2f289d6e-6da7-4b8f-a7b7-6a4b8bec27ae tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1487 microversion: 2.1 time: 0.368636 Jul 01 10:38:32.086725 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1440/2897] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:31 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1487 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:32.093787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:32.094713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:32.102772 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.103751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.104770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.106850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.512210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:32.512431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:32.521545 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e67c1c8b-29b8-4365-9cfd-305f7af076ff tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.481104 Jul 01 10:38:32.522143 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1458/2898] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:32 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:32.525397 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf8e89fb-1070-48aa-ba6b-3a942d557f15 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.437212 Jul 01 10:38:32.525982 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1441/2899] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:32 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:32.528279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:32.529066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:32.536811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.537688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.538885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.539527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.543331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:32.543886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:32.558719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.561030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.564133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.564614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.655492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lazy-loading 'flavor' on Instance uuid ebcfc56f-d6db-4c21-b1df-bb7fa078d352 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:38:32.934975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:32.941191 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:32.945004 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11690bde-0036-439f-acaa-10c7d6b856d0 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1519 microversion: 2.1 time: 0.421183 Jul 01 10:38:32.945801 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1459/2900] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:32 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1519 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:32.961440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:32.966656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:32.979832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.980672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:32.981905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:32.982677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:33.316742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:33.324760 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bd4063e1-3387-49b1-9a34-5604bd9c78aa tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.377728 Jul 01 10:38:33.328298 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1460/2901] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:32 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:33.345708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:33.348426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:33.364792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:33.365734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:33.366788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:33.368027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:33.390077 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2e4c8e0-4831-4b5a-819b-83575b7cbac0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352/action" status: 202 len: 0 microversion: 2.1 time: 0.858103 Jul 01 10:38:33.394680 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1442/2902] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:38:32 2022] POST /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:38:33.407223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-59eb8518-340c-4d27-9b41-87d03a597b32 req-878ccf8a-c7dc-4795-a85e-456609f5c453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76313d67-6ebf-4f72-af57-70281a063492", "tag": "031ca2c8-057b-41fe-a278-521f5a4dfb74"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:33.430533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-59eb8518-340c-4d27-9b41-87d03a597b32 req-878ccf8a-c7dc-4795-a85e-456609f5c453 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:33.434429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-59eb8518-340c-4d27-9b41-87d03a597b32 req-878ccf8a-c7dc-4795-a85e-456609f5c453 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:33.454029 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-59eb8518-340c-4d27-9b41-87d03a597b32 req-878ccf8a-c7dc-4795-a85e-456609f5c453 service nova] Creating event network-changed:031ca2c8-057b-41fe-a278-521f5a4dfb74 for instance 76313d67-6ebf-4f72-af57-70281a063492 on n-h2-master-1 Jul 01 10:38:33.478920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-59eb8518-340c-4d27-9b41-87d03a597b32 req-878ccf8a-c7dc-4795-a85e-456609f5c453 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083786 Jul 01 10:38:33.479553 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1443/2903] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:33.484918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:33.489638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:33.511686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:33.512351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:33.513357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:33.513993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:33.962148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:33.971036 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9d36b1e-0fb7-4047-a2d1-3c2f9c8a33f0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 0.641588 Jul 01 10:38:33.973116 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1461/2904] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:33 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:33.978754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:33.981236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:33.986493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:33.986964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:33.987846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:33.988685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:34.084171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:34.103835 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e6d83411-d1f0-402f-a41d-4198d5937648 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1493 microversion: 2.1 time: 0.611555 Jul 01 10:38:34.104498 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1444/2905] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:33 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1493 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:34.110673 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:34.111526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:34.122275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:34.122723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:34.123501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:34.124013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:34.576028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:34.594064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1e8c870d-b8a3-4b93-9182-ca36aa25fab9 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.618518 Jul 01 10:38:34.596807 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1462/2906] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:33 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:34.603043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:34.604147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:34.614634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:34.615643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:34.617531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:34.618141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:34.633809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:34.653506 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b68afba8-194b-4888-8efd-ff4c3492bb7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.547653 Jul 01 10:38:34.674827 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1445/2907] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:34 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:34.679804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e02e470c-7804-4141-802e-b9ca16531926 req-2ea4b4ad-778a-4707-8ef8-030f111efb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beb1734-a4f4-42f6-a108-197964bde936", "name": "network-vif-unplugged", "status": "completed", "tag": "08309fee-bc21-46d1-9d77-48c1be296251"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:34.705323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e02e470c-7804-4141-802e-b9ca16531926 req-2ea4b4ad-778a-4707-8ef8-030f111efb92 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:34.705323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e02e470c-7804-4141-802e-b9ca16531926 req-2ea4b4ad-778a-4707-8ef8-030f111efb92 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:34.719797 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e02e470c-7804-4141-802e-b9ca16531926 req-2ea4b4ad-778a-4707-8ef8-030f111efb92 service nova] Creating event network-vif-unplugged:08309fee-bc21-46d1-9d77-48c1be296251 for instance 6beb1734-a4f4-42f6-a108-197964bde936 on n-h2-master-1 Jul 01 10:38:34.726130 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e02e470c-7804-4141-802e-b9ca16531926 req-2ea4b4ad-778a-4707-8ef8-030f111efb92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049928 Jul 01 10:38:34.727034 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1446/2908] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:34.733380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:34.734617 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:34.743840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:34.744766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:34.745793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:34.746394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.325361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:35.327302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:35.334680 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-304e4637-a774-4b4d-b279-b444c41d3dc4 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.606184 Jul 01 10:38:35.335841 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1447/2909] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:34 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:35.340556 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2f85fe23-a225-48d7-bcda-d162c1153a66 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1519 microversion: 2.1 time: 0.742310 Jul 01 10:38:35.341176 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1463/2910] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:34 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1519 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:35.348101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:35.348101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:35.349058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:35.351425 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:35.353945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.354398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.355206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.355671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.362153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.362728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.363641 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.364168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.653571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:35.661168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:35.666408 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce4c371f-66b7-44c2-8995-844c4e64d96a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1514 microversion: 2.1 time: 0.323505 Jul 01 10:38:35.667220 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1464/2911] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:35 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:35.672184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:35.673642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:35.680202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.686891 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f07f9630-e13e-4d59-80e3-b129cc0e882f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 0.342210 Jul 01 10:38:35.687038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.687146 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1448/2912] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:35 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:35.687241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.687241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.687429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:35.687429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:35.702132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.702726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.703743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:35.704267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:35.947129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:35.956720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:35.965427 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad7efa8f-4f68-4eb2-b9fa-b304bac917a8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.290528 Jul 01 10:38:35.979000 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1465/2913] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:35 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:35.980314 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-22027ed1-2f06-425f-be2e-f7fa4d66a3ad tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.298133 Jul 01 10:38:35.991040 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1449/2914] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:35 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:36.352019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:36.353341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:36.357583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:36.357786 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=18 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:36.358426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:36.362957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.363415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.364200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.364731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.373208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.376107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.376107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.376107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.612004 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:36.632434 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d651abf-e071-48ab-b1b5-0d615bc582d9 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1306 microversion: 2.1 time: 0.278627 Jul 01 10:38:36.637398 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1450/2915] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:36 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1306 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:36.648658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-be46650f-a1cc-4c62-be2f-8e80b423cdcf req-bc533801-ccf6-45b6-b9ac-db2635e55a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e6456-18f8-4966-83d1-c27c09d75939", "name": "network-vif-plugged", "status": "completed", "tag": "f84c6603-163c-4144-8d04-acd128a6b696"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:36.660145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-be46650f-a1cc-4c62-be2f-8e80b423cdcf req-bc533801-ccf6-45b6-b9ac-db2635e55a54 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.665601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-be46650f-a1cc-4c62-be2f-8e80b423cdcf req-bc533801-ccf6-45b6-b9ac-db2635e55a54 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.674163 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-be46650f-a1cc-4c62-be2f-8e80b423cdcf req-bc533801-ccf6-45b6-b9ac-db2635e55a54 service nova] Creating event network-vif-plugged:f84c6603-163c-4144-8d04-acd128a6b696 for instance 147e6456-18f8-4966-83d1-c27c09d75939 on n-h1-master-1 Jul 01 10:38:36.679276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:36.680698 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-be46650f-a1cc-4c62-be2f-8e80b423cdcf req-bc533801-ccf6-45b6-b9ac-db2635e55a54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035817 Jul 01 10:38:36.681782 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1451/2916] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:36.689505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:36.697377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:36.697510 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f59823e7-e2ba-4dc2-9963-1803161c270e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.342159 Jul 01 10:38:36.697510 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1466/2917] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:36 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:36.699518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.700130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.701965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.703034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.706320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:36.707068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:36.715441 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.722918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.722918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:36.722918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:36.959676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:36.967881 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8bcc7a6-be96-48d9-9626-e5e78ee1724b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 0.269140 Jul 01 10:38:36.983106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:36.987727 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1467/2918] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:36 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:37.000561 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f841c6c7-f757-45f3-9e9c-c2e88960a7ac tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.312057 Jul 01 10:38:37.000561 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1452/2919] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:36 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:37.014090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:37.014797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:37.017614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2ceff341-adcf-4f56-8436-dcca711d5c97 req-80389b4c-1f9c-48cb-a366-fdbb51e4fbdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6beb1734-a4f4-42f6-a108-197964bde936", "tag": "08309fee-bc21-46d1-9d77-48c1be296251"}, {"server_uuid": "26b8a143-8738-4973-92b9-988cfd643c2c", "name": "network-vif-deleted", "tag": "d39cd4d9-2e9d-419b-8cf1-30f2257a458d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:37.041249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.042301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.044000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.045694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.051551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2ceff341-adcf-4f56-8436-dcca711d5c97 req-80389b4c-1f9c-48cb-a366-fdbb51e4fbdf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.051551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2ceff341-adcf-4f56-8436-dcca711d5c97 req-80389b4c-1f9c-48cb-a366-fdbb51e4fbdf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.083704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2ceff341-adcf-4f56-8436-dcca711d5c97 req-80389b4c-1f9c-48cb-a366-fdbb51e4fbdf service nova] Creating event network-changed:08309fee-bc21-46d1-9d77-48c1be296251 for instance 6beb1734-a4f4-42f6-a108-197964bde936 on n-h2-master-1 Jul 01 10:38:37.085501 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2ceff341-adcf-4f56-8436-dcca711d5c97 req-80389b4c-1f9c-48cb-a366-fdbb51e4fbdf service nova] Creating event network-vif-deleted:d39cd4d9-2e9d-419b-8cf1-30f2257a458d for instance 26b8a143-8738-4973-92b9-988cfd643c2c on n-h2-master-1 Jul 01 10:38:37.097860 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2ceff341-adcf-4f56-8436-dcca711d5c97 req-80389b4c-1f9c-48cb-a366-fdbb51e4fbdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.088332 Jul 01 10:38:37.101340 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1453/2920] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:37.140812 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:37.143117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:37.151046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.151951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.153489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.158432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.395845 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=40 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:37.434411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:37.444262 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60baec59-a423-4e26-aadf-e17529dd5348 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.450197 Jul 01 10:38:37.444859 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1468/2921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:36 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:37.485818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:37.494635 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af626da4-3932-4136-b240-efb2f49543a0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.390485 Jul 01 10:38:37.496483 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1454/2922] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:37 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:37.655823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:37.657859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:37.668793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.669895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.671476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.672085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.708832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:37.710251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:37.725410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.726154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.727146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.728142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.756197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:37.758328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:37.759278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lazy-loading 'fault' on Instance uuid 26b8a143-8738-4973-92b9-988cfd643c2c {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:38:38.054338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:38.069814 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee705f2d-e892-4959-86db-7f6291f78add tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.363046 Jul 01 10:38:38.072958 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1455/2923] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:37 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:38.084510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:38.090574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:38.091946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538b08000bbf48eb98640127bea8036f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a951f035ec74e2690d9a28934035056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:38.103153 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28a6de05-96fe-42f2-bff5-ba2b73979b94 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 200 len: 1311 microversion: 2.1 time: 0.457052 Jul 01 10:38:38.105431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:38.106112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:38.107147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:38.107782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:38.116556 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1469/2924] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:37 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 1311 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:38.124844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:38.125806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:38.132887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:38.133619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:38.135458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:38.136067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:38.777603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:38.797256 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bec81df5-825b-4cec-9c04-28e2e823311a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.671129 Jul 01 10:38:38.802625 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1470/2925] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:38 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:38.810837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:38.811665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:38.824725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:38.825435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:38.826391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:38.827158 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.257460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:39.265657 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af599ade-0f80-49e4-9096-be6166d6ff4e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 1.185405 Jul 01 10:38:39.275685 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1456/2926] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:38 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:39.499927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:39.512512 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d262107-1923-45c9-8209-c255910897e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.712746 Jul 01 10:38:39.531141 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1471/2927] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:38 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:39.537539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:39.538905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:39.555582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:39.556440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.557976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:39.558634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.584845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13111bd2-7d9e-48d6-b18e-c53be42646fe tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Action: 'create', calling method: .version_select at 0x7f6f91fa2d30>, body: {"keypair": {"name": "tempest-keypair-1728395592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDspFXcMzZbswAgODjRpOv+8C/j5gNG96rVnRvHCL9alw5nMXEej4xM2Wf/9Fnj9Tc78kxgAeqkaD/nc3FWO6a+xvCZcqaAtF8hRnngZkHn+XGqYebGhtTBWfCw/V0XaSw=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:39.635304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-13111bd2-7d9e-48d6-b18e-c53be42646fe tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Getting quotas for project d44a49743b1a4d548f03f1b1e8b0df33. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:39.659679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-13111bd2-7d9e-48d6-b18e-c53be42646fe tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Getting quotas for user af167555982f4953b40878dc2492bd21 and project d44a49743b1a4d548f03f1b1e8b0df33. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:39.819706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:39.830824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4985faec-4035-4735-8411-c24ee483747a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.297044 Jul 01 10:38:39.832679 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1472/2928] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:39 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:39.839236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c22457d0-dce5-45e0-9e50-dc06f00a07d3 req-abae2362-213f-41e1-b099-16e9ebf21c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e6456-18f8-4966-83d1-c27c09d75939", "name": "network-vif-plugged", "status": "completed", "tag": "dd076adb-dbb6-49c3-8cb2-6b9ff4246709"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:39.842976 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13111bd2-7d9e-48d6-b18e-c53be42646fe tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.566047 Jul 01 10:38:39.852696 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1457/2929] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:38:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:39.854322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:39.854461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c22457d0-dce5-45e0-9e50-dc06f00a07d3 req-abae2362-213f-41e1-b099-16e9ebf21c1e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:39.855159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c22457d0-dce5-45e0-9e50-dc06f00a07d3 req-abae2362-213f-41e1-b099-16e9ebf21c1e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.855321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:39.879465 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c22457d0-dce5-45e0-9e50-dc06f00a07d3 req-abae2362-213f-41e1-b099-16e9ebf21c1e service nova] Creating event network-vif-plugged:dd076adb-dbb6-49c3-8cb2-6b9ff4246709 for instance 147e6456-18f8-4966-83d1-c27c09d75939 on n-h1-master-1 Jul 01 10:38:39.883578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:39.888083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.889044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:39.889726 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c22457d0-dce5-45e0-9e50-dc06f00a07d3 req-abae2362-213f-41e1-b099-16e9ebf21c1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054256 Jul 01 10:38:39.891901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1473/2930] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:39.892536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.904476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:39.906090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] [instance: 26b8a143-8738-4973-92b9-988cfd643c2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:39.917989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:39.918656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.920092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:39.920735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:39.943129 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] HTTP exception thrown: Instance 26b8a143-8738-4973-92b9-988cfd643c2c could not be found. Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Request method failure captured: Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c HTTP/1.1 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs5RlVeS8q_nCieuEzxjwTP9kfzV5AsOy6eCJUegJwtmGlNb0DStpV5pqiLAduDa4NNKTGeG-WlPfP3_58KxXrhjucGRolgnIS-6kvMFI0cJskzLlRNcdT7ftmG6Qem9DqWjgQUOMBZlR9SUTTRBgZGGiDZvxXjk8PMKRwUYNj3vJM4 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2a951f035ec74e2690d9a28934035056 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a951f035ec74e2690d9a28934035056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2a951f035ec74e2690d9a28934035056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2a951f035ec74e2690d9a28934035056", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2a951f035ec74e2690d9a28934035056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2a951f035ec74e2690d9a28934035056 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-981306574 Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ListServerFiltersTestJSON-981306574-project Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 538b08000bbf48eb98640127bea8036f Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ListServerFiltersTestJSON-981306574-project Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 26b8a143-8738-4973-92b9-988cfd643c2c could not be found. Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '26b8a143-8738-4973-92b9-988cfd643c2c'} Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b8a143-8738-4973-92b9-988cfd643c2c could not be found. Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b8a143-8738-4973-92b9-988cfd643c2c could not be found. Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:39.947934 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b8a143-8738-4973-92b9-988cfd643c2c could not be found. Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] Returning 404 to user: Instance 26b8a143-8738-4973-92b9-988cfd643c2c could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1805361e-d640-4310-9108-dba604f1c308 tempest-ListServerFiltersTestJSON-981306574 tempest-ListServerFiltersTestJSON-981306574-project] 10.222.0.23 "GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c" status: 404 len: 111 microversion: 2.1 time: 0.056372 Jul 01 10:38:39.956849 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1474/2931] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:39 2022] GET /compute/v2.1/servers/26b8a143-8738-4973-92b9-988cfd643c2c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:38:39.976520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:39.984373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:40.004046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:40.004889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:40.007799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:40.009646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:40.989031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:41.006432 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-94117c68-14c6-410f-9324-74e6b7be1d9f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 1.052634 Jul 01 10:38:41.022037 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1475/2932] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:39 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:41.027718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:41.031903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:41.038135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:41.039113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:41.040112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:41.040719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:41.111369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:41.127180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a89300a-4742-4355-badd-79aa67c48679 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 1.270545 Jul 01 10:38:41.131968 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1458/2933] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:39 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:41.149489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:41.149489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:41.155389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:41.156105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:41.157274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:41.158176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:41.165383 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:41.677845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:41.692787 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d4f2fb6-6744-488f-ac9a-daf168afb733 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 0.669264 Jul 01 10:38:41.693763 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1476/2934] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:41 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:41.698438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:41.699053 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:41.714870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:41.715362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:41.716152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:41.716604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:41.765016 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:41.841033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:41.841033 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-54d7e986-9c0f-4c78-ab18-9a52fe6efd07 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.674135 Jul 01 10:38:41.841033 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1459/2935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:41 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:42.021742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f1e56c4d-2a61-4acb-a170-3da1ed3aa55d req-781ed116-8659-4b01-8077-455d089a28ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beb1734-a4f4-42f6-a108-197964bde936", "name": "network-vif-unplugged", "status": "completed", "tag": "08309fee-bc21-46d1-9d77-48c1be296251"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:42.036771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f1e56c4d-2a61-4acb-a170-3da1ed3aa55d req-781ed116-8659-4b01-8077-455d089a28ae service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:42.042318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f1e56c4d-2a61-4acb-a170-3da1ed3aa55d req-781ed116-8659-4b01-8077-455d089a28ae service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:42.073338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:42.079983 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f1e56c4d-2a61-4acb-a170-3da1ed3aa55d req-781ed116-8659-4b01-8077-455d089a28ae service nova] Creating event network-vif-unplugged:08309fee-bc21-46d1-9d77-48c1be296251 for instance 6beb1734-a4f4-42f6-a108-197964bde936 on n-h2-master-1 Jul 01 10:38:42.086827 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f1e56c4d-2a61-4acb-a170-3da1ed3aa55d req-781ed116-8659-4b01-8077-455d089a28ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068776 Jul 01 10:38:42.088470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1460/2936] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:38:42.091058 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b02be639-ea64-43b6-956b-a9d63c397376 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.395820 Jul 01 10:38:42.100711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:42.102814 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1477/2937] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:41 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:42.104115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:42.119823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:42.120459 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:42.123524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:42.124254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:42.167600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:42.169928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:42.199972 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:42.204779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:42.206052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:42.209755 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:42.956464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:42.970774 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b84da33-469c-4e9e-8926-04199065566f tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1333 microversion: 2.1 time: 0.818283 Jul 01 10:38:42.986341 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1478/2938] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:42 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1333 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:42.995390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:42.997140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-55a33e0e-c9c9-4c9e-92e1-418ceed31664 req-3b2df596-c199-4b17-9f2c-fa51b465d8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76313d67-6ebf-4f72-af57-70281a063492", "name": "network-vif-plugged", "status": "completed", "tag": "031ca2c8-057b-41fe-a278-521f5a4dfb74"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:43.012704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0394ab31-8b14-4119-bc71-1a6e9aa3eaf2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.919834 Jul 01 10:38:43.016196 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1461/2939] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:42 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:43.019653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-55a33e0e-c9c9-4c9e-92e1-418ceed31664 req-3b2df596-c199-4b17-9f2c-fa51b465d8e5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:43.020307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-55a33e0e-c9c9-4c9e-92e1-418ceed31664 req-3b2df596-c199-4b17-9f2c-fa51b465d8e5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:43.028957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:43.030921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:43.045602 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:43.051140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:43.051749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:43.051960 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-55a33e0e-c9c9-4c9e-92e1-418ceed31664 req-3b2df596-c199-4b17-9f2c-fa51b465d8e5 service nova] Creating event network-vif-plugged:031ca2c8-057b-41fe-a278-521f5a4dfb74 for instance 76313d67-6ebf-4f72-af57-70281a063492 on n-h2-master-1 Jul 01 10:38:43.052753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:43.053328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:43.068844 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-55a33e0e-c9c9-4c9e-92e1-418ceed31664 req-3b2df596-c199-4b17-9f2c-fa51b465d8e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080161 Jul 01 10:38:43.068844 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1479/2940] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:43.076174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:43.077795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:43.085179 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:43.086371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:43.087780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:43.088402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:43.590429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:43.599794 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3bf62a5-0d73-4efd-bdba-9e94963d9d2d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.528561 Jul 01 10:38:43.604927 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1480/2941] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:43 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:43.611969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:43.625827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:43.661268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:43.662142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:43.663111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:43.673949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:43.821675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:43.847771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-102bb124-a8c2-4607-9b6c-eec135c773a9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 0.827165 Jul 01 10:38:43.849026 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1462/2942] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:43 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:43.989786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:43.990479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:44.018611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:44.023729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:44.023729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:44.023729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:44.238755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:44.254757 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e76697a-9eb3-472e-a13c-99041eb61df7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.647867 Jul 01 10:38:44.256774 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1481/2943] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:43 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:44.277405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:44.278438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:44.295498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:44.301934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:44.304083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:44.304796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:44.940991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:44.952708 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed57529d-d11a-43d9-9db4-54ee5026cb7e tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1668 microversion: 2.1 time: 0.968002 Jul 01 10:38:44.954087 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1463/2944] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:43 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1668 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:44.960357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:44.961340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:44.968034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:44.968919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:44.970750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:44.971423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.127073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:45.160034 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-328fa0de-4683-418e-90f3-62a8696439ad tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.901183 Jul 01 10:38:45.161091 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1482/2945] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:44 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:45.177090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:45.178098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:45.189559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.190462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.191450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.192400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.431875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:45.443404 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd2f8c81-9d82-44cb-86f4-7f4c87dea947 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.487913 Jul 01 10:38:45.452925 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1464/2946] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:44 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:45.464692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-94ef9234-9875-41c0-9770-a3460fb7892c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:45.465218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-94ef9234-9875-41c0-9770-a3460fb7892c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:45.485786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94ef9234-9875-41c0-9770-a3460fb7892c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.486403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94ef9234-9875-41c0-9770-a3460fb7892c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.487424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94ef9234-9875-41c0-9770-a3460fb7892c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.488024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-94ef9234-9875-41c0-9770-a3460fb7892c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.575145 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-94ef9234-9875-41c0-9770-a3460fb7892c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939/ips" status: 200 len: 179 microversion: 2.1 time: 0.121168 Jul 01 10:38:45.576630 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1465/2947] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:38:45 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939/ips => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:45.585692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e68dfce0-af45-4f32-8d4e-76aed4626e9a req-217d3922-279f-4012-a507-2b08923e9432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcfc56f-d6db-4c21-b1df-bb7fa078d352", "name": "network-vif-plugged", "status": "completed", "tag": "9ed0e231-ab89-424a-bbba-a8d260b6e617"}, {"server_uuid": "47387c27-7fd3-476a-bdfb-040bbfd8e06d", "name": "network-vif-plugged", "status": "completed", "tag": "ef87defb-9443-4408-87be-fad540a0feab"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:45.611858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e68dfce0-af45-4f32-8d4e-76aed4626e9a req-217d3922-279f-4012-a507-2b08923e9432 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.612741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e68dfce0-af45-4f32-8d4e-76aed4626e9a req-217d3922-279f-4012-a507-2b08923e9432 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.629088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e68dfce0-af45-4f32-8d4e-76aed4626e9a req-217d3922-279f-4012-a507-2b08923e9432 service nova] Creating event network-vif-plugged:9ed0e231-ab89-424a-bbba-a8d260b6e617 for instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 on n-h1-master-1 Jul 01 10:38:45.629965 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e68dfce0-af45-4f32-8d4e-76aed4626e9a req-217d3922-279f-4012-a507-2b08923e9432 service nova] Creating event network-vif-plugged:ef87defb-9443-4408-87be-fad540a0feab for instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d on n-h2-master-1 Jul 01 10:38:45.649547 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e68dfce0-af45-4f32-8d4e-76aed4626e9a req-217d3922-279f-4012-a507-2b08923e9432 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068435 Jul 01 10:38:45.660420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:45.683079 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1466/2948] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:45.692442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba92fd6b-f9f1-4723-a427-b2b1c838f0b1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1317 microversion: 2.1 time: 0.520088 Jul 01 10:38:45.693265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:45.695698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:45.696987 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1483/2949] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:45 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:45.704635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.706008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.707047 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.707699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.713560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:45.714146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:45.738865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.745365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.749502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:45.750196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:45.843411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:38:46.243966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:46.253865 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a69ddc0-01dd-44e6-bfea-da38e8621d90 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.568280 Jul 01 10:38:46.265911 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1467/2950] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:45 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:46.344242 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f45a9e6-81d3-4522-86c5-4f340ea173f2 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 204 len: 0 microversion: 2.1 time: 0.645438 Jul 01 10:38:46.346715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1484/2951] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:38:45 2022] DELETE /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:46.382390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:46.383409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:46.411072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:46.416188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:46.417822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:46.417822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:46.582109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9945c245-3b4e-41b1-be18-1c233330d1b5 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1254552331", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:46.587225 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-9945c245-3b4e-41b1-be18-1c233330d1b5 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] HTTP exception thrown: min_count must be <= max_count Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9945c245-3b4e-41b1-be18-1c233330d1b5 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Request method failure captured: Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 184 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs61PWNk83dNH1nRr-CeO8IIWjqoUStDhOInPtfvxaVy-wLftOCglLFNrV9CyOE3r3Za8yyAHHfQXK9FeSUUbBXNW5dqcTW7fstaQDqtG-KTxhfZrepVDXVlyTq85JaeD1jm8-f4rVARx3tIslj1qvPZWesx3M3Te83J188Ny4zEg94 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_296c63b46565494c8d9f78fbbb0baac7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a4a448bae95746319abf4aaf562b193a Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1254552331", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: exception: min_count must be <= max_count Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1254552331', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 01 10:38:46.592359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:46.605000 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9945c245-3b4e-41b1-be18-1c233330d1b5 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Returning 400 to user: min_count must be <= max_count {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:46.608128 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9945c245-3b4e-41b1-be18-1c233330d1b5 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.340285 Jul 01 10:38:46.626188 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1468/2952] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:46 2022] POST /compute/v2.1/servers => generated 74 bytes in 356 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:38:46.673419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:46.674984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:46.703265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:46.720003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:46.724478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:46.725592 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:46.917891 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:46.934493 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c980226d-3723-4cfd-a98a-92a972cbfb68 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.585929 Jul 01 10:38:46.935703 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1485/2953] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:46 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:46.944581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:46.950185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:46.953241 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:46.961024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:46.962030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:46.963730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:46.964189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:47.008445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:47.036223 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4821cc54-254e-48c9-8fd6-0a9999a02708 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1674 microversion: 2.1 time: 0.403402 Jul 01 10:38:47.036223 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1469/2954] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:46 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1674 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:47.036223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:47.036891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:47.044651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:47.046082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:47.051661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:47.055531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:47.266834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:47.277353 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-036a617b-45d5-46b0-9650-94efc7018cb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1314 microversion: 2.1 time: 0.338835 Jul 01 10:38:47.286236 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1486/2955] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:46 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:47.306707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-363378073", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a4b4d786-2075-4348-a045-243cd6e0f64f"}], "security_groups": [{"name": "tempest-securitygroup--1888160265"}], "key_name": "tempest-keypair-1728395592", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:47.340392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:47.349302 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1abcd847-8247-4eee-872d-14a917d1fca8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1507 microversion: 2.1 time: 0.317953 Jul 01 10:38:47.349881 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1470/2956] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:47 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:47.357102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c7918be-3055-4dfa-aee3-14625072a8d7 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1539119407", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "max_count": 0}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c7918be-3055-4dfa-aee3-14625072a8d7 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Request method failure captured: Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 168 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs61PWNk83dNH1nRr-CeO8IIWjqoUStDhOInPtfvxaVy-wLftOCglLFNrV9CyOE3r3Za8yyAHHfQXK9FeSUUbBXNW5dqcTW7fstaQDqtG-KTxhfZrepVDXVlyTq85JaeD1jm8-f4rVARx3tIslj1qvPZWesx3M3Te83J188Ny4zEg94 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_296c63b46565494c8d9f78fbbb0baac7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a4a448bae95746319abf4aaf562b193a Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1539119407", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "max_count": 0}} Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1539119407', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'max_count': 0}}} Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 0 Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:38:47.360539 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 01 10:38:47.365410 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:47.376865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c7918be-3055-4dfa-aee3-14625072a8d7 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:47.378360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c7918be-3055-4dfa-aee3-14625072a8d7 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.026257 Jul 01 10:38:47.383065 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1471/2957] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:47 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:38:47.397710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:47.406027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:47.426834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:47.432886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:47.433981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:47.434828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:47.570939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] validate_networks() for [('a4b4d786-2075-4348-a045-243cd6e0f64f', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:38:47.728428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:47.751240 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99d7f741-a46c-4003-8538-e44a8a5bbcbf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1502 microversion: 2.1 time: 0.367948 Jul 01 10:38:47.752119 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1472/2958] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:47 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1502 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:47.756969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:47.757738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:47.764074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:47.764861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:47.765908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:47.767166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:47.795200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:38:48.096392 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-56769c85-1948-4237-b429-7e375b6ceb07 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 204 len: 0 microversion: 2.1 time: 0.342774 Jul 01 10:38:48.097453 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1473/2959] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:38:47 2022] DELETE /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:38:48.104899 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57bbe97b-f80a-42e8-8428-223494e031ab tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-762773314", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "max_count": 2.5}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57bbe97b-f80a-42e8-8428-223494e031ab tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Request method failure captured: Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 169 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs61PWNk83dNH1nRr-CeO8IIWjqoUStDhOInPtfvxaVy-wLftOCglLFNrV9CyOE3r3Za8yyAHHfQXK9FeSUUbBXNW5dqcTW7fstaQDqtG-KTxhfZrepVDXVlyTq85JaeD1jm8-f4rVARx3tIslj1qvPZWesx3M3Te83J188Ny4zEg94 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_296c63b46565494c8d9f78fbbb0baac7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a4a448bae95746319abf4aaf562b193a Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-762773314", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "max_count": 2.5}} Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-762773314', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'max_count': 2.5}}} Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 2.5 Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:38:48.113764 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57bbe97b-f80a-42e8-8428-223494e031ab tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-57bbe97b-f80a-42e8-8428-223494e031ab tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016171 Jul 01 10:38:48.126154 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1474/2960] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:48 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:38:48.136354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:48.140829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:48.161086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.162100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.162923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.163372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.274090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Getting quotas for project d44a49743b1a4d548f03f1b1e8b0df33. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:48.285482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Getting quotas for user af167555982f4953b40878dc2492bd21 and project d44a49743b1a4d548f03f1b1e8b0df33. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:48.316696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:38:48.321611 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:38:48.322305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:38:48.322890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:38:48.323471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:38:48.344111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.345480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.346541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.347149 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.377398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Getting quotas for project d44a49743b1a4d548f03f1b1e8b0df33. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:48.399887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Getting quotas for user af167555982f4953b40878dc2492bd21 and project d44a49743b1a4d548f03f1b1e8b0df33. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:48.441721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:38:48.449693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:38:48.535526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:48.543623 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e5b6429-2d40-40ea-b951-94cd42ffbdc3 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.423899 Jul 01 10:38:48.544514 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1475/2961] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:48 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:48.549842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:48.550479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:48.559769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.560259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.566380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.566380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.694100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-30e0e860-776d-43b5-a47c-35f305f9c862 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.406501 Jul 01 10:38:48.701178 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1487/2962] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:38:48.715752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:48.715752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:48.720003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.721241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.722587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:48.723247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:48.890439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:48.900581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae201646-9355-44fd-b8b3-5f4ccbaad358 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1674 microversion: 2.1 time: 0.354776 Jul 01 10:38:48.901181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1476/2963] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:48 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1674 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:48.928830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8c5ee56-23a9-458c-98a8-bbc886257c48 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-521160451", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 0}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8c5ee56-23a9-458c-98a8-bbc886257c48 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Request method failure captured: Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 167 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs61PWNk83dNH1nRr-CeO8IIWjqoUStDhOInPtfvxaVy-wLftOCglLFNrV9CyOE3r3Za8yyAHHfQXK9FeSUUbBXNW5dqcTW7fstaQDqtG-KTxhfZrepVDXVlyTq85JaeD1jm8-f4rVARx3tIslj1qvPZWesx3M3Te83J188Ny4zEg94 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_296c63b46565494c8d9f78fbbb0baac7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a4a448bae95746319abf4aaf562b193a Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-521160451", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 0}} Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-521160451', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'min_count': 0}}} Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 0 Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:38:48.943438 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8c5ee56-23a9-458c-98a8-bbc886257c48 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8c5ee56-23a9-458c-98a8-bbc886257c48 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021961 Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1477/2964] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:48 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:48.958591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:49.015930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.017109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.017972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.020654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.096375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:49.107845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a346360-7d81-4cf7-b3d0-59be962a5985 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1513 microversion: 2.1 time: 0.405358 Jul 01 10:38:49.125584 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1488/2965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:48 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:49.131291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-593df8ea-6f22-4aef-9708-537cd5300838 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:49.131927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-593df8ea-6f22-4aef-9708-537cd5300838 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:49.288189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-593df8ea-6f22-4aef-9708-537cd5300838 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:49.300513 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-593df8ea-6f22-4aef-9708-537cd5300838 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1269 microversion: 2.1 time: 0.173657 Jul 01 10:38:49.301514 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1489/2966] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:49 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:49.306270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:49.306894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:49.323736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.330458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.334280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.335226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.388265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:49.401956 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-308ade61-151d-4caa-b294-f5c3b5e73cc4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1501 microversion: 2.1 time: 0.454148 Jul 01 10:38:49.402773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1478/2967] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:48 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1501 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:49.418885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ea55df9-258a-4b8b-beb8-009b1be00008 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2000631890", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 2.5}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ea55df9-258a-4b8b-beb8-009b1be00008 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Request method failure captured: Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 170 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs61PWNk83dNH1nRr-CeO8IIWjqoUStDhOInPtfvxaVy-wLftOCglLFNrV9CyOE3r3Za8yyAHHfQXK9FeSUUbBXNW5dqcTW7fstaQDqtG-KTxhfZrepVDXVlyTq85JaeD1jm8-f4rVARx3tIslj1qvPZWesx3M3Te83J188Ny4zEg94 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_296c63b46565494c8d9f78fbbb0baac7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/296c63b46565494c8d9f78fbbb0baac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 296c63b46565494c8d9f78fbbb0baac7 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-717422625 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a4a448bae95746319abf4aaf562b193a Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-717422625-project Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2000631890", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 2.5}} Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2000631890', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'min_count': 2.5}}} Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 2.5 Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:38:49.423922 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 01 10:38:49.428477 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:49.434087 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ea55df9-258a-4b8b-beb8-009b1be00008 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:49.434087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ea55df9-258a-4b8b-beb8-009b1be00008 tempest-MultipleCreateNegativeTestJSON-717422625 tempest-MultipleCreateNegativeTestJSON-717422625-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018644 Jul 01 10:38:49.434907 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1479/2968] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:38:49.457577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-972cd1f9-111a-4b99-b1b7-fd07858bf487 req-f7fda43b-662e-4fc9-95d6-382c551c4b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e6456-18f8-4966-83d1-c27c09d75939", "name": "network-vif-deleted", "tag": "f84c6603-163c-4144-8d04-acd128a6b696"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:49.502413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-972cd1f9-111a-4b99-b1b7-fd07858bf487 req-f7fda43b-662e-4fc9-95d6-382c551c4b4d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.504443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-972cd1f9-111a-4b99-b1b7-fd07858bf487 req-f7fda43b-662e-4fc9-95d6-382c551c4b4d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.551172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-972cd1f9-111a-4b99-b1b7-fd07858bf487 req-f7fda43b-662e-4fc9-95d6-382c551c4b4d service nova] Creating event network-vif-deleted:f84c6603-163c-4144-8d04-acd128a6b696 for instance 147e6456-18f8-4966-83d1-c27c09d75939 on n-h1-master-1 Jul 01 10:38:49.562337 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-972cd1f9-111a-4b99-b1b7-fd07858bf487 req-f7fda43b-662e-4fc9-95d6-382c551c4b4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115821 Jul 01 10:38:49.567335 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1480/2969] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:49.574895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:49.580388 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ca52eb38-c4df-4429-aa13-545b5e2e972d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1477 microversion: 2.1 time: 0.277699 Jul 01 10:38:49.589610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb44daff-f1a1-4846-b923-f078292883a1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:49.593996 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1490/2970] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:49 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1477 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:49.605987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:49.607863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:49.614474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb44daff-f1a1-4846-b923-f078292883a1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.616130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb44daff-f1a1-4846-b923-f078292883a1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.623042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.630743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.632412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:49.633042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:49.655422 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:49.698082 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:49.717861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fb44daff-f1a1-4846-b923-f078292883a1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Going to try to stop instance {{(pid=119765) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:38:50.019119 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:50.034421 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-843048fd-df38-47a2-96f7-1153d6ea1971 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.438630 Jul 01 10:38:50.037459 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1491/2971] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:49 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:50.056714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e889c51-e61e-49d5-b279-e727edbad08c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '.version_select at 0x7f6f9259a700>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:50.063965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e889c51-e61e-49d5-b279-e727edbad08c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:50.066341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e889c51-e61e-49d5-b279-e727edbad08c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:50.103535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e889c51-e61e-49d5-b279-e727edbad08c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.058165 Jul 01 10:38:50.104136 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fb44daff-f1a1-4846-b923-f078292883a1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d/action" status: 202 len: 0 microversion: 2.1 time: 0.534948 Jul 01 10:38:50.105894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1481/2972] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:38:49 2022] POST /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:38:50.118463 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1492/2973] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:38:50 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:50.122694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:50.125493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:50.136310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:50.137356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:50.147780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:50.149272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:50.150319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:50.151293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:50.151989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:50.160007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:50.168056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:50.169513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:50.394147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:50.408031 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc5da001-0c54-462e-813b-538378e8f07c tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1453 microversion: 2.1 time: 0.300782 Jul 01 10:38:50.411140 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1482/2974] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:50 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:50.422116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4939ffc8-2e92-4af4-a875-5110919e7849 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:50.423630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4939ffc8-2e92-4af4-a875-5110919e7849 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:50.440807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4939ffc8-2e92-4af4-a875-5110919e7849 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:50.440933 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4939ffc8-2e92-4af4-a875-5110919e7849 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:50.441758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4939ffc8-2e92-4af4-a875-5110919e7849 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:50.442185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4939ffc8-2e92-4af4-a875-5110919e7849 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.017565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:51.034652 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2dd03d8b-240f-42aa-ab71-f94375ac82a7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.914791 Jul 01 10:38:51.035334 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1493/2975] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:50 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:51.043652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:51.044337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:51.051612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.052178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.053577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.054211 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.100429 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4939ffc8-2e92-4af4-a875-5110919e7849 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1628 microversion: 2.1 time: 0.688133 Jul 01 10:38:51.103001 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1483/2976] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:50 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1628 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:51.108460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:51.109080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:51.116101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.116756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.117797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.118406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.221788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:51.232636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3214c96f-fd38-4643-9530-6a37453f12e9 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1273 microversion: 2.1 time: 0.129515 Jul 01 10:38:51.239442 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1484/2977] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:51 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:51.240740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:51.241996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:51.251164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.251887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.255255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.255255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.300701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:51.309302 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ede86638-e1e4-4088-a70d-e3e0edd18571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1513 microversion: 2.1 time: 0.272784 Jul 01 10:38:51.310000 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1494/2978] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:51 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1513 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:51.320289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b060241-063b-43a3-96a2-5ca486cd8095 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Action: 'create', calling method: .version_select at 0x7f6f91a5bd30>, body: {"keypair": {"name": "tempest-keypair-1835621191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpIKfUYGCzi0IW1zEz1FIqY0KbLK2FTNwRxw5drOeAYOLUOLq0M1j1D4/Qvbh8uw8VeXvKH63rVADjirBF91g8mEABfequYk6ddaDiNGdnFm94Ip04E9jWHdgEJd9oISg=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:51.351531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9b060241-063b-43a3-96a2-5ca486cd8095 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:51.370340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9b060241-063b-43a3-96a2-5ca486cd8095 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for user e3ce54f4c29540dc8f7077c2717f6451 and project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:51.592132 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b060241-063b-43a3-96a2-5ca486cd8095 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.280575 Jul 01 10:38:51.593127 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1495/2979] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:38:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:51.609455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:51.616060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:51.668444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.678559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.679649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.681955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.748271 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:51.792333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.792986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.793465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lazy-loading 'fault' on Instance uuid 147e6456-18f8-4966-83d1-c27c09d75939 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:38:51.806773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:51.824518 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bfa8129f-50a5-4e86-b731-5b50b69e4cbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.582143 Jul 01 10:38:51.825349 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1485/2980] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:51 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:51.845071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-32971071-e204-47c7-b858-9383e072f783 req-becbdcfa-3ea2-455b-8dbd-66e5bb2efaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76313d67-6ebf-4f72-af57-70281a063492", "name": "network-vif-deleted", "tag": "031ca2c8-057b-41fe-a278-521f5a4dfb74"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:51.872450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-32971071-e204-47c7-b858-9383e072f783 req-becbdcfa-3ea2-455b-8dbd-66e5bb2efaee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.872893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-32971071-e204-47c7-b858-9383e072f783 req-becbdcfa-3ea2-455b-8dbd-66e5bb2efaee service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.914458 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-32971071-e204-47c7-b858-9383e072f783 req-becbdcfa-3ea2-455b-8dbd-66e5bb2efaee service nova] Creating event network-vif-deleted:031ca2c8-057b-41fe-a278-521f5a4dfb74 for instance 76313d67-6ebf-4f72-af57-70281a063492 on n-h2-master-1 Jul 01 10:38:51.931154 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-32971071-e204-47c7-b858-9383e072f783 req-becbdcfa-3ea2-455b-8dbd-66e5bb2efaee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104547 Jul 01 10:38:51.932704 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1486/2981] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:51.938937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-eb2300ad-97ba-4765-a816-e75903143355 req-152fc98c-b260-455d-bdd2-7286b1446997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e6456-18f8-4966-83d1-c27c09d75939", "name": "network-vif-deleted", "tag": "dd076adb-dbb6-49c3-8cb2-6b9ff4246709"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:51.956144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:51.958725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-eb2300ad-97ba-4765-a816-e75903143355 req-152fc98c-b260-455d-bdd2-7286b1446997 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:51.960333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-eb2300ad-97ba-4765-a816-e75903143355 req-152fc98c-b260-455d-bdd2-7286b1446997 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:51.964756 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9f065ea-4b93-49ec-9971-9a29765482be tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1302 microversion: 2.1 time: 0.370486 Jul 01 10:38:51.969074 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1496/2982] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:51 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1302 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:51.997841 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-eb2300ad-97ba-4765-a816-e75903143355 req-152fc98c-b260-455d-bdd2-7286b1446997 service nova] Creating event network-vif-deleted:dd076adb-dbb6-49c3-8cb2-6b9ff4246709 for instance 147e6456-18f8-4966-83d1-c27c09d75939 on n-h1-master-1 Jul 01 10:38:52.003922 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-eb2300ad-97ba-4765-a816-e75903143355 req-152fc98c-b260-455d-bdd2-7286b1446997 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069487 Jul 01 10:38:52.004803 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1487/2983] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:52.057882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:52.059684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:52.073711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.074162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.075022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.075459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.254302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:52.262126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:52.302397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.304289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.309336 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.310406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.478412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:52.493993 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bfbbb913-ffff-47e0-b38a-16c74fe792aa tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1321 microversion: 2.1 time: 0.243291 Jul 01 10:38:52.500978 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1488/2984] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:52 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:52.507473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:52.514369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:52.527065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.527531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.528335 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.528792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.575802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:52.590614 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a665d38-2a13-4461-8ac3-c73b13e332d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.538022 Jul 01 10:38:52.591233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1497/2985] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:52 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:52.606334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.606825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.607588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lazy-loading 'fault' on Instance uuid 76313d67-6ebf-4f72-af57-70281a063492 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:38:52.664554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:52.673832 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9572668-ef4c-4578-8a4e-f96ef6764392 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 200 len: 1307 microversion: 2.1 time: 0.171176 Jul 01 10:38:52.675051 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1489/2986] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:52 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:52.850712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:52.852540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:52.883400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.884332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.885702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:52.886150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:52.987411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:52.990676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:53.002141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.006446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.007464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.009495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.079528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.080485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.081246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lazy-loading 'fault' on Instance uuid 147e6456-18f8-4966-83d1-c27c09d75939 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:38:53.164211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750345ec443427c98a5cc52ef2194ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013f61b227894e55b2659e17a5cd5edc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:53.175818 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-083d3b10-64fd-45f0-b350-c8f62e1810a3 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 200 len: 1302 microversion: 2.1 time: 0.194313 Jul 01 10:38:53.191194 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1490/2987] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:52 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 1302 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:53.221206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:53.237198 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-727e8693-9c9a-40c7-a022-9818d28d2593 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.392460 Jul 01 10:38:53.238241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1498/2988] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:52 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:53.509167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:53.509910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:53.530060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.530510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.531294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.532340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.611631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:53.615664 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:53.616627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:53.632969 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa99a1c3-a8e3-4885-9154-02f4ed6cab4c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1329 microversion: 2.1 time: 0.128658 Jul 01 10:38:53.634205 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.635012 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1491/2989] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:53 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:53.635502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.636552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.641824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.695111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:53.695598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:53.729642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.730681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.732640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.733442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.776605 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 HTTP/1.1 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '76313d67-6ebf-4f72-af57-70281a063492'} Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:53.778497 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:53.784029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:53.784029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:53.784029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:53.784029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:53.784029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:53.784029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:38:53.784029 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:53.786161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:53.787236 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9e5aec0b-6639-415c-926d-90a35594bd92 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 404 len: 111 microversion: 2.1 time: 0.099975 Jul 01 10:38:53.788322 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1492/2990] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:53 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:38:53.801995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:53.802634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:53.827144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.831523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:53.834339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:53.836101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.036713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:54.046602 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4c78bd3c-bd7a-49be-ad4b-2d3e6d1340e5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.442062 Jul 01 10:38:54.047462 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1499/2991] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:53 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:54.138722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:54.149125 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6282c7d7-9522-4f4b-aed7-abce05d3b8e8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.356334 Jul 01 10:38:54.149959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1493/2992] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:53 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:54.199844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:54.200675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:54.209497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.210356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.212027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.212727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.242578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] HTTP exception thrown: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Request method failure captured: Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 HTTP/1.1 Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs5MXopNkjLoiQFWlg6KYZEpx-HPM0a9lvQPsTB10hZ9JEQv0R-U_jMiGxTGRicCMV12osRQX9T3hCjDrrziPfoUh4qwNhYA-Z6pDhMeowe1B0SmJ8QNfIx-Mo7rWJJStctzh1AjQUnMpIzktdP2LOCE3rx9ctLYGmKNtDcOiHOA5iM Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_013f61b227894e55b2659e17a5cd5edc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestMultiNic-1004232783 Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b750345ec443427c98a5cc52ef2194ea Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '147e6456-18f8-4966-83d1-c27c09d75939'} Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:54.244398 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.248320 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:54.248320 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:54.248320 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:54.248320 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:54.248320 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:54.248320 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:38:54.248320 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.255831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:54.256864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:54.272094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.272642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.273539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Returning 404 to user: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:54.273673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.275496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.275663 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53dc6248-7b57-4cf6-b94b-ac361234d4b6 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 404 len: 111 microversion: 2.1 time: 0.080120 Jul 01 10:38:54.285573 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1500/2993] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:54 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:38:54.342261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08dc0498-a044-4a78-bc7f-21f3e6fca79b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08dc0498-a044-4a78-bc7f-21f3e6fca79b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 163 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": 12345, "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 12345 Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:38:54.347037 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 01 10:38:54.352732 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:38:54.363236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08dc0498-a044-4a78-bc7f-21f3e6fca79b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:54.363387 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08dc0498-a044-4a78-bc7f-21f3e6fca79b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.025280 Jul 01 10:38:54.364463 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1501/2994] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:54 2022] POST /compute/v2.1/servers => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:38:54.372752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:54.373682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:54.389808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.391891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.394227 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.395725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.617990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:54.637354 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-331f6cc4-b15a-4c18-b802-e06e0dbb05ee tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.382758 Jul 01 10:38:54.638641 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1494/2995] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:54 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:54.662714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:54.665436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:54.677875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.680110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.685420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.686034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.702813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:54.716635 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-805f3824-94ac-48cb-96d6-11b29c62cff9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.347632 Jul 01 10:38:54.735857 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1502/2996] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:54 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:54.742002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:54.742623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:54.759067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.759525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:54.768002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:54.768462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:55.075185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:55.100573 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e039eaf-4185-4957-8905-24127f56a993 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.361969 Jul 01 10:38:55.104216 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1503/2997] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:54 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:55.118564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:55.119263 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:55.131885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:55.132602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:55.134719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:55.135624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:55.228478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:55.241843 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-40f01e29-9e07-4220-8284-4795db7523bf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.584112 Jul 01 10:38:55.242899 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1495/2998] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:54 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:55.407108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:55.423468 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-621a26e7-7eca-4f73-8194-3d0c8e72489a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.317640 Jul 01 10:38:55.424687 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1504/2999] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:55 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:55.656222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:55.658290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:55.694264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:55.696704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:55.702543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:55.702543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:56.017088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:56.030964 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c3bf2b0-0eec-4cf4-b40d-03896167467c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.379187 Jul 01 10:38:56.041466 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1496/3000] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:55 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:56.272583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-212816340", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "e95a279c-448a-4371-a9e0-60c5b05d38a7"}], "security_groups": [{"name": "tempest-securitygroup--752430406"}], "key_name": "tempest-keypair-1835621191", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:56.280478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:56.281546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:56.298724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:56.299463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:56.303329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:56.303329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:56.606832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] validate_networks() for [('e95a279c-448a-4371-a9e0-60c5b05d38a7', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:38:56.658822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:56.668990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d82dcc67-6001-4dcf-94c6-b690e1c56c2c tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.403541 Jul 01 10:38:56.680232 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1505/3001] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:56 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:56.686523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:56.687142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:56.696622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:56.697074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:56.702807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:56.703785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:56.989722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:57.005541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5394f07d-51e4-43d0-b5cd-fb06d8f884c5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.324018 Jul 01 10:38:57.015246 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1506/3002] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:56 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:57.024825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7bfe69b9-eb33-498f-8628-ecd7c3b689dc req-421cfca9-e57c-4fe2-a4f9-937bff2022cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db908b28-e5e5-4cdf-bd6b-85c797a4bb32", "tag": "8bb1f637-2aef-4d30-b38c-5392c3c741da"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:57.043716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7bfe69b9-eb33-498f-8628-ecd7c3b689dc req-421cfca9-e57c-4fe2-a4f9-937bff2022cb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:57.048891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7bfe69b9-eb33-498f-8628-ecd7c3b689dc req-421cfca9-e57c-4fe2-a4f9-937bff2022cb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:57.072361 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7bfe69b9-eb33-498f-8628-ecd7c3b689dc req-421cfca9-e57c-4fe2-a4f9-937bff2022cb service nova] Creating event network-changed:8bb1f637-2aef-4d30-b38c-5392c3c741da for instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 on n-h1-master-1 Jul 01 10:38:57.093888 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7bfe69b9-eb33-498f-8628-ecd7c3b689dc req-421cfca9-e57c-4fe2-a4f9-937bff2022cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064547 Jul 01 10:38:57.096340 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1507/3003] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:38:57.109438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:57.111237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:57.127646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:57.128482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:57.129507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:57.130108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:57.462774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:57.476419 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db32b593-a12c-405c-9415-a43ce357cc8b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.378592 Jul 01 10:38:57.477343 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1508/3004] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:57 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:57.568107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:38:57.569269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:38:57.570192 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:38:57.570616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:38:57.571028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:38:57.586920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:57.588739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:57.589818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:57.590270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:57.657644 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:38:57.664926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for user e3ce54f4c29540dc8f7077c2717f6451 and project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:38:57.684779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:38:57.686223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:57.686843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:57.688384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:38:57.696898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:57.697487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:57.698576 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:57.699435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:57.907084 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf197b00-7bd1-4365-944c-2bdd50e29bb5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.642598 Jul 01 10:38:57.908144 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1497/3005] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:38:57.919959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e9f8ae81-fd59-4c7c-a5d3-bf090ee35d9f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:57.925941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e9f8ae81-fd59-4c7c-a5d3-bf090ee35d9f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:58.085172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e9f8ae81-fd59-4c7c-a5d3-bf090ee35d9f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:58.103790 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e9f8ae81-fd59-4c7c-a5d3-bf090ee35d9f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1234 microversion: 2.1 time: 0.188885 Jul 01 10:38:58.106284 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1498/3006] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:57 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1234 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:58.121635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:58.127139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:58.134850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:58.144076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:58.147303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:58.151270 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e24ad451-2686-4289-af3b-d7e230a04984 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.469049 Jul 01 10:38:58.151443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:58.152146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:58.153348 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1509/3007] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:57 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:58.497004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:58.501578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:58.514607 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:58.519882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:58.521693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:58.523197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:58.526408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:58.597887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:58.610362 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca088f12-f0fd-480d-a43c-37e99895a5f7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.501086 Jul 01 10:38:58.610943 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1499/3008] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:58 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:58.629252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88c38431-da5a-4f1e-9eff-7adc67b49d45 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2085332685", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b98602a7-eacf-45b5-aa43-eb3214f13a37", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:38:58.727714 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-88c38431-da5a-4f1e-9eff-7adc67b49d45 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Block Device b98602a7-eacf-45b5-aa43-eb3214f13a37 is not bootable. Jul 01 10:38:58.738519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88c38431-da5a-4f1e-9eff-7adc67b49d45 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 358 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2085332685", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b98602a7-eacf-45b5-aa43-eb3214f13a37", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: exception: Block Device b98602a7-eacf-45b5-aa43-eb3214f13a37 is not bootable. Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2085332685', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b98602a7-eacf-45b5-aa43-eb3214f13a37'}], 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b98602a7-eacf-45b5-aa43-eb3214f13a37 is not bootable. Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:58.739134 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b98602a7-eacf-45b5-aa43-eb3214f13a37 is not bootable. Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b98602a7-eacf-45b5-aa43-eb3214f13a37 is not bootable. Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88c38431-da5a-4f1e-9eff-7adc67b49d45 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Block Device b98602a7-eacf-45b5-aa43-eb3214f13a37 is not bootable. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-88c38431-da5a-4f1e-9eff-7adc67b49d45 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.128736 Jul 01 10:38:58.742668 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1500/3009] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:38:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:38:58.757081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:58.758241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:58.760721 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-94f14ec8-c48e-4e21-a2a1-703e9970d48b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.271028 Jul 01 10:38:58.761383 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1510/3010] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:58 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:58.769137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:58.770139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:58.771767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:58.772295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:58.778202 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:59.026437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:59.042784 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13ac9c2d-4bf8-40f1-9bf9-59ffd2090139 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.285393 Jul 01 10:38:59.042784 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1501/3011] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:58 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:38:59.059173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:59.059877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:59.070818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:59.071320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:59.072334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:59.074701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:59.123450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-10e2b8d9-35ed-49bd-9e5c-149c42355bd2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:59.124329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-10e2b8d9-35ed-49bd-9e5c-149c42355bd2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:59.137248 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:38:59.287519 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-10e2b8d9-35ed-49bd-9e5c-149c42355bd2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:59.296769 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-10e2b8d9-35ed-49bd-9e5c-149c42355bd2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1234 microversion: 2.1 time: 0.176968 Jul 01 10:38:59.298068 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1502/3012] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:59 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1234 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:59.307849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:59.310153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:59.344532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:59.346274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:59.348923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:59.349712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:59.971112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:38:59.980183 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-502618c6-4fc5-4c7b-ab04-537220e54375 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.927817 Jul 01 10:38:59.980776 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1511/3013] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:59 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:38:59.987969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:38:59.988837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:38:59.995875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:59.996359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:38:59.997137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:38:59.998037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.181323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:00.190918 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a52c151-569f-4484-88a4-6b463aa1ea8e tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.891523 Jul 01 10:39:00.202137 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1503/3014] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:59 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:00.211370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:00.211370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:00.224923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.225528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.226412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.227076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.234763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:00.243144 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7bca6b6-808f-4a68-b33a-6fb87c725bcb tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.260535 Jul 01 10:39:00.244082 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1512/3015] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:38:59 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:00.257316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:00.263188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:00.267094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.267544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.268324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.268753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.295856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] HTTP exception thrown: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Request method failure captured: Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 HTTP/1.1 Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs5MXopNkjLoiQFWlg6KYZEpx-HPM0a9lvQPsTB10hZ9JEQv0R-U_jMiGxTGRicCMV12osRQX9T3hCjDrrziPfoUh4qwNhYA-Z6pDhMeowe1B0SmJ8QNfIx-Mo7rWJJStctzh1AjQUnMpIzktdP2LOCE3rx9ctLYGmKNtDcOiHOA5iM Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_013f61b227894e55b2659e17a5cd5edc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b750345ec443427c98a5cc52ef2194ea Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '147e6456-18f8-4966-83d1-c27c09d75939'} Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:00.299285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.303268 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.310623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Returning 404 to user: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:00.313749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04f22997-e5b0-40dd-af63-b8187417cf96 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 404 len: 111 microversion: 2.1 time: 0.066308 Jul 01 10:39:00.313749 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1513/3016] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:00 2022] DELETE /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:00.326691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:00.327356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:00.335800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.337255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.338331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.338804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.384688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:00.393300 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99673825-048e-43ad-93d9-ab7e46d84520 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1506 microversion: 2.1 time: 0.189857 Jul 01 10:39:00.403923 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1504/3017] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:00 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:00.410988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:00.411858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 147e6456-18f8-4966-83d1-c27c09d75939] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:00.424237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.424237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.424237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.424237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.434305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:00.448341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4a7187b-44e1-4f3d-a767-15d82f327c2c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1286 microversion: 2.1 time: 0.130003 Jul 01 10:39:00.448341 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1514/3018] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:00 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:00.457606 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] HTTP exception thrown: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Request method failure captured: Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 HTTP/1.1 Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs5MXopNkjLoiQFWlg6KYZEpx-HPM0a9lvQPsTB10hZ9JEQv0R-U_jMiGxTGRicCMV12osRQX9T3hCjDrrziPfoUh4qwNhYA-Z6pDhMeowe1B0SmJ8QNfIx-Mo7rWJJStctzh1AjQUnMpIzktdP2LOCE3rx9ctLYGmKNtDcOiHOA5iM Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_013f61b227894e55b2659e17a5cd5edc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b750345ec443427c98a5cc52ef2194ea Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '147e6456-18f8-4966-83d1-c27c09d75939'} Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.459981 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Returning 404 to user: Instance 147e6456-18f8-4966-83d1-c27c09d75939 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c0c4322e-f9b1-4283-9259-ca1f87900b94 tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939" status: 404 len: 111 microversion: 2.1 time: 0.056128 Jul 01 10:39:00.471517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1505/3019] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:00 2022] GET /compute/v2.1/servers/147e6456-18f8-4966-83d1-c27c09d75939 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:00.481445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:00.481959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:00.488884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.489270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.490188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.490639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.506192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] HTTP exception thrown: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Request method failure captured: Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 HTTP/1.1 Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs5MXopNkjLoiQFWlg6KYZEpx-HPM0a9lvQPsTB10hZ9JEQv0R-U_jMiGxTGRicCMV12osRQX9T3hCjDrrziPfoUh4qwNhYA-Z6pDhMeowe1B0SmJ8QNfIx-Mo7rWJJStctzh1AjQUnMpIzktdP2LOCE3rx9ctLYGmKNtDcOiHOA5iM Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_013f61b227894e55b2659e17a5cd5edc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b750345ec443427c98a5cc52ef2194ea Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '03cd4975-6716-45ae-92c9-bc2e611d4143'} Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:00.507767 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Returning 404 to user: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:00.511643 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d84201db-cf23-4b6c-8055-1f9780ec6e3d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 404 len: 111 microversion: 2.1 time: 0.035037 Jul 01 10:39:00.518937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:00.532026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] [instance: 03cd4975-6716-45ae-92c9-bc2e611d4143] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:00.532417 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1515/3020] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:00 2022] DELETE /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:00.532506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.532506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.532506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:00.532506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:00.544052 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] HTTP exception thrown: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Request method failure captured: Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 HTTP/1.1 Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs5MXopNkjLoiQFWlg6KYZEpx-HPM0a9lvQPsTB10hZ9JEQv0R-U_jMiGxTGRicCMV12osRQX9T3hCjDrrziPfoUh4qwNhYA-Z6pDhMeowe1B0SmJ8QNfIx-Mo7rWJJStctzh1AjQUnMpIzktdP2LOCE3rx9ctLYGmKNtDcOiHOA5iM Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_013f61b227894e55b2659e17a5cd5edc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/013f61b227894e55b2659e17a5cd5edc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 013f61b227894e55b2659e17a5cd5edc Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestMultiNic-1004232783 Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: b750345ec443427c98a5cc52ef2194ea Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestMultiNic-1004232783-project Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '03cd4975-6716-45ae-92c9-bc2e611d4143'} Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:00.545825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] Returning 404 to user: Instance 03cd4975-6716-45ae-92c9-bc2e611d4143 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc0c5586-7e9c-4d1e-b240-0337e2a8812d tempest-ServersTestMultiNic-1004232783 tempest-ServersTestMultiNic-1004232783-project] 10.222.0.23 "GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143" status: 404 len: 111 microversion: 2.1 time: 0.033079 Jul 01 10:39:00.555256 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1506/3021] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:00 2022] GET /compute/v2.1/servers/03cd4975-6716-45ae-92c9-bc2e611d4143 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:01.210341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:01.211675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:01.224899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:01.227166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:01.228684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:01.229416 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:01.259952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:01.260574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:01.264728 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:01.272156 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:01.276626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:01.285585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:01.286215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:01.399515 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=16 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:01.821536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:01.829214 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25671344-cbac-4afd-9b50-a4ad3d71da9a tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.624562 Jul 01 10:39:01.838341 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1516/3022] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:01 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:01.842585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:01.843207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:01.858144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:01.858607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:01.859947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:01.860393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:01.966521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:01.986477 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f13bd2ad-5883-4bd4-a9e9-75ff545e3251 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.730416 Jul 01 10:39:01.996128 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1507/3023] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:01 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:02.001345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:02.002055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:02.019468 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:02.019847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:02.020738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:02.021225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:02.505076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:02.520162 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c34b546d-e862-40d4-a81e-223afa32e35f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1292 microversion: 2.1 time: 0.519458 Jul 01 10:39:02.521705 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1508/3024] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:01 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1292 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:02.635924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7d442372-8878-4c03-8cb2-a4ada1386711 req-cc7d265c-3c34-47e6-8a13-fbfcd7ba9d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcfc56f-d6db-4c21-b1df-bb7fa078d352", "name": "network-vif-unplugged", "status": "completed", "tag": "9ed0e231-ab89-424a-bbba-a8d260b6e617"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:02.651896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7d442372-8878-4c03-8cb2-a4ada1386711 req-cc7d265c-3c34-47e6-8a13-fbfcd7ba9d5a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:02.662096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7d442372-8878-4c03-8cb2-a4ada1386711 req-cc7d265c-3c34-47e6-8a13-fbfcd7ba9d5a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:02.695100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:02.695731 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7d442372-8878-4c03-8cb2-a4ada1386711 req-cc7d265c-3c34-47e6-8a13-fbfcd7ba9d5a service nova] Creating event network-vif-unplugged:9ed0e231-ab89-424a-bbba-a8d260b6e617 for instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 on n-h1-master-1 Jul 01 10:39:02.709704 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-84d04250-5fb2-4887-b7b5-f768ea559536 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1506 microversion: 2.1 time: 0.870770 Jul 01 10:39:02.713890 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1517/3025] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:01 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:02.714217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7d442372-8878-4c03-8cb2-a4ada1386711 req-cc7d265c-3c34-47e6-8a13-fbfcd7ba9d5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087463 Jul 01 10:39:02.717611 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1509/3026] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:02.848096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:02.853229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:02.866945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:02.867901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:02.869039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:02.870431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:03.017118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:03.018215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:03.042283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:03.042923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:03.044642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:03.045321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:03.220742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:03.235559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0d3091ab-4cb4-4294-9e7b-650bd5193f45 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.393044 Jul 01 10:39:03.236154 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1518/3027] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:02 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc5397ad-d102-4a46-bae8-732c5a2b2a3d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-43999986", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "destination_type": "local"}, {"source_type": "volume", "uuid": "1c25b816-0524-495b-b086-1dff72766cb7", "destination_type": "invalid"}], "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc5397ad-d102-4a46-bae8-732c5a2b2a3d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 493 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-43999986", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "destination_type": "local"}, {"source_type": "volume", "uuid": "1c25b816-0524-495b-b086-1dff72766cb7", "destination_type": "invalid"}], "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-43999986', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1c25b816-0524-495b-b086-1dff72766cb7', 'destination_type': 'invalid'}], 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 01 10:39:03.245511 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'invalid' Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc5397ad-d102-4a46-bae8-732c5a2b2a3d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc5397ad-d102-4a46-bae8-732c5a2b2a3d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009345 Jul 01 10:39:03.252877 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1519/3028] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:03 2022] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:03.263765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:03.268611 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:03.286120 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:03.288701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:03.300704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:03.303624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:03.303624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:03.650289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:03.675957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d573a4fa-c5af-472b-8a6a-1a098cd3eba7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.674068 Jul 01 10:39:03.689370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1510/3029] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:02 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:03.694879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:03.696566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:03.704244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:03.705005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:03.706094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:03.706731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:04.016583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:04.027920 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2b4bd2c-5897-407e-94b4-5a04ec23780b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.767923 Jul 01 10:39:04.041006 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1520/3030] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:03 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:04.054384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:04.063956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:04.065383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:04.065913 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:04.066770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:04.067397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:04.263316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:04.276930 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-221d33ab-6248-44cf-92c8-5baa83af6767 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1359 microversion: 2.1 time: 0.586111 Jul 01 10:39:04.278157 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1511/3031] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:03 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1359 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:04.498727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-415783980", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "f7e80028-9838-4d3a-9f8d-a7f444bbcfb9"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:04.529111 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:04.538358 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f4d649a-b74c-455d-bde9-2a884e773b31 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 200 len: 1509 microversion: 2.1 time: 0.495025 Jul 01 10:39:04.539127 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1521/3032] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:04 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:04.544026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:04.544652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:04.554231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:04.554696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:04.555666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:04.556111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:04.625342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] validate_networks() for [('f7e80028-9838-4d3a-9f8d-a7f444bbcfb9', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:39:05.380896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:05.391905 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b9a6a05-916f-48f8-97cd-55a11333dbb0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.851269 Jul 01 10:39:05.393342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1522/3033] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:04 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:05.399001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:05.399624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:05.413392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:05.417304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:05.417304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:05.417304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:05.854566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:05.863557 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a678f829-7641-47dc-9cb2-ca36cf400ebc tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.468115 Jul 01 10:39:05.873342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1523/3034] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:05 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:05.873342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:05.873342 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:05.884440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:05.885284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:05.887374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:05.887818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.124141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:39:06.124732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:39:06.126160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:39:06.126160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:39:06.126445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:39:06.144244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.144617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.145515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.145885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.189910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Getting quotas for project feea48cb57e246bc95ec7f4a967951ed. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:39:06.202492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Getting quotas for user 38371496afec4cb5acc0896286e3ca5f and project feea48cb57e246bc95ec7f4a967951ed. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:39:06.234549 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:39:06.237269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:39:06.279684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:06.295414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-02178af9-8072-49ec-afde-9dece4817e7f tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.429559 Jul 01 10:39:06.296689 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1524/3035] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:05 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:06.302308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:06.305313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:06.316912 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.317612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.318394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.318829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.466922 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0adf3bd-03db-49f4-9df7-f543227d2b7d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.187553 Jul 01 10:39:06.473818 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1512/3036] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:39:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:39:06.480956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-37e08819-0af6-4bbf-9e70-6c1efcc783c3 req-d57bb709-3feb-4ed4-a33c-4eb9fbb5a2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db908b28-e5e5-4cdf-bd6b-85c797a4bb32", "name": "network-vif-plugged", "status": "completed", "tag": "8bb1f637-2aef-4d30-b38c-5392c3c741da"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:06.492326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-37e08819-0af6-4bbf-9e70-6c1efcc783c3 req-d57bb709-3feb-4ed4-a33c-4eb9fbb5a2c5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.493022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-37e08819-0af6-4bbf-9e70-6c1efcc783c3 req-d57bb709-3feb-4ed4-a33c-4eb9fbb5a2c5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.528473 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-37e08819-0af6-4bbf-9e70-6c1efcc783c3 req-d57bb709-3feb-4ed4-a33c-4eb9fbb5a2c5 service nova] Creating event network-vif-plugged:8bb1f637-2aef-4d30-b38c-5392c3c741da for instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 on n-h1-master-1 Jul 01 10:39:06.539932 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-37e08819-0af6-4bbf-9e70-6c1efcc783c3 req-d57bb709-3feb-4ed4-a33c-4eb9fbb5a2c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063368 Jul 01 10:39:06.541044 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1513/3037] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:06.548981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:06.552378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:06.561360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.562141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.563824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.564999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.571867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:06.597209 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-85ef55cf-fc2d-4b6b-980b-686a7117426f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.297704 Jul 01 10:39:06.598123 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1525/3038] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:06 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:06.669749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46532ac6-f5b9-457d-b682-8ad5a5d8b426 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-205349875", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46532ac6-f5b9-457d-b682-8ad5a5d8b426 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 491 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-205349875", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-205349875', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 01 10:39:06.698169 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 01 10:39:06.701263 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:06.713193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46532ac6-f5b9-457d-b682-8ad5a5d8b426 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:06.714355 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-46532ac6-f5b9-457d-b682-8ad5a5d8b426 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.097925 Jul 01 10:39:06.715877 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1526/3039] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:06 2022] POST /compute/v2.1/servers => generated 624 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:06.720971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:06.721926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:06.730766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.737807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:06.737807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:06.737807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.151189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:07.163403 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5461a8ac-3547-4998-837f-5d4b075b339d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1359 microversion: 2.1 time: 0.620096 Jul 01 10:39:07.165248 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1514/3040] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:06 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1359 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:07.184811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-acf6bcb5-63f6-47ad-980f-0d9a0adeff94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:07.185815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-acf6bcb5-63f6-47ad-980f-0d9a0adeff94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:07.210698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:07.220848 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7183bb33-50b6-4dab-967b-01f8d1a2d6cc tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.503583 Jul 01 10:39:07.222786 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1527/3041] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:06 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:07.236587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d54197cd-e17b-42d2-b460-4be650a209b5 req-0f903d44-c663-43d7-9cc9-b1312eec8873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde88491-5e85-4abb-8121-4cde61f444f4", "tag": "bb53c117-d46a-4008-ad58-e45ee05b55f4"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:07.251757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d54197cd-e17b-42d2-b460-4be650a209b5 req-0f903d44-c663-43d7-9cc9-b1312eec8873 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.252089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d54197cd-e17b-42d2-b460-4be650a209b5 req-0f903d44-c663-43d7-9cc9-b1312eec8873 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.274021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-acf6bcb5-63f6-47ad-980f-0d9a0adeff94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:07.275577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d54197cd-e17b-42d2-b460-4be650a209b5 req-0f903d44-c663-43d7-9cc9-b1312eec8873 service nova] Creating event network-changed:bb53c117-d46a-4008-ad58-e45ee05b55f4 for instance cde88491-5e85-4abb-8121-4cde61f444f4 on n-h2-master-1 Jul 01 10:39:07.285913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-acf6bcb5-63f6-47ad-980f-0d9a0adeff94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:07.291795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-acf6bcb5-63f6-47ad-980f-0d9a0adeff94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:07.292891 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-acf6bcb5-63f6-47ad-980f-0d9a0adeff94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1261 microversion: 2.26 time: 0.126361 Jul 01 10:39:07.293709 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d54197cd-e17b-42d2-b460-4be650a209b5 req-0f903d44-c663-43d7-9cc9-b1312eec8873 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069593 Jul 01 10:39:07.296405 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1528/3042] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:07.307670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1515/3043] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:07 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:07.307670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:07.307670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:07.315790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:07.317306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:07.322244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.322703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.323482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.323923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.325964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.331177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.332666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.333392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.691327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:07.705224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:07.705799 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e0504662-7144-454d-b8d4-1560963c80cf tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1395 microversion: 2.1 time: 0.407671 Jul 01 10:39:07.706506 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1516/3044] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:07 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1395 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:07.720599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:07.724801 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9360ad1b-b36f-4725-ae2a-b3090f447256 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.420513 Jul 01 10:39:07.724959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:07.725064 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1529/3045] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:07 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:07.729963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.730719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.731737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.736353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:07.736904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:07.743824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.759230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.759610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:07.760530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:07.760832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.042828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.052424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b12fbfd5-66c7-4970-ac57-11f47270f4d7 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.326224 Jul 01 10:39:08.053133 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1530/3046] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:07 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:08.057914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:08.058741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:08.065401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.065858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.066640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.067079 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.078514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.086776 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c04ca0e6-ec89-4ad1-8be8-f3bd550b602a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.376711 Jul 01 10:39:08.087688 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1517/3047] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:07 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:08.102783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:08.104236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:08.110842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.111560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.112511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.113100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.355604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.368175 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3eb71d5b-76d9-4c5a-a93a-937e2e3c3051 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.313946 Jul 01 10:39:08.370562 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1531/3048] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:08 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:08.398089 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:08.403104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:08.433457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.434240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.435234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.441440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.530209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.538535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-89f45e76-fdfd-4648-889b-a8c126893fdf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.439453 Jul 01 10:39:08.550305 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1518/3049] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:08 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:08.560975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:08.560975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:08.563784 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.564241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.565023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.565498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.697169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.706271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.707773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.710767 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ff2a7a3-a8ac-49bb-857d-45b827c455e0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1265 microversion: 2.26 time: 0.158628 Jul 01 10:39:08.712076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1519/3050] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:08 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:08.720577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a658e78d-b242-4c48-900a-b5bb59b7ce02 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a658e78d-b242-4c48-900a-b5bb59b7ce02 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 416 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:08.723468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a658e78d-b242-4c48-900a-b5bb59b7ce02 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a658e78d-b242-4c48-900a-b5bb59b7ce02 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011698 Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1520/3051] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:08 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:08.734275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a28ea926-d5d5-48c7-82f6-c9be9a6caef1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:08.742840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a28ea926-d5d5-48c7-82f6-c9be9a6caef1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.743284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a28ea926-d5d5-48c7-82f6-c9be9a6caef1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.771269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a28ea926-d5d5-48c7-82f6-c9be9a6caef1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Going to try to stop instance {{(pid=119765) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:39:08.788876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.801989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef579686-4f6a-4f76-94f6-f87027856e96 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1359 microversion: 2.1 time: 0.430106 Jul 01 10:39:08.803332 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1532/3052] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:08 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:08.815195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:08.817071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:08.833320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.834522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.835719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:08.836667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:08.987750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:08.995873 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8e380d82-ad98-4f7d-b271-bfd0ae43e447 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1576 microversion: 2.1 time: 0.186260 Jul 01 10:39:08.996457 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1533/3053] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:08 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:09.001276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:09.001881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:09.009603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.010106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.011461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.011904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.098447 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a28ea926-d5d5-48c7-82f6-c9be9a6caef1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.371409 Jul 01 10:39:09.104790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1521/3054] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:08 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:39:09.110505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7f30112f-6003-4e8e-b20b-aae9e92cc1d4 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:09.111095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7f30112f-6003-4e8e-b20b-aae9e92cc1d4 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:09.122191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f30112f-6003-4e8e-b20b-aae9e92cc1d4 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.122649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f30112f-6003-4e8e-b20b-aae9e92cc1d4 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.123767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f30112f-6003-4e8e-b20b-aae9e92cc1d4 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.124189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f30112f-6003-4e8e-b20b-aae9e92cc1d4 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.358043 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7f30112f-6003-4e8e-b20b-aae9e92cc1d4 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.256859 Jul 01 10:39:09.358762 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1522/3055] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:39:09 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:09.364278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:09.365459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:09.373551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.374288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.375438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.376207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.394797 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:09.488822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:09.504379 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4b1d01f8-2c87-438d-bffa-04d86be45c57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.506521 Jul 01 10:39:09.505705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1534/3056] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:08 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:09.511966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:09.513026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:09.524491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.526575 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.526992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.527614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.790179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:09.801717 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf6033a3-5da0-491d-b095-b857ca1c5aa6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.441799 Jul 01 10:39:09.807027 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1523/3057] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:09 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:09.821553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:09.822547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:09.835855 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.838170 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.842024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:09.843313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:09.987791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:10.002782 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:10.015914 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d5ec669-f70a-4924-a69e-5ee66c5f2f0c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.506110 Jul 01 10:39:10.016551 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1535/3058] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:09 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:10.030371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:10.031822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:10.045778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.046499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:10.047522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.049780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:10.457936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:10.477951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:10.480464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:10.483458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-71f6f5cd-f188-4011-a0e0-9ca76a9d7d94 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1313 microversion: 2.26 time: 0.462092 Jul 01 10:39:10.484386 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1536/3059] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:10 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:10.503683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:10.505904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:10.518347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.518973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:10.520091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.520779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:10.534320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:10.548563 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d7260e07-a87f-4c2c-a19d-88a1f0ce36ba tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.739895 Jul 01 10:39:10.549474 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1524/3060] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:09 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:10.808838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:10.809079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7cecb99-6f5d-481d-8d1d-ecec5fba7ea4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-7897676", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": -1, "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:10.821096 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4ecc2f6-67ec-4aec-8309-97f1a11ec31f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1359 microversion: 2.1 time: 0.328701 Jul 01 10:39:10.835874 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1537/3061] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:10 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:10.836911 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c7cecb99-6f5d-481d-8d1d-ecec5fba7ea4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Flavor -1 could not be found. Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7cecb99-6f5d-481d-8d1d-ecec5fba7ea4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 203 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-7897676", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": -1, "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: exception: Flavor -1 could not be found. Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-7897676', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': -1, 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:10.841886 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 01 10:39:10.850056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:10.851938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7cecb99-6f5d-481d-8d1d-ecec5fba7ea4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:10.853568 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c7cecb99-6f5d-481d-8d1d-ecec5fba7ea4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.047649 Jul 01 10:39:10.853691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:10.854212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1525/3062] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:10 2022] POST /compute/v2.1/servers => generated 73 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 01 10:39:10.854711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:10.863825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.864721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:10.865344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:10.865908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:10.866455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.867089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:10.887241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.887692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:10.891652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:10.894460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.267628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:11.286282 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4d88f144-407e-4596-a820-181cae466021 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.448184 Jul 01 10:39:11.289597 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1538/3063] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:10 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:11.301165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:11.302139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:11.316689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.319181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.320126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.323107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.333402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:11.347711 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-873227fc-066a-48f0-bc15-e2de563a74ac tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.480425 Jul 01 10:39:11.349004 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1526/3064] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:10 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:11.370372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:11.371360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:11.381271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.383523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.385378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.387129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.683210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:11.692357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:11.697499 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a0dca263-397d-45e7-a71b-46b27f837b23 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.406259 Jul 01 10:39:11.698973 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1539/3065] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:11 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:11.701236 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2ce0822c-9b2d-45f9-866f-cccf5dca81ad tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.335719 Jul 01 10:39:11.703551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1527/3066] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:11 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:11.706176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:11.706990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:11.708073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:11.717387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:11.717387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.717387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.717387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.717879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.730584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.732074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.733139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.733922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.828693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:11.842302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:11.847597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:11.849586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-07f2900b-a3c0-4db2-a5a6-5e458f35967b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1319 microversion: 2.26 time: 0.149314 Jul 01 10:39:11.852658 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1540/3067] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:11 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:11.865841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-38d67053-9c8c-454c-af3b-9512c7635b60 req-78e311ca-11e3-4b44-a468-dc218b08738a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db908b28-e5e5-4cdf-bd6b-85c797a4bb32", "tag": "8bb1f637-2aef-4d30-b38c-5392c3c741da"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:11.882938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-38d67053-9c8c-454c-af3b-9512c7635b60 req-78e311ca-11e3-4b44-a468-dc218b08738a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.883527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-38d67053-9c8c-454c-af3b-9512c7635b60 req-78e311ca-11e3-4b44-a468-dc218b08738a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.924894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-38d67053-9c8c-454c-af3b-9512c7635b60 req-78e311ca-11e3-4b44-a468-dc218b08738a service nova] Creating event network-changed:8bb1f637-2aef-4d30-b38c-5392c3c741da for instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 on n-h1-master-1 Jul 01 10:39:11.931424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-38d67053-9c8c-454c-af3b-9512c7635b60 req-78e311ca-11e3-4b44-a468-dc218b08738a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075895 Jul 01 10:39:11.932602 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1541/3068] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:11.940625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:11.941681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:11.959267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.959716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:11.960513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:11.960951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.274751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:12.293841 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-988bce10-36cf-4e8b-9697-68be40d8d057 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1576 microversion: 2.1 time: 0.590609 Jul 01 10:39:12.295205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1528/3069] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:11 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1576 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:12.314116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50b4573d-f506-4585-a807-8b3cd39b5f4d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1429544442", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50b4573d-f506-4585-a807-8b3cd39b5f4d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 173 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1429544442", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1429544442', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi -1 Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:12.318110 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50b4573d-f506-4585-a807-8b3cd39b5f4d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-50b4573d-f506-4585-a807-8b3cd39b5f4d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.023692 Jul 01 10:39:12.329409 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1529/3070] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:12 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:12.337724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f7ec624b-5b73-4d27-8c3e-8f1a97fd8d63 req-61baa16f-b63d-4e80-96b7-09b8cb242987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde88491-5e85-4abb-8121-4cde61f444f4", "name": "network-vif-plugged", "status": "completed", "tag": "bb53c117-d46a-4008-ad58-e45ee05b55f4"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:12.349587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f7ec624b-5b73-4d27-8c3e-8f1a97fd8d63 req-61baa16f-b63d-4e80-96b7-09b8cb242987 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:12.350498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f7ec624b-5b73-4d27-8c3e-8f1a97fd8d63 req-61baa16f-b63d-4e80-96b7-09b8cb242987 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.360261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:12.369060 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f7ec624b-5b73-4d27-8c3e-8f1a97fd8d63 req-61baa16f-b63d-4e80-96b7-09b8cb242987 service nova] Creating event network-vif-plugged:bb53c117-d46a-4008-ad58-e45ee05b55f4 for instance cde88491-5e85-4abb-8121-4cde61f444f4 on n-h2-master-1 Jul 01 10:39:12.369274 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3144b08b-1d83-47d1-9fd1-9e79927f1019 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1359 microversion: 2.1 time: 0.434902 Jul 01 10:39:12.378238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f7ec624b-5b73-4d27-8c3e-8f1a97fd8d63 req-61baa16f-b63d-4e80-96b7-09b8cb242987 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043155 Jul 01 10:39:12.379229 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1530/3071] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:12.382134 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1542/3072] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:11 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1359 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:12.387941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:12.387941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:12.393390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:12.395240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:12.395240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.395538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:12.395817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:12.396071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.405039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:12.405871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.408312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:12.408925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.925440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:12.934108 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-abee3913-a58b-4ff8-86bb-cb5e608d385e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.550797 Jul 01 10:39:12.934620 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1543/3073] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:12 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:12.939226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:12.940039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:12.955311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:12.955983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.956789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:12.957262 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:12.972888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:12.983411 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5560083a-e6cf-4a90-9116-ad8a5aa1cd38 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.602381 Jul 01 10:39:12.983992 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1531/3074] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:12 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:12.990612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:12.996840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:13.003139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.003812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.005271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.005876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.105990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:13.114331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:13.115894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:13.117074 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-be75f41c-9eae-408e-b20b-4219eef74b1a tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1319 microversion: 2.26 time: 0.131564 Jul 01 10:39:13.117670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1532/3075] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:12 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1319 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:13.122990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:13.123815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:13.130509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.131353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.132140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.132579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.324685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:13.334101 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7d4a78d1-b041-4005-bf3c-c19429b57fd6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.398406 Jul 01 10:39:13.334831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1544/3076] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:12 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:13.400228 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:13.400845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:13.411783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.412261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.417486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.418438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.506512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:13.531520 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72502220-14ae-407d-b0d5-fb55698f9081 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.410859 Jul 01 10:39:13.532150 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1533/3077] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:13 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:13.615567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:13.623568 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37640345-5d33-494e-b977-d6dbcbd73ceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1359 microversion: 2.1 time: 0.228734 Jul 01 10:39:13.624145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1545/3078] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:13 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:13.689761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76bd9ac8-c7b6-4e22-8170-97b5252044ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-376645571", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:13.693425 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-76bd9ac8-c7b6-4e22-8170-97b5252044ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76bd9ac8-c7b6-4e22-8170-97b5252044ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 215 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-376645571", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-376645571', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:13.695027 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76bd9ac8-c7b6-4e22-8170-97b5252044ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76bd9ac8-c7b6-4e22-8170-97b5252044ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.010673 Jul 01 10:39:13.699142 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1534/3079] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:13 2022] POST /compute/v2.1/servers => generated 123 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:13.705589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:13.706258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:13.713335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.713806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.714597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.715843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.936150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:13.945703 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93b6626c-4678-4775-9fcc-2dd86a501ad5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.244487 Jul 01 10:39:13.946220 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1546/3080] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:13 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:13.963171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:13.963779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:13.972822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.973314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:13.974098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:13.974534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.000280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:14.000900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:14.008521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.008980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.009836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.010273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.531919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:14.542254 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6729a5a5-d1fb-45cc-98ae-926535830f7e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.582845 Jul 01 10:39:14.543216 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1535/3081] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:13 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:14.549177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:14.550572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:14.557981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.558588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.559494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.560167 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.577422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:14.590944 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-553048a3-8ec6-43e8-82fc-dce92df949ce tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.590991 Jul 01 10:39:14.594526 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1547/3082] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:13 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:14.608487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:14.609247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:14.624833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.627133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.628237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.629617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.825047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:14.834649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:14.837492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:14.838919 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fa2a99d-6dfe-411e-9d63-d581c1eefe40 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.294526 Jul 01 10:39:14.839708 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1536/3083] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:14 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:14.845605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:14.847276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:14.855723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.856482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.857516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:14.858298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:14.886777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:14.896153 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1fe88d7a-0353-4d40-b696-a52c47a64d2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.301372 Jul 01 10:39:14.904305 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1548/3084] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:14 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:14.912953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e03c0c99-9ed5-479c-8392-535c0c997f6c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2132871053", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-key-532856373", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:14.985960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-e03c0c99-9ed5-479c-8392-535c0c997f6c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] validate_networks() for [('5cc96019-7f9a-4fe6-a8e5-4beaea1229fb', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:39:15.196114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:15.204916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a25468c3-cfb8-4b54-b23f-a74783e69021 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1541 microversion: 2.1 time: 0.363788 Jul 01 10:39:15.212736 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1537/3085] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:14 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1541 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:15.229309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0b3c97e8-737b-4bd5-9f11-5c6949f63fb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:15.230449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0b3c97e8-737b-4bd5-9f11-5c6949f63fb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:15.250129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b3c97e8-737b-4bd5-9f11-5c6949f63fb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.250975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b3c97e8-737b-4bd5-9f11-5c6949f63fb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:15.253377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b3c97e8-737b-4bd5-9f11-5c6949f63fb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.254786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0b3c97e8-737b-4bd5-9f11-5c6949f63fb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:15.353127 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e03c0c99-9ed5-479c-8392-535c0c997f6c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Invalid key_name provided. Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e03c0c99-9ed5-479c-8392-535c0c997f6c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 246 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2132871053", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-key-532856373", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid key_name provided. Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2132871053', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'key_name': 'tempest-key-532856373', 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-532856373 not found for user a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:15.356024 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 01 10:39:15.360717 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:15.363846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e03c0c99-9ed5-479c-8392-535c0c997f6c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid key_name provided. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:15.365250 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e03c0c99-9ed5-479c-8392-535c0c997f6c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.459925 Jul 01 10:39:15.366540 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1549/3086] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:14 2022] POST /compute/v2.1/servers => generated 70 bytes in 462 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:39:15.375834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:15.379056 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:15.386777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.393479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:15.401372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.402556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:15.404854 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0b3c97e8-737b-4bd5-9f11-5c6949f63fb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179618 Jul 01 10:39:15.405521 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1538/3087] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:39:15 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:39:15.840073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:15.866201 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06a0c634-8338-4a0b-9016-917c6c35e84c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.495178 Jul 01 10:39:15.867807 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1550/3088] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:15 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:15.900314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:15.900945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:15.914272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.915559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:15.916641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.917301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:15.938167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:15.938974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:15.955881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.955881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:15.956440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:15.956885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:16.169666 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:16.488446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:16.501968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:16.506017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:16.507553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:16.508744 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1f362a24-778a-4207-b2c1-df4a94cfe19c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.616755 Jul 01 10:39:16.510835 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7c10223e-b2c6-41d7-829a-f5c743f24399 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.905884 Jul 01 10:39:16.515917 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1551/3089] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:15 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:16.521110 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1539/3090] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:15 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:16.529918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4adb97ea-d4f3-46f1-b124-f08ed297fa1c req-ebb1d6e0-0514-483f-8333-369a81198435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df79725-ee19-4975-8e3e-f5b12ed18e0a", "tag": "fe0c2620-6ff5-4e35-b5d4-8c7e15297372"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:16.534476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:16.548151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:16.562536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4adb97ea-d4f3-46f1-b124-f08ed297fa1c req-ebb1d6e0-0514-483f-8333-369a81198435 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:16.563018 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:16.565372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:16.565372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:16.565726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4adb97ea-d4f3-46f1-b124-f08ed297fa1c req-ebb1d6e0-0514-483f-8333-369a81198435 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:16.566192 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:16.609677 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4adb97ea-d4f3-46f1-b124-f08ed297fa1c req-ebb1d6e0-0514-483f-8333-369a81198435 service nova] Creating event network-changed:fe0c2620-6ff5-4e35-b5d4-8c7e15297372 for instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a on n-h2-master-1 Jul 01 10:39:16.625355 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4adb97ea-d4f3-46f1-b124-f08ed297fa1c req-ebb1d6e0-0514-483f-8333-369a81198435 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107741 Jul 01 10:39:16.630165 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1552/3091] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:16.640938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:16.649817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:16.665045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:16.667396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:16.668217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:16.668667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:17.059521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:17.074870 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cab6da88-edab-43ce-ab8c-c519cd2691fb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.550385 Jul 01 10:39:17.076897 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1540/3092] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:16 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:17.119230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:17.131974 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-306018bd-0903-421a-951e-625262e98b24 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.498470 Jul 01 10:39:17.133697 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1553/3093] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:16 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:17.156968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0484f71-2071-40c6-8a1f-b6d85426a497 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-552349754", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:17.283545 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=18 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:17.536197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:17.537092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:17.548087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:17.548789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:17.550619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:17.551444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:17.688216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-b0484f71-2071-40c6-8a1f-b6d85426a497 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Neutron security group does_not_exist not found {{(pid=119765) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 01 10:39:17.690934 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b0484f71-2071-40c6-8a1f-b6d85426a497 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0484f71-2071-40c6-8a1f-b6d85426a497 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 257 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-552349754", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-552349754', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 01 10:39:17.697795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:17.702068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0484f71-2071-40c6-8a1f-b6d85426a497 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:17.711773 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b0484f71-2071-40c6-8a1f-b6d85426a497 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.546901 Jul 01 10:39:17.711773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1541/3094] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:17 2022] POST /compute/v2.1/servers => generated 106 bytes in 548 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:17.711773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:17.712753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:17.720282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:17.720745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:17.721593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:17.722244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:17.922503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:17.927143 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:17.935439 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99ce7d59-768f-4745-8c78-7123f78892ed tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.408491 Jul 01 10:39:17.938507 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1554/3095] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:17 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:17.946112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:17.947037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:17.956119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:17.956781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:17.958208 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:17.958657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.082101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:18.097643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:18.099259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:18.100846 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cbdecec4-9a5d-4211-b652-f2b1a4e36b45 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.399867 Jul 01 10:39:18.101521 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1542/3096] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:17 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:18.151291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:18.151291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:18.155097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.155814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.156777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.157457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.320422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:18.322243 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b5c82ce-1de0-4d94-9426-d28990d7357d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.382627 Jul 01 10:39:18.323356 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1555/3097] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:17 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:18.347810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:18.348711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:18.361864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.363483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.364358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.366296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.509197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:18.518453 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f23da553-f98c-4ac3-9cd0-09ed2e97026d tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1681 microversion: 2.1 time: 0.374959 Jul 01 10:39:18.544659 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1543/3098] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:18 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1681 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:18.598556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:18.618017 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7981e56-651e-42fb-9e5d-b6101b5d0988 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.275518 Jul 01 10:39:18.619174 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1556/3099] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:18 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:18.637836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3afd35e-b699-4884-bb27-94f483872a09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:18.639250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3afd35e-b699-4884-bb27-94f483872a09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 70027d30-3187-4cb4-934a-f7d0376d7409] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:18.655192 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f3afd35e-b699-4884-bb27-94f483872a09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 70027d30-3187-4cb4-934a-f7d0376d7409 could not be found. Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3afd35e-b699-4884-bb27-94f483872a09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/70027d30-3187-4cb4-934a-f7d0376d7409 HTTP/1.1 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 70027d30-3187-4cb4-934a-f7d0376d7409 could not be found. Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '70027d30-3187-4cb4-934a-f7d0376d7409'} Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70027d30-3187-4cb4-934a-f7d0376d7409 could not be found. Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70027d30-3187-4cb4-934a-f7d0376d7409 could not be found. Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:18.658563 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70027d30-3187-4cb4-934a-f7d0376d7409 could not be found. Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:18.664637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3afd35e-b699-4884-bb27-94f483872a09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 70027d30-3187-4cb4-934a-f7d0376d7409 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:18.666050 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3afd35e-b699-4884-bb27-94f483872a09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/70027d30-3187-4cb4-934a-f7d0376d7409" status: 404 len: 111 microversion: 2.1 time: 0.033308 Jul 01 10:39:18.667589 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1544/3100] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:18 2022] DELETE /compute/v2.1/servers/70027d30-3187-4cb4-934a-f7d0376d7409 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:18.673213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5b2b65a4-085a-4d29-9c93-8f6c748c023f req-21312529-3952-4a01-b3f4-d57de7c7bf76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde88491-5e85-4abb-8121-4cde61f444f4", "tag": "bb53c117-d46a-4008-ad58-e45ee05b55f4"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:18.681637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:18.682851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:18.692888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.693740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.694122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5b2b65a4-085a-4d29-9c93-8f6c748c023f req-21312529-3952-4a01-b3f4-d57de7c7bf76 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.694507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5b2b65a4-085a-4d29-9c93-8f6c748c023f req-21312529-3952-4a01-b3f4-d57de7c7bf76 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.695763 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.696520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.718042 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5b2b65a4-085a-4d29-9c93-8f6c748c023f req-21312529-3952-4a01-b3f4-d57de7c7bf76 service nova] Creating event network-changed:bb53c117-d46a-4008-ad58-e45ee05b55f4 for instance cde88491-5e85-4abb-8121-4cde61f444f4 on n-h2-master-1 Jul 01 10:39:18.732360 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5b2b65a4-085a-4d29-9c93-8f6c748c023f req-21312529-3952-4a01-b3f4-d57de7c7bf76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078106 Jul 01 10:39:18.735854 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1557/3101] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:39:18.955932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:18.957088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:18.971823 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.972286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:18.973086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:18.973565 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:19.204032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:19.213958 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ade9b40-d350-4230-9b62-de161d9b029a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.537924 Jul 01 10:39:19.214888 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1545/3102] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:18 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:19.220267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:19.221109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:19.228326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:19.229094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:19.230079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:19.231677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:19.260629 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:19.511332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:19.519700 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08b3b404-b14c-41d5-a6a1-8bb58af7c280 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.568965 Jul 01 10:39:19.524676 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1558/3103] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:18 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:19.537557 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:19.538833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:19.552895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:19.555047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:19.555866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:19.556310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:19.789534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:19.803040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:19.810824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:19.812532 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5373e2ba-abdd-4441-9afe-eb42eec18f56 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.596568 Jul 01 10:39:19.813892 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1546/3104] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:19 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:19.819904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:19.825426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:19.838931 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:19.840544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:19.846105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:19.849079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:19.850354 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:20.109288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:20.122016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa5350b8-7c4a-4dd6-8298-ce331884222a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.594988 Jul 01 10:39:20.122871 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1559/3105] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:19 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:20.145960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7809d4e3-48ed-4ea8-9b2b-c7b0cfea4974 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:20.152429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7809d4e3-48ed-4ea8-9b2b-c7b0cfea4974 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7809d4e3-48ed-4ea8-9b2b-c7b0cfea4974 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7809d4e3-48ed-4ea8-9b2b-c7b0cfea4974 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 9223372036854775808 could not be found. Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '9223372036854775808'} Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:20.156009 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 01 10:39:20.160624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:20.161778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7809d4e3-48ed-4ea8-9b2b-c7b0cfea4974 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:20.163884 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7809d4e3-48ed-4ea8-9b2b-c7b0cfea4974 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023752 Jul 01 10:39:20.166532 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1560/3106] 10.222.0.23 () {58 vars in 1187 bytes} [Fri Jul 1 10:39:20 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:39:20.175691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:20.176659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:20.208477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:20.214239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:20.214239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:20.214239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:20.534702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:20.554462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8361b131-2ed6-4f8b-a883-919980c20f45 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1658 microversion: 2.1 time: 0.738234 Jul 01 10:39:20.555016 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1547/3107] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:19 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1658 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:20.613088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:20.622879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5611724b-63fa-4f78-8ae4-e8c5291da30d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.450227 Jul 01 10:39:20.622879 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1561/3108] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:20 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:20.629333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:20.631604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:20.638659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:20.639300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:20.640824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:20.642305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:20.673623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2136439601", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "2684ed77-9d30-47e9-895a-70034a884348"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:20.759800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] validate_networks() for [('2684ed77-9d30-47e9-895a-70034a884348', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:39:20.959702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:20.969659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af5eb11a-b4c3-4c94-8d98-b0b2a7088929 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1511 microversion: 2.1 time: 0.345615 Jul 01 10:39:20.970255 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1562/3109] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:20 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:20.988051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-84b6e20d-6c76-4517-a146-736423a345d1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:20.994426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84b6e20d-6c76-4517-a146-736423a345d1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:20.994876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84b6e20d-6c76-4517-a146-736423a345d1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.018302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-84b6e20d-6c76-4517-a146-736423a345d1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Going to try to start instance {{(pid=119764) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 10:39:21.211939 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-84b6e20d-6c76-4517-a146-736423a345d1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.240435 Jul 01 10:39:21.215506 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1563/3110] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:20 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:39:21.220026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:21.224225 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:21.227716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.228167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.228987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.229462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.248158 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:39:21.249405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:39:21.249942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:39:21.250421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:39:21.250945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:39:21.262628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.263319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.264117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.264587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.288601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Getting quotas for project 6ce4c26e597d49ae899b1383eb9d7bb6. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:39:21.295254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Getting quotas for user 13a16defab134f49bbfe5c3f2ee78a4e and project 6ce4c26e597d49ae899b1383eb9d7bb6. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:39:21.312713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Going to run 3 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:39:21.315124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:39:21.394124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:21.401693 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa9c11e8-01dc-4c07-ab94-4d03244c868f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.187809 Jul 01 10:39:21.402259 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1564/3111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:21 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:21.408467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:21.409314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:21.415674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.416129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.417760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.418215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.483777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=f8b9bf7d-caf3-4001-9f5b-46c1a824e25c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:39:21.608245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=35008ac8-b20d-453b-9446-3d459f330baf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:39:21.660400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:21.670497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:21.673712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:21.676033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3942316-b01d-461f-89ef-0f91fa7d7dca tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.272637 Jul 01 10:39:21.677169 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1565/3112] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:21 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:21.686311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:21.687109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:21.694585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.696485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.696485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.696485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.862776 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ef08d13-0db9-4386-a9c0-f4a1074d8e81 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291095 Jul 01 10:39:21.863857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1548/3113] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:39:21.878335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe624972-24ce-4c62-8557-b8b677ca8da7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:21.881643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fe624972-24ce-4c62-8557-b8b677ca8da7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Failed to fetch instance by id -1 {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 01 10:39:21.882269 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-fe624972-24ce-4c62-8557-b8b677ca8da7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance -1 could not be found. Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe624972-24ce-4c62-8557-b8b677ca8da7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: exception: Instance -1 could not be found. Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '-1'} Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:21.886925 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:21.897036 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:21.897036 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:21.897036 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 01 10:39:21.897036 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:21.897036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe624972-24ce-4c62-8557-b8b677ca8da7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:21.897036 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fe624972-24ce-4c62-8557-b8b677ca8da7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014517 Jul 01 10:39:21.897036 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1549/3114] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:39:21 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:39:21.901091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:21.904827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:21.906382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:21.929499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.930105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.931187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.931932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.956592 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4cec73b3-ea98-4b18-9cb6-22368b5cbe6d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.066264 Jul 01 10:39:21.963764 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1550/3115] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:39:21 2022] GET /compute/v2.1/servers => generated 1018 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:21.970517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:21.971390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:21.979138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.979881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:21.982875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:21.983409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.319398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:22.330509 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fe04ebce-0455-4b37-90f1-9ee089bb6a2b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1667 microversion: 2.1 time: 0.652166 Jul 01 10:39:22.333951 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1566/3116] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:21 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1667 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:22.335301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:22.339264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-19d4607b-0c44-46b0-84d0-3130c0146d0a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:22.340298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-19d4607b-0c44-46b0-84d0-3130c0146d0a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:22.347909 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-32f53802-da4f-4482-ba5b-bbf706f965e2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.382468 Jul 01 10:39:22.348796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1551/3117] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:21 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:22.366813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:22.367950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:22.375629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.376137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.376987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.377515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.409671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-19d4607b-0c44-46b0-84d0-3130c0146d0a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:22.424026 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-19d4607b-0c44-46b0-84d0-3130c0146d0a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1223 microversion: 2.1 time: 0.091303 Jul 01 10:39:22.434830 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1567/3118] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:22 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:22.442834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7ffd40ee-c76f-4ebe-b914-c8aa33c0f800 req-6b03e2ed-fa8a-490c-9b0f-2572dad854fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df79725-ee19-4975-8e3e-f5b12ed18e0a", "name": "network-vif-plugged", "status": "completed", "tag": "fe0c2620-6ff5-4e35-b5d4-8c7e15297372"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:22.462528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7ffd40ee-c76f-4ebe-b914-c8aa33c0f800 req-6b03e2ed-fa8a-490c-9b0f-2572dad854fe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.462998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7ffd40ee-c76f-4ebe-b914-c8aa33c0f800 req-6b03e2ed-fa8a-490c-9b0f-2572dad854fe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.482242 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7ffd40ee-c76f-4ebe-b914-c8aa33c0f800 req-6b03e2ed-fa8a-490c-9b0f-2572dad854fe service nova] Creating event network-vif-plugged:fe0c2620-6ff5-4e35-b5d4-8c7e15297372 for instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a on n-h2-master-1 Jul 01 10:39:22.487733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7ffd40ee-c76f-4ebe-b914-c8aa33c0f800 req-6b03e2ed-fa8a-490c-9b0f-2572dad854fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051630 Jul 01 10:39:22.489156 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1568/3119] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:22.495486 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:22.496205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:22.514162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.514683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.517380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.518391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.647918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:22.657982 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf21d83e-b8c2-4129-a45b-693167484a1f tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1488 microversion: 2.1 time: 0.295084 Jul 01 10:39:22.658584 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1552/3120] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:22 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1488 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:22.676019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:22.676833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:22.684005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.684715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.686263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.690871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.725594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:22.765877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:22.787136 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-741d2ac0-b4bd-468a-bdb1-4813a850241a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.295186 Jul 01 10:39:22.789223 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1569/3121] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:22 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:22.808743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:22.810436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:22.817634 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:22.822519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.822976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.823761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:22.828537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:22.997744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.007465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.009180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.010607 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f075091-44bf-40e3-b09b-5c06a23f541f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.220061 Jul 01 10:39:23.011510 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1570/3122] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:22 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:23.017852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83fda06c-75d3-4301-b9ac-74663f2a959c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:23.018399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-83fda06c-75d3-4301-b9ac-74663f2a959c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: a27cb8a7-a2c8-4dff-a75f-42c4c92ac266] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.025103 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-83fda06c-75d3-4301-b9ac-74663f2a959c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance a27cb8a7-a2c8-4dff-a75f-42c4c92ac266 could not be found. Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83fda06c-75d3-4301-b9ac-74663f2a959c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/a27cb8a7-a2c8-4dff-a75f-42c4c92ac266/action HTTP/1.1 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 19 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: {"forceDelete": {}} Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: exception: Instance a27cb8a7-a2c8-4dff-a75f-42c4c92ac266 could not be found. Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'a27cb8a7-a2c8-4dff-a75f-42c4c92ac266', 'body': {'forceDelete': {}}} Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a27cb8a7-a2c8-4dff-a75f-42c4c92ac266 could not be found. Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a27cb8a7-a2c8-4dff-a75f-42c4c92ac266 could not be found. Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:23.033555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:23.038622 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:23.038622 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:23.038622 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a27cb8a7-a2c8-4dff-a75f-42c4c92ac266 could not be found. Jul 01 10:39:23.038622 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.038622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83fda06c-75d3-4301-b9ac-74663f2a959c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance a27cb8a7-a2c8-4dff-a75f-42c4c92ac266 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:23.038622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-83fda06c-75d3-4301-b9ac-74663f2a959c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/a27cb8a7-a2c8-4dff-a75f-42c4c92ac266/action" status: 404 len: 111 microversion: 2.1 time: 0.022329 Jul 01 10:39:23.038622 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1571/3123] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:23 2022] POST /compute/v2.1/servers/a27cb8a7-a2c8-4dff-a75f-42c4c92ac266/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:23.045131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.046333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.058519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.058519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.058519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.058519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.145463 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f407dbc4-3273-45ed-a115-25ac1ffa145e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 204 len: 0 microversion: 2.1 time: 0.474017 Jul 01 10:39:23.146095 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1553/3124] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:22 2022] DELETE /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:39:23.154535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.155423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.165925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.165925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.165925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.165925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.198235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.212649 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4172b730-0e2d-4da0-85d5-48a5a6508c2a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.171304 Jul 01 10:39:23.221301 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1572/3125] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:23.239983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.242752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.252933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.259503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.260617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.261083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.493321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.502694 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f6f711a7-05b0-432e-b8bd-4c97d3d525e0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1494 microversion: 2.1 time: 0.352304 Jul 01 10:39:23.513075 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1554/3126] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1494 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:23.518862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.519484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.529247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.529247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.529499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.529618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.529618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.535948 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f5f3158-85e5-48f4-98fc-78b700f25f00 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.304270 Jul 01 10:39:23.536892 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1573/3127] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:23.541594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a7a6358-6d5b-4e41-bd1e-88053ece4bf3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.542325 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a7a6358-6d5b-4e41-bd1e-88053ece4bf3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.623128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7a7a6358-6d5b-4e41-bd1e-88053ece4bf3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.631450 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a7a6358-6d5b-4e41-bd1e-88053ece4bf3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1223 microversion: 2.1 time: 0.093611 Jul 01 10:39:23.642067 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1574/3128] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:23.647551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1888dd3b-90f2-4e6d-9574-0db3be5c7114 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:23.650836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1888dd3b-90f2-4e6d-9574-0db3be5c7114 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: eda39f70-e0f8-4b4c-a61f-4a10da3cd973] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.657408 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-1888dd3b-90f2-4e6d-9574-0db3be5c7114 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance eda39f70-e0f8-4b4c-a61f-4a10da3cd973 could not be found. Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1888dd3b-90f2-4e6d-9574-0db3be5c7114 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/eda39f70-e0f8-4b4c-a61f-4a10da3cd973/action HTTP/1.1 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 39 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: {"os-getConsoleOutput": {"length": 10}} Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: exception: Instance eda39f70-e0f8-4b4c-a61f-4a10da3cd973 could not be found. Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'eda39f70-e0f8-4b4c-a61f-4a10da3cd973', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda39f70-e0f8-4b4c-a61f-4a10da3cd973 could not be found. Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda39f70-e0f8-4b4c-a61f-4a10da3cd973 could not be found. Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.661758 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda39f70-e0f8-4b4c-a61f-4a10da3cd973 could not be found. Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1888dd3b-90f2-4e6d-9574-0db3be5c7114 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance eda39f70-e0f8-4b4c-a61f-4a10da3cd973 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1888dd3b-90f2-4e6d-9574-0db3be5c7114 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/eda39f70-e0f8-4b4c-a61f-4a10da3cd973/action" status: 404 len: 111 microversion: 2.1 time: 0.019815 Jul 01 10:39:23.666131 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1575/3129] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:23 2022] POST /compute/v2.1/servers/eda39f70-e0f8-4b4c-a61f-4a10da3cd973/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:23.674059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.675843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.683153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.683735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.684622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.685177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.710582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.721503 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63b82451-731a-4596-a24a-043cf32a97d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.207004 Jul 01 10:39:23.736077 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1555/3130] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:23.743903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.744837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.754066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.755615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.757260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.757919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.938748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:23.942231 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:23.948406 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a0806e7d-001d-4c1c-b47e-54c3cfc62a98 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.279800 Jul 01 10:39:23.949351 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1576/3131] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:23.972962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:23.972962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:23.977357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.978015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:23.978811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:23.979256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.008547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.018629 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-83191dcb-533a-4539-95f2-32f1e2fb5999 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.279889 Jul 01 10:39:24.028772 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1556/3132] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:24.029397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.030036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.037775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.038444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.039409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.040029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.211925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.220773 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60d282c5-adad-43e9-a005-e10f468ba9f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.254364 Jul 01 10:39:24.221678 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1577/3133] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:23 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:24.226430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.227262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.233498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.234033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.234944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.235380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.242299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.253763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.255286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.256456 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9080a989-df88-4f49-9ade-1bdcf17f8656 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.231377 Jul 01 10:39:24.257289 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1557/3134] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:39:24.262028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f40c2dd5-25db-4483-bf55-a33adfa72243 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.262829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f40c2dd5-25db-4483-bf55-a33adfa72243 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 9f969e79-a9c6-4767-8fec-addbcce57944] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.269466 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f40c2dd5-25db-4483-bf55-a33adfa72243 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 9f969e79-a9c6-4767-8fec-addbcce57944 could not be found. Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f40c2dd5-25db-4483-bf55-a33adfa72243 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/9f969e79-a9c6-4767-8fec-addbcce57944 HTTP/1.1 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 9f969e79-a9c6-4767-8fec-addbcce57944 could not be found. Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '9f969e79-a9c6-4767-8fec-addbcce57944'} Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f969e79-a9c6-4767-8fec-addbcce57944 could not be found. Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f969e79-a9c6-4767-8fec-addbcce57944 could not be found. Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:24.271380 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:24.276085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:24.276085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:24.276085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:24.276085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f969e79-a9c6-4767-8fec-addbcce57944 could not be found. Jul 01 10:39:24.276085 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:24.277626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f40c2dd5-25db-4483-bf55-a33adfa72243 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 9f969e79-a9c6-4767-8fec-addbcce57944 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:24.283192 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f40c2dd5-25db-4483-bf55-a33adfa72243 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/9f969e79-a9c6-4767-8fec-addbcce57944" status: 404 len: 111 microversion: 2.1 time: 0.020545 Jul 01 10:39:24.283192 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1558/3135] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/9f969e79-a9c6-4767-8fec-addbcce57944 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:24.288407 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.289033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.296477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.296929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.305067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.305585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.444674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.453991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e45750a3-d729-42a4-95b5-456a48cf158a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.231086 Jul 01 10:39:24.455102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1578/3136] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:24.471341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.472125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.491216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.497116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.497116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.497116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.497771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.509181 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8202fafa-6333-4b9f-b85e-ccd11307f444 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.224632 Jul 01 10:39:24.511403 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1559/3137] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:24.524682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.525521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.533205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.533965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.534949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.535646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.813355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.823165 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e5e857a-1014-4e16-bd08-5c12b8aad6f3 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1494 microversion: 2.1 time: 0.303244 Jul 01 10:39:24.823766 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1560/3138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1494 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:24.826759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.836869 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9171df81-806f-4a04-9df9-f615fc0888d0 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.370612 Jul 01 10:39:24.837610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.837762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1579/3139] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:24.838956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.846284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.846939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.847861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.848440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.857513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a078daf-e040-43fc-8c9e-7f14448ca2f8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.858353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a078daf-e040-43fc-8c9e-7f14448ca2f8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.935429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6a078daf-e040-43fc-8c9e-7f14448ca2f8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:24.942753 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a078daf-e040-43fc-8c9e-7f14448ca2f8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1223 microversion: 2.1 time: 0.091889 Jul 01 10:39:24.944734 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1580/3140] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:24.957248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:24.957860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:24.974105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.974694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:24.975548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:24.976639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.196710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:25.206137 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ddfd55ed-f496-4574-beec-a87c56ef4fbe tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.380997 Jul 01 10:39:25.206715 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1561/3141] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:25.277715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:25.279157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:25.279790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:25.288358 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc876b2f-5b93-4f67-8319-0ea56a6a6160 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.337828 Jul 01 10:39:25.289355 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1581/3142] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:24 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:25.294933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c95e548c-8c71-442f-81a8-3c09e65c4ab5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1269994787", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c95e548c-8c71-442f-81a8-3c09e65c4ab5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 238 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1269994787", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1269994787', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:25.304162 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 01 10:39:25.315051 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:25.316501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.316501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.316501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.316501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.317094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c95e548c-8c71-442f-81a8-3c09e65c4ab5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:25.317094 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c95e548c-8c71-442f-81a8-3c09e65c4ab5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020862 Jul 01 10:39:25.317563 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1582/3143] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:25.322441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:25.322994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:25.330733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.331504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.338814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.338814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.364491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lazy-loading 'flavor' on Instance uuid c4d5f7e5-c239-4d67-8350-35e6cc070a68 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:25.514793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:25.523667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:25.525196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:25.526342 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c6ffc2b-1cab-4701-9373-c8a5d06ff1c9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1361 microversion: 2.26 time: 0.255589 Jul 01 10:39:25.526928 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1562/3144] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:25 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:39:25.532161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:25.533230 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:25.540141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.540597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.541416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.541861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.712432 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-363fbef9-a7a0-47d1-a509-7b357d3cbdfa tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.393191 Jul 01 10:39:25.716061 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1583/3145] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:25 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:39:25.731094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:25.731909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:25.743654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.751563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.751563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.751563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.882230 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:25.901886 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-846123d1-20dc-4c95-9bee-aadb4fc8e00f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.373812 Jul 01 10:39:25.902858 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1563/3146] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:25 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:25.910324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3787fcd6-a71d-4dc7-8a78-403d2a9aedfb req-65752d10-5777-44b6-ae52-d9249967be26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47387c27-7fd3-476a-bdfb-040bbfd8e06d", "name": "network-vif-deleted", "tag": "ef87defb-9443-4408-87be-fad540a0feab"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:25.921589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3787fcd6-a71d-4dc7-8a78-403d2a9aedfb req-65752d10-5777-44b6-ae52-d9249967be26 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.922328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3787fcd6-a71d-4dc7-8a78-403d2a9aedfb req-65752d10-5777-44b6-ae52-d9249967be26 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.945996 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3787fcd6-a71d-4dc7-8a78-403d2a9aedfb req-65752d10-5777-44b6-ae52-d9249967be26 service nova] Creating event network-vif-deleted:ef87defb-9443-4408-87be-fad540a0feab for instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d on n-h2-master-1 Jul 01 10:39:25.945996 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3787fcd6-a71d-4dc7-8a78-403d2a9aedfb req-65752d10-5777-44b6-ae52-d9249967be26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038010 Jul 01 10:39:25.945996 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1564/3147] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:25.949720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:25.950889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:25.960301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.960855 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.961940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:25.962453 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:25.967317 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:25.977765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:25.985841 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-91db300e-c51e-4e0b-bae5-b0777ee330c1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1679 microversion: 2.1 time: 0.259176 Jul 01 10:39:25.986981 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1584/3148] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:25 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:25.991821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:25.992625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:25.999847 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.002531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.002531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.002889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.047794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.059912 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-adfb15d0-cdae-40c0-940e-8728e497a0b2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 200 len: 1452 microversion: 2.1 time: 0.114713 Jul 01 10:39:26.060520 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1565/3149] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:25 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:26.066681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:26.067697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:26.075816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.077383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.077383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.078290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.158417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.170635 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-606ab1b8-d46e-4347-9f61-3a1113be73d7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1227 microversion: 2.1 time: 0.108694 Jul 01 10:39:26.171900 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1566/3150] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:26 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1227 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:26.202000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.210201 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1095025f-cb27-45fe-aa8a-688f0da36820 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.221903 Jul 01 10:39:26.210999 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1585/3151] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:25 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:26.265863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe01aa24-470b-46cd-ae23-a2d935c4bf2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1467637932", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe01aa24-470b-46cd-ae23-a2d935c4bf2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 235 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1467637932", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1467637932', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:26.274945 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe01aa24-470b-46cd-ae23-a2d935c4bf2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fe01aa24-470b-46cd-ae23-a2d935c4bf2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.015130 Jul 01 10:39:26.282587 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1567/3152] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:26 2022] POST /compute/v2.1/servers => generated 133 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:39:26.287248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:26.288064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:26.294484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.294999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.296355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.300926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.449480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.458188 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-887d4d16-ef5a-4c32-97c0-437b93fc482f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.176566 Jul 01 10:39:26.475684 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1586/3153] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:26 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:26.482823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:26.483347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:26.498159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.498607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.499962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.500402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.546002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:26.546751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:26.552885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.553583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.555001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.555450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.757305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.765624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-08520cd6-b5a8-494d-92d1-a9eb89d276df tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.287738 Jul 01 10:39:26.766208 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1568/3154] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:26 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:26.779464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.782163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a6e9d58-6972-4655-93bc-ef64051d5a1d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:26.782709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a6e9d58-6972-4655-93bc-ef64051d5a1d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:26.787926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.789436 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4a6e9d58-6972-4655-93bc-ef64051d5a1d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8 could not be found. Jul 01 10:39:26.789559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:26.790700 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65ebb212-342d-4b0a-bd00-0165741addae tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1545 microversion: 2.26 time: 0.248693 Jul 01 10:39:26.791206 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1587/3155] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:26 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1545 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a6e9d58-6972-4655-93bc-ef64051d5a1d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8/action HTTP/1.1 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 13 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: {"pause": {}} Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: exception: Instance bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8 could not be found. Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8', 'body': {'pause': {}}} Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8 could not be found. Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8 could not be found. Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:26.793607 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:26.797939 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:26.797939 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:26.797939 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8 could not be found. Jul 01 10:39:26.797939 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:26.797939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a6e9d58-6972-4655-93bc-ef64051d5a1d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:26.797939 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a6e9d58-6972-4655-93bc-ef64051d5a1d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8/action" status: 404 len: 111 microversion: 2.1 time: 0.017288 Jul 01 10:39:26.797939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1569/3156] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:26 2022] POST /compute/v2.1/servers/bd6a06ee-f9d3-4e6c-8f3d-97612c0816c8/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:26.804782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:26.805509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:26.810565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f91f8c280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:26.812562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.813096 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.813935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.814368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.822346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.823220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.824093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:26.830825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.831419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.832228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.833061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.858565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.859537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.875220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:26.875676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:26.972911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:26.991088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc669d3b-b05f-4201-baca-8e1a6e1e4be8 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-193104179" status: 201 len: 0 microversion: 2.26 time: 0.185214 Jul 01 10:39:26.992164 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1570/3157] 10.222.0.23 () {62 vars in 1376 bytes} [Fri Jul 1 10:39:26 2022] PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-193104179 => generated 0 bytes in 187 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 01 10:39:27.002232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb4fb627-276f-46b7-a429-8d58851b7432 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f91ad2b80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.012164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb4fb627-276f-46b7-a429-8d58851b7432 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.012691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb4fb627-276f-46b7-a429-8d58851b7432 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.024580 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb4fb627-276f-46b7-a429-8d58851b7432 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-193104179" status: 204 len: 0 microversion: 2.26 time: 0.027675 Jul 01 10:39:27.026050 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1571/3158] 10.222.0.23 () {60 vars in 1357 bytes} [Fri Jul 1 10:39:26 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-193104179 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:27.031978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.032704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:27.039231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.039675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.040587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.041024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.187140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:27.196102 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6a0fbf8-fc0a-4638-b89b-2383ded54168 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.395840 Jul 01 10:39:27.196787 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1588/3159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:26 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:27.203951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f92426430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.214779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.215234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.215926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:27.222368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.222815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.223583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.224021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.246352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.246807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.337228 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:27.362979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b310a88e-3836-4374-93c3-031e8f0a68e4 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 204 len: 0 microversion: 2.26 time: 0.165054 Jul 01 10:39:27.369118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1589/3160] 10.222.0.23 () {60 vars in 1294 bytes} [Fri Jul 1 10:39:27 2022] DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:27.375541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.377290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:27.386415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.387352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.393298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.393298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.394319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:27.405809 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d HTTP/1.1 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '47387c27-7fd3-476a-bdfb-040bbfd8e06d'} Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:27.407742 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:27.413379 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:27.413379 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:27.413379 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:27.413379 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:27.413379 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:27.413379 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:27.413379 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:27.415755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:27.417710 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04f3430d-7b73-4ca4-a35c-10ee6c2db217 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 404 len: 111 microversion: 2.1 time: 0.047165 Jul 01 10:39:27.418743 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-463807f0-bbf7-4051-be7c-22d626ed64cd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1662 microversion: 2.1 time: 0.388358 Jul 01 10:39:27.424102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1590/3161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:27 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:27.425294 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1572/3162] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:27 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1662 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:27.429740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.433802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:27.439117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.439912 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.440883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.441572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.459320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.461621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:27.479540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.482548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.485325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.487554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.553955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:27.565036 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-018a6f52-9c98-449a-bd54-36f0cfe56e9f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1283 microversion: 2.1 time: 0.139358 Jul 01 10:39:27.565862 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1591/3163] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:27 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:27.573524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a0d3ecd-965b-411a-9c5a-003a8a22f1ef tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f92426d30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.584668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a0d3ecd-965b-411a-9c5a-003a8a22f1ef tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.585501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a0d3ecd-965b-411a-9c5a-003a8a22f1ef tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.598749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a0d3ecd-965b-411a-9c5a-003a8a22f1ef tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 200 len: 12 microversion: 2.26 time: 0.031379 Jul 01 10:39:27.599939 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1592/3164] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:39:27 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:27.605233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6e065e73-3aef-417f-b25f-685f5a8886d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:27.606040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6e065e73-3aef-417f-b25f-685f5a8886d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:27.612692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e065e73-3aef-417f-b25f-685f5a8886d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.613441 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e065e73-3aef-417f-b25f-685f5a8886d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.614224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e065e73-3aef-417f-b25f-685f5a8886d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.614660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e065e73-3aef-417f-b25f-685f5a8886d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.675774 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:27.756900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:27.765578 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e1041f24-2cc9-4ac3-9e3f-0ca351c6bb40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.338115 Jul 01 10:39:27.766158 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1573/3165] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:27 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:27.781556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-867029256", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "ce42240f-1f36-4657-993c-cfa415e6f19d"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:27.833867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] validate_networks() for [('ce42240f-1f36-4657-993c-cfa415e6f19d', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:39:27.845784 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6e065e73-3aef-417f-b25f-685f5a8886d2 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action" status: 202 len: 0 microversion: 2.1 time: 0.244071 Jul 01 10:39:27.846837 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1593/3166] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:27 2022] POST /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:39:27.853931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f9249d1f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:27.864517 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.865121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.865848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:27.872023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.872462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.873243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.873673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.900633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.901086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:27.910719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:27.911307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:28.014613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:28.032249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93f749ec-4b27-4394-91d7-79599c7f6b10 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-1258577280" status: 201 len: 0 microversion: 2.26 time: 0.183905 Jul 01 10:39:28.032925 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1594/3167] 10.222.0.23 () {62 vars in 1379 bytes} [Fri Jul 1 10:39:27 2022] PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-1258577280 => generated 0 bytes in 186 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 01 10:39:28.040951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7aaa251c-c23c-4006-b10f-5c9892edc4a7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:28.046232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7aaa251c-c23c-4006-b10f-5c9892edc4a7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:28.048259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aaa251c-c23c-4006-b10f-5c9892edc4a7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:28.048711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aaa251c-c23c-4006-b10f-5c9892edc4a7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:28.049537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aaa251c-c23c-4006-b10f-5c9892edc4a7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:28.049973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aaa251c-c23c-4006-b10f-5c9892edc4a7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:28.297582 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7aaa251c-c23c-4006-b10f-5c9892edc4a7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 202 len: 0 microversion: 2.1 time: 0.263211 Jul 01 10:39:28.298513 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1595/3168] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:28 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:39:28.303504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:28.304206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:28.327014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:28.327014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:28.327014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:28.327014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:28.839196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:28.846899 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4235d90e-69bd-44dd-b0fc-8e362da24af8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1668 microversion: 2.1 time: 0.547331 Jul 01 10:39:28.847655 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1596/3169] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:28 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1668 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:28.861920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cefee5bf-2337-482f-bc0f-059bb11f802f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f91bd8550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:28.870489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cefee5bf-2337-482f-bc0f-059bb11f802f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:28.871168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cefee5bf-2337-482f-bc0f-059bb11f802f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:28.880877 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cefee5bf-2337-482f-bc0f-059bb11f802f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 200 len: 36 microversion: 2.26 time: 0.023252 Jul 01 10:39:28.881683 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1597/3170] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:39:28 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 36 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:28.887029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:28.895222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:28.895222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:28.895222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:28.895633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:28.896020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.368331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:29.376976 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da284805-8daf-47ee-8b55-2d960adc88f3 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1491 microversion: 2.1 time: 0.494280 Jul 01 10:39:29.391080 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1598/3171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:28 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1491 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:29.391080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:29.391080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:29.391080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.391853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.392716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.393446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.517438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:29.527166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68da37e4-5e7b-49e3-97e8-6ebe691a9524 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1281 microversion: 2.1 time: 0.148464 Jul 01 10:39:29.528138 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1599/3172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:29 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1281 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:29.544133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f92291040>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:29.552637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.553085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.553594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:29.565017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.566140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.566975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.567420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.588115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:39:29.588614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:39:29.591053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:39:29.591587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:39:29.593650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:39:29.596162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.596618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.615079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.615827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.617431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.618670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.648832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:39:29.656402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Getting quotas for user cc8012fcb48840f1b778ab759457e66c and project 8a2553a410f24e8f9552704e7e9c14f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:39:29.673440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:39:29.682867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:39:29.703580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:29.734287 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f15afc8b-635b-4502-8c86-304513d77782 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-1258577280" status: 204 len: 0 microversion: 2.26 time: 0.204977 Jul 01 10:39:29.735058 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1600/3173] 10.222.0.23 () {60 vars in 1363 bytes} [Fri Jul 1 10:39:29 2022] DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-1258577280 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:29.740562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:29.741568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:29.749992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.752762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.752762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.752762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.777811 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Cannot 'pause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state paused Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action HTTP/1.1 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 13 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: {"pause": {}} Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: exception: Cannot 'pause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state paused Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'pause': {}}} Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 in vm_state paused. Cannot pause while the instance is in this state. Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state paused Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:29.779993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state paused Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 409 to user: Cannot 'pause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state paused {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3259c77f-1750-457b-a71f-51f5b34c971f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 409 len: 143 microversion: 2.1 time: 0.045771 Jul 01 10:39:29.787745 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1601/3174] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:29 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 143 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:39:29.791000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48dda210-ea27-45ff-8c63-6079a843a006 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f921379d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:29.800261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48dda210-ea27-45ff-8c63-6079a843a006 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.801092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48dda210-ea27-45ff-8c63-6079a843a006 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.811544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-48dda210-ea27-45ff-8c63-6079a843a006 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 200 len: 12 microversion: 2.26 time: 0.024374 Jul 01 10:39:29.812321 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1602/3175] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:39:29 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 12 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:29.816944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2f0096b-5fd5-4a30-8c87-10c34e7f3b74 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:29.817454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f2f0096b-5fd5-4a30-8c87-10c34e7f3b74 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:29.824311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2f0096b-5fd5-4a30-8c87-10c34e7f3b74 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.825650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2f0096b-5fd5-4a30-8c87-10c34e7f3b74 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.825650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2f0096b-5fd5-4a30-8c87-10c34e7f3b74 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.826036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2f0096b-5fd5-4a30-8c87-10c34e7f3b74 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.874370 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07a83507-a492-4c96-b1c2-2684625f3243 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.097478 Jul 01 10:39:29.879046 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1574/3176] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:39:29.885015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f96efc160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:29.893540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.898105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.898105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:29.931275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.932507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.942284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.945865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:29.984956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:29.988291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.012838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:30.043410 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03aba812-2720-4a3a-8620-f7a28f497479 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 204 len: 0 microversion: 2.26 time: 0.162914 Jul 01 10:39:30.044051 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1575/3177] 10.222.0.23 () {60 vars in 1294 bytes} [Fri Jul 1 10:39:29 2022] DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:30.058930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:30.059327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:30.063666 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:30.068682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.072421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.072421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.072421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.104277 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2f0096b-5fd5-4a30-8c87-10c34e7f3b74 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 202 len: 0 microversion: 2.1 time: 0.290738 Jul 01 10:39:30.105328 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1603/3178] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:29 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:39:30.127958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10b79107-7e0d-4e00-9dab-c4fa4628dcb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:30.129687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10b79107-7e0d-4e00-9dab-c4fa4628dcb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:30.301346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10b79107-7e0d-4e00-9dab-c4fa4628dcb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:30.308579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10b79107-7e0d-4e00-9dab-c4fa4628dcb0 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1214 microversion: 2.1 time: 0.202141 Jul 01 10:39:30.313790 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1604/3179] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:30 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:30.315110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f9249d820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:30.324018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.324460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.324936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:30.334957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.335611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.336399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.337321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.375561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.376256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.404461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.405560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.514101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:30.520980 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:30.528764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:30.538152 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66579f55-13d8-4874-a2e1-e66615d57a84 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1668 microversion: 2.1 time: 0.484146 Jul 01 10:39:30.549051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef62ea6d-a0f4-4271-a2d2-e13f89022ad9 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-73989873" status: 201 len: 0 microversion: 2.26 time: 0.238780 Jul 01 10:39:30.549315 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1576/3180] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:30 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1668 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:30.552005 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1605/3181] 10.222.0.23 () {62 vars in 1373 bytes} [Fri Jul 1 10:39:30 2022] PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-73989873 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Jul 01 10:39:30.559743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:30.559743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:30.563900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:30.564811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:30.568215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.568678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.569523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.569966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.575135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.575589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:30.576374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:30.576810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.266638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:31.273099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:31.275239 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-632611f1-16d2-4237-85c9-83228f34e47a tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.721905 Jul 01 10:39:31.275933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1606/3182] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:30 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:31.281491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f97040310>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:31.287845 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e9eb86b2-42c6-4d89-8b87-36d025dcff9a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1498 microversion: 2.1 time: 0.735830 Jul 01 10:39:31.288522 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1577/3183] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:30 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1498 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:31.290811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.291682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.292403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:31.300002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.300551 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.301385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9a65da97-e2fb-40c4-96d5-d38720bbd3bb req-7ada9bbd-b813-4bfb-808c-ebba5a371642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc378ab-395f-4871-b6eb-bcac4ddfcfcc", "tag": "906acb93-d3df-4172-9bd4-2c6bedb7688c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:31.306329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.306329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.314748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9a65da97-e2fb-40c4-96d5-d38720bbd3bb req-7ada9bbd-b813-4bfb-808c-ebba5a371642 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.315251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9a65da97-e2fb-40c4-96d5-d38720bbd3bb req-7ada9bbd-b813-4bfb-808c-ebba5a371642 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.334474 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9a65da97-e2fb-40c4-96d5-d38720bbd3bb req-7ada9bbd-b813-4bfb-808c-ebba5a371642 service nova] Creating event network-changed:906acb93-d3df-4172-9bd4-2c6bedb7688c for instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc on n-h1-master-1 Jul 01 10:39:31.335117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.335970 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.340558 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9a65da97-e2fb-40c4-96d5-d38720bbd3bb req-7ada9bbd-b813-4bfb-808c-ebba5a371642 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050105 Jul 01 10:39:31.341511 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1578/3184] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:31.348166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:31.349105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.349875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.351169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:31.397332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.397332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.397332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.397332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.462023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:31.480218 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2adb0fb-b36e-4ddf-9e0b-e364ac3179ea tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-123691072" status: 201 len: 0 microversion: 2.26 time: 0.202980 Jul 01 10:39:31.480892 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1607/3185] 10.222.0.23 () {62 vars in 1376 bytes} [Fri Jul 1 10:39:31 2022] PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-123691072 => generated 0 bytes in 204 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 01 10:39:31.495477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5a986ad2-b5f9-4a95-87f0-a77fc2099536 req-b2391a54-54f8-49f9-9bd2-db9c5d9d8a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b9bf7d-caf3-4001-9f5b-46c1a824e25c", "tag": "c4e05dac-ef03-4689-8dff-d2a5ca558414"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:31.515915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5a986ad2-b5f9-4a95-87f0-a77fc2099536 req-b2391a54-54f8-49f9-9bd2-db9c5d9d8a1b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.516365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5a986ad2-b5f9-4a95-87f0-a77fc2099536 req-b2391a54-54f8-49f9-9bd2-db9c5d9d8a1b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.540081 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5a986ad2-b5f9-4a95-87f0-a77fc2099536 req-b2391a54-54f8-49f9-9bd2-db9c5d9d8a1b service nova] Creating event network-changed:c4e05dac-ef03-4689-8dff-d2a5ca558414 for instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c on n-h1-master-1 Jul 01 10:39:31.546521 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5a986ad2-b5f9-4a95-87f0-a77fc2099536 req-b2391a54-54f8-49f9-9bd2-db9c5d9d8a1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062766 Jul 01 10:39:31.547694 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1608/3186] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:31.553538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f9249d670>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:31.565424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.566884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.567808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:31.577975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.578432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.579232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.579670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.605015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.606139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.620067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:31.630665 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d17dcb9b-8d90-4fcc-8cbb-13c8bae48834 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1218 microversion: 2.1 time: 0.287583 Jul 01 10:39:31.631675 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1579/3187] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:31 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1218 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:31.644598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:31.645494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:31.663854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.671083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.671083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.671083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.699409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:31.740418 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c32d144-0ab0-4cde-b41f-ae863ac1eb0d tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 204 len: 0 microversion: 2.26 time: 0.191296 Jul 01 10:39:31.741890 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1609/3188] 10.222.0.23 () {60 vars in 1294 bytes} [Fri Jul 1 10:39:31 2022] DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:31.765740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f0b4267-7564-4ba9-a9d0-05675f8f4cdc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f92291430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:31.790578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f0b4267-7564-4ba9-a9d0-05675f8f4cdc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.791301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f0b4267-7564-4ba9-a9d0-05675f8f4cdc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.805051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f0b4267-7564-4ba9-a9d0-05675f8f4cdc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 200 len: 12 microversion: 2.26 time: 0.058022 Jul 01 10:39:31.806260 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1610/3189] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:39:31 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:31.817390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f97040e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:31.827825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.829094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.829094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:31.831748 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:31.836330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.836785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.837593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.838091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.866589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.867047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.883268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:31.902146 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e4ff0dd1-19ee-4559-b953-f39bc1ffb766 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 204 len: 0 microversion: 2.26 time: 0.088868 Jul 01 10:39:31.905079 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1611/3190] 10.222.0.23 () {60 vars in 1294 bytes} [Fri Jul 1 10:39:31 2022] DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:31.914614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f92291c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:31.923684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.924137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.924647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:31.931138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.931588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.936240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.936240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.959979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.964697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.969350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:31.969807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:31.988747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:31.996498 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1220289a-2f88-42df-89ad-d2989c27f67a tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.363678 Jul 01 10:39:31.997078 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1580/3191] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:31 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:32.013599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:32.014271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:32.021305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.021757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.022518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.022949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.046416 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:32.062757 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-339ecd1f-f58e-4c87-ac82-417453a29379 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-1767408239" status: 201 len: 0 microversion: 2.26 time: 0.152912 Jul 01 10:39:32.063413 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1612/3192] 10.222.0.23 () {62 vars in 1379 bytes} [Fri Jul 1 10:39:31 2022] PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-1767408239 => generated 0 bytes in 154 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 01 10:39:32.072662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f970405e0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:32.081880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.082336 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.082820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:32.089255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.089709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.090462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.090996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.114018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.114407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.123684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.124663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.225566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:32.235435 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2a504bf-1129-4fc4-8882-44272b53af67 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1671 microversion: 2.1 time: 0.225864 Jul 01 10:39:32.244029 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1581/3193] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:32 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:32.244169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:32.253835 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d805a908-be62-480e-be41-ebc67ba0becc tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-979153357" status: 201 len: 0 microversion: 2.26 time: 0.184920 Jul 01 10:39:32.254063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:32.254533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:32.255473 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1613/3194] 10.222.0.23 () {62 vars in 1376 bytes} [Fri Jul 1 10:39:32 2022] PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags/tempest-tag-979153357 => generated 0 bytes in 187 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 01 10:39:32.261622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.262288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.263307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.263908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.266725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Action: 'update_all', calling method: .version_select at 0x7f6f97040280>, body: {"tags": ["tempest-tag-1524446511", "tempest-tag-845630019"]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:32.286567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.286567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.286567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:32.303216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.306698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.308965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:32.309786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.310248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.319300 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.api [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Working on deleting snapshot fbc7d5c5-d2f4-4655-8a75-90267bd03e79 from shelved instance... Jul 01 10:39:32.347716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.349127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.434827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:32.457426 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c69d82de-9445-4756-9b2f-3a9ee2ad007c tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 200 len: 61 microversion: 2.26 time: 0.195731 Jul 01 10:39:32.472569 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1614/3195] 10.222.0.23 () {62 vars in 1311 bytes} [Fri Jul 1 10:39:32 2022] PUT /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 61 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:32.481236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:32.483321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:32.494040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.494487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.495306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.495807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.804467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:32.815522 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-245c769e-6968-481b-84d7-7d4265d5b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.341183 Jul 01 10:39:32.825054 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1615/3196] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:32 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:32.825054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:32.825054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:32.828335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.828782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:32.829599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:32.830026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.135673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:33.146837 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e5341f4-09e7-437a-9da4-063712279b15 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.329072 Jul 01 10:39:33.151701 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1616/3197] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:32 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:33.153372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c40acd28-25cb-4343-b2cf-e325be21d790 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f96fa0670>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:33.162650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c40acd28-25cb-4343-b2cf-e325be21d790 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.163187 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c40acd28-25cb-4343-b2cf-e325be21d790 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.174117 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c40acd28-25cb-4343-b2cf-e325be21d790 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 200 len: 61 microversion: 2.26 time: 0.024903 Jul 01 10:39:33.175062 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1617/3198] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Jul 1 10:39:33 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 61 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:33.179703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:33.188937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:33.191591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.192251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.193097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.193661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-431688c1-78f4-4754-8743-ac2474f87c77 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1272 microversion: 2.1 time: 0.132430 Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1618/3199] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:33 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.330881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.554822 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:33.652395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:33.660943 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e69fb502-2a03-4620-9f9f-914d0c78c666 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.350538 Jul 01 10:39:33.661818 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1619/3200] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:33 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:33.671069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '.version_select at 0x7f6f92604e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:33.680420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.681139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.681809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:33.688773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.689245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.690003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.690435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.712962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.713438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.762266 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:33.838936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'flavor' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:33.849465 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bfff329f-35a5-489a-ac7f-889b4a1254e1 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags" status: 204 len: 0 microversion: 2.26 time: 0.186256 Jul 01 10:39:33.850122 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1620/3201] 10.222.0.23 () {60 vars in 1294 bytes} [Fri Jul 1 10:39:33 2022] DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a/tags => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:33.854765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2b7fad81-7449-473a-bb90-b27cfaf88156 req-2054de38-10b7-460c-884e-07125c429cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35008ac8-b20d-453b-9446-3d459f330baf", "tag": "715c9bfd-bbc8-4175-92b8-3aa85ccacbe9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:33.874668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Doing local delete in cell dfe0d2a4-39ae-4976-badb-e47e9e297f2f(cell1) {{(pid=119765) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 01 10:39:33.875806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.876653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.879118 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.api [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 01 10:39:33.882616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2b7fad81-7449-473a-bb90-b27cfaf88156 req-2054de38-10b7-460c-884e-07125c429cc3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.883125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2b7fad81-7449-473a-bb90-b27cfaf88156 req-2054de38-10b7-460c-884e-07125c429cc3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.885025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] deallocate_for_instance() {{(pid=119765) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 01 10:39:33.896073 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2b7fad81-7449-473a-bb90-b27cfaf88156 req-2054de38-10b7-460c-884e-07125c429cc3 service nova] Creating event network-changed:715c9bfd-bbc8-4175-92b8-3aa85ccacbe9 for instance 35008ac8-b20d-453b-9446-3d459f330baf on n-h2-master-1 Jul 01 10:39:33.901888 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2b7fad81-7449-473a-bb90-b27cfaf88156 req-2054de38-10b7-460c-884e-07125c429cc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049811 Jul 01 10:39:33.901888 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1621/3202] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:33.907526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:33.908612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:33.917308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.918031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.918896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.919410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.937074 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492/action HTTP/1.1 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 28 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: {"reboot": {"type": "SOFT"}} Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '76313d67-6ebf-4f72-af57-70281a063492', 'body': {'reboot': {'type': 'SOFT'}}} Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:33.940184 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d6e8a4f-edc0-433e-bf9b-35f1259ab11f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492/action" status: 404 len: 111 microversion: 2.1 time: 0.038467 Jul 01 10:39:33.944721 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1622/3203] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:33 2022] POST /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:33.953594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:33.960131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:33.961891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.962444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:33.963316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:33.963826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:34.214800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:34.222763 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-32114b19-fa17-4ae4-bb54-ddd49682af94 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.278028 Jul 01 10:39:34.232407 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1623/3204] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:33 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:34.232407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:34.232407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:34.237653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:34.238103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:34.238876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:34.239309 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:34.265931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:34.665350 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f9f7ef5e-af21-4848-b527-16bd94e8bc8b tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 204 len: 0 microversion: 2.26 time: 0.440674 Jul 01 10:39:34.672715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1624/3205] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:39:34 2022] DELETE /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:39:34.683842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:34.684855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:34.692605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:34.693050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:34.694046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:34.694479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:34.750601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Updating instance_info_cache with network_info: [] {{(pid=119765) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 01 10:39:34.965259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:34.981006 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33bb7ac8-f910-4f5d-bc34-df57cdb2fcbd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.306762 Jul 01 10:39:34.986153 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1625/3206] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:34 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:34.994451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:34.994451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:34.996844 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:34.997337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:34.998124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:34.999464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.223133 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b37babb4-6f7a-41c5-8d24-5f795edc2429 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 204 len: 0 microversion: 2.1 time: 2.974254 Jul 01 10:39:35.224354 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1582/3207] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:32 2022] DELETE /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 0 bytes in 2976 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:39:35.234623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:35.235546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:35.243537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.253368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.253368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.253368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.540901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:35.543047 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bec5705e-29cc-4b30-a4b6-6a9959a5fb84 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.560105 Jul 01 10:39:35.543628 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1626/3208] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:34 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:35.557734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:35.558345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:35.564217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.564671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.565469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.565904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.596394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:35.610889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:35.612980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:35.614306 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17e50243-7a4c-4138-94ea-8b6f19f97b67 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1551 microversion: 2.26 time: 0.388615 Jul 01 10:39:35.638769 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1583/3209] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:35 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1551 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:35.642573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:35.643352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebcfc56f-d6db-4c21-b1df-bb7fa078d352] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:35.649418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.649913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.650722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.651165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.665877 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] HTTP exception thrown: Instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 could not be found. Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Request method failure captured: Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 HTTP/1.1 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszjVKMte_ts7Jv-cDXMyjEhSnWz4wS387Uwsvp-vYY217jOuWA3zd3eYQwA0Rdq-dIzXtVGejeSrtv9BFzN-ilT4kjM3B3cvV2_OtGIFVGLYEr3XxTz7dW8aIY0qr29FrYLv9cAbipRXnW_Yk7WImY61dlPvgqjsTiGaAS2IAYFNw4 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb942eeb3788403687ba800c070babd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb942eeb3788403687ba800c070babd5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: adf336817b04429b930e1f80ea25b1f7 Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: exception: Instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 could not be found. Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ebcfc56f-d6db-4c21-b1df-bb7fa078d352'} Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 could not be found. Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 could not be found. Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:35.667575 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:35.672814 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:35.672814 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:35.672814 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:35.672814 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:35.672814 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:35.672814 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 could not be found. Jul 01 10:39:35.672814 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:35.674171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Returning 404 to user: Instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:35.675226 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a3291cf0-4712-40bb-a4f5-c6c9238f517b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352" status: 404 len: 111 microversion: 2.1 time: 0.036813 Jul 01 10:39:35.676221 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1584/3210] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:35 2022] GET /compute/v2.1/servers/ebcfc56f-d6db-4c21-b1df-bb7fa078d352 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:35.681223 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:35.681858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:35.697616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.698329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.699279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.699873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.875521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:35.883963 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8a4899b7-9c24-47d7-9c3c-2e8adcc7aff2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.330132 Jul 01 10:39:35.884633 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1627/3211] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:35 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:35.890135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:35.890998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:35.904583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.907296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.907296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:35.907296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:35.938366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:36.051276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.060527 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3b7c8765-312b-404c-bece-705c0179c7c0 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.382597 Jul 01 10:39:36.071237 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1585/3212] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:35 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:36.077175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0ac5e4a-3ca9-49c2-8159-f2e22105c4c6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:36.078427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b0ac5e4a-3ca9-49c2-8159-f2e22105c4c6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: ff9c0580-7d80-42d0-90de-95b0d41be82f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.084318 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b0ac5e4a-3ca9-49c2-8159-f2e22105c4c6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance ff9c0580-7d80-42d0-90de-95b0d41be82f could not be found. Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0ac5e4a-3ca9-49c2-8159-f2e22105c4c6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/ff9c0580-7d80-42d0-90de-95b0d41be82f/action HTTP/1.1 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 28 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: {"reboot": {"type": "SOFT"}} Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: exception: Instance ff9c0580-7d80-42d0-90de-95b0d41be82f could not be found. Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ff9c0580-7d80-42d0-90de-95b0d41be82f', 'body': {'reboot': {'type': 'SOFT'}}} Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9c0580-7d80-42d0-90de-95b0d41be82f could not be found. Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9c0580-7d80-42d0-90de-95b0d41be82f could not be found. Jul 01 10:39:36.086486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9c0580-7d80-42d0-90de-95b0d41be82f could not be found. Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0ac5e4a-3ca9-49c2-8159-f2e22105c4c6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance ff9c0580-7d80-42d0-90de-95b0d41be82f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b0ac5e4a-3ca9-49c2-8159-f2e22105c4c6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/ff9c0580-7d80-42d0-90de-95b0d41be82f/action" status: 404 len: 111 microversion: 2.1 time: 0.015799 Jul 01 10:39:36.091088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1586/3213] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:36 2022] POST /compute/v2.1/servers/ff9c0580-7d80-42d0-90de-95b0d41be82f/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:36.097639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-fa075c6b-e577-4396-9395-ed79869f059c req-1d118d76-ec7b-4492-8f83-5172dc8f4520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcfc56f-d6db-4c21-b1df-bb7fa078d352", "name": "network-vif-deleted", "tag": "9ed0e231-ab89-424a-bbba-a8d260b6e617"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:36.107787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fa075c6b-e577-4396-9395-ed79869f059c req-1d118d76-ec7b-4492-8f83-5172dc8f4520 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.114105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fa075c6b-e577-4396-9395-ed79869f059c req-1d118d76-ec7b-4492-8f83-5172dc8f4520 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.123270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.compute.server_external_events [req-fa075c6b-e577-4396-9395-ed79869f059c req-1d118d76-ec7b-4492-8f83-5172dc8f4520 service nova] Unable to find a host for instance ebcfc56f-d6db-4c21-b1df-bb7fa078d352. Dropping event network-vif-deleted {{(pid=119765) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 10:39:36.124180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-fa075c6b-e577-4396-9395-ed79869f059c req-1d118d76-ec7b-4492-8f83-5172dc8f4520 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030138 Jul 01 10:39:36.125139 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1587/3214] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 10:39:36.131450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:36.133292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.141956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.148577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.148577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.148577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.328474 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ed5096e-36cd-4b27-9b28-b2da4f103ad8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 204 len: 0 microversion: 2.1 time: 0.440691 Jul 01 10:39:36.339138 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1628/3215] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:35 2022] DELETE /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:39:36.346524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:36.347421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.356199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.356645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.357603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.358350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.402757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.412189 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c566960d-df1d-4c96-abd1-203b1a3b1374 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.286001 Jul 01 10:39:36.412794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1588/3216] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:36 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:36.429565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:36.430188 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.437325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.438070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.439157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.439654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.459232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.475112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e5588fc-9d2c-4259-a170-fcbe78f3db28 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1466 microversion: 2.1 time: 0.133700 Jul 01 10:39:36.475701 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1629/3217] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:36 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1466 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:36.560043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:36.560950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.567209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.567893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.568872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.569358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.591058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.599773 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1baa1cbb-67f7-4e59-8a7f-84e5f02bf1ec tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.174016 Jul 01 10:39:36.600362 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1589/3218] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:36 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:36.616485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:36.618288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.626155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.626829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.627767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.628345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.650136 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492/action HTTP/1.1 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 65 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '76313d67-6ebf-4f72-af57-70281a063492', 'body': {'rebuild': {'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e'}}} Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 01 10:39:36.652001 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-701650e3-b1e5-44bb-82da-2a2026792363 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492/action" status: 404 len: 111 microversion: 2.1 time: 0.040930 Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1590/3219] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:36 2022] POST /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:36.661754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.667036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.667367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.668285 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.668661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.765744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.770145 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:36.774449 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4da3ce2-1475-4fbf-beea-95374eab42c6 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.218525 Jul 01 10:39:36.775027 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1630/3220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:36 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:36.786727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:36.786727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.787074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.787384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.788199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.788631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.837781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.846819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.848341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.849534 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a27d640a-7fcf-4697-89a1-5e9f0d44265f tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1551 microversion: 2.26 time: 0.194413 Jul 01 10:39:36.850103 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1591/3221] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:36 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1551 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:36.922314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:36.929622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cfab457c-e946-4265-87f8-8d8785d40611 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.153579 Jul 01 10:39:36.930219 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1631/3222] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:36 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:36.946942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:36.947706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:36.954271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.954711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:36.955458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:36.955886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.078006 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:37.078618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.084839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.085320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.086083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.086511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.090754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:37.098274 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef1d141e-f1b5-46be-88a1-6825e02b5312 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.155478 Jul 01 10:39:37.098854 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1592/3223] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:36 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:37.115185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47628076-8625-4f58-91fb-b685be86255a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:37.116536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47628076-8625-4f58-91fb-b685be86255a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 86ae2682-5918-48c2-a61b-028d009d9773] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.122169 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-47628076-8625-4f58-91fb-b685be86255a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 86ae2682-5918-48c2-a61b-028d009d9773 could not be found. Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47628076-8625-4f58-91fb-b685be86255a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/86ae2682-5918-48c2-a61b-028d009d9773/action HTTP/1.1 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 65 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 86ae2682-5918-48c2-a61b-028d009d9773 could not be found. Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '86ae2682-5918-48c2-a61b-028d009d9773', 'body': {'rebuild': {'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e'}}} Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ae2682-5918-48c2-a61b-028d009d9773 could not be found. Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 01 10:39:37.123847 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ae2682-5918-48c2-a61b-028d009d9773 could not be found. Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ae2682-5918-48c2-a61b-028d009d9773 could not be found. Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47628076-8625-4f58-91fb-b685be86255a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 86ae2682-5918-48c2-a61b-028d009d9773 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47628076-8625-4f58-91fb-b685be86255a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/86ae2682-5918-48c2-a61b-028d009d9773/action" status: 404 len: 111 microversion: 2.1 time: 0.014525 Jul 01 10:39:37.129445 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1593/3224] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:37 2022] POST /compute/v2.1/servers/86ae2682-5918-48c2-a61b-028d009d9773/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:37.133951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:37.134563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.142017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.142466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.143232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.143669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.275945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:37.283627 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a154643-4923-4698-b5a6-c94f7be0ca42 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.209660 Jul 01 10:39:37.284219 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1632/3225] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:37 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:37.302170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:37.310099 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e743a94-360d-498e-abfe-d1c5931bfdc7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.179755 Jul 01 10:39:37.310647 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1594/3226] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:37 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:37.328084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:37.328690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.334651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.335093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.335842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.336279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.493780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:37.494323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.501862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.502434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.503860 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.504390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.562199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:37.569798 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87bbccd7-3f9d-42f7-a401-ad7fa9430ecb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.246236 Jul 01 10:39:37.570378 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1633/3227] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:37 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:37.586540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ce8d59d-5d93-4284-85e5-db6a5f2a2cd8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:37.587159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3ce8d59d-5d93-4284-85e5-db6a5f2a2cd8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 56a99e0c-077b-456d-af38-a775a47389e3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.592579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3ce8d59d-5d93-4284-85e5-db6a5f2a2cd8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 56a99e0c-077b-456d-af38-a775a47389e3 could not be found. Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ce8d59d-5d93-4284-85e5-db6a5f2a2cd8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/56a99e0c-077b-456d-af38-a775a47389e3/action HTTP/1.1 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 15 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: {"restore": {}} Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 56a99e0c-077b-456d-af38-a775a47389e3 could not be found. Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '56a99e0c-077b-456d-af38-a775a47389e3', 'body': {'restore': {}}} Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56a99e0c-077b-456d-af38-a775a47389e3 could not be found. Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56a99e0c-077b-456d-af38-a775a47389e3 could not be found. Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:37.594239 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:37.602306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:37.602306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:37.602306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56a99e0c-077b-456d-af38-a775a47389e3 could not be found. Jul 01 10:39:37.602306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:37.602306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ce8d59d-5d93-4284-85e5-db6a5f2a2cd8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 56a99e0c-077b-456d-af38-a775a47389e3 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:37.602306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ce8d59d-5d93-4284-85e5-db6a5f2a2cd8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/56a99e0c-077b-456d-af38-a775a47389e3/action" status: 404 len: 111 microversion: 2.1 time: 0.012792 Jul 01 10:39:37.602306 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1634/3228] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:37 2022] POST /compute/v2.1/servers/56a99e0c-077b-456d-af38-a775a47389e3/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:37.604351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:37.604958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.614355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.614801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.615579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.616007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.707042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:37.715261 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13a8d48f-1f45-4fa0-9e6f-1cbdc73b0887 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1466 microversion: 2.1 time: 0.225878 Jul 01 10:39:37.715980 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1595/3229] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:37 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1466 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:37.793883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:37.794788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:37.802879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.803333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:37.804115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:37.804732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.064509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.072978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab775973-e9f2-43dd-b85a-890a48f61909 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.472146 Jul 01 10:39:38.073776 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1635/3230] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:37 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:38.079870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:38.080840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:38.092178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.093013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.095036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.095036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.244881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.254591 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9628d090-616f-484c-a614-c165bf8f3df5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.465008 Jul 01 10:39:38.266188 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1596/3231] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:37 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:38.270727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:38.271631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:38.278298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.278829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.279714 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.280563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.301538 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:38.484450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.494596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.497113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.498583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e8d3b3c-6b30-4068-972f-e78f195e5018 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1551 microversion: 2.26 time: 0.423627 Jul 01 10:39:38.499971 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1636/3232] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:38 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1551 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:38.518571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d4520732-5d1a-4cce-84d5-f2057bebddef req-42234c65-b1e6-46c9-bd11-2293508d8366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3357ec0a-9b18-46fc-b756-a6519b03eae5", "tag": "b1f1083c-37e7-4577-8190-c5e6a5aaf376"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:38.527644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d4520732-5d1a-4cce-84d5-f2057bebddef req-42234c65-b1e6-46c9-bd11-2293508d8366 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.528083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d4520732-5d1a-4cce-84d5-f2057bebddef req-42234c65-b1e6-46c9-bd11-2293508d8366 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.540161 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d4520732-5d1a-4cce-84d5-f2057bebddef req-42234c65-b1e6-46c9-bd11-2293508d8366 service nova] Creating event network-changed:b1f1083c-37e7-4577-8190-c5e6a5aaf376 for instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 on n-h2-master-1 Jul 01 10:39:38.545318 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d4520732-5d1a-4cce-84d5-f2057bebddef req-42234c65-b1e6-46c9-bd11-2293508d8366 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033300 Jul 01 10:39:38.546672 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1637/3233] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:38.551762 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:38.552440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:38.558983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.559431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.560197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.560628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.610249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.617984 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71d250fc-59e0-44d4-b665-c0babb6463b0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.351305 Jul 01 10:39:38.635045 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1597/3234] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:38 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:38.640366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-dfa2bd34-8ee9-48c7-8358-2ee999008c5f req-597da34d-947b-414f-8d22-b89bdd8ca0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35008ac8-b20d-453b-9446-3d459f330baf", "name": "network-vif-plugged", "status": "completed", "tag": "715c9bfd-bbc8-4175-92b8-3aa85ccacbe9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:38.651606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dfa2bd34-8ee9-48c7-8358-2ee999008c5f req-597da34d-947b-414f-8d22-b89bdd8ca0b1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.652958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dfa2bd34-8ee9-48c7-8358-2ee999008c5f req-597da34d-947b-414f-8d22-b89bdd8ca0b1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.669107 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-dfa2bd34-8ee9-48c7-8358-2ee999008c5f req-597da34d-947b-414f-8d22-b89bdd8ca0b1 service nova] Creating event network-vif-plugged:715c9bfd-bbc8-4175-92b8-3aa85ccacbe9 for instance 35008ac8-b20d-453b-9446-3d459f330baf on n-h2-master-1 Jul 01 10:39:38.675015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-dfa2bd34-8ee9-48c7-8358-2ee999008c5f req-597da34d-947b-414f-8d22-b89bdd8ca0b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041585 Jul 01 10:39:38.676821 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1598/3235] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:38.687722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:38.688485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:38.697871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.699051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.700106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.700932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.740250 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Cannot 'restore' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action HTTP/1.1 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 15 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: {"restore": {}} Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'restore' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'restore': {}}} Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 in vm_state active. Cannot restore while the instance is in this state. Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:38.743179 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 409 to user: Cannot 'restore' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a4031d9-dd94-42bf-b4da-a9031fb60388 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 409 len: 145 microversion: 2.1 time: 0.065366 Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1599/3236] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:38 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:39:38.758516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:38.760787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:38.768927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.769776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.771073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.771878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.912695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.916540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:38.920676 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eedf4286-d784-4e34-b8a6-ab8520946bc7 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1466 microversion: 2.1 time: 0.172712 Jul 01 10:39:38.930563 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1600/3237] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:38 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1466 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:38.930762 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c54dd0cd-fe3d-4aa9-8943-5cf5177efada tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.377192 Jul 01 10:39:38.930762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1638/3238] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:38 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:38.930960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:38.930960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:38.934022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.934495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:38.935248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:38.935676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.221846 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:39.231317 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-defd4e4a-ef24-4402-9e44-b60772e5adab tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.308142 Jul 01 10:39:39.235048 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1601/3239] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:38 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:39.255368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:39.256673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:39.267101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.267749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.269351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.270010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.272036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:39.272654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:39.279798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.280893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.281713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.282918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.588667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:39.592907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:39.596384 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-18219280-a091-4a0d-ab7b-0892c401f770 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.328345 Jul 01 10:39:39.597274 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1602/3240] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:39 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:39.601684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:39.602244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:39.604323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-830638ab-7b0a-41d9-b0ed-9a2707ba3c5e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.353538 Jul 01 10:39:39.605563 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1639/3241] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:39 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:39.609023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.609023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.609887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.610332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.624951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff0d1181-8e89-4158-9e12-549aa0926ed1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:39.625774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ff0d1181-8e89-4158-9e12-549aa0926ed1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: feb68667-ee5f-4173-8093-16f9ab3f0026] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:39.631564 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ff0d1181-8e89-4158-9e12-549aa0926ed1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance feb68667-ee5f-4173-8093-16f9ab3f0026 could not be found. Jul 01 10:39:39.638028 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff0d1181-8e89-4158-9e12-549aa0926ed1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/feb68667-ee5f-4173-8093-16f9ab3f0026/action HTTP/1.1 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 14 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: {"resume": {}} Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: exception: Instance feb68667-ee5f-4173-8093-16f9ab3f0026 could not be found. Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'feb68667-ee5f-4173-8093-16f9ab3f0026', 'body': {'resume': {}}} Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb68667-ee5f-4173-8093-16f9ab3f0026 could not be found. Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb68667-ee5f-4173-8093-16f9ab3f0026 could not be found. Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:39.638218 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:39.644824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:39.644824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:39.644824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb68667-ee5f-4173-8093-16f9ab3f0026 could not be found. Jul 01 10:39:39.644824 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:39.644824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff0d1181-8e89-4158-9e12-549aa0926ed1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance feb68667-ee5f-4173-8093-16f9ab3f0026 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:39.644824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ff0d1181-8e89-4158-9e12-549aa0926ed1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/feb68667-ee5f-4173-8093-16f9ab3f0026/action" status: 404 len: 111 microversion: 2.1 time: 0.018970 Jul 01 10:39:39.644824 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1640/3242] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:39 2022] POST /compute/v2.1/servers/feb68667-ee5f-4173-8093-16f9ab3f0026/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:39.648617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:39.649408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:39.652265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.652448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.653361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'fault' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:39.656456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.657031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.657835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.658357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.665709 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:39.698992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:39.708071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:39.709481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:39.710675 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-34ac7719-ef55-4db7-9c9b-6f8858753402 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1351 microversion: 2.26 time: 0.112586 Jul 01 10:39:39.711237 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1603/3243] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:39 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:39.829351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:39.836908 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5862db35-5541-402e-a3a2-bf0023aebc95 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.192079 Jul 01 10:39:39.837504 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1641/3244] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:39 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:39.854763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:39.855383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:39.864197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.864648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.865436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.865878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.938841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:39.939753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:39.953559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.954315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.955314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.955959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.991573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:39.992490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:39.992947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lazy-loading 'fault' on Instance uuid 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:40.006709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:40.019822 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d1008cc-7ae2-4414-9ba9-caf4b43c017c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.168969 Jul 01 10:39:40.032199 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1604/3245] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:39 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:40.032199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:40.032199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:40.037769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.038223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.039007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.039446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.301353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:40.306953 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:40.310079 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1218e476-af21-46fd-8f98-860f46cf9fdd tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 200 len: 1305 microversion: 2.1 time: 0.375385 Jul 01 10:39:40.310669 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1642/3246] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:39 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 1305 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:40.315872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:40.316405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:40.322426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.322881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.327572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.327572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.347998 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Cannot 'resume' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action HTTP/1.1 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 14 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: {"resume": {}} Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: exception: Cannot 'resume' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'resume': {}}} Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 in vm_state active. Cannot resume while the instance is in this state. Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:40.349822 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 409 to user: Cannot 'resume' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-05b662e4-a3a4-4cda-9f7a-98deeb281740 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 409 len: 144 microversion: 2.1 time: 0.039259 Jul 01 10:39:40.362304 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1643/3247] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:40 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 144 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:39:40.366112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:40.366724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:40.372904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.373396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.374701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.375136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.454072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:40.462783 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7042a824-8f69-42eb-8803-3c4652ba413d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.441224 Jul 01 10:39:40.463436 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1605/3248] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:40 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:40.526976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:40.532968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-30119d1a-29db-48c9-83c8-b791a593b000 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.170462 Jul 01 10:39:40.533663 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1644/3249] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:40 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:40.564412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:40.565048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:40.573871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.574941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.575152 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.575624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.586568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-93354f04-9e81-483a-aa7d-4fad78d9f80e req-faa7f767-6264-46fd-b17b-745d47d84dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df79725-ee19-4975-8e3e-f5b12ed18e0a", "name": "network-vif-deleted", "tag": "fe0c2620-6ff5-4e35-b5d4-8c7e15297372"}, {"server_uuid": "2e4ce907-5b6b-4be2-acf0-53b68de91bb8", "name": "network-vif-deleted", "tag": "d99125af-b8e0-4479-bcac-52cca801f513"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:40.598131 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-93354f04-9e81-483a-aa7d-4fad78d9f80e req-faa7f767-6264-46fd-b17b-745d47d84dcd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.599489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-93354f04-9e81-483a-aa7d-4fad78d9f80e req-faa7f767-6264-46fd-b17b-745d47d84dcd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.617918 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-93354f04-9e81-483a-aa7d-4fad78d9f80e req-faa7f767-6264-46fd-b17b-745d47d84dcd service nova] Creating event network-vif-deleted:fe0c2620-6ff5-4e35-b5d4-8c7e15297372 for instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a on n-h2-master-1 Jul 01 10:39:40.624255 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-93354f04-9e81-483a-aa7d-4fad78d9f80e req-faa7f767-6264-46fd-b17b-745d47d84dcd service nova] Creating event network-vif-deleted:d99125af-b8e0-4479-bcac-52cca801f513 for instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 on n-h2-master-1 Jul 01 10:39:40.627283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-93354f04-9e81-483a-aa7d-4fad78d9f80e req-faa7f767-6264-46fd-b17b-745d47d84dcd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044989 Jul 01 10:39:40.629226 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1645/3250] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:40.635992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:40.637335 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:40.645480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.650330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.660921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.660921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.900275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:40.909102 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f4f630d-f792-4fb4-9511-6467c5934145 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.355911 Jul 01 10:39:40.909794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1606/3251] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:40 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:40.931626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:40.934423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2ca82bcb-15dd-424e-a366-5f0a7ad84a4b req-997656fc-b585-4fe0-b6b7-5cef215f2c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc378ab-395f-4871-b6eb-bcac4ddfcfcc", "name": "network-vif-plugged", "status": "completed", "tag": "906acb93-d3df-4172-9bd4-2c6bedb7688c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:40.942834 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-15efe050-05b1-44d0-ac58-517262467e14 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.310255 Jul 01 10:39:40.943755 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1646/3252] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:40 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:40.945983 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2ca82bcb-15dd-424e-a366-5f0a7ad84a4b req-997656fc-b585-4fe0-b6b7-5cef215f2c82 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.946627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2ca82bcb-15dd-424e-a366-5f0a7ad84a4b req-997656fc-b585-4fe0-b6b7-5cef215f2c82 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.948590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:40.950012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:40.956109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.956711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.957583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.958093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.964923 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2ca82bcb-15dd-424e-a366-5f0a7ad84a4b req-997656fc-b585-4fe0-b6b7-5cef215f2c82 service nova] Creating event network-vif-plugged:906acb93-d3df-4172-9bd4-2c6bedb7688c for instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc on n-h1-master-1 Jul 01 10:39:40.978449 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2ca82bcb-15dd-424e-a366-5f0a7ad84a4b req-997656fc-b585-4fe0-b6b7-5cef215f2c82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048926 Jul 01 10:39:40.979606 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1607/3253] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:40.997008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:40.997501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:40.998035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lazy-loading 'fault' on Instance uuid 0df79725-ee19-4975-8e3e-f5b12ed18e0a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:41.008995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-45004a2f-71e0-4439-8f04-a5aa86079b60 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-45004a2f-71e0-4439-8f04-a5aa86079b60 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 160 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "5cc96019-7f9a-4fe6-a8e5-4beaea1229fb"}]}} Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'networks': [{'uuid': '5cc96019-7f9a-4fe6-a8e5-4beaea1229fb'}]}}} Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '' Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:41.011487 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-45004a2f-71e0-4439-8f04-a5aa86079b60 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-45004a2f-71e0-4439-8f04-a5aa86079b60 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008500 Jul 01 10:39:41.016253 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1608/3254] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:39:41 2022] POST /compute/v2.1/servers => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:41.024928 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.026609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.036361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.036819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.037643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.038128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.052132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.063545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.065303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38371496afec4cb5acc0896286e3ca5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea48cb57e246bc95ec7f4a967951ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.067162 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-646f3b08-f967-44ff-849f-84845fea9d6e tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 200 len: 1351 microversion: 2.26 time: 0.122271 Jul 01 10:39:41.070056 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1647/3255] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:40 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:41.252596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.261198 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c32cb11-4f7e-4a68-bde5-4a6ffe3afc99 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.240528 Jul 01 10:39:41.261854 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1609/3256] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:41.278528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.279149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.286222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.286679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.287459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.287899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.335750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.336714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 2e4ce907-5b6b-4be2-acf0-53b68de91bb8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.343361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.343809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.344994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.344994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.359385 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] HTTP exception thrown: Instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 could not be found. Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Request method failure captured: Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 HTTP/1.1 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszjVKMte_ts7Jv-cDXMyjEhSnWz4wS387Uwsvp-vYY217jOuWA3zd3eYQwA0Rdq-dIzXtVGejeSrtv9BFzN-ilT4kjM3B3cvV2_OtGIFVGLYEr3XxTz7dW8aIY0qr29FrYLv9cAbipRXnW_Yk7WImY61dlPvgqjsTiGaAS2IAYFNw4 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb942eeb3788403687ba800c070babd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb942eeb3788403687ba800c070babd5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: adf336817b04429b930e1f80ea25b1f7 Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 could not be found. Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '2e4ce907-5b6b-4be2-acf0-53b68de91bb8'} Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 could not be found. Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 could not be found. Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:41.360953 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 could not be found. Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Returning 404 to user: Instance 2e4ce907-5b6b-4be2-acf0-53b68de91bb8 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-60ac2a69-06e7-4386-a60e-fa63773a071b tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8" status: 404 len: 111 microversion: 2.1 time: 0.030625 Jul 01 10:39:41.365774 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1610/3257] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/2e4ce907-5b6b-4be2-acf0-53b68de91bb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:41.371873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.373785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.379003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.379554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.380452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.380952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.411631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:41.432880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.440983 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3fba0008-c5d6-4767-9444-008baaac7871 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.166388 Jul 01 10:39:41.441608 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1648/3258] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:41.458290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0228dcc6-979c-43d2-afdd-6e8a452bb69c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:41.458788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0228dcc6-979c-43d2-afdd-6e8a452bb69c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 7b5a7b2b-939c-4920-ba6c-bc283f944fd6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.460729 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:41.465118 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-0228dcc6-979c-43d2-afdd-6e8a452bb69c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 7b5a7b2b-939c-4920-ba6c-bc283f944fd6 could not be found. Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0228dcc6-979c-43d2-afdd-6e8a452bb69c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/7b5a7b2b-939c-4920-ba6c-bc283f944fd6/action HTTP/1.1 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 14 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: {"shelve": {}} Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 7b5a7b2b-939c-4920-ba6c-bc283f944fd6 could not be found. Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '7b5a7b2b-939c-4920-ba6c-bc283f944fd6', 'body': {'shelve': {}}} Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5a7b2b-939c-4920-ba6c-bc283f944fd6 could not be found. Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5a7b2b-939c-4920-ba6c-bc283f944fd6 could not be found. Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:41.478185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:41.482872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:41.482872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:41.482872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5a7b2b-939c-4920-ba6c-bc283f944fd6 could not be found. Jul 01 10:39:41.482872 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:41.482872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0228dcc6-979c-43d2-afdd-6e8a452bb69c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 7b5a7b2b-939c-4920-ba6c-bc283f944fd6 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:41.482872 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0228dcc6-979c-43d2-afdd-6e8a452bb69c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5a7b2b-939c-4920-ba6c-bc283f944fd6/action" status: 404 len: 111 microversion: 2.1 time: 0.025390 Jul 01 10:39:41.482872 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1649/3259] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:41 2022] POST /compute/v2.1/servers/7b5a7b2b-939c-4920-ba6c-bc283f944fd6/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:41.484759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.485516 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.493915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.494366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.495153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.495644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.635566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.644961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62adb598-f6e5-4be4-976e-14f61ff4d378 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.163816 Jul 01 10:39:41.646330 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1650/3260] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:41.650478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.653587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.657842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.658287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.659038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.659468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.677137 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:41.726774 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a4f2a5b1-e33f-44e5-a10b-0e0590752074 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 204 len: 0 microversion: 2.1 time: 0.358929 Jul 01 10:39:41.727369 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1611/3261] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:41 2022] DELETE /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:39:41.735759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.736469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.742558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.743003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.743794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.744227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.800234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.808784 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a8ec777d-b0f0-4695-8fa0-0b596c12a812 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.161754 Jul 01 10:39:41.809399 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1651/3262] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:41.830788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.831323 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.837424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.837906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.838635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.839077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.921552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:41.939154 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aaa4dbca-d1ba-43bd-b340-7e742b7c8e78 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1509 microversion: 2.1 time: 0.207518 Jul 01 10:39:41.939751 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1612/3263] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:41.961586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:41.962218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:41.969125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.969596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.970508 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:41.970831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:41.997929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:42.006081 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9eb1c7fa-4ab7-4dd4-af7c-f1532c92d2a4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.179676 Jul 01 10:39:42.006869 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1652/3264] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:42.022437 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:42.023278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:42.032226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.032916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.033977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.034599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.060314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lazy-loading 'flavor' on Instance uuid 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:42.112317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:42.120640 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae9bd575-be90-4b45-904f-043341d7dff1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.162776 Jul 01 10:39:42.121600 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1613/3265] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:41 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:42.126804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:42.127413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] [instance: 0df79725-ee19-4975-8e3e-f5b12ed18e0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:42.134318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.136799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.136799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.136799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.151353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] HTTP exception thrown: Instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a could not be found. Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Request method failure captured: Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a HTTP/1.1 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs7Ho-crA0yIFJnxwK_w-Kw0Lk140GG5LGU3vTZd3K1C0M2WmaJvIGAQXHBUbZPFKvJvy2dRzDmNp6AkSR86DPSNBEwwZqTm2earja1nmn0HuLmEBpurp9CVGpUJmuH7W9JSEhBI-3ErhnnLI3SN_-nNPzEOrSv-JmqKNTDlzLq1VB4 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.26 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: feea48cb57e246bc95ec7f4a967951ed Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerTagsTestJSON-1571947417 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/feea48cb57e246bc95ec7f4a967951ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/feea48cb57e246bc95ec7f4a967951ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_feea48cb57e246bc95ec7f4a967951ed", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/feea48cb57e246bc95ec7f4a967951ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerTagsTestJSON-1571947417 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: feea48cb57e246bc95ec7f4a967951ed Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerTagsTestJSON-1571947417 Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerTagsTestJSON-1571947417-project Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 38371496afec4cb5acc0896286e3ca5f Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerTagsTestJSON-1571947417-project Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a could not be found. Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0df79725-ee19-4975-8e3e-f5b12ed18e0a'} Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a could not be found. Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a could not be found. Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:42.153041 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a could not be found. Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] Returning 404 to user: Instance 0df79725-ee19-4975-8e3e-f5b12ed18e0a could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c22a7c8-73c2-4e5a-b442-432fb86c6db0 tempest-ServerTagsTestJSON-1571947417 tempest-ServerTagsTestJSON-1571947417-project] 10.222.0.23 "GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a" status: 404 len: 111 microversion: 2.26 time: 0.034253 Jul 01 10:39:42.163255 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1614/3266] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:42 2022] GET /compute/v2.1/servers/0df79725-ee19-4975-8e3e-f5b12ed18e0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:42.650699 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-61447b9c-732a-477c-855c-2072608628c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 202 len: 0 microversion: 2.1 time: 0.631974 Jul 01 10:39:42.651577 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1653/3267] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:42 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:39:42.664679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:42.665231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:42.672148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:42.672532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.673003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.674023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.674465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.674828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:42.681884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.687346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.687346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.687346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.879918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:42.883508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:42.888286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-960b5e31-188f-407b-aa3a-8940dafc48c1 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1323 microversion: 2.1 time: 0.229465 Jul 01 10:39:42.888871 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1615/3268] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:42 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:42.892213 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cab6da15-8ca4-468d-87cb-8eae6d8c286f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.225583 Jul 01 10:39:42.892781 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1654/3269] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:42 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:42.956908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:42.957557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:42.963979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.964486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.965307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:42.965746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:42.970532 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:42.995545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-69092af2-97ae-456d-8112-a0d8a3eea7ad req-f94ef56d-e918-47ed-b5d7-a2ecfdd888d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b9bf7d-caf3-4001-9f5b-46c1a824e25c", "name": "network-vif-plugged", "status": "completed", "tag": "c4e05dac-ef03-4689-8dff-d2a5ca558414"}, {"server_uuid": "3357ec0a-9b18-46fc-b756-a6519b03eae5", "name": "network-vif-plugged", "status": "completed", "tag": "b1f1083c-37e7-4577-8190-c5e6a5aaf376"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:43.005448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-69092af2-97ae-456d-8112-a0d8a3eea7ad req-f94ef56d-e918-47ed-b5d7-a2ecfdd888d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.006009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-69092af2-97ae-456d-8112-a0d8a3eea7ad req-f94ef56d-e918-47ed-b5d7-a2ecfdd888d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.018728 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-69092af2-97ae-456d-8112-a0d8a3eea7ad req-f94ef56d-e918-47ed-b5d7-a2ecfdd888d8 service nova] Creating event network-vif-plugged:c4e05dac-ef03-4689-8dff-d2a5ca558414 for instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c on n-h1-master-1 Jul 01 10:39:43.019235 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-69092af2-97ae-456d-8112-a0d8a3eea7ad req-f94ef56d-e918-47ed-b5d7-a2ecfdd888d8 service nova] Creating event network-vif-plugged:b1f1083c-37e7-4577-8190-c5e6a5aaf376 for instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 on n-h2-master-1 Jul 01 10:39:43.027238 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-69092af2-97ae-456d-8112-a0d8a3eea7ad req-f94ef56d-e918-47ed-b5d7-a2ecfdd888d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035438 Jul 01 10:39:43.027829 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1655/3270] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:39:43.135076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:43.142906 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4274dd8-0553-4688-9374-3ba5986e2318 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1509 microversion: 2.1 time: 0.190674 Jul 01 10:39:43.144492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:43.146570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:43.153327 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1616/3271] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:42 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:43.157457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.158313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.159882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.160775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.211235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:43.212057 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:43.219424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.220315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.221350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.221979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.443730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:43.453140 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb178881-b41e-4559-8038-50ce29a2f1c2 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.318839 Jul 01 10:39:43.462913 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1656/3272] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:43 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:43.485336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:43.495848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:43.497409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:43.499258 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aadd1a4d-f6a5-4746-91a6-ecb487e64456 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2953 microversion: 2.42 time: 0.291396 Jul 01 10:39:43.499827 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1617/3273] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:43 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2953 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:39:43.520184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3b008d04-c1c9-4705-82ed-58e68bb8238f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:43.520727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3b008d04-c1c9-4705-82ed-58e68bb8238f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:43.530175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b008d04-c1c9-4705-82ed-58e68bb8238f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.530175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b008d04-c1c9-4705-82ed-58e68bb8238f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.530175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b008d04-c1c9-4705-82ed-58e68bb8238f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.530175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b008d04-c1c9-4705-82ed-58e68bb8238f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.673338 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3b008d04-c1c9-4705-82ed-58e68bb8238f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.157593 Jul 01 10:39:43.677533 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1657/3274] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Jul 1 10:39:43 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad/os-interface => generated 1830 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:43.907610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:43.908527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:43.909555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:43.910262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:43.915176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.915555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.916313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.916937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.917064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.917504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:43.918280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:43.918909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:44.356687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:44.378576 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-47b5e1b5-fd9f-43c5-87a2-be2a54e4d551 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.471791 Jul 01 10:39:44.379386 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1658/3275] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:43 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:44.384630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:44.392037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:44.403383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:44.404148 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:44.406315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:44.406771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:44.431973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:44.444015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e47e3932-2f77-4f13-94df-e3b49f553db7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1515 microversion: 2.1 time: 0.542156 Jul 01 10:39:44.458679 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1618/3276] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:43 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1515 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:44.485828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:44.486694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:44.490003 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:44.494051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:44.494767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:44.495698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:44.496133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:44.777070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:44.786255 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-63433438-910f-4dd3-8c03-d8506b021987 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1509 microversion: 2.1 time: 0.404516 Jul 01 10:39:44.786840 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1659/3277] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:44 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:44.800843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:44.801696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:44.809853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:44.810799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:44.812196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:44.812766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:44.887315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:44.894939 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-38d3c87c-92a3-4d81-823a-e9974ee8d54d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1314 microversion: 2.1 time: 0.413098 Jul 01 10:39:44.895525 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1619/3278] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:44 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:45.262595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:45.272966 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b02f583-c533-4d4c-b082-8a98dae0896f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf" status: 200 len: 1515 microversion: 2.1 time: 0.484879 Jul 01 10:39:45.273686 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1660/3279] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:44 2022] GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf => generated 1515 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:45.290349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:45.290977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:45.298774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:45.302990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:45.302990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:45.302990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:45.396731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:45.397392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:45.403693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:45.404140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:45.405624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:45.406055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.067515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:46.075917 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-05bbe2b2-4c45-43cc-aa9e-80601768cb69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.683113 Jul 01 10:39:46.086503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1661/3280] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:45 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:46.091638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:46.095769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:46.108590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:46.109720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.111213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:46.112972 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.126889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:46.139937 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68211b88-f14c-4613-abba-f47034707c4e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 200 len: 1323 microversion: 2.1 time: 0.854525 Jul 01 10:39:46.140862 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1620/3281] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:45 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 1323 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:46.154113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:46.154832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:46.164642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:46.165639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.167298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:46.168077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.679117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:46.692626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45a30978-03dc-48c4-a9bc-600cf62d0f01 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1509 microversion: 2.1 time: 0.604471 Jul 01 10:39:46.695412 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1662/3282] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:46 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:46.722150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:46.735428 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7142cd9-9d35-46b6-8adf-ba082b2e473e tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1502 microversion: 2.1 time: 0.593844 Jul 01 10:39:46.739539 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1621/3283] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:46 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1502 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:46.762216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:46.763139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:46.774699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:46.777664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.780880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:46.781446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.846017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lazy-loading 'flavor' on Instance uuid 3357ec0a-9b18-46fc-b756-a6519b03eae5 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:46.860091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7bcffcf1-6ebc-440a-8c55-4a8aefa18e65 req-36f3af5e-7122-4ebc-bdaf-5da945e66374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc136f1-7c35-4323-846e-3cfb690ad678", "name": "network-vif-deleted", "tag": "899c4965-a8ed-4a54-bb17-041d0d35059b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:46.876439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7bcffcf1-6ebc-440a-8c55-4a8aefa18e65 req-36f3af5e-7122-4ebc-bdaf-5da945e66374 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:46.881610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7bcffcf1-6ebc-440a-8c55-4a8aefa18e65 req-36f3af5e-7122-4ebc-bdaf-5da945e66374 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:46.900063 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7bcffcf1-6ebc-440a-8c55-4a8aefa18e65 req-36f3af5e-7122-4ebc-bdaf-5da945e66374 service nova] Creating event network-vif-deleted:899c4965-a8ed-4a54-bb17-041d0d35059b for instance ebc136f1-7c35-4323-846e-3cfb690ad678 on n-h1-master-1 Jul 01 10:39:46.909637 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7bcffcf1-6ebc-440a-8c55-4a8aefa18e65 req-36f3af5e-7122-4ebc-bdaf-5da945e66374 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052790 Jul 01 10:39:46.911482 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1622/3284] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:47.098727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:47.099707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:47.108682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.113405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.113405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.113405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.300916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:47.309262 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93ed5412-d0a9-4d48-aeec-2d42309d0987 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.217435 Jul 01 10:39:47.309848 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1623/3285] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:47 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:47.310885 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81145ca7-da9b-4012-ace2-a57796c90a15 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "POST /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5/action" status: 202 len: 0 microversion: 2.1 time: 0.552429 Jul 01 10:39:47.313214 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1663/3286] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:39:46 2022] POST /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:39:47.315859 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:47.316650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:47.323454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.323668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:47.323908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.324417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:47.324958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.325608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.335226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.335661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.336435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.337018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.566750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:47.581308 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fd45c67-15ad-4868-82f6-c753c5c203f5 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 200 len: 1516 microversion: 2.1 time: 0.264356 Jul 01 10:39:47.581931 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1624/3287] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:47 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:47.591224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:47.594268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:47.596316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:47.601423 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d0e114a-8d99-4ada-8be0-db19393bb97c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1510 microversion: 2.1 time: 0.284110 Jul 01 10:39:47.602477 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1664/3288] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:47 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:47.602713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.603077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.603868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.604298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.654169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:47.712683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:47.713326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:47.721039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.721748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.722687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.723127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.744647 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:47.761385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.762220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.762828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lazy-loading 'fault' on Instance uuid ebc136f1-7c35-4323-846e-3cfb690ad678 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:47.815288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:47.823416 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f98ed75-91c2-4edb-ab3c-af668adda6b1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1305 microversion: 2.1 time: 0.116063 Jul 01 10:39:47.824424 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1665/3289] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:47 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:47.911285 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cfe1ac8-065c-4a65-99a5-717119198da2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 204 len: 0 microversion: 2.1 time: 0.321790 Jul 01 10:39:47.912728 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1625/3290] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:47 2022] DELETE /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:39:47.921549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:47.922766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:47.931948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.933213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:47.934261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:47.935035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.094926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:48.102798 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80f641f5-3f3f-4c02-a9ae-3f2966b1bd2c tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 200 len: 1522 microversion: 2.1 time: 0.186040 Jul 01 10:39:48.103379 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1666/3291] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:47 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:48.327632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:48.328337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:48.334514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.334967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.335759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.336198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.470647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:48.479126 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61911203-4a53-4950-ba42-7b4085fb5290 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.156277 Jul 01 10:39:48.485078 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1626/3292] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:48 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:48.618016 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:48.618631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:48.628973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.629548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.630439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.630950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.770343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:48.777788 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a1b4714-f269-4896-a9bf-d4b8b242dba4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1493 microversion: 2.1 time: 0.163638 Jul 01 10:39:48.778352 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1667/3293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:48 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1493 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:48.794165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:48.794655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:48.801500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.801929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.802688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.803116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.828920 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:48.843553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:48.850338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:48.850338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.850739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.851509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.852003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.882988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:48.883432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:48.884660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lazy-loading 'fault' on Instance uuid ebc136f1-7c35-4323-846e-3cfb690ad678 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:48.931624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:48.940968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a48015c3-314f-41ed-be9e-c96cc51f6849 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 200 len: 1305 microversion: 2.1 time: 0.101340 Jul 01 10:39:48.941363 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1668/3294] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:48 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:49.120246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:49.120861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:49.127708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.128275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.128919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.129385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.167994 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf99ddb8-d56b-449e-b7bc-8b47bcb7617b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 204 len: 0 microversion: 2.1 time: 0.377353 Jul 01 10:39:49.175642 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1627/3295] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:48 2022] DELETE /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:39:49.177762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:49.178450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:49.184726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.185200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.186608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.187046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.314040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:49.323077 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7997781a-d6d2-4188-87e4-6b6e191d8885 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 200 len: 1522 microversion: 2.1 time: 0.206666 Jul 01 10:39:49.324024 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1669/3296] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:49 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:49.360736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:49.369871 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af819ac6-4a3b-48cc-a006-6af346576a2c tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1499 microversion: 2.1 time: 0.196239 Jul 01 10:39:49.370529 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1628/3297] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:49 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1499 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:49.497473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:49.498010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:49.505137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.505614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.506369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.506799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.647185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:49.655546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b0c4ca00-e0bd-4962-94ff-95f24a8ee0f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.161930 Jul 01 10:39:49.656112 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1670/3298] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:49 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:49.959488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:49.964911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: ebc136f1-7c35-4323-846e-3cfb690ad678] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:49.974455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.975457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.976429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:49.977651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:49.997137 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] HTTP exception thrown: Instance ebc136f1-7c35-4323-846e-3cfb690ad678 could not be found. Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Request method failure captured: Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 HTTP/1.1 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivszjVKMte_ts7Jv-cDXMyjEhSnWz4wS387Uwsvp-vYY217jOuWA3zd3eYQwA0Rdq-dIzXtVGejeSrtv9BFzN-ilT4kjM3B3cvV2_OtGIFVGLYEr3XxTz7dW8aIY0qr29FrYLv9cAbipRXnW_Yk7WImY61dlPvgqjsTiGaAS2IAYFNw4 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb942eeb3788403687ba800c070babd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb942eeb3788403687ba800c070babd5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: adf336817b04429b930e1f80ea25b1f7 Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: exception: Instance ebc136f1-7c35-4323-846e-3cfb690ad678 could not be found. Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ebc136f1-7c35-4323-846e-3cfb690ad678'} Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc136f1-7c35-4323-846e-3cfb690ad678 could not be found. Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc136f1-7c35-4323-846e-3cfb690ad678 could not be found. Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:50.000320 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:50.005084 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:50.005084 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:50.005084 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:50.005084 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:50.005084 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:50.005084 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc136f1-7c35-4323-846e-3cfb690ad678 could not be found. Jul 01 10:39:50.005084 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:50.006889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Returning 404 to user: Instance ebc136f1-7c35-4323-846e-3cfb690ad678 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:50.008091 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ab09ee2b-fafc-4f9f-bf60-58c5f52743c8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678" status: 404 len: 111 microversion: 2.1 time: 0.053123 Jul 01 10:39:50.008883 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1629/3299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:49 2022] GET /compute/v2.1/servers/ebc136f1-7c35-4323-846e-3cfb690ad678 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:50.018123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:50.018617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:50.026343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.026994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.027947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.028555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.055977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:50.258454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1086081257", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": "none"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:50.315878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:39:50.316460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:39:50.317100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:39:50.317830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:39:50.318351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:39:50.329568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.330513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.331347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.331988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.359336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Getting quotas for project e8d7540a813842989984c39a083231a6. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:39:50.367654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Getting quotas for user ad95f62df369438798e6a0e58dbb0fd9 and project e8d7540a813842989984c39a083231a6. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:39:50.374321 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c6fd3cd-379b-4dc8-89bc-3d925405ae69 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "DELETE /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 204 len: 0 microversion: 2.1 time: 0.360072 Jul 01 10:39:50.375095 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1671/3300] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:50 2022] DELETE /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:39:50.383459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:50.384876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:50.408047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.408732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.410336 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.412044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:39:50.413033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.420041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:39:50.502088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:50.511762 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65230eee-69b6-4526-845a-f01c1da31d41 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 200 len: 1480 microversion: 2.1 time: 0.135101 Jul 01 10:39:50.512285 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1672/3301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:50 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 1480 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:50.517809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:50.518590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:50.529346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.529841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.530643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.531246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.626994 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d22d81b1-e9a9-4641-824d-c1a5655a6ed6 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.495036 Jul 01 10:39:50.628063 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1630/3302] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 01 10:39:50.640233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:50.643143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:50.652257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.652721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.653537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.654032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.682023 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:50.762230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:50.770218 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f2607b2-afd8-4d34-b30a-a021fbb92e8c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1496 microversion: 2.1 time: 0.256817 Jul 01 10:39:50.770794 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1673/3303] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:50 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1496 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:50.775382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5bd68ba1-dad8-40c7-9520-3c4f296d3f3e req-8f283533-feae-47f7-80e1-3ecc36463771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b9bf7d-caf3-4001-9f5b-46c1a824e25c", "name": "network-vif-deleted", "tag": "c4e05dac-ef03-4689-8dff-d2a5ca558414"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:50.784446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5bd68ba1-dad8-40c7-9520-3c4f296d3f3e req-8f283533-feae-47f7-80e1-3ecc36463771 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.784898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5bd68ba1-dad8-40c7-9520-3c4f296d3f3e req-8f283533-feae-47f7-80e1-3ecc36463771 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.796788 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5bd68ba1-dad8-40c7-9520-3c4f296d3f3e req-8f283533-feae-47f7-80e1-3ecc36463771 service nova] Creating event network-vif-deleted:c4e05dac-ef03-4689-8dff-d2a5ca558414 for instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c on n-h1-master-1 Jul 01 10:39:50.804803 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5bd68ba1-dad8-40c7-9520-3c4f296d3f3e req-8f283533-feae-47f7-80e1-3ecc36463771 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031332 Jul 01 10:39:50.805611 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1674/3304] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:50.811861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-89508b56-1472-4004-af42-2fdbb96010bf tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:50.812398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-89508b56-1472-4004-af42-2fdbb96010bf tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:50.898382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-89508b56-1472-4004-af42-2fdbb96010bf tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:50.905905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-89508b56-1472-4004-af42-2fdbb96010bf tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:50.907412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-89508b56-1472-4004-af42-2fdbb96010bf tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:50.908578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-89508b56-1472-4004-af42-2fdbb96010bf tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1278 microversion: 2.54 time: 0.101853 Jul 01 10:39:50.909543 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1675/3305] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:50 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:50.914107 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:50.914721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:50.921209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.921921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.922700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:50.923134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:50.983961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:50.991454 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-db0a8fe2-babe-4667-8581-c5daff4837fd tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1499 microversion: 2.1 time: 0.362240 Jul 01 10:39:50.992070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1631/3306] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:50 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1499 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:51.283061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:51.291454 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f152f6e1-b32d-4227-b032-f53932058093 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.380415 Jul 01 10:39:51.301947 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1676/3307] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:50 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:51.416729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:51.420782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:51.421609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Searching by: {'deleted': False, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:51.427649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.428356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.428958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.429526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.455969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:39:51.488535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-79df18cb-712f-46b4-8dba-887bfd1c3682 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.075975 Jul 01 10:39:51.489204 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1632/3308] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:39:51 2022] GET /compute/v2.1/servers => generated 333 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:51.500613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:51.504277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:51.505206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Searching by: {'deleted': False, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:51.510679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.511322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.512141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.512582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.538026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:51.539604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:51.547529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.547786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:39:51.548776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.550005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.550692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.593024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.593699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.594414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lazy-loading 'fault' on Instance uuid f8b9bf7d-caf3-4001-9f5b-46c1a824e25c {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:51.594783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:51.601894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.602573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.689686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:51.697193 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7936bc80-f047-46e4-a5b7-6b2825017574 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 200 len: 1313 microversion: 2.1 time: 0.171706 Jul 01 10:39:51.697786 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1633/3309] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:51 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:51.787431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:51.788071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:51.795077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.796112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:51.796897 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:51.797356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.124109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.132745 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-705e6d5a-eb77-4225-91a8-a913c6a09fa1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1454 microversion: 2.1 time: 0.349343 Jul 01 10:39:52.136688 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1634/3310] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:51 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1454 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:52.136801 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d7f2ddd-5dd8-4aab-8f0b-0aa37a4abb9f tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.639350 Jul 01 10:39:52.137482 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1677/3311] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:39:51 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:52.146591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.150204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:52.150970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.151597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:52.166840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.170861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.170861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.170861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.171382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.178287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.183585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.184353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.359389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.372476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.372601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.372796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.376803 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-15747d86-fcbf-4f7b-a062-fd1bdd1ad6fa tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1457 microversion: 2.1 time: 0.237885 Jul 01 10:39:52.377412 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1678/3312] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1457 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:52.378780 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2fbbfd58-16be-4b9c-8cc8-7bfd5e69c5e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1282 microversion: 2.54 time: 0.243753 Jul 01 10:39:52.379625 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1635/3313] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:52.392431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.392431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:52.392740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83053d76-73ac-49d4-80d2-f3401a6227f3 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.397738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.400272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.400272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.400272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.400539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-83053d76-73ac-49d4-80d2-f3401a6227f3 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021625 Jul 01 10:39:52.401034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1679/3314] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:52.634281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.643897 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1dd633d2-bd83-461c-97fd-803b7224f1b6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.263096 Jul 01 10:39:52.644504 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1636/3315] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:52.714154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.714814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:52.722311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.723282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.723536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.723971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.740259 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] HTTP exception thrown: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c HTTP/1.1 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f8b9bf7d-caf3-4001-9f5b-46c1a824e25c'} Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:52.741977 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.746370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:52.746370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:52.746370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:52.746370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:52.746370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:52.746370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:52.746370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.747790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 404 to user: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:52.748770 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b1a39c69-3d52-4d6c-bfb9-bc5cee7d6f2b tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 404 len: 111 microversion: 2.1 time: 0.038626 Jul 01 10:39:52.749940 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1680/3316] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:52.758837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.763041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.764375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:52.769781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.770239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.771030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.771472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.827874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-302e499f-1c47-410a-8444-0a645896eb98 req-fa90a7fa-5898-42d1-bd44-4e70f5bd11b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3357ec0a-9b18-46fc-b756-a6519b03eae5", "name": "network-vif-deleted", "tag": "b1f1083c-37e7-4577-8190-c5e6a5aaf376"}, {"server_uuid": "29ac2563-eab2-46bc-9f37-d99f043604d9", "name": "network-vif-deleted", "tag": "88f28118-7e7b-49bb-8de1-107cc8b4288e"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:52.839401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-302e499f-1c47-410a-8444-0a645896eb98 req-fa90a7fa-5898-42d1-bd44-4e70f5bd11b2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.839954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-302e499f-1c47-410a-8444-0a645896eb98 req-fa90a7fa-5898-42d1-bd44-4e70f5bd11b2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.853592 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48d2eb4f-7047-4d16-a3fe-94f2ca470be7 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.098468 Jul 01 10:39:52.854086 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-302e499f-1c47-410a-8444-0a645896eb98 req-fa90a7fa-5898-42d1-bd44-4e70f5bd11b2 service nova] Creating event network-vif-deleted:b1f1083c-37e7-4577-8190-c5e6a5aaf376 for instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 on n-h2-master-1 Jul 01 10:39:52.854600 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-302e499f-1c47-410a-8444-0a645896eb98 req-fa90a7fa-5898-42d1-bd44-4e70f5bd11b2 service nova] Creating event network-vif-deleted:88f28118-7e7b-49bb-8de1-107cc8b4288e for instance 29ac2563-eab2-46bc-9f37-d99f043604d9 on n-h1-master-1 Jul 01 10:39:52.861386 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1637/3317] 10.222.0.23 () {58 vars in 1229 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:39:52.864909 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-302e499f-1c47-410a-8444-0a645896eb98 req-fa90a7fa-5898-42d1-bd44-4e70f5bd11b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041571 Jul 01 10:39:52.866448 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1681/3318] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:39:52.867766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-514b5b60-6458-47c8-9b84-4a3e7f9d6682 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-514b5b60-6458-47c8-9b84-4a3e7f9d6682 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: action_args: {} Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 01 10:39:52.870309 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-514b5b60-6458-47c8-9b84-4a3e7f9d6682 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-514b5b60-6458-47c8-9b84-4a3e7f9d6682 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009090 Jul 01 10:39:52.878610 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1638/3319] 10.222.0.23 () {58 vars in 1181 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:52.882263 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.885596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.886338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:52.891819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.892269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.893069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.893533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.926756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:39:52.948564 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:52.955205 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6f06825-772d-4c9a-907b-9f33026cf3d8 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.077058 Jul 01 10:39:52.955783 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1682/3320] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers => generated 683 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:52.965944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:52.970339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:52.970777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.compute.servers [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Removing options 'limit' from query {{(pid=119765) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 01 10:39:52.971424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:52.978293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.978739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:52.979532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:52.979963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.004734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:39:53.035396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39ff6d9c-4927-4745-a954-86bb11c0cbe2 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.073287 Jul 01 10:39:53.035966 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1639/3321] 10.222.0.23 () {58 vars in 1143 bytes} [Fri Jul 1 10:39:52 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:53.047783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e034566d-c266-4d3b-93e8-57ad85b7eee3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e034566d-c266-4d3b-93e8-57ad85b7eee3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: action_args: {} Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi '-1' Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 01 10:39:53.050552 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e034566d-c266-4d3b-93e8-57ad85b7eee3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e034566d-c266-4d3b-93e8-57ad85b7eee3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008681 Jul 01 10:39:53.055296 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1683/3322] 10.222.0.23 () {58 vars in 1141 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:53.061797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55c1b888-5676-46bc-94a0-731376293683 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55c1b888-5676-46bc-94a0-731376293683 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: action_args: {} Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'testing' Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 01 10:39:53.064479 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55c1b888-5676-46bc-94a0-731376293683 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-55c1b888-5676-46bc-94a0-731376293683 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.007713 Jul 01 10:39:53.069535 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1640/3323] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:39:53.075915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eee96d8a-aa67-4834-b7f1-7207ae4151b6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.079542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eee96d8a-aa67-4834-b7f1-7207ae4151b6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.080218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eee96d8a-aa67-4834-b7f1-7207ae4151b6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:53.088294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.servers [None req-eee96d8a-aa67-4834-b7f1-7207ae4151b6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Flavor 'non_existing_flavor' could not be found {{(pid=119764) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 01 10:39:53.089287 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eee96d8a-aa67-4834-b7f1-7207ae4151b6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.017863 Jul 01 10:39:53.089806 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1684/3324] 10.222.0.23 () {58 vars in 1177 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:39:53.101702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.105093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.105251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3e31964-6b0c-4492-9110-b53c0a452fc8 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.105771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:53.105986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e3e31964-6b0c-4492-9110-b53c0a452fc8 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:53.112464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.112627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3e31964-6b0c-4492-9110-b53c0a452fc8 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.112911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.113071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3e31964-6b0c-4492-9110-b53c0a452fc8 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.113750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.113871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3e31964-6b0c-4492-9110-b53c0a452fc8 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.114186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.114290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3e31964-6b0c-4492-9110-b53c0a452fc8 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.203263 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-023630ae-3cbb-4b0c-a2af-03bde20d7f63 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.105496 Jul 01 10:39:53.204067 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1641/3325] 10.222.0.23 () {58 vars in 1173 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:39:53.210408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.211029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:53.218818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.219275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.220080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.220518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.252419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.254607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.254607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lazy-loading 'fault' on Instance uuid 29ac2563-eab2-46bc-9f37-d99f043604d9 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:53.317834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.328703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b0370b65-b9ff-487c-a97c-64a481a7dbb1 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 200 len: 1305 microversion: 2.1 time: 0.123378 Jul 01 10:39:53.329894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1642/3326] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:53.334917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.338675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.339333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:53.345348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.345786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.346873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.347068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.351776 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e3e31964-6b0c-4492-9110-b53c0a452fc8 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1810 microversion: 2.1 time: 0.249866 Jul 01 10:39:53.352923 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1685/3327] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:53.371081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1bce134f-6cc2-489a-9930-6718f23fc28d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.372818 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:39:53.372818 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 10:39:53.374525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bce134f-6cc2-489a-9930-6718f23fc28d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.375769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bce134f-6cc2-489a-9930-6718f23fc28d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.376761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bce134f-6cc2-489a-9930-6718f23fc28d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.377219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bce134f-6cc2-489a-9930-6718f23fc28d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.408383 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1bce134f-6cc2-489a-9930-6718f23fc28d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042448 Jul 01 10:39:53.410715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1686/3328] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:39:53.415532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.416420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:53.424368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.424825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.425663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.426135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.511531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a502a138-37d4-49a6-961d-3bb0e7fa6833 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.180449 Jul 01 10:39:53.518826 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1643/3329] 10.222.0.23 () {58 vars in 1183 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:39:53.523961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.524584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:53.532261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.532936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.533755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.534357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.545838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.546569 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.550380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lazy-loading 'fault' on Instance uuid 3357ec0a-9b18-46fc-b756-a6519b03eae5 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:39:53.612872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8012fcb48840f1b778ab759457e66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2553a410f24e8f9552704e7e9c14f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.620594 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e85b9da-4f2f-47e6-a954-cec8be66c9ad tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 200 len: 1304 microversion: 2.1 time: 0.208641 Jul 01 10:39:53.625328 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1687/3330] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:53.634252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.635121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:53.636435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.642495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.642940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.643736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.644163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.647391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.648916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.650125 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa815ad0-f5f4-4353-ac61-012f610ec786 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1330 microversion: 2.54 time: 0.130063 Jul 01 10:39:53.652212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1644/3331] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:53.669276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.669276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.669276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:53.669276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.669276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.669276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.669276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.676176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:53.697873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:39:53.767835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:53.774552 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.775056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.899636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6dbfac00-6d12-4a02-9416-31c13b11c25e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.246822 Jul 01 10:39:53.900240 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1645/3332] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:53.905396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:53.906005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:53.912251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.912692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.913836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:53.914475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:53.931423 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:54.035048 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1af5749-4e7b-4327-a585-e75b7ed59fd6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 204 len: 0 microversion: 2.1 time: 0.411788 Jul 01 10:39:54.041872 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1688/3333] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:53 2022] DELETE /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:39:54.047595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70701b7b-d9b9-4d99-9bcf-32362e3d655f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.051858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-70701b7b-d9b9-4d99-9bcf-32362e3d655f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:54.053374 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-70701b7b-d9b9-4d99-9bcf-32362e3d655f tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010354 Jul 01 10:39:54.054376 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1689/3334] 10.222.0.23 () {58 vars in 1177 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:39:54.064761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.065788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.070406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:54.072294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.072954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.073791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.074227 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.079071 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af58a510-12b4-40c2-a1e7-ab951270261e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.177747 Jul 01 10:39:54.079726 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1646/3335] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:53 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:54.085825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.089932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:54.090791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Searching by: {'deleted': False, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:39:54.096917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.097478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.098200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.098635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.125174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:39:54.153646 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d9684652-ee29-44f4-8d6d-8f2a2151b54e tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.071223 Jul 01 10:39:54.160639 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1647/3336] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers => generated 683 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:54.165314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.165805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.172330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.172813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.173602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.174033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.187810 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] HTTP exception thrown: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c HTTP/1.1 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: exception: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'f8b9bf7d-caf3-4001-9f5b-46c1a824e25c'} Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:54.189307 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 404 to user: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7fb82a8-a9bd-4295-8829-3aa075a489ab tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 404 len: 111 microversion: 2.1 time: 0.029076 Jul 01 10:39:54.193392 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1648/3337] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:54 2022] DELETE /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:54.198900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.199432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.206112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.206555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.207309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.207743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.239286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:54.246704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:54.257974 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f365d61d-898f-472c-af51-894d4526f4e1 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1701 microversion: 2.1 time: 0.202338 Jul 01 10:39:54.258695 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1690/3338] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1701 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:54.267917 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:54.345830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.346444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: 29ac2563-eab2-46bc-9f37-d99f043604d9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.352523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.353112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.353807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.354241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.370265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] HTTP exception thrown: Instance 29ac2563-eab2-46bc-9f37-d99f043604d9 could not be found. Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Request method failure captured: Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 HTTP/1.1 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivszjVKMte_ts7Jv-cDXMyjEhSnWz4wS387Uwsvp-vYY217jOuWA3zd3eYQwA0Rdq-dIzXtVGejeSrtv9BFzN-ilT4kjM3B3cvV2_OtGIFVGLYEr3XxTz7dW8aIY0qr29FrYLv9cAbipRXnW_Yk7WImY61dlPvgqjsTiGaAS2IAYFNw4 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb942eeb3788403687ba800c070babd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb942eeb3788403687ba800c070babd5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: adf336817b04429b930e1f80ea25b1f7 Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 29ac2563-eab2-46bc-9f37-d99f043604d9 could not be found. Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '29ac2563-eab2-46bc-9f37-d99f043604d9'} Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ac2563-eab2-46bc-9f37-d99f043604d9 could not be found. Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ac2563-eab2-46bc-9f37-d99f043604d9 could not be found. Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:54.371908 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ac2563-eab2-46bc-9f37-d99f043604d9 could not be found. Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Returning 404 to user: Instance 29ac2563-eab2-46bc-9f37-d99f043604d9 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fbc3db8b-24fe-4d89-a213-973e8b74d4ef tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9" status: 404 len: 111 microversion: 2.1 time: 0.031364 Jul 01 10:39:54.378958 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1691/3339] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers/29ac2563-eab2-46bc-9f37-d99f043604d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:54.382084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.382573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.388651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.389100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.390045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.390484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.415115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:54.590360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e9470ec4-375f-4282-ba6d-6e4a93bfaf2d tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf" status: 204 len: 0 microversion: 2.1 time: 0.394681 Jul 01 10:39:54.590939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1649/3340] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:54 2022] DELETE /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:39:54.599813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.600395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.607427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.608670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.609512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.609948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.636540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:39:54.768190 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31401d38-e514-448a-acbc-e510bc6b4241 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 204 len: 0 microversion: 2.1 time: 0.389355 Jul 01 10:39:54.769004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1692/3341] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:54 2022] DELETE /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:39:54.777310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.778009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.784060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.784502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.785299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.785737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 HTTP/1.1 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3357ec0a-9b18-46fc-b756-a6519b03eae5'} Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:54.804802 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-473751fd-d88f-4354-885d-429f7781eee1 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 404 len: 111 microversion: 2.1 time: 0.028702 Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1693/3342] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.809183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.814443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.814891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.815668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.816100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.870584 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:54.882008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:54.890670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:54.892185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:54.893491 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-466b0166-4078-4cf9-9708-ea0a739d438b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1336 microversion: 2.54 time: 0.089978 Jul 01 10:39:54.894036 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1694/3343] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1336 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:54.898617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.899620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.905916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.912783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.912783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.912783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.962078 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b61ac173-aac6-4a02-97af-9f319d14b610 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 204 len: 0 microversion: 2.1 time: 0.365762 Jul 01 10:39:54.962670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1650/3344] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:54 2022] DELETE /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:39:54.968326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:54.968918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:54.976400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.981434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.981434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:54.981434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:54.994859 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 HTTP/1.1 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3357ec0a-9b18-46fc-b756-a6519b03eae5'} Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:54.996547 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-006e23c6-9b03-4945-b7ec-440ff15f4c31 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 404 len: 111 microversion: 2.1 time: 0.033855 Jul 01 10:39:55.001066 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1651/3345] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:54 2022] DELETE /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.005487 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.006133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: f8b9bf7d-caf3-4001-9f5b-46c1a824e25c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.012918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.013400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.014229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.014711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.028508 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] HTTP exception thrown: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c HTTP/1.1 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: exception: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'f8b9bf7d-caf3-4001-9f5b-46c1a824e25c'} Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.030091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 404 to user: Instance f8b9bf7d-caf3-4001-9f5b-46c1a824e25c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c54cda06-57e2-4505-b294-3a5af7b4b2e3 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c" status: 404 len: 111 microversion: 2.1 time: 0.031022 Jul 01 10:39:55.037839 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1652/3346] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers/f8b9bf7d-caf3-4001-9f5b-46c1a824e25c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.042210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.042818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3357ec0a-9b18-46fc-b756-a6519b03eae5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.049623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.050069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.050862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.050973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:55.051296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.058949 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-32456663-14e4-4871-8f6f-6b0d6a7fbdd5 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1677 microversion: 2.1 time: 0.163945 Jul 01 10:39:55.059503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1695/3347] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:54 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:55.064521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.065123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.065807 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 HTTP/1.1 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3357ec0a-9b18-46fc-b756-a6519b03eae5'} Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.067317 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 3357ec0a-9b18-46fc-b756-a6519b03eae5 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fb6eb0a6-5a8e-410b-9ed2-4ccbe0d22411 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5" status: 404 len: 111 microversion: 2.1 time: 0.035760 Jul 01 10:39:55.071518 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1653/3348] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/3357ec0a-9b18-46fc-b756-a6519b03eae5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.073069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.073562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.075366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.075366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.080988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.081529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.088062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.088820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.091036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.091036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.105549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d HTTP/1.1 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '47387c27-7fd3-476a-bdfb-040bbfd8e06d'} Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.107113 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c7ba4c0-bb15-4cfb-8232-fbdf62909632 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 404 len: 111 microversion: 2.1 time: 0.035260 Jul 01 10:39:55.111817 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1654/3349] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:55 2022] DELETE /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.115324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.115933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.124971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.129724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.130548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.131706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.294756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:55.304329 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9727401d-be4c-4f50-872b-8753bb320052 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf" status: 200 len: 1521 microversion: 2.1 time: 0.243691 Jul 01 10:39:55.305096 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1696/3350] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:55.324270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.324270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 47387c27-7fd3-476a-bdfb-040bbfd8e06d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.327722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.328176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.328976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.329411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.343540 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d HTTP/1.1 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '47387c27-7fd3-476a-bdfb-040bbfd8e06d'} Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.351448 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 47387c27-7fd3-476a-bdfb-040bbfd8e06d could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-603cfc19-a920-4693-a003-ca69431033d5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d" status: 404 len: 111 microversion: 2.1 time: 0.032535 Jul 01 10:39:55.356558 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1697/3351] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/47387c27-7fd3-476a-bdfb-040bbfd8e06d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.358395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:55.358497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.358497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.358497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.358880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.359646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.360081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.365033 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51d28035-adeb-4bb9-8342-1f044aa144d1 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.253130 Jul 01 10:39:55.369913 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1655/3352] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:55.370647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.371141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.377183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.377639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.378402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.378832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.394031 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 HTTP/1.1 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e4afc470-5045-4a5c-b6a9-f83ca6ef7815'} Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.395574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a6b6c2e3-71e4-4cf2-994f-09b28e244254 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 404 len: 111 microversion: 2.1 time: 0.029995 Jul 01 10:39:55.401683 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1656/3353] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:55 2022] DELETE /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.408979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.408979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: e4afc470-5045-4a5c-b6a9-f83ca6ef7815] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.413753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.414269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.415101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.415597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.430575 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 HTTP/1.1 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e4afc470-5045-4a5c-b6a9-f83ca6ef7815'} Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.432204 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance e4afc470-5045-4a5c-b6a9-f83ca6ef7815 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e737a7f-2f43-4d54-9fcd-59ea86edc59b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815" status: 404 len: 111 microversion: 2.1 time: 0.032893 Jul 01 10:39:55.438091 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1657/3354] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/e4afc470-5045-4a5c-b6a9-f83ca6ef7815 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.443977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.444467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.452000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.459173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.459173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.459173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.467394 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 HTTP/1.1 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3e846ba7-bb0b-4f03-92d9-7084538531c5'} Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.469254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7838d65f-e501-43bf-9405-2234384ddd4d tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 404 len: 111 microversion: 2.1 time: 0.030348 Jul 01 10:39:55.475140 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1658/3355] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:55 2022] DELETE /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:39:55.478729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.479338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 3e846ba7-bb0b-4f03-92d9-7084538531c5] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.485427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.485873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.486638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.487098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.502135 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 HTTP/1.1 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3e846ba7-bb0b-4f03-92d9-7084538531c5'} Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.503662 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 3e846ba7-bb0b-4f03-92d9-7084538531c5 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c3d5aa2-bd7f-480a-a4d4-76dd5a06ab3a tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5" status: 404 len: 111 microversion: 2.1 time: 0.029842 Jul 01 10:39:55.508651 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1659/3356] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/3e846ba7-bb0b-4f03-92d9-7084538531c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.512904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:55.513042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.513636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d50de6c5-56b4-4ae5-863f-26679db7901e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.521315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.521468 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bb16af27-7aac-4fd8-bf0e-76ce6ed95ab8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1701 microversion: 2.1 time: 0.173364 Jul 01 10:39:55.521759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.521882 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1698/3357] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1701 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:55.522518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.523002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.536305 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e HTTP/1.1 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: exception: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'd50de6c5-56b4-4ae5-863f-26679db7901e'} Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.537917 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3584da0d-ce91-4aa0-b1e3-f8e31f7a55f8 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e" status: 404 len: 111 microversion: 2.1 time: 0.029794 Jul 01 10:39:55.542772 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1660/3358] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:39:55 2022] DELETE /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.548032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.548606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d50de6c5-56b4-4ae5-863f-26679db7901e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.556866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.556866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.556866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.556866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.570706 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e HTTP/1.1 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: exception: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd50de6c5-56b4-4ae5-863f-26679db7901e'} Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:55.572208 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance d50de6c5-56b4-4ae5-863f-26679db7901e could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-399f9e7e-7496-4603-ba71-c540a8f1f71b tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e" status: 404 len: 111 microversion: 2.1 time: 0.029781 Jul 01 10:39:55.577178 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1699/3359] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/d50de6c5-56b4-4ae5-863f-26679db7901e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:55.913181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:55.913815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:55.926634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.927038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.927857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:55.928299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:55.995045 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:56.003309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:56.004932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:56.006100 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-25228161-747e-46a0-952a-11dee98ebcdc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1336 microversion: 2.54 time: 0.097260 Jul 01 10:39:56.006659 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1661/3360] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:55 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:56.076229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:56.077139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:56.084220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.084679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.085490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.085937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.224971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:56.233858 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5579c82-cbb8-4e48-a8ca-a2e539e1b30e tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1677 microversion: 2.1 time: 0.161702 Jul 01 10:39:56.234420 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1700/3361] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:56 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:56.246826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca64427b-9f6b-40f0-b78c-5c21f353b3b6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e25e4203-33e3-45a1-88bb-05b6c84ee570", "device": "/dev/xvdb"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:56.248514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca64427b-9f6b-40f0-b78c-5c21f353b3b6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:56.254913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca64427b-9f6b-40f0-b78c-5c21f353b3b6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.255353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca64427b-9f6b-40f0-b78c-5c21f353b3b6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.256126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca64427b-9f6b-40f0-b78c-5c21f353b3b6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.256561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca64427b-9f6b-40f0-b78c-5c21f353b3b6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.323067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:56.323681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:56.330817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.331272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.332038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.332476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.465859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:56.474690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77d728c6-870d-4171-9e97-3ba70287bac6 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf" status: 200 len: 1521 microversion: 2.1 time: 0.155750 Jul 01 10:39:56.475265 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1701/3362] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:56 2022] GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:56.480117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:56.480894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:56.487617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.488080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.488890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.489359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.493511 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:39:56.663007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:56.673123 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10791e0c-23bc-456f-b8d1-3561f012de69 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.195871 Jul 01 10:39:56.673782 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1702/3363] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:56 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:56.687173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:56.687797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:56.694476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.694933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.695724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:56.696298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:56.830709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:56.838897 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6a89d46-60f6-4fd7-b9c8-f51de2444f3b tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1701 microversion: 2.1 time: 0.164124 Jul 01 10:39:56.840154 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1703/3364] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:56 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:57.023903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:57.028059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:57.031085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.031538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.032318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.032753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.135333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:57.145354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:57.147271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:57.149367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da3d4444-9464-4749-a7d0-038d4faa837a tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1336 microversion: 2.54 time: 0.129363 Jul 01 10:39:57.150122 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1704/3365] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:57 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1336 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:39:57.250852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:57.252919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:57.262508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.266702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.267765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.268486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.428283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:57.436864 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a79cf6d-3c7e-4759-a8eb-328c4456d1a6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1677 microversion: 2.1 time: 0.189903 Jul 01 10:39:57.437461 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1705/3366] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:57 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:57.459391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca64427b-9f6b-40f0-b78c-5c21f353b3b6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "POST /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.220486 Jul 01 10:39:57.464414 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1662/3367] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:39:56 2022] POST /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 194 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:57.492196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:57.492811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:57.507040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.507493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.508323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.508759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.693447 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:57.694011 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:57.695988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:57.701002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.702314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.703250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.703837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.707792 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d068c88d-de26-4ef6-8c69-15ddf2d2c075 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf" status: 200 len: 1479 microversion: 2.1 time: 0.219827 Jul 01 10:39:57.708389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1706/3368] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:57 2022] GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf => generated 1479 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:57.722951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6b7a07c4-0abe-40b9-b124-a8e2053b8532 req-d3c42ad8-52a4-4527-bbf9-7a047715d5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35008ac8-b20d-453b-9446-3d459f330baf", "name": "network-vif-deleted", "tag": "715c9bfd-bbc8-4175-92b8-3aa85ccacbe9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:57.741577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6b7a07c4-0abe-40b9-b124-a8e2053b8532 req-d3c42ad8-52a4-4527-bbf9-7a047715d5f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.742107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6b7a07c4-0abe-40b9-b124-a8e2053b8532 req-d3c42ad8-52a4-4527-bbf9-7a047715d5f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.788463 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6b7a07c4-0abe-40b9-b124-a8e2053b8532 req-d3c42ad8-52a4-4527-bbf9-7a047715d5f4 service nova] Creating event network-vif-deleted:715c9bfd-bbc8-4175-92b8-3aa85ccacbe9 for instance 35008ac8-b20d-453b-9446-3d459f330baf on n-h2-master-1 Jul 01 10:39:57.798826 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6b7a07c4-0abe-40b9-b124-a8e2053b8532 req-d3c42ad8-52a4-4527-bbf9-7a047715d5f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079359 Jul 01 10:39:57.802784 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1707/3369] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:57.862717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:57.863439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:57.870248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.870707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.871538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:57.871990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:57.928352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:57.942888 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f100fea-ac0e-4105-8ad2-bce0c83e1c3f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.255700 Jul 01 10:39:57.954171 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1663/3370] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:57 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:58.078220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:58.086532 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f89c6ba3-8c7f-432e-9ae3-640941eb4ece tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1701 microversion: 2.1 time: 0.228969 Jul 01 10:39:58.087106 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1708/3371] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:57 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1701 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:39:58.168357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:58.169375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:58.179910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:58.180654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:58.181904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:58.182675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:58.257573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:58.268200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:58.270266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:58.271480 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fba89d77-b41f-4f56-88a9-e4d605a2425c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1357 microversion: 2.54 time: 0.107507 Jul 01 10:39:58.272723 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1664/3372] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:39:58 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:39:58.292456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00c9e7f4-0d0d-4972-ada9-d20a0d22d52b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Action: 'create', calling method: .version_select at 0x7f6f92291c10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1430027627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzUFkbkw6Fr71BHxfJyNY4Bc/OwC3VH4ODHg7RYuU0CoiroXpIsPZiU1fpXNH2DEVkGgh2Is4frVHQqNbcNqNCOSBxcaG8a8RL9CTO47O11rKFstKUp6KMFbEniHriGWA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:58.320233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-00c9e7f4-0d0d-4972-ada9-d20a0d22d52b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Getting quotas for project e8d7540a813842989984c39a083231a6. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:39:58.338729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-00c9e7f4-0d0d-4972-ada9-d20a0d22d52b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Getting quotas for user ad95f62df369438798e6a0e58dbb0fd9 and project e8d7540a813842989984c39a083231a6. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:39:58.454837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:58.455623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:58.466980 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00c9e7f4-0d0d-4972-ada9-d20a0d22d52b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.178462 Jul 01 10:39:58.467592 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1709/3373] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:39:58 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:39:58.470905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:58.472874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:58.474745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:58.475201 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:58.481282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1430027627", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:58.485101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:58.503607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:58.504265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:58.504821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:58.505283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:58.665540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:39:58.665969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:39:58.666451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:39:58.666866 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:39:58.667282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:39:59.022531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:39:59.030766 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4c0026e-c4e3-4fc9-88a5-e8af7a6cefbf tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1677 microversion: 2.1 time: 0.581615 Jul 01 10:39:59.031339 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1665/3374] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:58 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1677 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:39:59.054287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:59.055292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 35008ac8-b20d-453b-9446-3d459f330baf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:59.094890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.095675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.097041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.104687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.128720 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] HTTP exception thrown: Instance 35008ac8-b20d-453b-9446-3d459f330baf could not be found. Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf HTTP/1.1 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 35008ac8-b20d-453b-9446-3d459f330baf could not be found. Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '35008ac8-b20d-453b-9446-3d459f330baf'} Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35008ac8-b20d-453b-9446-3d459f330baf could not be found. Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35008ac8-b20d-453b-9446-3d459f330baf could not be found. Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:39:59.131314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:59.136197 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:39:59.136197 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:39:59.136197 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:39:59.136197 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:39:59.136197 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:39:59.136197 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35008ac8-b20d-453b-9446-3d459f330baf could not be found. Jul 01 10:39:59.136197 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:39:59.137610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 404 to user: Instance 35008ac8-b20d-453b-9446-3d459f330baf could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:39:59.138665 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-75054ca7-5134-4675-a027-907d488a2734 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf" status: 404 len: 111 microversion: 2.1 time: 0.106384 Jul 01 10:39:59.139684 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1666/3375] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:59 2022] GET /compute/v2.1/servers/35008ac8-b20d-453b-9446-3d459f330baf => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:39:59.144713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-fcc55b79-6dff-46d0-83e6-627477fbf4c3 req-a8a101f7-658a-4ecb-8aab-9e29c255f81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db908b28-e5e5-4cdf-bd6b-85c797a4bb32", "name": "network-vif-unplugged", "status": "completed", "tag": "8bb1f637-2aef-4d30-b38c-5392c3c741da"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:39:59.153641 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fcc55b79-6dff-46d0-83e6-627477fbf4c3 req-a8a101f7-658a-4ecb-8aab-9e29c255f81f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.154923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fcc55b79-6dff-46d0-83e6-627477fbf4c3 req-a8a101f7-658a-4ecb-8aab-9e29c255f81f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.168025 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-fcc55b79-6dff-46d0-83e6-627477fbf4c3 req-a8a101f7-658a-4ecb-8aab-9e29c255f81f service nova] Creating event network-vif-unplugged:8bb1f637-2aef-4d30-b38c-5392c3c741da for instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 on n-h1-master-1 Jul 01 10:39:59.176708 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-fcc55b79-6dff-46d0-83e6-627477fbf4c3 req-a8a101f7-658a-4ecb-8aab-9e29c255f81f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035503 Jul 01 10:39:59.179769 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1667/3376] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:39:59.198516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:59.198516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:59.205659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.206110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.206819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:59.211306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.211865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.216258 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.224077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.225201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.225822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.275636 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fe85ed64-7e23-49d1-8ae6-25037c1935b7 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "POST /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a/action" status: 202 len: 1140 microversion: 2.54 time: 0.801292 Jul 01 10:39:59.278773 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1710/3377] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Jul 1 10:39:58 2022] POST /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a/action => generated 1140 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 01 10:39:59.286532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:39:59.287483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:39:59.297791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.298148 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:39:59.299324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:39:59.299815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:00.403488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:00.415540 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b48812d8-3f2c-43c3-841b-b979a71333f8 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1701 microversion: 2.1 time: 1.134407 Jul 01 10:40:00.416128 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1711/3378] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:59 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1701 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:00.429461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:00.430080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:00.456612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:00.457195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:00.457941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:00.458388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:00.535685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:00.554730 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dae0fe09-e48b-4f3d-8be9-4fe3ce3a0641 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1533 microversion: 2.1 time: 1.361929 Jul 01 10:40:00.555324 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1668/3379] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:39:59 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1533 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:00.570842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:00.579871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:00.599603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:00.600188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:00.601027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:00.601491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:00.868906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:00.876080 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:00.884721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:00.887979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:00.891976 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a1eadf42-3beb-4559-a79e-fd1fe44d57a1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.330819 Jul 01 10:40:00.893847 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1669/3380] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:00 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:00.918903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:00.921870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:00.941448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:00.941906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:00.942694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:00.943136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.013321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.013808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.014266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lazy-loading 'fault' on Instance uuid c4d5f7e5-c239-4d67-8350-35e6cc070a68 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:40:01.145661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf336817b04429b930e1f80ea25b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb942eeb3788403687ba800c070babd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:01.155784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:01.165903 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45efcb5b-d8e7-42ce-a5c7-7ca398926396 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1521 microversion: 2.1 time: 0.748684 Jul 01 10:40:01.177921 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1712/3381] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:00 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:01.183303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:01.184666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:01.189125 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b350afe4-04ec-44fb-8293-ec7e84edbea6 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 200 len: 1329 microversion: 2.1 time: 0.293346 Jul 01 10:40:01.189738 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1670/3382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:00 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 1329 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:01.205940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-cbce1051-7ce6-4a54-9bc6-38fc52d30848 req-62db11d8-9160-4490-885c-6ab9a8f920b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5f7e5-c239-4d67-8350-35e6cc070a68", "name": "network-vif-deleted", "tag": "2f15b32f-f5a8-470f-a091-900b3a056d8b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:01.208729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.209224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.210014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.210455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.233672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cbce1051-7ce6-4a54-9bc6-38fc52d30848 req-62db11d8-9160-4490-885c-6ab9a8f920b0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.237396 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cbce1051-7ce6-4a54-9bc6-38fc52d30848 req-62db11d8-9160-4490-885c-6ab9a8f920b0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.258982 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 HTTP/1.1 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '4e04ea24-b9fd-4851-bc55-68c32ab78300'} Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:01.265405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.269403 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.274563 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-cbce1051-7ce6-4a54-9bc6-38fc52d30848 req-62db11d8-9160-4490-885c-6ab9a8f920b0 service nova] Creating event network-vif-deleted:2f15b32f-f5a8-470f-a091-900b3a056d8b for instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 on n-h1-master-1 Jul 01 10:40:01.283866 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-cbce1051-7ce6-4a54-9bc6-38fc52d30848 req-62db11d8-9160-4490-885c-6ab9a8f920b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092734 Jul 01 10:40:01.291125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:01.293858 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-084c46d3-9a07-45a4-8034-fe44e50b9147 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 404 len: 111 microversion: 2.1 time: 0.113414 Jul 01 10:40:01.293994 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1671/3383] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:01.300932 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1713/3384] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:40:01 2022] DELETE /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:01.303038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-729e4895-0db4-4bfe-990a-c7346d72dc6f req-a4a7283b-0f98-47b0-b13d-20ce1f331c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc378ab-395f-4871-b6eb-bcac4ddfcfcc", "name": "network-vif-unplugged", "status": "completed", "tag": "906acb93-d3df-4172-9bd4-2c6bedb7688c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:01.308633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:01.309662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: 4e04ea24-b9fd-4851-bc55-68c32ab78300] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:01.320407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.321287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.322481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.323116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.336034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-729e4895-0db4-4bfe-990a-c7346d72dc6f req-a4a7283b-0f98-47b0-b13d-20ce1f331c9e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.343179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-729e4895-0db4-4bfe-990a-c7346d72dc6f req-a4a7283b-0f98-47b0-b13d-20ce1f331c9e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.349072 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 HTTP/1.1 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '4e04ea24-b9fd-4851-bc55-68c32ab78300'} Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.351135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.355237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.355237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.355237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.355237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:01.355237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:01.355237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. Jul 01 10:40:01.355237 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.374436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance 4e04ea24-b9fd-4851-bc55-68c32ab78300 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:01.377230 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b7d63ce8-3e81-4342-9d5a-1bf71eba38e4 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300" status: 404 len: 111 microversion: 2.1 time: 0.074793 Jul 01 10:40:01.382605 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1714/3385] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:01 2022] GET /compute/v2.1/servers/4e04ea24-b9fd-4851-bc55-68c32ab78300 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:01.389970 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-729e4895-0db4-4bfe-990a-c7346d72dc6f req-a4a7283b-0f98-47b0-b13d-20ce1f331c9e service nova] Creating event network-vif-unplugged:906acb93-d3df-4172-9bd4-2c6bedb7688c for instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc on n-h1-master-1 Jul 01 10:40:01.393931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:01.394743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:01.407457 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-729e4895-0db4-4bfe-990a-c7346d72dc6f req-a4a7283b-0f98-47b0-b13d-20ce1f331c9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110675 Jul 01 10:40:01.409819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.410730 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1672/3386] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:01.411221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.412245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.421668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.433784 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.434198 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:01.434906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd HTTP/1.1 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: exception: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd5c714a3-ef52-4f61-9e38-db2a6d5cf2fd'} Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:01.437743 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.441800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.450350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:01.450471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.450650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.450936 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9577bd69-ba74-4cf7-ab3c-2fa5552ce797 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 404 len: 111 microversion: 2.1 time: 0.067082 Jul 01 10:40:01.452181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.455388 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1715/3387] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:40:01 2022] DELETE /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:01.457706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.471216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3fe27739-5678-44b6-b61d-5bd36298558d req-e776ba57-22ac-4e5a-9ed2-720e93464c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc378ab-395f-4871-b6eb-bcac4ddfcfcc", "name": "network-vif-deleted", "tag": "906acb93-d3df-4172-9bd4-2c6bedb7688c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:01.499751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3fe27739-5678-44b6-b61d-5bd36298558d req-e776ba57-22ac-4e5a-9ed2-720e93464c9c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.500543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3fe27739-5678-44b6-b61d-5bd36298558d req-e776ba57-22ac-4e5a-9ed2-720e93464c9c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.529032 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3fe27739-5678-44b6-b61d-5bd36298558d req-e776ba57-22ac-4e5a-9ed2-720e93464c9c service nova] Creating event network-vif-deleted:906acb93-d3df-4172-9bd4-2c6bedb7688c for instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc on n-h1-master-1 Jul 01 10:40:01.535959 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3fe27739-5678-44b6-b61d-5bd36298558d req-e776ba57-22ac-4e5a-9ed2-720e93464c9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082189 Jul 01 10:40:01.542117 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1716/3388] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:40:01.566311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:01.567435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] [instance: d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:01.586278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.587323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.589809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.593401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.617666 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] HTTP exception thrown: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Request method failure captured: Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd HTTP/1.1 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs2liYPsmGpTYSzb3IRuWDgA9v3WS0BqvAvi1c4flCYKiEfa9xt7JQi4faqaoyzYXlAaUF8ml3jWos-9ZnlQsN4Cbpx3bPXp3JmyPEfiO7EMcZTvSewF6HjxhaKNztJtasyKxJ8BkdHBzGJj17b0PbrDL45AnmDst9kOHZnZppVm5PU Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a2553a410f24e8f9552704e7e9c14f2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a2553a410f24e8f9552704e7e9c14f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a2553a410f24e8f9552704e7e9c14f2 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-309014139 Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: cc8012fcb48840f1b778ab759457e66c Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-309014139-project Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: exception: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd5c714a3-ef52-4f61-9e38-db2a6d5cf2fd'} Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:01.629085 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:01.633113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] Returning 404 to user: Instance d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:01.651302 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4c90e7e-62cc-4362-b2bf-8529837dcec5 tempest-DeleteServersTestJSON-309014139 tempest-DeleteServersTestJSON-309014139-project] 10.222.0.23 "GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd" status: 404 len: 111 microversion: 2.1 time: 0.098683 Jul 01 10:40:01.652025 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1717/3389] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:01 2022] GET /compute/v2.1/servers/d5c714a3-ef52-4f61-9e38-db2a6d5cf2fd => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:01.665408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:01.666022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:01.680507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.681269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.683714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.684115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.771977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:01.781746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea3c0c21-d01c-4100-8703-da50fbaeacb6 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1633 microversion: 2.1 time: 0.352163 Jul 01 10:40:01.794796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1673/3390] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:01 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1633 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:01.911933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:01.912543 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:01.928293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.928792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:01.929907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:01.933337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.137010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:02.146001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:02.147496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:02.159298 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4fef17fe-d373-4084-8275-4d27ef19872d tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.251335 Jul 01 10:40:02.159884 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1674/3391] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:01 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:40:02.188294 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:02.190259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:02.214457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.214906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.215687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.216117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.298481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:02.310832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f1c58d1-d32c-4f5e-ba93-167d67b8fbd6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.656943 Jul 01 10:40:02.311716 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1718/3392] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:01 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:02.325718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:02.326793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] [instance: c4d5f7e5-c239-4d67-8350-35e6cc070a68] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:02.342831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.343556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.344231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lazy-loading 'fault' on Instance uuid 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:40:02.359529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.360371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.363349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.366185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.390735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] HTTP exception thrown: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 could not be found. Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Request method failure captured: Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 HTTP/1.1 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivszjVKMte_ts7Jv-cDXMyjEhSnWz4wS387Uwsvp-vYY217jOuWA3zd3eYQwA0Rdq-dIzXtVGejeSrtv9BFzN-ilT4kjM3B3cvV2_OtGIFVGLYEr3XxTz7dW8aIY0qr29FrYLv9cAbipRXnW_Yk7WImY61dlPvgqjsTiGaAS2IAYFNw4 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb942eeb3788403687ba800c070babd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb942eeb3788403687ba800c070babd5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb942eeb3788403687ba800c070babd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: cb942eeb3788403687ba800c070babd5 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-1562998632 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: adf336817b04429b930e1f80ea25b1f7 Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-1562998632-project Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: exception: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 could not be found. Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c4d5f7e5-c239-4d67-8350-35e6cc070a68'} Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 could not be found. Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 could not be found. Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:02.394561 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:02.399913 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:02.399913 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:02.399913 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:02.399913 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:02.399913 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:02.399913 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 could not be found. Jul 01 10:40:02.399913 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:02.406193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Returning 404 to user: Instance c4d5f7e5-c239-4d67-8350-35e6cc070a68 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:02.407929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f8e2193-d692-4116-b3c9-fcd85587855c tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68" status: 404 len: 111 microversion: 2.1 time: 0.095061 Jul 01 10:40:02.410487 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1719/3393] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:02 2022] GET /compute/v2.1/servers/c4d5f7e5-c239-4d67-8350-35e6cc070a68 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:02.426576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ecf0ee24-5252-440f-a830-a049b3921db8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] Calling method '.version_select at 0x7f6f910174c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:02.433362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a16defab134f49bbfe5c3f2ee78a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4c26e597d49ae899b1383eb9d7bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:02.444102 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bde225e0-d760-4f81-a983-ff3de37bb810 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 200 len: 1313 microversion: 2.1 time: 0.264578 Jul 01 10:40:02.447439 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1675/3394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:02 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:02.579383 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ecf0ee24-5252-440f-a830-a049b3921db8 tempest-ServerActionsTestJSON-1562998632 tempest-ServerActionsTestJSON-1562998632-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804035014" status: 202 len: 0 microversion: 2.1 time: 0.157868 Jul 01 10:40:02.584135 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1720/3395] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804035014 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:40:02.801299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:02.802507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:02.818382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.820385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.822759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.825128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.941332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:02.944508 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:02.950409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lazy-loading 'fault' on Instance uuid db908b28-e5e5-4cdf-bd6b-85c797a4bb32 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:40:03.087114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af167555982f4953b40878dc2492bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a49743b1a4d548f03f1b1e8b0df33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:03.097274 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b1feafb-38f0-45e7-901d-b601a3982b23 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 200 len: 1359 microversion: 2.1 time: 0.301243 Jul 01 10:40:03.101939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1676/3396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:02 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:03.182710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:03.183422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:03.195417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.196405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.197621 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.198258 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.327953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:03.328955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:03.329990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:03.343353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:03.344505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:03.345851 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8a07b97-cdf9-4fd4-9a61-b329b6cd6d58 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.169632 Jul 01 10:40:03.346432 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1721/3397] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:03 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:40:03.364515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.367735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.368814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.369578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.472453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:03.474054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] [instance: 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:03.476354 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:03.494625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.501594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.502623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.504541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.536425 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] HTTP exception thrown: Instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc could not be found. Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Request method failure captured: Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc HTTP/1.1 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs7Y8SXA15_x2xn7LcQ_ElG1rcvOxY20tQXZcNKTSSSHfeHcEJXmkRz2T4B8zH2eazHbRXpWot7jV1H3L3i2iztJkSbv9QIzMRjEzyruj1t_Ot7-MUBQZQdqXgf3KyZR--3wbj31SWaH10A2YEoxSzyqrl0lKhbFEpmMnPt_X4hGZFo Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ce4c26e597d49ae899b1383eb9d7bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ce4c26e597d49ae899b1383eb9d7bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 6ce4c26e597d49ae899b1383eb9d7bb6 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1685167421 Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 13a16defab134f49bbfe5c3f2ee78a4e Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ListServersNegativeTestJSON-1685167421-project Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc could not be found. Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3cc378ab-395f-4871-b6eb-bcac4ddfcfcc'} Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc could not be found. Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc could not be found. Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:03.539245 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:03.543149 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:03.543149 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:03.543149 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:03.543149 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:03.543149 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:03.543149 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc could not be found. Jul 01 10:40:03.543149 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:03.558513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] Returning 404 to user: Instance 3cc378ab-395f-4871-b6eb-bcac4ddfcfcc could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:03.559729 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e5eb439-45d6-4c25-a723-d8d248955908 tempest-ListServersNegativeTestJSON-1685167421 tempest-ListServersNegativeTestJSON-1685167421-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc" status: 404 len: 111 microversion: 2.1 time: 0.091496 Jul 01 10:40:03.561393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1722/3398] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:03 2022] GET /compute/v2.1/servers/3cc378ab-395f-4871-b6eb-bcac4ddfcfcc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:40:03.568831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f3f75ce3-8961-43c0-a229-a31c9cf7d56d req-fa19b897-6a77-4286-b762-53ad7dad47d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90661f1e-ecda-4ea8-99c9-ca7fe1434b86", "name": "network-vif-plugged", "status": "completed", "tag": "800ffdd2-a08c-47ca-9832-cd3ac49ad796"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:03.583704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f3f75ce3-8961-43c0-a229-a31c9cf7d56d req-fa19b897-6a77-4286-b762-53ad7dad47d6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.588874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f3f75ce3-8961-43c0-a229-a31c9cf7d56d req-fa19b897-6a77-4286-b762-53ad7dad47d6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.631468 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f3f75ce3-8961-43c0-a229-a31c9cf7d56d req-fa19b897-6a77-4286-b762-53ad7dad47d6 service nova] Creating event network-vif-plugged:800ffdd2-a08c-47ca-9832-cd3ac49ad796 for instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 on n-h2-master-1 Jul 01 10:40:03.649881 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f3f75ce3-8961-43c0-a229-a31c9cf7d56d req-fa19b897-6a77-4286-b762-53ad7dad47d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086965 Jul 01 10:40:03.655212 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1723/3399] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:03.697969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6df48679-34de-42b6-8b10-f0cf038ccbe7 req-0c0a752a-ae93-4d43-ade7-f52eb065e381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db908b28-e5e5-4cdf-bd6b-85c797a4bb32", "name": "network-vif-deleted", "tag": "8bb1f637-2aef-4d30-b38c-5392c3c741da"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:03.719127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6df48679-34de-42b6-8b10-f0cf038ccbe7 req-0c0a752a-ae93-4d43-ade7-f52eb065e381 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:03.719632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6df48679-34de-42b6-8b10-f0cf038ccbe7 req-0c0a752a-ae93-4d43-ade7-f52eb065e381 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:03.753304 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6df48679-34de-42b6-8b10-f0cf038ccbe7 req-0c0a752a-ae93-4d43-ade7-f52eb065e381 service nova] Creating event network-vif-deleted:8bb1f637-2aef-4d30-b38c-5392c3c741da for instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 on n-h1-master-1 Jul 01 10:40:03.764698 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:03.767817 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6df48679-34de-42b6-8b10-f0cf038ccbe7 req-0c0a752a-ae93-4d43-ade7-f52eb065e381 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074252 Jul 01 10:40:03.769666 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1724/3400] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:40:03.874175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:03.882922 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5fa502a-7a5d-4dfe-9482-de7489c43ef8 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.558729 Jul 01 10:40:03.886533 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1677/3401] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:03 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:04.119244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:04.120347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] [instance: db908b28-e5e5-4cdf-bd6b-85c797a4bb32] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:04.128546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:04.129001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:04.129843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:04.130287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:04.144090 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:04.163210 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] HTTP exception thrown: Instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 could not be found. Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Request method failure captured: Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 HTTP/1.1 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6uQ9qEKzZxwCeWc4fpSQD6YdJGkNeQZqrjBHdjElmdplNIaLSOC8UPA2wDnGM7Ml1zk1gYUbbMYbmgrSsRcaz9JVXELBD-f9LrrWyZ1xeSf4LhncqSd2pzWuhcSjHK2-q7McjZrHmAanV4TKLH9TI_boWVInEzVgJH1kRubJzUbJY Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: d44a49743b1a4d548f03f1b1e8b0df33 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-1167015617 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44a49743b1a4d548f03f1b1e8b0df33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d44a49743b1a4d548f03f1b1e8b0df33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d44a49743b1a4d548f03f1b1e8b0df33", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44a49743b1a4d548f03f1b1e8b0df33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-1167015617 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: d44a49743b1a4d548f03f1b1e8b0df33 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-1167015617 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-1167015617-project Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: af167555982f4953b40878dc2492bd21 Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-1167015617-project Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: exception: Instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 could not be found. Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'db908b28-e5e5-4cdf-bd6b-85c797a4bb32'} Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 could not be found. Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 could not be found. Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:04.166572 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 could not be found. Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Returning 404 to user: Instance db908b28-e5e5-4cdf-bd6b-85c797a4bb32 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:04.173050 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0266a2c8-5bde-4b02-aa4e-149b275d1115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32" status: 404 len: 111 microversion: 2.1 time: 0.056742 Jul 01 10:40:04.196602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4202a408-ba84-4ed4-906f-c4757aea8115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] Calling method '.version_select at 0x7f6f90e3b160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:04.196941 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=16 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:04.198393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1725/3402] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:04 2022] GET /compute/v2.1/servers/db908b28-e5e5-4cdf-bd6b-85c797a4bb32 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:04.367400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:04.368252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:04.392223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:04.392223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:04.393107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:04.393747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:04.415715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4202a408-ba84-4ed4-906f-c4757aea8115 tempest-ServersTestJSON-1167015617 tempest-ServersTestJSON-1167015617-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728395592" status: 202 len: 0 microversion: 2.1 time: 0.236306 Jul 01 10:40:04.416309 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1678/3403] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:40:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728395592 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:40:04.636524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:04.652378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:04.653935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:04.662265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e3327e70-90a6-4c35-9fc6-532f1dca4cf5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.300232 Jul 01 10:40:04.681943 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1726/3404] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:04 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:04.903503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:04.905779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:04.925633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:04.936870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:04.936870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:04.936870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:05.368123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:05.381605 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e6d105f8-38c6-48da-bedd-670732513717 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.482055 Jul 01 10:40:05.382514 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1679/3405] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:04 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:05.680874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:05.681515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:05.684897 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:05.695836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:05.702495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:05.702495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:05.702495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:05.837460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:05.854284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:05.862625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:05.864295 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c02c7913-df8c-45b1-8f29-f6add22f6e1e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.188292 Jul 01 10:40:05.865429 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1727/3406] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:05 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:06.399021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:06.399817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:06.422926 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:06.423379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:06.430237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:06.430695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:06.884502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:06.885930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:06.900472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:06.901535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:06.903995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:06.905680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:06.908814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:06.917700 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e25b44a-c10a-4972-bf41-de3e81552077 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.522772 Jul 01 10:40:06.927129 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1680/3407] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:06 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:07.048177 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:07.063573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:07.068773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:07.070340 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-afb45ffc-3989-4068-b648-61f67a460e99 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.190128 Jul 01 10:40:07.072981 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1728/3408] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:06 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:07.939624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:07.941186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:07.954628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:07.957783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:07.958865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:07.963237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:08.093811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:08.094601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:08.111357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:08.111872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:08.112901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:08.113606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:08.267694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:08.279982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:08.284547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:08.285936 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f80431f0-6018-4c73-95a4-7026bce011cc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.198003 Jul 01 10:40:08.290709 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1729/3409] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:08 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:40:08.481720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:08.493873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f249e9a8-b6fc-4f56-8d9f-4709d75ed36b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.558092 Jul 01 10:40:08.501384 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1681/3410] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:07 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:09.308422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:09.311348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:09.313452 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:09.325537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:09.326986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:09.328200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:09.328750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:09.476284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:09.485958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:09.488348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:09.490057 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0d5409b5-4b75-40a8-9496-9f68af5ba2b8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.185871 Jul 01 10:40:09.491145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1730/3411] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:09 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:09.517657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:09.518387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:09.528595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:09.529745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:09.530641 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:09.531306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:09.834581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:09.848072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f27f9d7-a08e-4660-99f8-0078e7684892 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.334847 Jul 01 10:40:09.851410 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1682/3412] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:09 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:10.510470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:10.511216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:10.523989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:10.528195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:10.530668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:10.535265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:10.800961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:10.812965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:10.816630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:10.819346 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea607c34-4beb-4fa9-bee9-8dc45238d0bd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.313031 Jul 01 10:40:10.820499 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1731/3413] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:10 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:10.871359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:10.872666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:10.891193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:10.891908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:10.894583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:10.897443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:11.247408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:11.296896 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5544df5f-26fc-4102-a8f1-c10c48399436 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.412445 Jul 01 10:40:11.296896 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1683/3414] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:10 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:11.844251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:11.850593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:11.900876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:11.909984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:11.912992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:11.915885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:12.113835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:12.131864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:12.133817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:12.135640 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ba94ea9-f98c-442a-b028-8e73905667eb tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.298181 Jul 01 10:40:12.149305 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1732/3415] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:11 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:12.300636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:12.302844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:12.331928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:12.333974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:12.335098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:12.335752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:12.663208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:12.677361 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f32f11a-7913-4ceb-b252-5cb5907d41e4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.381754 Jul 01 10:40:12.692198 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1684/3416] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:12 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:13.155661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:13.157171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:13.177631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:13.179471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:13.186356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:13.189024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:13.362959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6f7e7a80-f6c5-4ab2-90b7-8eb2f16bdbe3 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:13.366402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6f7e7a80-f6c5-4ab2-90b7-8eb2f16bdbe3 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:13.376079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f7e7a80-f6c5-4ab2-90b7-8eb2f16bdbe3 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:13.381445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f7e7a80-f6c5-4ab2-90b7-8eb2f16bdbe3 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:13.381445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f7e7a80-f6c5-4ab2-90b7-8eb2f16bdbe3 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:13.381445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f7e7a80-f6c5-4ab2-90b7-8eb2f16bdbe3 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:13.519685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:13.533827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:13.537679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:13.542870 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3b36603-d041-47fa-8f00-7b28d02570dd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.391484 Jul 01 10:40:13.556732 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1733/3417] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:13 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:13.701833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:13.701833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:13.711231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:13.711986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:13.716906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:13.717741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:14.137353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6f7e7a80-f6c5-4ab2-90b7-8eb2f16bdbe3 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1856 microversion: 2.1 time: 0.787141 Jul 01 10:40:14.138358 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1685/3418] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:13 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1856 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:14.155251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:14.157728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:14.165380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:14.166026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:14.167021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:14.167798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:14.205256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lazy-loading 'flavor' on Instance uuid cde88491-5e85-4abb-8121-4cde61f444f4 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:40:14.223584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Going to try to live migrate instance to n-h1-master-1 {{(pid=119765) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:40:14.242727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:14.255639 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64499076-5c23-4380-a9ff-30938fe45cf4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.561062 Jul 01 10:40:14.265865 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1734/3419] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:13 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:14.417040 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:14.562672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:14.563347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:14.577185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:14.577890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:14.581346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:14.582775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:14.709771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:14.728310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:14.733389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:14.741320 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1278b70d-c9c0-40ba-afff-10caf8d15618 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.176723 Jul 01 10:40:14.741320 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1735/3420] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:14 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:15.294373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:15.299798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:15.306163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:15.308801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:15.311875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:15.314036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:15.715776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:15.724779 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a45358cf-cacb-46b8-ba07-da2d6a287481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.434097 Jul 01 10:40:15.726001 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1736/3421] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:15 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:15.756378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:15.757592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:15.765769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:15.766224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:15.767210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:15.767655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:15.888542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:15.900580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:15.907238 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:15.907570 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e745386-d45a-4f9f-b896-b51e30105c22 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.156799 Jul 01 10:40:15.923966 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1737/3422] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:15 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:40:16.745607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:16.749718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:16.753938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:16.754468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:16.755326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:16.755831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:17.145353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:17.158038 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-597c8e19-5842-4627-acf4-5ec2a7088059 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.416203 Jul 01 10:40:17.161225 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1738/3423] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:16 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:17.179683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:17.180392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:17.196731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:17.199773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:17.201683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:17.202801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:17.285969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:17.297729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:17.299347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:17.300678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-672ee877-d532-45be-bab5-7d37cc06ffe1 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.138468 Jul 01 10:40:17.301353 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1739/3424] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:17 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:18.146090 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-88abb7db-f95a-4b5c-afb8-fd4c7a28e916 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/action" status: 202 len: 0 microversion: 2.1 time: 3.995953 Jul 01 10:40:18.147296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1686/3425] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:40:14 2022] POST /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/action => generated 0 bytes in 3998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:40:18.155622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:18.156261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:18.167821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:18.169088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:18.177649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:18.178656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:18.187010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:18.188480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:18.197261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:18.198217 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:18.202032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:18.204983 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:19.115623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:19.126628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:19.132237 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e39b0a9-012d-498e-87a6-67989d605103 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.980727 Jul 01 10:40:19.135401 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1740/3426] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:18 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:19.149987 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2f293ef-44a6-440b-a220-7ba8578f9585 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.964315 Jul 01 10:40:19.149987 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1687/3427] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:18 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:19.149987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:19.149987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:19.165783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:19.171046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:19.172150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:19.172800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:19.300946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:19.311974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:19.319087 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:19.320488 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-97194b37-a4ba-48a9-9d16-ff28b2ec796f tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.181907 Jul 01 10:40:19.333181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1688/3428] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:19 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:19.462885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a099f79f-f16a-41a7-a68e-6a70629d2d91 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Action: 'create', calling method: .version_select at 0x7f6f90d9dd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1046744861"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:20.157672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:20.158461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:20.166255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:20.166844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:20.167871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:20.168541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:20.327607 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a099f79f-f16a-41a7-a68e-6a70629d2d91 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.190869 Jul 01 10:40:20.328541 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1741/3429] 10.222.0.23 () {60 vars in 1154 bytes} [Fri Jul 1 10:40:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1192 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 10:40:20.333914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:20.334837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:20.358173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:20.359284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:20.362651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:20.363239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:20.684954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:20.700248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0bfce0ee-8979-4501-b000-7528b656708b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.546442 Jul 01 10:40:20.712419 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1689/3430] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:20 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:20.724292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0140be86-c527-4a4d-b427-994980a83575 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90ee0dc0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:20.858573 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0140be86-c527-4a4d-b427-994980a83575 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 200 len: 345 microversion: 2.1 time: 0.143325 Jul 01 10:40:20.859744 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1690/3431] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:20 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:20.864664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:20.865556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:20.883610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:20.884293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:20.885406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:20.886097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:20.910954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:20.920840 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31198919-3067-4430-bbb2-3c547e8a19e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.590997 Jul 01 10:40:20.926079 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1742/3432] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:20 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:21.155451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:21.166342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:21.178654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:21.180833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d128b5f-0926-450d-90fa-35550550bcdd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.319866 Jul 01 10:40:21.181708 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1691/3433] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:20 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:21.719391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:21.720010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:21.727508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:21.727956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:21.729697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:21.733113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:21.753584 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:21.882177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2f9591e0-f537-411c-a4ba-bada39465f92 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90ecbc10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:22.008790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:22.030522 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2f9591e0-f537-411c-a4ba-bada39465f92 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 200 len: 345 microversion: 2.1 time: 0.162632 Jul 01 10:40:22.035849 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7c3dafa9-e51e-4ed7-a3a6-3b55eed0af65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.313258 Jul 01 10:40:22.036112 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1692/3434] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:21 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:40:22.041493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:22.043201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:22.047341 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1743/3435] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:21 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:22.057805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:22.062644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:22.063583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:22.064278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:22.211730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:22.221975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:22.239334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:22.243103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:22.248157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:22.248898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:22.427542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:22.444984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:22.446896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:22.449396 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-429b29e6-932e-46db-aaa2-519c869abacd tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.242221 Jul 01 10:40:22.453579 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1744/3436] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:22 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:40:22.461732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:22.472007 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-861df24e-2628-4766-89a9-2d7125e8ab09 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.433120 Jul 01 10:40:22.473526 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1693/3437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:22 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:23.043780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c8f9606-79e5-451a-af83-db1991d9fe36 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90db5280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:23.055526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:23.058616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:23.071956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:23.073993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:23.076088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:23.079622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:23.253940 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c8f9606-79e5-451a-af83-db1991d9fe36 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 200 len: 346 microversion: 2.1 time: 0.214500 Jul 01 10:40:23.260660 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1745/3438] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:23 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 346 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:23.268455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f0b49ce-2bda-4865-8fc6-e7919940c937 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Action: 'create', calling method: .version_select at 0x7f6f90da6c10>, body: {"snapshot": {"volume_id": "34cc3cf9-5f76-4975-94be-c2160318ee92", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1078760350"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:23.663927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:23.677910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c56e76cd-b6a5-4f7a-aa95-0f26882bfd81 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.627417 Jul 01 10:40:23.683396 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1694/3439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:23 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:23.688378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:23.691616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:23.709020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:23.709775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:23.710551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:23.711154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:23.850554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:23.866951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:23.868611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:23.875637 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d33539b7-805f-4b18-8395-e9e7b446f143 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.188625 Jul 01 10:40:23.876753 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1695/3440] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:23 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:23.887520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:23.891094 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:23.910090 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:23.911900 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:23.912518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:23.913668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:23.914272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:24.146424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f0b49ce-2bda-4865-8fc6-e7919940c937 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.884545 Jul 01 10:40:24.148051 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1746/3441] 10.222.0.23 () {60 vars in 1161 bytes} [Fri Jul 1 10:40:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:40:24.157899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5217dd23-d2ac-413b-a941-7a373e3b8d77 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90d93280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:24.219073 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5217dd23-d2ac-413b-a941-7a373e3b8d77 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 287 microversion: 2.1 time: 0.065439 Jul 01 10:40:24.220266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1747/3442] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:24 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:24.229912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb94a503-247c-442d-aa8e-e424dd17aa71 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90db5e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:24.324612 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb94a503-247c-442d-aa8e-e424dd17aa71 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.098407 Jul 01 10:40:24.327888 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1748/3443] 10.222.0.23 () {58 vars in 1139 bytes} [Fri Jul 1 10:40:24 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:40:24.340692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a93bee11-04de-4221-8b6c-aa7c8ce1e636 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f96f4eb80>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:24.381633 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a93bee11-04de-4221-8b6c-aa7c8ce1e636 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 287 microversion: 2.1 time: 0.045530 Jul 01 10:40:24.383398 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1749/3444] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:24 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:24.415339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:24.425490 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-061ebb4b-a7c5-426a-9a7f-b358238d926e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1528 microversion: 2.1 time: 0.546609 Jul 01 10:40:24.435873 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1696/3445] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:23 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1528 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:24.699911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:24.701094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:24.732955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:24.733444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:24.736642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:24.737352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:24.895080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:24.896058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:24.908137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:24.908525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:24.916708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:24.917941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:25.087368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:25.100458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:25.104628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:25.109763 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-36eb93e1-8f16-4c80-bc34-6f47bc403a01 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.212563 Jul 01 10:40:25.110783 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1697/3446] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:24 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:40:25.162452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:25.173603 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c74d70ce-d091-464e-9d0a-140b242e65b4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.477470 Jul 01 10:40:25.174196 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1750/3447] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:24 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:25.394409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-799d00ff-03f3-4225-9512-e11c7d772c41 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90e3b280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:25.444386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:25.445590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:25.458903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:25.460728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:25.466627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:25.467250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:25.489593 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-799d00ff-03f3-4225-9512-e11c7d772c41 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 287 microversion: 2.1 time: 0.099181 Jul 01 10:40:25.490661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1698/3448] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:25 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:26.128734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:26.129538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:26.142566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:26.148891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:26.148891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:26.148891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:26.428194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:26.445395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:26.454963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:26.457770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:26.462828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-382bae18-065e-4160-b718-3a3ae48ef4f8 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.337222 Jul 01 10:40:26.466524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0680e1a6-4d86-411b-907e-62bacb59766d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1510 microversion: 2.1 time: 1.025547 Jul 01 10:40:26.478717 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1751/3449] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:25 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1510 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:26.484922 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1699/3450] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:26 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:26.490090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:26.490713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:26.504148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9bbd520d-253e-4704-bd88-41c6de380c1b tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90ee0310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:26.506900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:26.507568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:26.512584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:26.513893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:26.587023 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9bbd520d-253e-4704-bd88-41c6de380c1b tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 287 microversion: 2.1 time: 0.088739 Jul 01 10:40:26.587023 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1700/3451] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:26 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:27.031561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:27.044039 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7eaeda38-3305-4c09-9c95-ea97ced40e08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.560879 Jul 01 10:40:27.045359 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1752/3452] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:26 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:27.484982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:27.485586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:27.485956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:27.487485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:27.498573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:27.499027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:27.500256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:27.501436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:27.502802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:27.504813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:27.507266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:27.507864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:27.827863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:27.846505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:27.848561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:27.851521 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3b5511af-322a-4e9c-af3a-b4ce791247e5 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.371095 Jul 01 10:40:27.856201 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1701/3453] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:27 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:27.866134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-95b8b0e0-c23c-41ec-aecb-0c7c9df824e4 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90ee05e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:27.940661 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-95b8b0e0-c23c-41ec-aecb-0c7c9df824e4 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 288 microversion: 2.1 time: 0.082166 Jul 01 10:40:27.942120 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1702/3454] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:27 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:27.954300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-779e15af-42ca-4d1b-a818-437ddb3235ea tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f9145aee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:27.986901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:28.002385 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a06bcc2-f372-429b-a5ce-6cd0934523ee tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1510 microversion: 2.1 time: 0.514143 Jul 01 10:40:28.002385 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1753/3455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:27 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:28.062031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:28.071472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:28.073200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:28.073758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:28.074548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:28.081167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:28.179101 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-779e15af-42ca-4d1b-a818-437ddb3235ea tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 202 len: 0 microversion: 2.1 time: 0.229957 Jul 01 10:40:28.186227 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1703/3456] 10.222.0.23 () {58 vars in 1253 bytes} [Fri Jul 1 10:40:27 2022] DELETE /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:40:28.194455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-33cbde1b-8d47-47f4-83e9-1e13f69a3f84 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f91170ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:28.255667 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-33cbde1b-8d47-47f4-83e9-1e13f69a3f84 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 287 microversion: 2.1 time: 0.065184 Jul 01 10:40:28.257851 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1704/3457] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:28 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:28.355087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:28.363902 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c4b94393-354f-49ff-bc04-846a1b6d70ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.306686 Jul 01 10:40:28.364574 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1754/3458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:28 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:28.875635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:28.879672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:28.896374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:28.898734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:28.906368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:28.907105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:29.011894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:29.012560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:29.039430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:29.039701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:29.040508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:29.040954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:29.067643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:29.083099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:29.089809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:29.093628 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d620ea2-08e0-4a6f-b955-15e384fb44b4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.222767 Jul 01 10:40:29.095807 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1705/3459] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:28 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:29.161424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-aa7dbdc7-c260-404c-862b-99c5410a8a85 req-3aa67b1f-8597-46e1-8976-098e5b1fa2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90661f1e-ecda-4ea8-99c9-ca7fe1434b86", "name": "network-vif-unplugged", "status": "completed", "tag": "800ffdd2-a08c-47ca-9832-cd3ac49ad796"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:29.181822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-aa7dbdc7-c260-404c-862b-99c5410a8a85 req-3aa67b1f-8597-46e1-8976-098e5b1fa2f1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:29.185621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-aa7dbdc7-c260-404c-862b-99c5410a8a85 req-3aa67b1f-8597-46e1-8976-098e5b1fa2f1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:29.286867 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-aa7dbdc7-c260-404c-862b-99c5410a8a85 req-3aa67b1f-8597-46e1-8976-098e5b1fa2f1 service nova] Creating event network-vif-unplugged:800ffdd2-a08c-47ca-9832-cd3ac49ad796 for instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 on n-h2-master-1 Jul 01 10:40:29.300548 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-aa7dbdc7-c260-404c-862b-99c5410a8a85 req-3aa67b1f-8597-46e1-8976-098e5b1fa2f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141297 Jul 01 10:40:29.304223 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1706/3460] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:40:29.317168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:29.317721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-058108aa-74c6-495e-a778-cf5f662b46f2 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90eeaa60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:29.324863 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d866238e-db0b-4505-bb48-3dbc99e30d67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1510 microversion: 2.1 time: 0.316854 Jul 01 10:40:29.327571 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1755/3461] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:29 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:29.381867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:29.389407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:29.389700 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-058108aa-74c6-495e-a778-cf5f662b46f2 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 287 microversion: 2.1 time: 0.076537 Jul 01 10:40:29.389700 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1707/3462] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:29 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:29.391818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:29.393851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:29.394535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:29.394980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:29.675305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:29.690207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-83602b44-da65-4317-bd50-85c77ad96bf3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.312341 Jul 01 10:40:29.705446 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1756/3463] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:29 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:30.113681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:30.115101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:30.129265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.129719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:30.130505 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.130934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:30.247902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:30.256245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:30.257793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:30.263134 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e21af9bb-dbd9-4a6e-84b5-fa92adaeb816 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.149322 Jul 01 10:40:30.263134 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1708/3464] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:30 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:30.345777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:30.347821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:30.366315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.366898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:30.368412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.368955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:30.395924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff87ef8f-4b9b-4e42-8589-131f5c1b1a9d tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90eeae50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:30.535141 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff87ef8f-4b9b-4e42-8589-131f5c1b1a9d tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 200 len: 287 microversion: 2.1 time: 0.143228 Jul 01 10:40:30.539854 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1709/3465] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:30 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:30.711462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:30.712280 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:30.732697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.733341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:30.740483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.741356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:30.812314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:30.829323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec70ddfc-986f-4664-9fc5-f710944c2b8a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1513 microversion: 2.1 time: 0.489137 Jul 01 10:40:30.830783 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1757/3466] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:30 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1513 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:30.848197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:30.848907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:30.867124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.867579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:30.868382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:30.868825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:31.024936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:31.039646 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d20cd37-22ef-478c-9775-0fa7d5ee3d75 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.335758 Jul 01 10:40:31.040649 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1710/3467] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:30 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:31.281348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:31.281989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:31.305415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:31.305934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:31.306794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:31.313125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:31.406785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:31.426666 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc6b3e8e-aab4-43cb-94f6-a821db226163 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1453 microversion: 2.1 time: 0.583499 Jul 01 10:40:31.427350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1758/3468] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:30 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1453 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:31.512548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:31.512548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:31.526965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:31.529242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:31.533024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:31.533547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:31.619588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lazy-loading 'flavor' on Instance uuid 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:40:31.647649 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Cannot 'shelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state shelved_offloaded Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action HTTP/1.1 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 14 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: {"shelve": {}} Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: exception: Cannot 'shelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state shelved_offloaded Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'shelve': {}}} Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 01 10:40:31.649790 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state shelved_offloaded Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state shelved_offloaded Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 409 to user: Cannot 'shelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state shelved_offloaded {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a3e45ed9-89cb-4870-9523-9f3fc286c090 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 409 len: 155 microversion: 2.1 time: 0.146833 Jul 01 10:40:31.659993 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1759/3469] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:40:31 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 155 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:40:31.666426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e4a17a1-0b89-45b4-bd73-7c2c468d078c tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f97125430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:31.707072 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3e4a17a1-0b89-45b4-bd73-7c2c468d078c tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] HTTP exception thrown: Snapshot df35cacd-0a99-44b6-ab0c-d30999729108 could not be found. Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e4a17a1-0b89-45b4-bd73-7c2c468d078c tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Request method failure captured: Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 HTTP/1.1 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8SN36OS9QNWu51SN0mSm7C1jLcb35NisLVSZn68XbzmmnsMo1-FKYmAt3ZmeYDClIG-v6tAJhsFK8i5_hRrvzi8wBu5Z15N7LElJd-DXc5RW_KsrpIf0VmpwgaZKKFXA4KtJJXf6AHPfN7PsXn_x_Iglc_bYgUmJBUbPY3g7zcm7Y Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5aa94177f874cef928a18ab59b7bde3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0e46b6fcfe8b464e95d56d1415009686 Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: exception: Snapshot df35cacd-0a99-44b6-ab0c-d30999729108 could not be found. Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'df35cacd-0a99-44b6-ab0c-d30999729108'} Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot df35cacd-0a99-44b6-ab0c-d30999729108 could not be found. (HTTP 404) (Request-ID: req-a4dd288c-becf-4fb2-a3c8-94c183c5c8e2) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:40:31.735258 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot df35cacd-0a99-44b6-ab0c-d30999729108 could not be found. Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot df35cacd-0a99-44b6-ab0c-d30999729108 could not be found. Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot df35cacd-0a99-44b6-ab0c-d30999729108 could not be found. Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e4a17a1-0b89-45b4-bd73-7c2c468d078c tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Returning 404 to user: Snapshot df35cacd-0a99-44b6-ab0c-d30999729108 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e4a17a1-0b89-45b4-bd73-7c2c468d078c tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108" status: 404 len: 111 microversion: 2.1 time: 0.084222 Jul 01 10:40:31.743610 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1760/3470] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 10:40:31 2022] GET /compute/v2.1/os-snapshots/df35cacd-0a99-44b6-ab0c-d30999729108 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:31.747876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6338949-ce82-4484-8abe-1243a360425c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:31.748412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6338949-ce82-4484-8abe-1243a360425c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:31.763151 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6338949-ce82-4484-8abe-1243a360425c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:31.763606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6338949-ce82-4484-8abe-1243a360425c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:31.765094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6338949-ce82-4484-8abe-1243a360425c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:31.768562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6338949-ce82-4484-8abe-1243a360425c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:31.775478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:31.792250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:31.798627 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:31.804776 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31a7685f-d598-4c5b-afb8-7b81fb8083bc tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1409 microversion: 2.54 time: 0.523884 Jul 01 10:40:31.804776 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1711/3471] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:31 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1409 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:31.812240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0b62a4bc-61c6-4e63-be82-ebecfa46cadc tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90eea430>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:32.152581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0b62a4bc-61c6-4e63-be82-ebecfa46cadc tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 202 len: 0 microversion: 2.1 time: 0.348759 Jul 01 10:40:32.154274 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1712/3472] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:40:31 2022] DELETE /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:40:32.163260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:32.164067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:32.184126 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6338949-ce82-4484-8abe-1243a360425c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 202 len: 0 microversion: 2.1 time: 0.442969 Jul 01 10:40:32.190824 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1761/3473] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:40:31 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:40:32.191601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d407e53b-aef3-40a4-a41d-1092a4352694 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90d42670>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:32.194357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:32.197547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:32.198808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:32.199741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:32.216117 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:32.284674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d407e53b-aef3-40a4-a41d-1092a4352694 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 200 len: 345 microversion: 2.1 time: 0.097632 Jul 01 10:40:32.285393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1762/3474] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:32 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:32.291161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:32.292828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:32.310327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:32.311157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:32.312186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:32.320074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:32.769298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:32.779177 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8741c89c-3b56-4f6c-9fc8-35fae1edc15a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.623772 Jul 01 10:40:32.792707 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1713/3475] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:32 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:32.801770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:32.832322 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68d913e2-cf60-488a-8c09-77a8e0487751 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1461 microversion: 2.1 time: 0.542233 Jul 01 10:40:32.833319 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1763/3476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:32 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1461 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:32.848524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:32.852485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:32.879719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:32.880538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:32.883765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:32.888020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:32.962934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1020199440", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "371a5971-b423-416e-b4e4-4fcf91e99708"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:33.041799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:33.054124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] validate_networks() for [('371a5971-b423-416e-b4e4-4fcf91e99708', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:40:33.059985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:33.059985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:33.062657 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-727fee7d-09c1-4951-9179-39b231b2e39c tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1415 microversion: 2.54 time: 0.224525 Jul 01 10:40:33.065439 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1764/3477] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:32 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1415 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:33.297628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31f646fa-7a20-4859-a22e-61780843ef63 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f923d1af0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:33.474232 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31f646fa-7a20-4859-a22e-61780843ef63 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 200 len: 345 microversion: 2.1 time: 0.105684 Jul 01 10:40:33.474232 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1765/3478] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:33 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:40:33.800151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:33.800969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:33.811320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:33.814480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:33.818875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:33.819525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:34.464157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:40:34.464649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:40:34.465379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:40:34.466495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:40:34.466902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:40:34.484216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:34.485011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:34.486963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:34.487599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:34.523754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Getting quotas for project c6496f7a52f848ca92de5fb29da0a4e3. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:40:34.557864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Getting quotas for user 7f151eff4474418fbeb4fb009d5bc0bd and project c6496f7a52f848ca92de5fb29da0a4e3. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:40:34.600601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:40:34.607733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:40:34.676147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:34.687195 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e7eb9290-e5ce-489d-8d1d-456b1249f25f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.892355 Jul 01 10:40:34.690691 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1766/3479] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:33 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:34.701961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:34.709767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:34.720806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:34.722342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:34.724888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:34.725781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:34.754016 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:34.862226 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a0daa16b-22fe-408b-88eb-8df21dbc8c29 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.067291 Jul 01 10:40:34.863257 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1714/3480] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:40:34.877244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:34.879033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:34.886491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:34.887250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:34.902784 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:34.904158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:35.163143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:35.182318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:35.184914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:35.188487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:35.202880 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-06b874ec-ea5e-4cd4-9176-4b3f0299e98b tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1400 microversion: 2.54 time: 0.329876 Jul 01 10:40:35.203042 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-47171c09-5476-470a-9e58-237a814d488c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1461 microversion: 2.1 time: 0.505680 Jul 01 10:40:35.203042 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1767/3481] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:34 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1461 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:35.208407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1715/3482] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:34 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1400 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:35.223288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd9ca2e2-c1dc-4d65-8252-43f4a9c3becf tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f911ad3a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:35.296301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1678667320", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:35.357590 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd9ca2e2-c1dc-4d65-8252-43f4a9c3becf tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 200 len: 345 microversion: 2.1 time: 0.146907 Jul 01 10:40:35.358643 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1716/3483] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:35 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:35.363846 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0556174-395a-4c18-9a3d-fd9daac1a8f3 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:35.364914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f0556174-395a-4c18-9a3d-fd9daac1a8f3 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:35.388886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] validate_networks() for [('2006e634-1434-4f2b-944c-5a4cb509d23a', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:40:35.473873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f0556174-395a-4c18-9a3d-fd9daac1a8f3 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:35.496063 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0556174-395a-4c18-9a3d-fd9daac1a8f3 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1225 microversion: 2.1 time: 0.124392 Jul 01 10:40:35.496063 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1717/3484] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:35 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:35.502003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea6f3401-e9ac-472e-aa43-8bc43f7b901e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '.version_select at 0x7f6f913c8430>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:35.646632 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea6f3401-e9ac-472e-aa43-8bc43f7b901e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1430027627" status: 204 len: 0 microversion: 2.54 time: 0.155576 Jul 01 10:40:35.654463 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1718/3485] 10.222.0.23 () {60 vars in 1318 bytes} [Fri Jul 1 10:40:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1430027627 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:40:35.671735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:35.672586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:35.681315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:35.682131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:35.683571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:35.685087 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:35.737598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:40:36.161021 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3aab799d-7cc2-47d8-91ed-a4aef5348dd4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 204 len: 0 microversion: 2.54 time: 0.494684 Jul 01 10:40:36.163938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1719/3486] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:40:35 2022] DELETE /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:40:36.186184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:36.187813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:36.201969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:36.203028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:36.204140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:36.204984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:37.579186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:40:37.580312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:40:37.580973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:40:37.581846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:40:37.583330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:37.583976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:40:37.589378 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=68 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:37.596957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4256954a-54c7-42a4-a6de-f6ba32c6cb89 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 1.430446 Jul 01 10:40:37.597900 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1720/3487] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:36 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:37.606772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:37.609267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:37.609789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:37.611929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:37.613227 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:37.614270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:37.631493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:37.631976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:37.632729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:37.639877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:37.651741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Getting quotas for project 2182bc6e5f9d439a8a146dc2b8aa1219. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:40:37.658560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Getting quotas for user 1787c6f2f7c84dfc9c1ba94d4a04432e and project 2182bc6e5f9d439a8a146dc2b8aa1219. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:40:37.674287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:40:37.677498 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:40:37.850089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:37.859069 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:37.861557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:37.865336 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96043de7-7b6b-42d9-95c0-36530ad0eb31 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1406 microversion: 2.54 time: 0.265620 Jul 01 10:40:37.887507 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1721/3488] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:37 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:37.940580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:37.943013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:37.959833 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e672156-87ad-434a-b546-3caace800eb7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.755175 Jul 01 10:40:37.960507 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1768/3489] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:40:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:40:37.961362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:37.962135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:37.963696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:37.967081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:37.973009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0d8d232-10ef-4607-94fb-0118946c0f0a tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f923d1af0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:38.038637 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f0d8d232-10ef-4607-94fb-0118946c0f0a tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] HTTP exception thrown: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0d8d232-10ef-4607-94fb-0118946c0f0a tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Request method failure captured: Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 HTTP/1.1 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8SN36OS9QNWu51SN0mSm7C1jLcb35NisLVSZn68XbzmmnsMo1-FKYmAt3ZmeYDClIG-v6tAJhsFK8i5_hRrvzi8wBu5Z15N7LElJd-DXc5RW_KsrpIf0VmpwgaZKKFXA4KtJJXf6AHPfN7PsXn_x_Iglc_bYgUmJBUbPY3g7zcm7Y Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5aa94177f874cef928a18ab59b7bde3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0e46b6fcfe8b464e95d56d1415009686 Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: exception: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '34cc3cf9-5f76-4975-94be-c2160318ee92'} Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. (HTTP 404) (Request-ID: req-18c8ccda-175a-433a-a323-ab164cd3f052) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:40:38.042644 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0d8d232-10ef-4607-94fb-0118946c0f0a tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Returning 404 to user: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0d8d232-10ef-4607-94fb-0118946c0f0a tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 404 len: 109 microversion: 2.1 time: 0.085595 Jul 01 10:40:38.054052 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1769/3490] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:37 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:38.057012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:38.058146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:38.085048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:38.085684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:38.086496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:38.086936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:38.899015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:38.910475 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f55c1103-4b5e-4fe3-b22b-134ab6149259 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1285 microversion: 2.1 time: 0.861003 Jul 01 10:40:38.917734 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1770/3491] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:38 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1285 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:38.934602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bd19c13-0eaa-4970-9989-652043ce024c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:38.943840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6bd19c13-0eaa-4970-9989-652043ce024c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:38.983076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:38.990983 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b75e7ce7-ea08-4d58-b549-01dbc0732b2b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 1.095448 Jul 01 10:40:38.994781 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1722/3492] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:37 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:39.009397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90fa5ece-c81e-4bdc-a3da-ac51c1307331 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f9146c670>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:39.100822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6bd19c13-0eaa-4970-9989-652043ce024c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:39.106846 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-90fa5ece-c81e-4bdc-a3da-ac51c1307331 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] HTTP exception thrown: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90fa5ece-c81e-4bdc-a3da-ac51c1307331 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Request method failure captured: Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 HTTP/1.1 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8SN36OS9QNWu51SN0mSm7C1jLcb35NisLVSZn68XbzmmnsMo1-FKYmAt3ZmeYDClIG-v6tAJhsFK8i5_hRrvzi8wBu5Z15N7LElJd-DXc5RW_KsrpIf0VmpwgaZKKFXA4KtJJXf6AHPfN7PsXn_x_Iglc_bYgUmJBUbPY3g7zcm7Y Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5aa94177f874cef928a18ab59b7bde3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 0e46b6fcfe8b464e95d56d1415009686 Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: exception: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '34cc3cf9-5f76-4975-94be-c2160318ee92'} Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. (HTTP 404) (Request-ID: req-d047b2b5-b255-496c-808b-3e7ba9fcfa45) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:40:39.110795 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.115068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90fa5ece-c81e-4bdc-a3da-ac51c1307331 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Returning 404 to user: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:39.121536 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6bd19c13-0eaa-4970-9989-652043ce024c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1214 microversion: 2.1 time: 0.190262 Jul 01 10:40:39.129913 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-90fa5ece-c81e-4bdc-a3da-ac51c1307331 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 404 len: 109 microversion: 2.1 time: 0.116715 Jul 01 10:40:39.129913 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1723/3494] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:40:38 2022] DELETE /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:39.130176 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1771/3493] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:38 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:39.130176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:39.130410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:39.132437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:39.134143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:39.155023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:39.158466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:39.158922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:39.159493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:39.160514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:39.161138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:39.164018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:39.164475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:39.241652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:39.244413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:39.249993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lazy-loading 'fault' on Instance uuid 00daf0fe-ea38-4fdc-af4a-9187142a652a {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:40:39.469983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:39.488522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:39.490718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad95f62df369438798e6a0e58dbb0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d7540a813842989984c39a083231a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:39.501431 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-13ba3e19-7f4b-4b0c-ae12-c258ad0b8f9e tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 200 len: 1411 microversion: 2.54 time: 0.381648 Jul 01 10:40:39.505914 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1772/3495] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:39 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 1411 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:40:39.522096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d94fc5e-beef-42b3-acbb-763288bbf194 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Calling method '.version_select at 0x7f6f90d2f5e0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:39.608474 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3d94fc5e-beef-42b3-acbb-763288bbf194 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] HTTP exception thrown: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d94fc5e-beef-42b3-acbb-763288bbf194 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Request method failure captured: Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 HTTP/1.1 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8SN36OS9QNWu51SN0mSm7C1jLcb35NisLVSZn68XbzmmnsMo1-FKYmAt3ZmeYDClIG-v6tAJhsFK8i5_hRrvzi8wBu5Z15N7LElJd-DXc5RW_KsrpIf0VmpwgaZKKFXA4KtJJXf6AHPfN7PsXn_x_Iglc_bYgUmJBUbPY3g7zcm7Y Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5aa94177f874cef928a18ab59b7bde3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5aa94177f874cef928a18ab59b7bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: d5aa94177f874cef928a18ab59b7bde3 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-772426354 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0e46b6fcfe8b464e95d56d1415009686 Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-772426354-project Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: exception: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '34cc3cf9-5f76-4975-94be-c2160318ee92'} Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. (HTTP 404) (Request-ID: req-7d84efea-e397-48d8-80dc-2acb2e5bf7b6) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:40:39.610554 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d94fc5e-beef-42b3-acbb-763288bbf194 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] Returning 404 to user: Volume 34cc3cf9-5f76-4975-94be-c2160318ee92 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d94fc5e-beef-42b3-acbb-763288bbf194 tempest-VolumesSnapshotsTestJSON-772426354 tempest-VolumesSnapshotsTestJSON-772426354-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92" status: 404 len: 109 microversion: 2.1 time: 0.106705 Jul 01 10:40:39.615803 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1773/3496] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:40:39 2022] GET /compute/v2.1/os-volumes/34cc3cf9-5f76-4975-94be-c2160318ee92 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:39.622054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3a60f7c8-decf-4cd9-9589-cd6d1210edbb req-9fa46ed8-5b37-4b38-9f57-9739bb6db11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde88491-5e85-4abb-8121-4cde61f444f4", "name": "network-vif-unplugged", "status": "completed", "tag": "bb53c117-d46a-4008-ad58-e45ee05b55f4"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:39.662038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3a60f7c8-decf-4cd9-9589-cd6d1210edbb req-9fa46ed8-5b37-4b38-9f57-9739bb6db11f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:39.662569 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3a60f7c8-decf-4cd9-9589-cd6d1210edbb req-9fa46ed8-5b37-4b38-9f57-9739bb6db11f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:39.689767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3a60f7c8-decf-4cd9-9589-cd6d1210edbb req-9fa46ed8-5b37-4b38-9f57-9739bb6db11f service nova] Creating event network-vif-unplugged:bb53c117-d46a-4008-ad58-e45ee05b55f4 for instance cde88491-5e85-4abb-8121-4cde61f444f4 on n-h2-master-1 Jul 01 10:40:39.702672 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3a60f7c8-decf-4cd9-9589-cd6d1210edbb req-9fa46ed8-5b37-4b38-9f57-9739bb6db11f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086285 Jul 01 10:40:39.704276 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1774/3497] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:39.888190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-409771358", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "9025d00e-6ad8-47ef-80bc-484168809931"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:40.035603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:40:40.268059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:40.284552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d12d065-9105-4869-8250-709ee9e474a8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 1.160546 Jul 01 10:40:40.286641 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1724/3498] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:39 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:40.304318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:40.304947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:40.345382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:40.345946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:40.346790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:40.347294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:41.218194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:41.223374 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c03a00b2-4cd6-4109-b214-07143fa24d34 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1325 microversion: 2.1 time: 0.931663 Jul 01 10:40:41.231152 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1725/3499] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:40 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1325 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:41.243379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:41.244088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:41.257430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:41.260216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:41.261500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:41.263099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:42.080201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:42.094470 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1bc9b04f-5e11-4e96-8351-bb66c6102207 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.860382 Jul 01 10:40:42.107424 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1726/3500] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:41 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:42.121996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:42.122700 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:42.141661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:42.141661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:42.141661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:42.143739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:42.471242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:42.479963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f13dafe-740d-4e5e-aadb-6cb78a956ff1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1272 microversion: 2.1 time: 0.370316 Jul 01 10:40:42.480553 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1727/3501] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:42 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:42.485266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:42.485863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] [instance: 00daf0fe-ea38-4fdc-af4a-9187142a652a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:42.497394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:42.498397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:42.500326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:42.501014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:42.520420 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] HTTP exception thrown: Instance 00daf0fe-ea38-4fdc-af4a-9187142a652a could not be found. Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Request method failure captured: Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a HTTP/1.1 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs71SxmKMqwWYOnUXduTJZy6Bz6hEDdTe4HLwhKf_J6-KZXvZ5qoTR4KETmGHgB5O6Nr0m4FEtxA69QogrE1SGCiEFAP3JwHtQK9r_L0HZTSOSn0WQp64jrPJFfXCMaBRqogQ2sVS2VcrhG-jeR7npnmObShis-IERVIeIMT79XVsfY Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.54 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e8d7540a813842989984c39a083231a6 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerShowV254Test-1454052897 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8d7540a813842989984c39a083231a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8d7540a813842989984c39a083231a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8d7540a813842989984c39a083231a6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8d7540a813842989984c39a083231a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerShowV254Test-1454052897 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e8d7540a813842989984c39a083231a6 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerShowV254Test-1454052897 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerShowV254Test-1454052897-project Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: ad95f62df369438798e6a0e58dbb0fd9 Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerShowV254Test-1454052897-project Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 00daf0fe-ea38-4fdc-af4a-9187142a652a could not be found. Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '00daf0fe-ea38-4fdc-af4a-9187142a652a'} Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00daf0fe-ea38-4fdc-af4a-9187142a652a could not be found. Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00daf0fe-ea38-4fdc-af4a-9187142a652a could not be found. Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:42.522081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00daf0fe-ea38-4fdc-af4a-9187142a652a could not be found. Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:42.527196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] Returning 404 to user: Instance 00daf0fe-ea38-4fdc-af4a-9187142a652a could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:42.529512 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61c14f57-16b2-47e6-a161-4a9aeb4452e4 tempest-ServerShowV254Test-1454052897 tempest-ServerShowV254Test-1454052897-project] 10.222.0.23 "GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a" status: 404 len: 111 microversion: 2.54 time: 0.047812 Jul 01 10:40:42.530952 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1728/3502] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:40:42 2022] GET /compute/v2.1/servers/00daf0fe-ea38-4fdc-af4a-9187142a652a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:40:42.541136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:42.546341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:42.561981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:42.562429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:42.563547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:42.564287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:42.994203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:43.010816 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6b6bcffa-bd69-4985-bb13-e46d45f12a38 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.478071 Jul 01 10:40:43.020847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:40:43.020847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:40:43.020847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:40:43.020847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:40:43.020847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:40:43.021827 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1729/3503] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:42 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:43.028536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.031119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b9066f8a-4577-43eb-b24c-69bcbda84cfd req-a7e8a014-d32c-48e2-8e46-8ce713d952d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd014169-75d2-4565-9c1c-70cdfd8591c6", "tag": "18b26ffb-9858-4fef-9e8d-30e3705fdd3e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:43.031911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.033031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.033691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.062378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b9066f8a-4577-43eb-b24c-69bcbda84cfd req-a7e8a014-d32c-48e2-8e46-8ce713d952d0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.062822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b9066f8a-4577-43eb-b24c-69bcbda84cfd req-a7e8a014-d32c-48e2-8e46-8ce713d952d0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.086739 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b9066f8a-4577-43eb-b24c-69bcbda84cfd req-a7e8a014-d32c-48e2-8e46-8ce713d952d0 service nova] Creating event network-changed:18b26ffb-9858-4fef-9e8d-30e3705fdd3e for instance bd014169-75d2-4565-9c1c-70cdfd8591c6 on n-h1-master-1 Jul 01 10:40:43.097218 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b9066f8a-4577-43eb-b24c-69bcbda84cfd req-a7e8a014-d32c-48e2-8e46-8ce713d952d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078747 Jul 01 10:40:43.100337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1730/3504] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:43.103362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:40:43.117079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ad28f61c-c5f9-4315-930e-3f6981a49e57 req-6560d5e4-a890-42e4-9a80-9494fcbb7719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90661f1e-ecda-4ea8-99c9-ca7fe1434b86", "tag": "800ffdd2-a08c-47ca-9832-cd3ac49ad796"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:43.123885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:40:43.141751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ad28f61c-c5f9-4315-930e-3f6981a49e57 req-6560d5e4-a890-42e4-9a80-9494fcbb7719 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.143112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ad28f61c-c5f9-4315-930e-3f6981a49e57 req-6560d5e4-a890-42e4-9a80-9494fcbb7719 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.158892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:40:43.161858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:40:43.163452 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ad28f61c-c5f9-4315-930e-3f6981a49e57 req-6560d5e4-a890-42e4-9a80-9494fcbb7719 service nova] Creating event network-changed:800ffdd2-a08c-47ca-9832-cd3ac49ad796 for instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 on n-h1-master-1 Jul 01 10:40:43.180399 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ad28f61c-c5f9-4315-930e-3f6981a49e57 req-6560d5e4-a890-42e4-9a80-9494fcbb7719 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070509 Jul 01 10:40:43.181463 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1731/3505] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:43.190593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:43.191622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:43.206972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.208096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.210967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.212514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.354981 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-253c7bd7-7b64-4afa-bf40-474ecbc6755c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.648670 Jul 01 10:40:43.366108 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1775/3506] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:40:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:40:43.376301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:43.383523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:43.403529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.403981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.404754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:43.405222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:43.941708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:43.956738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-668205b8-16e5-4f0a-8827-a59e60b2f5f5 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1325 microversion: 2.1 time: 0.772731 Jul 01 10:40:43.958031 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1732/3507] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:43 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1325 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:43.963773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-294501ba-fd5e-45b4-b84e-2a5ca6201ef8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:43.964663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-294501ba-fd5e-45b4-b84e-2a5ca6201ef8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:44.029921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:44.039634 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-588e644f-a5ca-414e-9fd9-90d84a85f941 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.671630 Jul 01 10:40:44.053927 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1776/3508] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:43 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:44.053927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:44.053927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:44.053927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:44.054731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:44.055767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:44.056279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:44.130826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-294501ba-fd5e-45b4-b84e-2a5ca6201ef8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:44.140087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-294501ba-fd5e-45b4-b84e-2a5ca6201ef8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1192 microversion: 2.1 time: 0.180755 Jul 01 10:40:44.141368 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1733/3509] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:43 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1192 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:44.146989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:44.147921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:44.155432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:44.156093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:44.157190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:44.157812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:44.224490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:44.239051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-14f4feed-31c0-44e8-b2f8-f891583de193 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1272 microversion: 2.1 time: 0.196616 Jul 01 10:40:44.240256 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1777/3510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:44 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:44.500003 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:44.947309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:44.973608 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-26f0b78b-cfd9-4916-aa72-7d0353387f72 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.826502 Jul 01 10:40:44.980095 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1734/3511] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:44 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:44.993850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:44.995003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:45.005360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:45.006105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:45.007105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:45.008128 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:45.056524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:45.057280 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:45.065946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:45.065946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:45.076417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:45.080487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:45.586707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:45.601759 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9c8cf34-08e0-4a62-b5d6-2a01239c1d03 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1325 microversion: 2.1 time: 0.623380 Jul 01 10:40:45.601759 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1778/3512] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:44 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:45.616511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:45.616511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:45.631524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:45.641662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:45.641662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:45.641662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:45.969726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:45.983496 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a57d9431-e8f2-4ae9-b9ad-d9c99fd93d74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1244 microversion: 2.1 time: 0.378237 Jul 01 10:40:45.984389 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1779/3513] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:45 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1244 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:45.990077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9999339f-6c1e-4641-bbe2-208d772c38a2 req-daaa28e6-8911-4db9-84ea-b5bc78f58ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde88491-5e85-4abb-8121-4cde61f444f4", "tag": "bb53c117-d46a-4008-ad58-e45ee05b55f4"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:46.020115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9999339f-6c1e-4641-bbe2-208d772c38a2 req-daaa28e6-8911-4db9-84ea-b5bc78f58ced service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:46.020565 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9999339f-6c1e-4641-bbe2-208d772c38a2 req-daaa28e6-8911-4db9-84ea-b5bc78f58ced service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:46.038833 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9999339f-6c1e-4641-bbe2-208d772c38a2 req-daaa28e6-8911-4db9-84ea-b5bc78f58ced service nova] Creating event network-changed:bb53c117-d46a-4008-ad58-e45ee05b55f4 for instance cde88491-5e85-4abb-8121-4cde61f444f4 on n-h2-master-1 Jul 01 10:40:46.053292 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9999339f-6c1e-4641-bbe2-208d772c38a2 req-daaa28e6-8911-4db9-84ea-b5bc78f58ced service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066820 Jul 01 10:40:46.055279 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1780/3514] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:46.064893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:46.065689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:46.077127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:46.081272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:46.082287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:46.083417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:46.235093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:46.247943 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:46.253912 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b66aed31-3845-49c1-9c46-7ce02b4af306 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 1.201221 Jul 01 10:40:46.258527 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1735/3515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:45 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:46.265889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:46.266553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:46.285344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:46.286748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:46.287789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:46.288457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:47.839875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:47.855638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e7c2d4b-d308-43d0-bfc9-2245cef74c26 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 1.594784 Jul 01 10:40:47.859832 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1736/3516] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:46 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:47.891261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:47.893922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:47.912392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:47.915166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:47.916380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:47.916996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:48.108514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:48.122800 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a5703af-07be-4e0f-89dd-0385e954f1fb tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 2.066115 Jul 01 10:40:48.152924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1781/3517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:46 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:48.166530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:48.169998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:48.245114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:48.248492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:48.251154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:48.256582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:49.114743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:49.137500 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae64838e-461c-44ba-9aaa-51ce8c5f752f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1292 microversion: 2.1 time: 0.974972 Jul 01 10:40:49.138402 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1782/3518] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:48 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1292 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:49.163172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:49.165840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:49.185085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:49.185904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:49.188358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:49.191231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:49.597998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:49.614705 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a609ede6-023b-42fe-a1dc-23c52062239c tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1325 microversion: 2.1 time: 1.752560 Jul 01 10:40:49.616431 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1737/3519] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:47 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1325 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:49.633616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5c654ea7-660e-4415-8214-92a93a94280f req-434d7d30-003a-4205-8049-3fe921b0bfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd014169-75d2-4565-9c1c-70cdfd8591c6", "name": "network-vif-plugged", "status": "completed", "tag": "18b26ffb-9858-4fef-9e8d-30e3705fdd3e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:49.678815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5c654ea7-660e-4415-8214-92a93a94280f req-434d7d30-003a-4205-8049-3fe921b0bfd9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:49.685514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5c654ea7-660e-4415-8214-92a93a94280f req-434d7d30-003a-4205-8049-3fe921b0bfd9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:49.723240 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5c654ea7-660e-4415-8214-92a93a94280f req-434d7d30-003a-4205-8049-3fe921b0bfd9 service nova] Creating event network-vif-plugged:18b26ffb-9858-4fef-9e8d-30e3705fdd3e for instance bd014169-75d2-4565-9c1c-70cdfd8591c6 on n-h1-master-1 Jul 01 10:40:49.734757 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5c654ea7-660e-4415-8214-92a93a94280f req-434d7d30-003a-4205-8049-3fe921b0bfd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117049 Jul 01 10:40:49.748167 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1738/3520] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:49.752376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:49.758746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:49.775530 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:49.777255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:49.779042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:49.782065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:50.494512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:50.516747 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d5e08c01-de98-4cab-b0b5-07b63dbc89e9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 1.373445 Jul 01 10:40:50.520990 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1783/3521] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:49 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:50.526756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:50.537002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:50.550012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:50.550763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:50.551878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:50.553600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:50.984777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:51.007205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc654861-1f23-4c32-b63a-861ff9f33d79 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 1.260807 Jul 01 10:40:51.010358 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1739/3522] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:49 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:51.046915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:51.060946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:51.078442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:51.079694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:51.083935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:51.086730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:51.384095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:51.393222 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7c335426-c994-446e-888e-254a5297d2cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 0.870345 Jul 01 10:40:51.393808 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1784/3523] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:50 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:51.409954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3d6b24d2-7bb0-4148-88c3-93916dbea37d req-abfbcc07-552a-4d3c-b403-b97fe432b3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3988bb91-b5bb-4f8a-b081-e3368b62d4eb", "tag": "d745fecb-3453-4d1e-b984-1d13f89bdaf1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:51.431628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3d6b24d2-7bb0-4148-88c3-93916dbea37d req-abfbcc07-552a-4d3c-b403-b97fe432b3f7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:51.434356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3d6b24d2-7bb0-4148-88c3-93916dbea37d req-abfbcc07-552a-4d3c-b403-b97fe432b3f7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:51.452183 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3d6b24d2-7bb0-4148-88c3-93916dbea37d req-abfbcc07-552a-4d3c-b403-b97fe432b3f7 service nova] Creating event network-changed:d745fecb-3453-4d1e-b984-1d13f89bdaf1 for instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb on n-h2-master-1 Jul 01 10:40:51.470828 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3d6b24d2-7bb0-4148-88c3-93916dbea37d req-abfbcc07-552a-4d3c-b403-b97fe432b3f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064886 Jul 01 10:40:51.471979 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1785/3524] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:51.483658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:51.490304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:51.500980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:51.504567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:51.505591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:51.505837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:51.596145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:51.608597 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39814a90-095f-41e5-869e-d99ed43eca37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1292 microversion: 2.1 time: 0.596842 Jul 01 10:40:51.609224 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1740/3525] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:51 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1292 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:51.622232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:51.623132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:51.635250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:51.635974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:51.637561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:51.639936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.203481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:52.226167 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-22750b0f-2f80-4b1d-a0a0-4113ba6166ea tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1325 microversion: 2.1 time: 0.752593 Jul 01 10:40:52.227135 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1786/3526] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:51 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1325 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:52.238909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:52.239900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:52.256048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.258700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.263452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.264257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.273170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:52.282564 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-678b0349-b65d-4053-b6b9-c2f36f53158d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.672112 Jul 01 10:40:52.294885 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1741/3527] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:51 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:52.302138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7349f569-d0fa-4883-bbe0-e409c048b4a1 req-fb740741-321b-46d1-ab40-fadf8c0223b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e89a17-8291-460c-9a92-cbe07e990961", "tag": "9bc08b81-8205-450f-9451-29239f13b73c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:52.335507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7349f569-d0fa-4883-bbe0-e409c048b4a1 req-fb740741-321b-46d1-ab40-fadf8c0223b4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.336358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7349f569-d0fa-4883-bbe0-e409c048b4a1 req-fb740741-321b-46d1-ab40-fadf8c0223b4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.360746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7349f569-d0fa-4883-bbe0-e409c048b4a1 req-fb740741-321b-46d1-ab40-fadf8c0223b4 service nova] Creating event network-changed:9bc08b81-8205-450f-9451-29239f13b73c for instance 72e89a17-8291-460c-9a92-cbe07e990961 on n-h2-master-1 Jul 01 10:40:52.373092 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7349f569-d0fa-4883-bbe0-e409c048b4a1 req-fb740741-321b-46d1-ab40-fadf8c0223b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073881 Jul 01 10:40:52.374176 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1742/3528] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:52.411117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:52.413397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:52.420812 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:52.428466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.439822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.441123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.444467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.774421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:52.798852 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3124cca4-32fe-474c-8e7e-cde063256d0d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.563112 Jul 01 10:40:52.816130 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1787/3529] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:52 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:52.833599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:52.835894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:52.856786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.856786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.859203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.860481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.862050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:52.876384 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b005e060-cdc0-465c-85d0-1662f630a94c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 0.463616 Jul 01 10:40:52.876384 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1743/3530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:52 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:52.920710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3ca91524-6dae-4850-92e8-1139d2f5b94b req-efa511da-1eb3-4589-a426-5b00ee0b8f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde88491-5e85-4abb-8121-4cde61f444f4", "name": "network-vif-unplugged", "status": "completed", "tag": "bb53c117-d46a-4008-ad58-e45ee05b55f4"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:52.944221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ca91524-6dae-4850-92e8-1139d2f5b94b req-efa511da-1eb3-4589-a426-5b00ee0b8f62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:52.945082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ca91524-6dae-4850-92e8-1139d2f5b94b req-efa511da-1eb3-4589-a426-5b00ee0b8f62 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:52.981393 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3ca91524-6dae-4850-92e8-1139d2f5b94b req-efa511da-1eb3-4589-a426-5b00ee0b8f62 service nova] Creating event network-vif-unplugged:bb53c117-d46a-4008-ad58-e45ee05b55f4 for instance cde88491-5e85-4abb-8121-4cde61f444f4 on n-h2-master-1 Jul 01 10:40:52.987578 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3ca91524-6dae-4850-92e8-1139d2f5b94b req-efa511da-1eb3-4589-a426-5b00ee0b8f62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073246 Jul 01 10:40:52.995842 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1744/3531] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:53.072300 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:53.145392 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=14 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:53.247872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:53.248904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:53.273310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:53.277837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:53.281264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:53.282788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:53.615636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:53.637829 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e52033e-5b06-4e9a-8b67-612576edc39e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1292 microversion: 2.1 time: 0.820140 Jul 01 10:40:53.649113 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1788/3532] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:52 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1292 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:53.655691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:53.656778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:53.678227 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:53.680474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:53.681870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:53.683403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:54.062151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:54.073826 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca53973f-06e2-44e4-948d-7b9de3e697c4 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1522 microversion: 2.1 time: 0.833805 Jul 01 10:40:54.077292 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1745/3533] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:53 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1522 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:54.087922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:54.089109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:54.103123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:54.104017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:54.104995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:54.117890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:54.137846 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:54.882596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:54.891928 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:40:54.900031 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79ca1016-ebea-463d-b02b-d6a99a082baf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 1.248425 Jul 01 10:40:54.909915 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1789/3534] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:53 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:54.914659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:54.916235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:54.923751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:54.925930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:54.925930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:54.926206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:55.422610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:55.446871 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eec7f03b-b7e4-46f2-ab56-60349a51f8eb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 1.365928 Jul 01 10:40:55.462564 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1746/3535] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:54 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:55.472607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:55.474090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:55.483159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:55.483819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:55.484866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:55.485510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:55.550572 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] HTTP exception thrown: Action 999 not found Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Request method failure captured: Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6/os-instance-actions/999 HTTP/1.1 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8gpfKQZnuQUmXcrmnNvX6IGxUgoAZnrNRyySIiz62wwUoZdsZ4WvZJEikT7lskN-Bo6xNXJ1GLvmocJEi__PkRnpcXEAkar3U5ZWIeE8B6ekLGiBum2FL8txtmwj-3tmlCOB1Jo93X082P0TpSNjPjReW4H4jhndu6eIKZ8ZqEIa0 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c6496f7a52f848ca92de5fb29da0a4e3 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6496f7a52f848ca92de5fb29da0a4e3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c6496f7a52f848ca92de5fb29da0a4e3 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-InstanceActionsNegativeTestJSON-822922794-project Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7f151eff4474418fbeb4fb009d5bc0bd Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-822922794-project Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: exception: Action 999 not found Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': 'bd014169-75d2-4565-9c1c-70cdfd8591c6', 'id': '999'} Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 01 10:40:55.558421 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:55.567767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Returning 404 to user: Action 999 not found {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:55.567767 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-feac69e9-6eea-4430-afb2-90a40b37d1ef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.098175 Jul 01 10:40:55.567767 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1747/3536] 10.222.0.23 () {58 vars in 1307 bytes} [Fri Jul 1 10:40:55 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6/os-instance-actions/999 => generated 66 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:40:55.570633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:55.574745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:55.579839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:55.580649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:55.581998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:55.582474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:56.265229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:56.274513 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4dafbaec-cb8d-496f-b015-58fc347d4201 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1292 microversion: 2.1 time: 0.710513 Jul 01 10:40:56.277905 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1748/3537] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:55 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1292 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:56.284291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5df8b8c3-de38-401b-9d69-aeaa983a5cef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '.version_select at 0x7f6f909453a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:56.290102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5df8b8c3-de38-401b-9d69-aeaa983a5cef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: e59e9ace-4807-4f2f-a10a-cf105dd9753b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:56.309661 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-5df8b8c3-de38-401b-9d69-aeaa983a5cef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] HTTP exception thrown: Instance e59e9ace-4807-4f2f-a10a-cf105dd9753b could not be found. Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5df8b8c3-de38-401b-9d69-aeaa983a5cef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Request method failure captured: Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e59e9ace-4807-4f2f-a10a-cf105dd9753b/os-instance-actions HTTP/1.1 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8gpfKQZnuQUmXcrmnNvX6IGxUgoAZnrNRyySIiz62wwUoZdsZ4WvZJEikT7lskN-Bo6xNXJ1GLvmocJEi__PkRnpcXEAkar3U5ZWIeE8B6ekLGiBum2FL8txtmwj-3tmlCOB1Jo93X082P0TpSNjPjReW4H4jhndu6eIKZ8ZqEIa0 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c6496f7a52f848ca92de5fb29da0a4e3 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6496f7a52f848ca92de5fb29da0a4e3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c6496f7a52f848ca92de5fb29da0a4e3 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-InstanceActionsNegativeTestJSON-822922794-project Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7f151eff4474418fbeb4fb009d5bc0bd Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-822922794-project Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e59e9ace-4807-4f2f-a10a-cf105dd9753b could not be found. Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': 'e59e9ace-4807-4f2f-a10a-cf105dd9753b'} Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59e9ace-4807-4f2f-a10a-cf105dd9753b could not be found. Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:40:56.312005 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59e9ace-4807-4f2f-a10a-cf105dd9753b could not be found. Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59e9ace-4807-4f2f-a10a-cf105dd9753b could not be found. Jul 01 10:40:56.316472 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:40:56.318959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5df8b8c3-de38-401b-9d69-aeaa983a5cef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Returning 404 to user: Instance e59e9ace-4807-4f2f-a10a-cf105dd9753b could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:40:56.320085 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5df8b8c3-de38-401b-9d69-aeaa983a5cef tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/e59e9ace-4807-4f2f-a10a-cf105dd9753b/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.039707 Jul 01 10:40:56.321304 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1749/3538] 10.222.0.23 () {58 vars in 1295 bytes} [Fri Jul 1 10:40:56 2022] GET /compute/v2.1/servers/e59e9ace-4807-4f2f-a10a-cf105dd9753b/os-instance-actions => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:40:56.331130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:56.337081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:56.337392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:56.349483 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f44f1711-7ac9-43ca-9274-fbb2b298ba2d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 1.440859 Jul 01 10:40:56.353647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:56.365751 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1790/3539] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:54 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:56.367340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:56.368502 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:56.369232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:56.388181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:56.389488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:56.407532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:56.409290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:56.412493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:56.413008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:56.505894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:40:57.023767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:57.037864 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-941a1544-5e72-458f-8c10-658bb6edfc59 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.715056 Jul 01 10:40:57.038829 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1750/3540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:56 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:57.042644 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9688719b-7d06-453a-9005-ad9228fcd89e tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 204 len: 0 microversion: 2.1 time: 0.686403 Jul 01 10:40:57.047348 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1791/3541] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:40:56 2022] DELETE /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:40:57.055283 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:57.055922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:57.063252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:57.064472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:57.078825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.079279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.080074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.081936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.089247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.091987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.094166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.101356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.520365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:57.534999 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-863ef287-1876-4c16-bf19-a918c4582cc3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.492912 Jul 01 10:40:57.546011 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1751/3542] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:57 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:57.554016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-28fad62e-1ddc-467d-abfe-02581cdf40e5 req-dfc3734f-7218-4a30-952c-2f65263dcfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3988bb91-b5bb-4f8a-b081-e3368b62d4eb", "name": "network-vif-plugged", "status": "completed", "tag": "d745fecb-3453-4d1e-b984-1d13f89bdaf1"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:40:57.578886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:57.590178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4cb3d500-3075-4613-9a27-efcc57fee323 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1528 microversion: 2.1 time: 0.539852 Jul 01 10:40:57.592554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-28fad62e-1ddc-467d-abfe-02581cdf40e5 req-dfc3734f-7218-4a30-952c-2f65263dcfa7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.592975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-28fad62e-1ddc-467d-abfe-02581cdf40e5 req-dfc3734f-7218-4a30-952c-2f65263dcfa7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.593134 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1792/3543] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:57 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1528 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:57.603816 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:57.610349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:57.630006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.633290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.633290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.633290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.633768 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-28fad62e-1ddc-467d-abfe-02581cdf40e5 req-dfc3734f-7218-4a30-952c-2f65263dcfa7 service nova] Creating event network-vif-plugged:d745fecb-3453-4d1e-b984-1d13f89bdaf1 for instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb on n-h2-master-1 Jul 01 10:40:57.644391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-28fad62e-1ddc-467d-abfe-02581cdf40e5 req-dfc3734f-7218-4a30-952c-2f65263dcfa7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095800 Jul 01 10:40:57.645234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1752/3544] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:40:57.681948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:57.691181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:57.708129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.708573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:57.709526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:57.709941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:58.108542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:58.118822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:58.123656 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f87c4819-72f2-484a-ac64-a792720d7c43 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1292 microversion: 2.1 time: 0.529428 Jul 01 10:40:58.129268 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1793/3545] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:57 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1292 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:58.129427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:58.129956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:58.136115 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a0e3dd39-eaa3-4a2f-9a08-493e608e6d44 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 0.477573 Jul 01 10:40:58.138675 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:58.139055 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1753/3546] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:57 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:58.139273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:58.139876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:58.140319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:58.388968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:58.399109 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a3f28342-87b5-4aa7-ab2c-4105fa17e0ae tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.271995 Jul 01 10:40:58.401610 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1794/3547] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:58 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:58.554099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:58.573681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:58.573681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:58.573681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:58.573681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:58.573681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:58.609078 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:58.610826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:58.632178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:58.633288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:58.638358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:58.639708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:58.855869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:58.867274 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f02a70fe-f978-42b5-9a06-11d5062da463 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.317117 Jul 01 10:40:58.878412 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1754/3548] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:58 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:58.894965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:58.905450 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e38a5975-8139-4353-a83b-0adda628658b tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1528 microversion: 2.1 time: 0.300240 Jul 01 10:40:58.906444 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1795/3549] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:58 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1528 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:40:59.145034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:59.146033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:59.151956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:59.152900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:59.171919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:59.172497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:59.172884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:59.173021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:59.173801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:59.175397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:59.177604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:59.178108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:59.799340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:40:59.807349 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-971a5fbd-d2e6-4e1f-a819-6ff13564c53b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1292 microversion: 2.1 time: 0.669051 Jul 01 10:40:59.827918 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1755/3550] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:59 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1292 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:40:59.836702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:40:59.842228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:40:59.870042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:59.870837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:59.872599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:40:59.873311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:40:59.879135 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:00.198031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:00.208401 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e7f58cc-d40e-446e-9f24-fa98355a526a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 1.060383 Jul 01 10:41:00.221328 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1796/3551] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:59 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:00.226890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:00.232697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:00.234390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:00.235015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:00.236126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:00.236817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:00.499190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:00.521984 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7aa6ca7b-638e-47a2-8f10-183652612066 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.692497 Jul 01 10:41:00.522586 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1756/3552] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:40:59 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:00.538317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:00.538926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:00.551757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:00.552198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:00.553418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:00.554154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:01.055814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:01.102545 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-341dc7ce-9bdf-4ffd-bdc5-209bf0ebaed9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.879795 Jul 01 10:41:01.103933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1797/3553] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:00 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:01.128447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:01.134878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:01.154717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:01.155183 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:01.163058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:01.163531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:01.254378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:01.266237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39c84e9b-0110-43d8-b132-ad69461384b9 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1528 microversion: 2.1 time: 0.732422 Jul 01 10:41:01.278634 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1757/3554] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:00 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1528 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:01.297138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-949bac55-c1e2-4ea1-8307-557645076365 req-5f27ec3f-748b-4951-9dd0-e97477b9878a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e89a17-8291-460c-9a92-cbe07e990961", "name": "network-vif-plugged", "status": "completed", "tag": "9bc08b81-8205-450f-9451-29239f13b73c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:01.331650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-949bac55-c1e2-4ea1-8307-557645076365 req-5f27ec3f-748b-4951-9dd0-e97477b9878a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:01.332510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-949bac55-c1e2-4ea1-8307-557645076365 req-5f27ec3f-748b-4951-9dd0-e97477b9878a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:01.362542 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-949bac55-c1e2-4ea1-8307-557645076365 req-5f27ec3f-748b-4951-9dd0-e97477b9878a service nova] Creating event network-vif-plugged:9bc08b81-8205-450f-9451-29239f13b73c for instance 72e89a17-8291-460c-9a92-cbe07e990961 on n-h2-master-1 Jul 01 10:41:01.391123 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-949bac55-c1e2-4ea1-8307-557645076365 req-5f27ec3f-748b-4951-9dd0-e97477b9878a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101565 Jul 01 10:41:01.392351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1758/3555] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:01.400722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:01.401892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:01.429303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:01.431776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:01.434870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:01.435701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.305363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:02.315888 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29375fd6-b22c-4639-afa4-6553ccfa549d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1473 microversion: 2.1 time: 1.210530 Jul 01 10:41:02.316337 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1798/3556] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:01 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1473 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:02.325941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:02.330157 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:02.348601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:02.349079 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.351104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:02.354924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.358002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:02.371823 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2bf6f4e2-2b71-400d-acf4-ad60ce4c149b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 0.976834 Jul 01 10:41:02.383532 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1759/3557] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:01 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:02.393175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:02.396746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:02.411221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:02.414140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.414140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:02.417443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.807101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:02.816897 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.496575 Jul 01 10:41:02.827544 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1799/3558] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:02 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:02.827544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:02.827544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a492869b-f68c-4385-a247-967f9d2211eb tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001090 Jul 01 10:41:02.827544 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1800/3559] 10.222.0.23 () {56 vars in 885 bytes} [Fri Jul 1 10:41:02 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 01 10:41:02.827544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:02.827544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:02.832547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:02.833013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.833915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:02.834265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.837901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:02.847333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c893c1cb-eea4-4468-a7ed-73120f3612f4 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1715 microversion: 2.1 time: 0.462393 Jul 01 10:41:02.847994 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1760/3560] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:02 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1715 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:02.853241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1034683764", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:02.921946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:41:02.929201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:02.938555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d57ff2da-3e47-48c5-b6af-2167c79da2f6 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1486 microversion: 2.1 time: 0.117559 Jul 01 10:41:02.946039 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1801/3561] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:02 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1486 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:02.946039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-adfc3518-856f-4106-980c-d2fc058d639a req-1b51cf12-4a26-4644-8870-0092bb38e7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd014169-75d2-4565-9c1c-70cdfd8591c6", "name": "network-vif-deleted", "tag": "18b26ffb-9858-4fef-9e8d-30e3705fdd3e"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:02.954923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-adfc3518-856f-4106-980c-d2fc058d639a req-1b51cf12-4a26-4644-8870-0092bb38e7e6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:02.955407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-adfc3518-856f-4106-980c-d2fc058d639a req-1b51cf12-4a26-4644-8870-0092bb38e7e6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:02.968011 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-adfc3518-856f-4106-980c-d2fc058d639a req-1b51cf12-4a26-4644-8870-0092bb38e7e6 service nova] Creating event network-vif-deleted:18b26ffb-9858-4fef-9e8d-30e3705fdd3e for instance bd014169-75d2-4565-9c1c-70cdfd8591c6 on n-h1-master-1 Jul 01 10:41:02.973420 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-adfc3518-856f-4106-980c-d2fc058d639a req-1b51cf12-4a26-4644-8870-0092bb38e7e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Jul 01 10:41:02.978172 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1802/3562] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:03.359804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:41:03.360324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:41:03.360825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:41:03.361261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:41:03.361857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:41:03.411199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:03.411199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:03.411199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:03.411199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:03.412189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:03.412189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:03.412189 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:03.412762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:41:03.412864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:03.412864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:03.412864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:03.412864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:03.413260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:41:03.422429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:41:03.425660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: b5ac277d-6723-4d43-a622-abb36c83c23f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:41:03.707513 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cec34e1-ac7d-4d67-b2bd-f5bff1f5a455 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852223 Jul 01 10:41:03.712690 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1761/3563] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:41:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:41:03.733470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ddb377f2-fe2c-494f-8474-e01b3ac8b71b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:03.733970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ddb377f2-fe2c-494f-8474-e01b3ac8b71b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: b5ac277d-6723-4d43-a622-abb36c83c23f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:03.820507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ddb377f2-fe2c-494f-8474-e01b3ac8b71b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: b5ac277d-6723-4d43-a622-abb36c83c23f] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:41:03.857618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:03.869712 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77a936ed-39fb-4c1d-8547-849a80d5dbcf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1314 microversion: 2.1 time: 0.482453 Jul 01 10:41:03.870302 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1803/3564] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:03 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:03.883203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:03.883830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:03.909034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:03.909034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:03.913859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:03.916967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.127701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ddb377f2-fe2c-494f-8474-e01b3ac8b71b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f" status: 204 len: 0 microversion: 2.1 time: 0.407007 Jul 01 10:41:04.129693 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1762/3565] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:41:03 2022] DELETE /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:41:04.137474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:04.138414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:04.146406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.147608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.149806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.151643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.548999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:04.557933 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53edad79-1dae-428e-90c6-bcfc0d703b1a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.686170 Jul 01 10:41:04.558814 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1804/3566] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:03 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:04.569338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:04.569338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:04.571793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.572769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.574152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.574848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.602120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:04.616015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc9ebd89-efd3-441c-b5a2-338836a6029d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1705 microversion: 2.1 time: 0.482264 Jul 01 10:41:04.616471 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1763/3567] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:04 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1705 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:04.625084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.626248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.627279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lazy-loading 'fault' on Instance uuid bd014169-75d2-4565-9c1c-70cdfd8591c6 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:41:04.651765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-658019cb-4400-4bd0-962f-f0d4f30c871d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:04.654328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-658019cb-4400-4bd0-962f-f0d4f30c871d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: b5ac277d-6723-4d43-a622-abb36c83c23f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:04.686121 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-658019cb-4400-4bd0-962f-f0d4f30c871d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-658019cb-4400-4bd0-962f-f0d4f30c871d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f HTTP/1.1 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: exception: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'b5ac277d-6723-4d43-a622-abb36c83c23f'} Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance b5ac277d-6723-4d43-a622-abb36c83c23f Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:04.696778 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-658019cb-4400-4bd0-962f-f0d4f30c871d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-658019cb-4400-4bd0-962f-f0d4f30c871d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f" status: 404 len: 111 microversion: 2.1 time: 0.086072 Jul 01 10:41:04.706729 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1764/3568] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:04 2022] GET /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:04.717712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48b0df62-a2ed-4e12-ba10-43b04937a03d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '.version_select at 0x7f6f90e90700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:04.721911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b0df62-a2ed-4e12-ba10-43b04937a03d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.722926 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b0df62-a2ed-4e12-ba10-43b04937a03d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.730936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f151eff4474418fbeb4fb009d5bc0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6496f7a52f848ca92de5fb29da0a4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:04.742774 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc6176ea-91ce-4eee-b1cc-423310a5ffc2 tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 200 len: 1315 microversion: 2.1 time: 0.182821 Jul 01 10:41:04.743769 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1805/3569] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:04 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:04.758172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48b0df62-a2ed-4e12-ba10-43b04937a03d tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.046963 Jul 01 10:41:04.763350 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1765/3570] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:41:04 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:04.773832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54d4b2e1-2673-4918-9f4d-534f7cbcc38c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:04.774928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-54d4b2e1-2673-4918-9f4d-534f7cbcc38c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:04.785011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54d4b2e1-2673-4918-9f4d-534f7cbcc38c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.785499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54d4b2e1-2673-4918-9f4d-534f7cbcc38c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.791061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54d4b2e1-2673-4918-9f4d-534f7cbcc38c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:04.791526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54d4b2e1-2673-4918-9f4d-534f7cbcc38c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:04.828611 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:04.883942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-918239811", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "9025d00e-6ad8-47ef-80bc-484168809931"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:04.957548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:41:05.187227 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-54d4b2e1-2673-4918-9f4d-534f7cbcc38c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1856 microversion: 2.1 time: 0.417178 Jul 01 10:41:05.190099 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1806/3571] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:04 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1856 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:05.207462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:05.208436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:05.224560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:05.225726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:05.227934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:05.231485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:05.806218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:05.816839 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b518c3a0-ad82-459b-956c-d12b412a938a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1499 microversion: 2.1 time: 0.621313 Jul 01 10:41:05.821878 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1807/3572] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:05 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1499 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:05.828147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b302746-a1be-41ca-b41a-521e75ecf50f tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:05.829113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b302746-a1be-41ca-b41a-521e75ecf50f tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:05.836809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b302746-a1be-41ca-b41a-521e75ecf50f tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:05.837351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b302746-a1be-41ca-b41a-521e75ecf50f tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:05.838221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b302746-a1be-41ca-b41a-521e75ecf50f tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:05.838663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b302746-a1be-41ca-b41a-521e75ecf50f tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.097072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:41:06.098229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:41:06.098700 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:41:06.099270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:41:06.099920 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:41:06.113203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.114008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.114964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.115569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.209997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:41:06.209997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:41:06.209997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:41:06.209997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:41:06.234144 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b302746-a1be-41ca-b41a-521e75ecf50f tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1856 microversion: 2.1 time: 0.414224 Jul 01 10:41:06.234764 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1808/3573] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:05 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1856 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:06.239601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:06.240442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:06.248291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.260898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.262324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.264963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.517622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:06.526016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd69c377-d62e-47d5-830c-af94ffdb9cdf tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.289928 Jul 01 10:41:06.526704 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1809/3574] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:06 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:06.532193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:06.533183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] [instance: bd014169-75d2-4565-9c1c-70cdfd8591c6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:06.545826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.546417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.547281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.547797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.563961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] HTTP exception thrown: Instance bd014169-75d2-4565-9c1c-70cdfd8591c6 could not be found. Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Request method failure captured: Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 HTTP/1.1 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8gpfKQZnuQUmXcrmnNvX6IGxUgoAZnrNRyySIiz62wwUoZdsZ4WvZJEikT7lskN-Bo6xNXJ1GLvmocJEi__PkRnpcXEAkar3U5ZWIeE8B6ekLGiBum2FL8txtmwj-3tmlCOB1Jo93X082P0TpSNjPjReW4H4jhndu6eIKZ8ZqEIa0 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c6496f7a52f848ca92de5fb29da0a4e3 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6496f7a52f848ca92de5fb29da0a4e3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6496f7a52f848ca92de5fb29da0a4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c6496f7a52f848ca92de5fb29da0a4e3 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-822922794 Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-InstanceActionsNegativeTestJSON-822922794-project Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7f151eff4474418fbeb4fb009d5bc0bd Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-822922794-project Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: exception: Instance bd014169-75d2-4565-9c1c-70cdfd8591c6 could not be found. Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'bd014169-75d2-4565-9c1c-70cdfd8591c6'} Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd014169-75d2-4565-9c1c-70cdfd8591c6 could not be found. Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd014169-75d2-4565-9c1c-70cdfd8591c6 could not be found. Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:06.567235 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd014169-75d2-4565-9c1c-70cdfd8591c6 could not be found. Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] Returning 404 to user: Instance bd014169-75d2-4565-9c1c-70cdfd8591c6 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6bd3c300-b00b-4919-9c4b-77bb5259f6ac tempest-InstanceActionsNegativeTestJSON-822922794 tempest-InstanceActionsNegativeTestJSON-822922794-project] 10.222.0.23 "GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6" status: 404 len: 111 microversion: 2.1 time: 0.041730 Jul 01 10:41:06.572286 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1810/3575] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:06 2022] GET /compute/v2.1/servers/bd014169-75d2-4565-9c1c-70cdfd8591c6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:06.577708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:06.578878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:06.585983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.586772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.587780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:06.588600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:06.618803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lazy-loading 'flavor' on Instance uuid 72e89a17-8291-460c-9a92-cbe07e990961 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:41:07.103084 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a530807e-3ee2-4c5f-a815-284e31de38a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222739 Jul 01 10:41:07.105689 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1766/3576] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:41:07.112644 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:07.114668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:07.124225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:07.147646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:07.151434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:07.154540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:07.392071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lazy-loading 'services' on Instance uuid cde88491-5e85-4abb-8121-4cde61f444f4 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:41:07.412391 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bad49576-e20d-4b29-a833-d90e7e6c2fac tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "POST /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961/action" status: 200 len: 32 microversion: 2.1 time: 0.840441 Jul 01 10:41:07.423164 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1811/3577] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:06 2022] POST /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961/action => generated 32 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:41:07.438495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0fac2fe4-9695-4990-8bed-d6eb181d2bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:07.442253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0fac2fe4-9695-4990-8bed-d6eb181d2bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:07.563802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0fac2fe4-9695-4990-8bed-d6eb181d2bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:07.572083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0fac2fe4-9695-4990-8bed-d6eb181d2bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1220 microversion: 2.1 time: 0.156830 Jul 01 10:41:07.582407 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1812/3578] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:07 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1220 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:07.591543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:07.592849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:07.600083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:07.600834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:07.602043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:07.602883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:07.955855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:07.975559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b4a2d7f-8906-46ef-a23d-41a1c7bdd8ab tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.391725 Jul 01 10:41:07.976741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee315e3b-a9d0-4c20-ab59-b3b272fa0253 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments/e25e4203-33e3-45a1-88bb-05b6c84ee570" status: 202 len: 0 microversion: 2.1 time: 0.868594 Jul 01 10:41:07.978064 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1767/3579] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:41:07 2022] DELETE /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments/e25e4203-33e3-45a1-88bb-05b6c84ee570 => generated 0 bytes in 872 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:41:07.991838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:07.994186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:08.009980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:08.022781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:08.022897 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1813/3580] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:07 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:08.023006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:08.023006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:08.023180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbf2616d-1bac-49f1-ae5f-194337feb3a6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:08.023180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fbf2616d-1bac-49f1-ae5f-194337feb3a6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:08.031377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbf2616d-1bac-49f1-ae5f-194337feb3a6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:08.034347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbf2616d-1bac-49f1-ae5f-194337feb3a6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:08.036781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbf2616d-1bac-49f1-ae5f-194337feb3a6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:08.038207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbf2616d-1bac-49f1-ae5f-194337feb3a6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:08.100843 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fbf2616d-1bac-49f1-ae5f-194337feb3a6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086861 Jul 01 10:41:08.102452 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1814/3581] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:41:08 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:08.121114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b55ec426-a9af-4a10-9c83-01f0f6304a34 req-28dfc6ce-996a-45f7-929a-35a6f95aa10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90661f1e-ecda-4ea8-99c9-ca7fe1434b86", "name": "network-vif-plugged", "status": "completed", "tag": "800ffdd2-a08c-47ca-9832-cd3ac49ad796"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:08.131251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b55ec426-a9af-4a10-9c83-01f0f6304a34 req-28dfc6ce-996a-45f7-929a-35a6f95aa10e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:08.131954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b55ec426-a9af-4a10-9c83-01f0f6304a34 req-28dfc6ce-996a-45f7-929a-35a6f95aa10e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:08.159528 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b55ec426-a9af-4a10-9c83-01f0f6304a34 req-28dfc6ce-996a-45f7-929a-35a6f95aa10e service nova] Creating event network-vif-plugged:800ffdd2-a08c-47ca-9832-cd3ac49ad796 for instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 on n-h1-master-1 Jul 01 10:41:08.185954 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b55ec426-a9af-4a10-9c83-01f0f6304a34 req-28dfc6ce-996a-45f7-929a-35a6f95aa10e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074387 Jul 01 10:41:08.186590 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1815/3582] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:08.405242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:08.415741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fe1e0df9-ad8d-4aac-9657-30162e888bc5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.435524 Jul 01 10:41:08.417275 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1768/3583] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:07 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:08.590715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:08.591427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:08.600014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:08.600464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:08.601601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:08.602201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:08.867426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:08.887402 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58369810-c25a-4285-a2c1-2caba4f2acab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1224 microversion: 2.1 time: 0.300002 Jul 01 10:41:08.888004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1816/3584] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:08 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1224 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:08.995625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:08.996238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:09.004586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.005003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:09.005911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.006333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:09.115128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8a35d579-e9b4-4dd9-9816-60c6575823c6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:09.116058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8a35d579-e9b4-4dd9-9816-60c6575823c6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:09.131261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a35d579-e9b4-4dd9-9816-60c6575823c6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.131714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a35d579-e9b4-4dd9-9816-60c6575823c6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:09.132511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a35d579-e9b4-4dd9-9816-60c6575823c6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.136929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a35d579-e9b4-4dd9-9816-60c6575823c6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:09.220649 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8a35d579-e9b4-4dd9-9816-60c6575823c6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106052 Jul 01 10:41:09.222421 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1817/3585] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:41:09 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:41:09.373895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:09.384161 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4d7dce7-2139-4adb-93bc-7fa438875f3f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.393144 Jul 01 10:41:09.384834 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1769/3586] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:08 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:09.433865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:09.434553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:09.444494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.446176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:09.447054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.449926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:09.664826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:09.675514 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f0c2056-ae7c-4161-87e4-9417da61910a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.246398 Jul 01 10:41:09.676737 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1818/3587] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:09 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:09.905482 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:09.906097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:09.912819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.913578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:09.914503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:09.915091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:10.121582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:10.135746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4519084-73ea-4b7e-96dc-e1c408333cb7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1216 microversion: 2.1 time: 0.235625 Jul 01 10:41:10.137875 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1770/3588] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:09 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1216 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:10.228659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9702a7ab-56a4-4b20-a7aa-db6ee2d79284 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:10.229733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9702a7ab-56a4-4b20-a7aa-db6ee2d79284 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:10.243820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9702a7ab-56a4-4b20-a7aa-db6ee2d79284 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:10.244236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9702a7ab-56a4-4b20-a7aa-db6ee2d79284 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:10.247388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9702a7ab-56a4-4b20-a7aa-db6ee2d79284 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:10.247826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9702a7ab-56a4-4b20-a7aa-db6ee2d79284 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:10.334566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9702a7ab-56a4-4b20-a7aa-db6ee2d79284 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108204 Jul 01 10:41:10.345318 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1819/3589] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:41:10 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:10.405971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:10.406828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:10.423868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:10.426612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:10.432406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:10.432406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:10.694425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:10.695095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:10.699765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:10.712069 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-210e37bf-f748-4139-95de-9e0214d929fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.312458 Jul 01 10:41:10.715130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:10.718660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:10.719752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:10.721201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:10.722365 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1771/3590] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:10 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:10.932081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:10.942390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1dc599dd-0f72-4097-9f3e-52de6f708acc tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.251766 Jul 01 10:41:10.943518 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1820/3591] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:10 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:11.157482 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:11.158492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:11.162714 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:11.173952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.175260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:11.176079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.176530 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:11.346966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ebc281a-816e-4349-8639-8e3d6fb89ce9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:11.353555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:11.353712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ebc281a-816e-4349-8639-8e3d6fb89ce9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:11.358479 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-534fd312-fe36-4896-821d-c6905eb521fe tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1280 microversion: 2.1 time: 0.207759 Jul 01 10:41:11.359558 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1772/3592] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:11 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:11.362863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebc281a-816e-4349-8639-8e3d6fb89ce9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.363669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebc281a-816e-4349-8639-8e3d6fb89ce9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:11.364684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebc281a-816e-4349-8639-8e3d6fb89ce9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.365187 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebc281a-816e-4349-8639-8e3d6fb89ce9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:11.416180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ebc281a-816e-4349-8639-8e3d6fb89ce9 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073346 Jul 01 10:41:11.417552 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1821/3593] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:41:11 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:11.733350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:11.736244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:11.765181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.765665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:11.767593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.768343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:11.965376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:11.966777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:11.992439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.993271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:11.997343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:11.998061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:12.178345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:12.207949 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-04673d06-d99f-4787-b67c-7e034444b8e0 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.481706 Jul 01 10:41:12.215932 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1773/3594] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:11 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:12.376706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:12.377786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:12.398943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:12.399811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:12.405506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:12.407216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:12.743274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:12.755832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-16d283a5-c5eb-45ac-83c1-e9fa7dadf571 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1519 microversion: 2.1 time: 0.796485 Jul 01 10:41:12.756665 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1822/3595] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:11 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1519 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:12.760832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:12.774113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ed0f5504-8fc2-441b-bd9c-e4de213d5547 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:12.777072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c99b33b6-056e-4f9f-9545-a688113c3523 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1278 microversion: 2.1 time: 0.403291 Jul 01 10:41:12.777450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ed0f5504-8fc2-441b-bd9c-e4de213d5547 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:12.782066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0f5504-8fc2-441b-bd9c-e4de213d5547 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:12.782844 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0f5504-8fc2-441b-bd9c-e4de213d5547 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:12.782969 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1774/3596] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:12 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:12.783985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0f5504-8fc2-441b-bd9c-e4de213d5547 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:12.784495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed0f5504-8fc2-441b-bd9c-e4de213d5547 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:12.834033 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:12.839544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ed0f5504-8fc2-441b-bd9c-e4de213d5547 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069330 Jul 01 10:41:12.841078 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1823/3597] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:41:12 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:13.235526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:13.237026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:13.254387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:13.254853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:13.256817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:13.258556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:13.571797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:13.582474 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c551968-8f7e-4613-8be6-c5fbd253a142 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.354398 Jul 01 10:41:13.583291 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1775/3598] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:13 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:13.773794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:13.774677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:13.783917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:13.784448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:13.785563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:13.786273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:13.794909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:13.794909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:13.801378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:13.802238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:13.803247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:13.803989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.116883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:14.129938 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c05181a6-67dc-40e0-b3ee-1b57d2b12d32 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.360040 Jul 01 10:41:14.135537 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1824/3599] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:13 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:14.226779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:14.232036 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:14.236594 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c7a6425-c483-42f0-b302-1022f369399a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1320 microversion: 2.1 time: 0.447622 Jul 01 10:41:14.240932 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1776/3600] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:13 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:14.249931 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96dccea4-35b8-4914-aea7-fc118ee0e120 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:14.258244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96dccea4-35b8-4914-aea7-fc118ee0e120 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:14.272109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96dccea4-35b8-4914-aea7-fc118ee0e120 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.276266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96dccea4-35b8-4914-aea7-fc118ee0e120 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.278337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96dccea4-35b8-4914-aea7-fc118ee0e120 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.279143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96dccea4-35b8-4914-aea7-fc118ee0e120 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.338611 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96dccea4-35b8-4914-aea7-fc118ee0e120 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096339 Jul 01 10:41:14.349038 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1777/3601] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:41:14 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:14.361490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:14.363267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:14.376409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.380754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.383824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.387589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.475102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8393384a-fc4a-4b05-8b7c-9077f40753b2 tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] Calling method '.version_select at 0x7f6f90db54c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:14.570382 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8393384a-fc4a-4b05-8b7c-9077f40753b2 tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295/defaults" status: 200 len: 371 microversion: 2.1 time: 0.427959 Jul 01 10:41:14.572119 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1825/3602] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:41:14 2022] GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295/defaults => generated 371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:14.590902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-75d8eedf-5dbc-4371-836f-28b1740957fb tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] Calling method '.version_select at 0x7f6f90db53a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:14.615266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:14.630721 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d53733fd-5671-4f27-a54f-51bf0663fbb5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.276363 Jul 01 10:41:14.633849 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1778/3603] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:14 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:14.658575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:14.658575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:14.664655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.664993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.665812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.666254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.729413 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-75d8eedf-5dbc-4371-836f-28b1740957fb tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295" status: 200 len: 371 microversion: 2.1 time: 0.149026 Jul 01 10:41:14.730955 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1826/3604] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:41:14 2022] GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295 => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:14.736223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:14.737076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:14.744433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.745414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:14.746492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:14.747225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.099985 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:15.117358 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4481c653-48fe-4c2f-99e3-982ba7b4d5a8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.471277 Jul 01 10:41:15.128904 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1779/3605] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:14 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:15.165897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:15.181793 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a9582916-71be-4b0e-9377-9778912793c4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.449674 Jul 01 10:41:15.183668 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1827/3606] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:14 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:15.193933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10066ae7-0a4e-4981-bce3-780e6cdf0224 tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] Calling method '.version_select at 0x7f6f90db5f70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:15.293029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-058e5e18-3a21-4190-85ec-b054d21e904d req-9b1865aa-aa9c-4aec-924a-d8bc49356d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93ed880-7073-4f2a-bd35-71071fda6bf0", "tag": "1ec60999-b1aa-4578-a2cb-b272e9ac5cca"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:15.303703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-058e5e18-3a21-4190-85ec-b054d21e904d req-9b1865aa-aa9c-4aec-924a-d8bc49356d88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.308085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-058e5e18-3a21-4190-85ec-b054d21e904d req-9b1865aa-aa9c-4aec-924a-d8bc49356d88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.326519 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-058e5e18-3a21-4190-85ec-b054d21e904d req-9b1865aa-aa9c-4aec-924a-d8bc49356d88 service nova] Creating event network-changed:1ec60999-b1aa-4578-a2cb-b272e9ac5cca for instance c93ed880-7073-4f2a-bd35-71071fda6bf0 on n-h1-master-1 Jul 01 10:41:15.333198 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-058e5e18-3a21-4190-85ec-b054d21e904d req-9b1865aa-aa9c-4aec-924a-d8bc49356d88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202184 Jul 01 10:41:15.334225 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1780/3607] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:15.341181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-138b55e6-78a2-464f-8c43-4d868a6b870b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:15.347765 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-138b55e6-78a2-464f-8c43-4d868a6b870b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 9a070bc9-b311-4ec0-8096-fdd1f4dc1585 has no mapping to a cell. Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-138b55e6-78a2-464f-8c43-4d868a6b870b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/9a070bc9-b311-4ec0-8096-fdd1f4dc1585/action HTTP/1.1 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 15 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: {"os-stop": {}} Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 9a070bc9-b311-4ec0-8096-fdd1f4dc1585 has no mapping to a cell. Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '9a070bc9-b311-4ec0-8096-fdd1f4dc1585', 'body': {'os-stop': {}}} Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 9a070bc9-b311-4ec0-8096-fdd1f4dc1585 has no mapping to a cell. Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:15.356164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a070bc9-b311-4ec0-8096-fdd1f4dc1585 has no mapping to a cell. Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a070bc9-b311-4ec0-8096-fdd1f4dc1585 has no mapping to a cell. Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-138b55e6-78a2-464f-8c43-4d868a6b870b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 9a070bc9-b311-4ec0-8096-fdd1f4dc1585 has no mapping to a cell. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:15.361363 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-138b55e6-78a2-464f-8c43-4d868a6b870b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/9a070bc9-b311-4ec0-8096-fdd1f4dc1585/action" status: 404 len: 117 microversion: 2.1 time: 0.021675 Jul 01 10:41:15.362422 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1781/3608] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:15 2022] POST /compute/v2.1/servers/9a070bc9-b311-4ec0-8096-fdd1f4dc1585/action => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:15.373637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:15.373637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:15.385768 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.387199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.388268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.388890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.507332 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10066ae7-0a4e-4981-bce3-780e6cdf0224 tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295/defaults" status: 200 len: 371 microversion: 2.1 time: 0.322295 Jul 01 10:41:15.510110 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1828/3609] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:41:15 2022] GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295/defaults => generated 371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:15.523756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-37c43f6f-3b39-4846-ab07-106c7e55bb4f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:15.525130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-37c43f6f-3b39-4846-ab07-106c7e55bb4f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:15.531879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37c43f6f-3b39-4846-ab07-106c7e55bb4f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.532530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37c43f6f-3b39-4846-ab07-106c7e55bb4f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.533718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37c43f6f-3b39-4846-ab07-106c7e55bb4f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.534148 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-37c43f6f-3b39-4846-ab07-106c7e55bb4f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.565377 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-37c43f6f-3b39-4846-ab07-106c7e55bb4f tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054003 Jul 01 10:41:15.566023 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1829/3610] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:41:15 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:41:15.579263 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:15.580036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:15.586856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.587444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.588470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.588971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.618341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:15.627560 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b7a2c6c1-0508-4865-bdec-3d30811bd6c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1320 microversion: 2.1 time: 0.260818 Jul 01 10:41:15.628237 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1782/3611] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:15 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:15.633396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47061a6d-7658-44f7-aea0-df1acb3b0edb tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] Calling method '.version_select at 0x7f6f9089ca60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:15.768523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:15.777267 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-df42a83b-d1bf-4809-8686-4512c3bb8e51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.210175 Jul 01 10:41:15.777838 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1830/3612] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:15 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:15.796258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:15.797246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:15.809897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.809897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.811602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:15.811802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:15.998884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:16.007044 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4805fee1-4418-4fa0-be0b-7faa7d55e4c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.214987 Jul 01 10:41:16.007693 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1831/3613] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:15 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:16.029769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ddb0a97-3ce0-49fc-b965-783d7062a4b9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:16.033075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ddb0a97-3ce0-49fc-b965-783d7062a4b9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: dc264afc-d8ff-4bf8-abe4-d065cb3d0715] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:16.039619 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7ddb0a97-3ce0-49fc-b965-783d7062a4b9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance dc264afc-d8ff-4bf8-abe4-d065cb3d0715 could not be found. Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ddb0a97-3ce0-49fc-b965-783d7062a4b9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/dc264afc-d8ff-4bf8-abe4-d065cb3d0715/action HTTP/1.1 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 15 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: {"suspend": {}} Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: exception: Instance dc264afc-d8ff-4bf8-abe4-d065cb3d0715 could not be found. Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'dc264afc-d8ff-4bf8-abe4-d065cb3d0715', 'body': {'suspend': {}}} Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc264afc-d8ff-4bf8-abe4-d065cb3d0715 could not be found. Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc264afc-d8ff-4bf8-abe4-d065cb3d0715 could not be found. Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:16.042069 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:16.047706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:16.047706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:16.047706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc264afc-d8ff-4bf8-abe4-d065cb3d0715 could not be found. Jul 01 10:41:16.047706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:16.048158 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47061a6d-7658-44f7-aea0-df1acb3b0edb tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295" status: 200 len: 371 microversion: 2.1 time: 0.417605 Jul 01 10:41:16.051327 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1783/3614] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 10:41:15 2022] GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295 => generated 371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:16.051495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ddb0a97-3ce0-49fc-b965-783d7062a4b9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance dc264afc-d8ff-4bf8-abe4-d065cb3d0715 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:16.051495 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ddb0a97-3ce0-49fc-b965-783d7062a4b9 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/dc264afc-d8ff-4bf8-abe4-d065cb3d0715/action" status: 404 len: 111 microversion: 2.1 time: 0.028301 Jul 01 10:41:16.051495 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1832/3615] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:16 2022] POST /compute/v2.1/servers/dc264afc-d8ff-4bf8-abe4-d065cb3d0715/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:16.060824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e645f6ac-5255-4629-aa4f-9ed51599a12c tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] Calling method '.version_select at 0x7f6f90cc9670>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:16.064915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:16.064915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:16.071074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.071626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.072599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.073100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.126764 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:16.210728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:16.220301 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c0cbb399-d2da-49d3-8c7c-e1969d490b40 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.164902 Jul 01 10:41:16.220876 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1784/3616] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:16 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:16.239690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:16.240312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:16.247349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.248712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.249678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.250119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.413564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:16.421393 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52fb8304-3138-4a7a-bca6-27adfdcad829 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.186290 Jul 01 10:41:16.423313 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1785/3617] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:16 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:16.426866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:16.427556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:16.434243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.434744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.435514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.436175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.555399 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e645f6ac-5255-4629-aa4f-9ed51599a12c tempest-QuotasTestJSON-511380367 tempest-QuotasTestJSON-511380367-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295?user_id=1509af7a27f349c59d5a9fbc0cc7cf68" status: 200 len: 371 microversion: 2.1 time: 0.499227 Jul 01 10:41:16.562150 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1833/3618] 10.222.0.23 () {58 vars in 1322 bytes} [Fri Jul 1 10:41:16 2022] GET /compute/v2.1/os-quota-sets/3172b132563140b29c3e1559b665f295?user_id=1509af7a27f349c59d5a9fbc0cc7cf68 => generated 371 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:16.643851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:16.644484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:16.654101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.654567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.661277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.661277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.695310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:16.703785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a8ac5ff9-371e-4a47-9ace-a13382c44b57 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.280638 Jul 01 10:41:16.704363 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1786/3619] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:16 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:16.721540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:16.722215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:16.728815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.729444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.730512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:16.731038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:16.757919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lazy-loading 'flavor' on Instance uuid 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:41:17.187679 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a916d77-b97b-45c1-92f4-6582d53844f5 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 202 len: 0 microversion: 2.1 time: 0.470667 Jul 01 10:41:17.189293 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1787/3620] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:16 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:41:17.215873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:17.222041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:17.224915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:17.225405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:17.226274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:17.226689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:17.500912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:17.513522 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-59a361e7-c60d-4418-8b99-9b8bcdf76729 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1320 microversion: 2.1 time: 0.873107 Jul 01 10:41:17.522770 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1834/3621] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:16 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1320 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:17.522770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:17.522770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:17.530731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:17.531437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:17.532509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:17.532985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:17.570680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:17.580117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-79d10b8a-729d-4010-a00b-4254c88bac51 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1514 microversion: 2.1 time: 0.375463 Jul 01 10:41:17.590185 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1788/3622] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:17 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:17.920669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:17.928641 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11549839-18c0-409f-9264-5b92d8b5ebe9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.413473 Jul 01 10:41:17.945283 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1835/3623] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:17 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:18.534556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:18.535432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:18.543134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.543846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.544767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.545243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.597949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:18.598825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:18.606216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.607382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.608322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.608930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.871892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:18.882022 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7bd7332b-dceb-4a8d-9eba-3b6f36aa1d36 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1320 microversion: 2.1 time: 0.354271 Jul 01 10:41:18.882983 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1789/3624] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:18 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:18.905203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:18.920422 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ec52361-93c7-4a94-92c7-6a73adfd9f7b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1497 microversion: 2.1 time: 0.326274 Jul 01 10:41:18.920997 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1836/3625] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:18 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1497 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:18.937383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:18.937925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:18.946806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.946806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.947438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.947892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.954139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:18.955544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:18.962901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.964016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.965425 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:18.966100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:18.977809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lazy-loading 'flavor' on Instance uuid 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:41:18.990791 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Cannot 'suspend' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state suspended Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action HTTP/1.1 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 15 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: {"suspend": {}} Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'suspend' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state suspended Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'suspend': {}}} Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 01 10:41:18.993353 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state suspended Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state suspended Jul 01 10:41:18.998416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:19.000317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 409 to user: Cannot 'suspend' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state suspended {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:19.001411 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de2f7b05-54de-43bc-9dbe-334b96458a38 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 409 len: 148 microversion: 2.1 time: 0.068459 Jul 01 10:41:19.002250 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1790/3626] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:18 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 148 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:41:19.012160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61a6487b-4cfa-41c1-8150-26ab5316dd05 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:19.012777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61a6487b-4cfa-41c1-8150-26ab5316dd05 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:19.019276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61a6487b-4cfa-41c1-8150-26ab5316dd05 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:19.020382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61a6487b-4cfa-41c1-8150-26ab5316dd05 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:19.021544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61a6487b-4cfa-41c1-8150-26ab5316dd05 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:19.024907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61a6487b-4cfa-41c1-8150-26ab5316dd05 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:19.185291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:19.192989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a33c0eaa-f003-465d-b959-a5f646ddbac3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.250572 Jul 01 10:41:19.193611 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1837/3627] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:18 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:19.256596 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61a6487b-4cfa-41c1-8150-26ab5316dd05 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 202 len: 0 microversion: 2.1 time: 0.248822 Jul 01 10:41:19.263298 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1791/3628] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:19 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:41:19.271042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:19.271859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:19.281423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:19.282593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:19.284455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:19.285479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:19.556690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:19.568828 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b88ee3fd-7819-4e08-9178-8bd7218a5b2f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1503 microversion: 2.1 time: 0.303149 Jul 01 10:41:19.569475 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1838/3629] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:19 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:19.633797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0ece50ff-1198-412f-a0d9-7dff1a7ddb95 req-71e20e77-7791-4b0f-9d84-a20d32d383ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93ed880-7073-4f2a-bd35-71071fda6bf0", "name": "network-vif-plugged", "status": "completed", "tag": "1ec60999-b1aa-4578-a2cb-b272e9ac5cca"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:19.659871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0ece50ff-1198-412f-a0d9-7dff1a7ddb95 req-71e20e77-7791-4b0f-9d84-a20d32d383ff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:19.660326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0ece50ff-1198-412f-a0d9-7dff1a7ddb95 req-71e20e77-7791-4b0f-9d84-a20d32d383ff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:19.681242 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0ece50ff-1198-412f-a0d9-7dff1a7ddb95 req-71e20e77-7791-4b0f-9d84-a20d32d383ff service nova] Creating event network-vif-plugged:1ec60999-b1aa-4578-a2cb-b272e9ac5cca for instance c93ed880-7073-4f2a-bd35-71071fda6bf0 on n-h1-master-1 Jul 01 10:41:19.696988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0ece50ff-1198-412f-a0d9-7dff1a7ddb95 req-71e20e77-7791-4b0f-9d84-a20d32d383ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074309 Jul 01 10:41:19.697939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1792/3630] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:19.900997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:19.902395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:19.913769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:19.913769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:19.913769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:19.914099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:20.211290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:20.217368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:20.234610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:20.235066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:20.235851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:20.236288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:20.523355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:20.537846 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9e45f302-bbaa-48fd-a982-c2ea821622c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1320 microversion: 2.1 time: 0.641361 Jul 01 10:41:20.538999 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1839/3631] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:19 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1320 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:20.598414 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:20.600112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:20.615447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:20.617173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:20.618094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:20.618545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:20.830166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:20.843702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea6e725c-b647-46cf-bcbe-6ff429eec933 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.636489 Jul 01 10:41:20.856342 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1793/3632] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:20 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:21.037402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:21.047130 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20439dfd-3a80-4b86-bfd7-4ca065fe0c4b tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1503 microversion: 2.1 time: 0.459737 Jul 01 10:41:21.057048 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1840/3633] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:20 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:21.556313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:21.557822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:21.567023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:21.567474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:21.568267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:21.568668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:21.590754 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:21.868832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:21.868832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:21.874359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:21.874822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:21.877736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:21.878188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:21.894266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:21.903323 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4fff54e-398b-479f-8e1e-357fa10076f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1320 microversion: 2.1 time: 0.351159 Jul 01 10:41:21.903909 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1794/3634] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:21 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:22.068886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:22.069815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:22.100720 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:22.106017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:22.107624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:22.113524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:22.389767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:22.400167 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6f9829c-a659-4f04-8c64-92197500f118 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.541659 Jul 01 10:41:22.402532 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1841/3635] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:21 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:22.507353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:22.522759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a16c1d0a-15af-46f8-8dea-06f9f07203c7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1503 microversion: 2.1 time: 0.457495 Jul 01 10:41:22.531470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1795/3636] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:22 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1503 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:22.920325 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:22.921887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:22.930159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:22.930796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:22.933496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:22.933496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.164931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:23.177474 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6db0098-64d0-4039-a4c1-13ff2657015c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1502 microversion: 2.1 time: 0.261177 Jul 01 10:41:23.178440 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1842/3637] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:22 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1502 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:23.197680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:23.199011 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:23.206356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.207005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.207758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.208380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.422775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:23.423935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:23.434387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.434770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.438868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.439653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.464585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:23.473889 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1348cf02-c3cc-40b1-ae4f-bb69ca0eb01e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1502 microversion: 2.1 time: 0.279666 Jul 01 10:41:23.474820 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1796/3638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:23 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:23.495142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:23.495142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:23.504166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.504731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.506011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.506558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.614668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:41:23.716288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:23.730409 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8de518f5-6f59-4c7b-af79-964528e5661a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.313882 Jul 01 10:41:23.732575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1843/3639] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:23 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:23.750138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:23.751125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:23.762776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.763957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:23.767620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:23.768395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.040735 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39f00378-273f-4935-94db-41b1e8c39ba6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 204 len: 0 microversion: 2.1 time: 0.552576 Jul 01 10:41:24.046929 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1797/3640] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:41:23 2022] DELETE /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:41:24.062960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:24.064067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:24.074668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.074979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.075953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.076611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.119607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:24.132451 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:24.137417 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0547f2f4-01c4-4386-b36c-85fcba4fac67 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.403143 Jul 01 10:41:24.142613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1844/3641] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:23 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:24.168240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:24.168240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:24.175785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.176499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.177504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.178152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.490593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:24.502214 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c7089fd-359f-457e-8832-8e3feaa5927f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.345901 Jul 01 10:41:24.503144 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1845/3642] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:24 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:24.515655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:24.520182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fe287a7-bc1a-4649-9cd3-1c208deb91ea tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:24.521105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5fe287a7-bc1a-4649-9cd3-1c208deb91ea tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: c631fcdc-74f9-4009-8096-d711f0c76519] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:24.527505 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5fe287a7-bc1a-4649-9cd3-1c208deb91ea tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance c631fcdc-74f9-4009-8096-d711f0c76519 could not be found. Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fe287a7-bc1a-4649-9cd3-1c208deb91ea tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/c631fcdc-74f9-4009-8096-d711f0c76519/action HTTP/1.1 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 15 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: {"unpause": {}} Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: exception: Instance c631fcdc-74f9-4009-8096-d711f0c76519 could not be found. Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c631fcdc-74f9-4009-8096-d711f0c76519', 'body': {'unpause': {}}} Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c631fcdc-74f9-4009-8096-d711f0c76519 could not be found. Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c631fcdc-74f9-4009-8096-d711f0c76519 could not be found. Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:24.529544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:24.534978 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:24.534978 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:24.534978 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c631fcdc-74f9-4009-8096-d711f0c76519 could not be found. Jul 01 10:41:24.534978 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:24.535493 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73ac8616-2e07-4d17-965a-5589e1265f3e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1508 microversion: 2.1 time: 0.481679 Jul 01 10:41:24.536667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fe287a7-bc1a-4649-9cd3-1c208deb91ea tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance c631fcdc-74f9-4009-8096-d711f0c76519 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:24.537730 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1798/3643] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:24 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1508 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:24.537946 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5fe287a7-bc1a-4649-9cd3-1c208deb91ea tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/c631fcdc-74f9-4009-8096-d711f0c76519/action" status: 404 len: 111 microversion: 2.1 time: 0.021811 Jul 01 10:41:24.542536 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1846/3644] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:24 2022] POST /compute/v2.1/servers/c631fcdc-74f9-4009-8096-d711f0c76519/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:41:24.558387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:24.559632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:24.571356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.571813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.573931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.573931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.750289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:24.750929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:24.763625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.764317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.765553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.766154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.888031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:24.896438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dfc8eb77-dff8-42fb-b54f-6c4c1b8724e0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.350814 Jul 01 10:41:24.896438 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1799/3645] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:24 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:24.914309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:24.915158 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:24.924696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.925404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:24.926601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:24.927388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.026865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:25.038088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0eebe5e0-1c75-4442-a434-2eea8f51f273 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.291856 Jul 01 10:41:25.038686 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1847/3646] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:24 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:25.225358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:25.236379 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-769964b8-9711-4bde-83bc-0c0d3d14acf7 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.323257 Jul 01 10:41:25.237559 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1800/3647] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:24 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:25.256056 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:25.256619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:25.269406 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:25.276814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.278653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.279688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.280413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.311626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Cannot 'unpause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action HTTP/1.1 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 15 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: {"unpause": {}} Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: exception: Cannot 'unpause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'unpause': {}}} Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 in vm_state active. Cannot unpause while the instance is in this state. Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:25.313624 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:25.317779 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:25.317779 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:25.317779 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:25.317779 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:25.317779 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:25.320019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 409 to user: Cannot 'unpause' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:25.321180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6bc6c12-b51a-4594-a596-54384462ee19 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 409 len: 145 microversion: 2.1 time: 0.069331 Jul 01 10:41:25.322284 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1848/3648] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:25 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 145 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:41:25.330936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:25.332080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:25.339776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.340238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.341009 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.341469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.551601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:25.552587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:25.559852 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.560306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.561093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.561811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.772916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:25.798328 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98304f51-ce5c-4dd1-b731-e87a9dbcd1a0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.462743 Jul 01 10:41:25.799010 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1801/3649] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:25 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:25.828952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:25.833962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:25.846803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.848693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:25.852650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:25.854073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:26.000255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:26.007977 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1ede519-9a1a-433b-aabb-06629823388f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1508 microversion: 2.1 time: 0.461342 Jul 01 10:41:26.017105 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1849/3650] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:25 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:26.034935 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=16 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:26.056103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:26.056713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:26.072184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:26.072648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:26.074300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:26.074747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:26.527815 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:26.562153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:26.574140 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4d0b1cd-a6c3-42d1-afbd-a6c63ac9736c tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.755126 Jul 01 10:41:26.574714 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1802/3651] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:25 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:26.593175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c5c40dab-ef86-483e-89b9-c4e93da6d6f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:26.593982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c5c40dab-ef86-483e-89b9-c4e93da6d6f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: b185f0ad-1a86-4b06-8970-b653961f386d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:26.600119 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c5c40dab-ef86-483e-89b9-c4e93da6d6f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance b185f0ad-1a86-4b06-8970-b653961f386d could not be found. Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c5c40dab-ef86-483e-89b9-c4e93da6d6f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/b185f0ad-1a86-4b06-8970-b653961f386d/action HTTP/1.1 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 18 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: {"unshelve": null} Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: exception: Instance b185f0ad-1a86-4b06-8970-b653961f386d could not be found. Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'b185f0ad-1a86-4b06-8970-b653961f386d', 'body': {'unshelve': None}} Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b185f0ad-1a86-4b06-8970-b653961f386d could not be found. Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b185f0ad-1a86-4b06-8970-b653961f386d could not be found. Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:26.602373 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:26.607809 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:26.607809 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:26.607809 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:26.607809 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:26.607809 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b185f0ad-1a86-4b06-8970-b653961f386d could not be found. Jul 01 10:41:26.607809 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:26.609470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c5c40dab-ef86-483e-89b9-c4e93da6d6f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance b185f0ad-1a86-4b06-8970-b653961f386d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:26.610832 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c5c40dab-ef86-483e-89b9-c4e93da6d6f2 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/b185f0ad-1a86-4b06-8970-b653961f386d/action" status: 404 len: 111 microversion: 2.1 time: 0.022285 Jul 01 10:41:26.616858 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1803/3652] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:26 2022] POST /compute/v2.1/servers/b185f0ad-1a86-4b06-8970-b653961f386d/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:41:26.621792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:26.622419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:26.630549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:26.631001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:26.631782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:26.632230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:26.762338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:26.775770 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-064e545b-2ef8-4cdc-8919-4e5ea417210c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.723405 Jul 01 10:41:26.777121 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1850/3653] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:26 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:26.973298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:26.981707 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ac8c8bcf-0ce8-48d9-a8c6-57a60d3cbce4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.364909 Jul 01 10:41:26.982701 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1804/3654] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:26 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:27.001830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:27.003121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:27.012307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.013095 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:27.019987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.019987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:27.025575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:27.026626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:27.038340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.039068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:27.041998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.042545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:27.780857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:27.789849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:27.806772 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d22d16cc-d52f-4da6-8bf8-c8269e58ad86 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.803071 Jul 01 10:41:27.812205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-57a48e5e-55cb-4eb6-97dc-0d77890bb177 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1508 microversion: 2.1 time: 0.785066 Jul 01 10:41:27.813083 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1851/3655] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:26 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:27.813889 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1805/3656] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:27 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1508 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:27.840059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:27.840059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:27.840268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:27.840268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:27.858210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.858530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:27.859351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.859793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:27.860620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.862235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:27.865131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:27.866386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.051647 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Cannot 'unshelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action HTTP/1.1 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 18 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: {"unshelve": null} Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'unshelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'unshelve': None}} Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 in vm_state active. Cannot unshelve while the instance is in this state. Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:41:28.055054 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 409 to user: Cannot 'unshelve' instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 while it is in vm_state active {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61638a24-7130-471a-9209-4fc5f393a21f tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action" status: 409 len: 146 microversion: 2.1 time: 0.229398 Jul 01 10:41:28.064303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1806/3657] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:41:27 2022] POST /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86/action => generated 146 bytes in 231 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:41:28.068139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5212b148-f7e9-4159-9582-b430b023ab28 req-b27b1c3e-47f6-4243-89f6-56342ffe53a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93ed880-7073-4f2a-bd35-71071fda6bf0", "name": "network-vif-deleted", "tag": "1ec60999-b1aa-4578-a2cb-b272e9ac5cca"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:28.110494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5212b148-f7e9-4159-9582-b430b023ab28 req-b27b1c3e-47f6-4243-89f6-56342ffe53a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.110958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5212b148-f7e9-4159-9582-b430b023ab28 req-b27b1c3e-47f6-4243-89f6-56342ffe53a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.178642 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5212b148-f7e9-4159-9582-b430b023ab28 req-b27b1c3e-47f6-4243-89f6-56342ffe53a6 service nova] Creating event network-vif-deleted:1ec60999-b1aa-4578-a2cb-b272e9ac5cca for instance c93ed880-7073-4f2a-bd35-71071fda6bf0 on n-h1-master-1 Jul 01 10:41:28.224055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5212b148-f7e9-4159-9582-b430b023ab28 req-b27b1c3e-47f6-4243-89f6-56342ffe53a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159297 Jul 01 10:41:28.225789 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1807/3658] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:28.253092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:28.261419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:28.268103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.268543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.269508 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.270808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.544497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:28.556003 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-12d0940c-2e33-4c16-9781-03e7f55130c6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.740835 Jul 01 10:41:28.567874 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1852/3659] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:27 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:28.617336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:28.632521 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-da77ad91-7fbd-40fa-9cd4-c7edb5d440d4 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.403083 Jul 01 10:41:28.634050 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1808/3660] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:28 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:28.661076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:28.662685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:28.701946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.702431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.704255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.705720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.831394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:28.832676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:28.843617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.844293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.851402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.852274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.923848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:28.924297 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:28.924751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lazy-loading 'fault' on Instance uuid c93ed880-7073-4f2a-bd35-71071fda6bf0 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:41:29.009526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:29.022609 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6100e2c4-2f7a-495a-948b-4a111d7008f2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 200 len: 1310 microversion: 2.1 time: 0.195158 Jul 01 10:41:29.023239 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1809/3661] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:28 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:29.071560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:29.087380 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef644e61-e62d-4dd7-9c4f-855556bc51d6 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.433324 Jul 01 10:41:29.087977 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1853/3662] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:28 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:29.104835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1cc70bf4-1786-4c37-a5fe-2bc8b767edf0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1097835566_updated"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:29.106683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1cc70bf4-1786-4c37-a5fe-2bc8b767edf0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: ab7f6cea-9b88-4c19-9b91-15199ea907c3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:29.117998 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-1cc70bf4-1786-4c37-a5fe-2bc8b767edf0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance ab7f6cea-9b88-4c19-9b91-15199ea907c3 could not be found. Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1cc70bf4-1786-4c37-a5fe-2bc8b767edf0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/servers/ab7f6cea-9b88-4c19-9b91-15199ea907c3 HTTP/1.1 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 81 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1097835566_updated"}} Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: exception: Instance ab7f6cea-9b88-4c19-9b91-15199ea907c3 could not be found. Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ab7f6cea-9b88-4c19-9b91-15199ea907c3', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1097835566_updated'}}} Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7f6cea-9b88-4c19-9b91-15199ea907c3 could not be found. Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 01 10:41:29.121679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7f6cea-9b88-4c19-9b91-15199ea907c3 could not be found. Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7f6cea-9b88-4c19-9b91-15199ea907c3 could not be found. Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1cc70bf4-1786-4c37-a5fe-2bc8b767edf0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance ab7f6cea-9b88-4c19-9b91-15199ea907c3 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1cc70bf4-1786-4c37-a5fe-2bc8b767edf0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab7f6cea-9b88-4c19-9b91-15199ea907c3" status: 404 len: 111 microversion: 2.1 time: 0.028748 Jul 01 10:41:29.133574 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1810/3663] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:41:29 2022] PUT /compute/v2.1/servers/ab7f6cea-9b88-4c19-9b91-15199ea907c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:29.140527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:29.141647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:29.148232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:29.153250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:29.153250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:29.153250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:29.374047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:29.403690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d3994d1-a05f-4670-9694-01c843afbf42 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.266867 Jul 01 10:41:29.409174 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1854/3664] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:29 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:29.422903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:29.427619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:29.433434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:29.434042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:29.435021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:29.435563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:29.794970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:29.802705 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:29.812072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3aa845a2-3854-474d-99e5-b0dbed623cc0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.392995 Jul 01 10:41:29.813406 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1811/3665] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:29 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:29.822724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:29.822724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:29.842546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:29.844977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:29.846388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:29.849969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:29.965243 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2052725706", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a0eddd1e-04be-490b-be44-3374d41f6aa1"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:30.075893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:30.083604 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a19ca4b-7de5-49a4-84ba-97679daeee92 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.267996 Jul 01 10:41:30.084744 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1812/3666] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:29 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:30.090164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-978c1c5c-c80f-4764-b908-edaaf39ff535 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-978c1c5c-c80f-4764-b908-edaaf39ff535 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 HTTP/1.1 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 280 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.092748 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-978c1c5c-c80f-4764-b908-edaaf39ff535 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-978c1c5c-c80f-4764-b908-edaaf39ff535 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "PUT /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 400 len: 619 microversion: 2.1 time: 0.008262 Jul 01 10:41:30.096799 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1813/3667] 10.222.0.23 () {60 vars in 1256 bytes} [Fri Jul 1 10:41:30 2022] PUT /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:41:30.106774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:30.106774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:30.111219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:30.111675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:30.112453 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:30.112892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:30.126857 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 HTTP/1.1 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: exception: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c93ed880-7073-4f2a-bd35-71071fda6bf0'} Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.128611 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f4ee0742-85a6-4b26-b857-1501ead9d162 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 404 len: 111 microversion: 2.1 time: 0.032972 Jul 01 10:41:30.136592 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1814/3668] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:30 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:30.142317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:30.143058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:30.149392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:30.149919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:30.150766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:30.152560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:30.191946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] validate_networks() for [('a0eddd1e-04be-490b-be44-3374d41f6aa1', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:41:30.456864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:30.465180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ca83a31-0ed1-4822-aaa1-d87aa33d74c0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.333539 Jul 01 10:41:30.465723 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1815/3669] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:30 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:30.482205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7871972-aabb-418c-ab53-dceb608ebb74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: .version_select at 0x7f6f909b6af0>, body: {"keypair": {"name": "tempest-key-970883441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkxm/eqIY/g1HMvWx6u5yJyjl+2soPxF2fVHNSuEnHmd1zLB/GECNB47s0h1xPvRaUNUwL16/1xRjRaCOa4B6Gtz3fQs9/8CQCBwLhIXBPjuRfdDr0aKto8YvKtO7h/Eg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:30.514931 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f7871972-aabb-418c-ab53-dceb608ebb74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:41:30.520943 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:30.530270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f7871972-aabb-418c-ab53-dceb608ebb74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:41:30.712210 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7871972-aabb-418c-ab53-dceb608ebb74 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.239802 Jul 01 10:41:30.713376 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1816/3670] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:41:30 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:30.723413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:30.725556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:30.753846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:30.754307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:30.755104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:30.759276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:31.011723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:41:31.012572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:41:31.013397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:41:31.014022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:41:31.014456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:41:31.032382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:31.034249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:31.038666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:31.040800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:31.080389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Getting quotas for project f49749e42dfc4e57907fa26c055b206a. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:41:31.086417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Getting quotas for user d14bb96f0a004412a4a41baa22f15ad8 and project f49749e42dfc4e57907fa26c055b206a. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:41:31.086611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:31.096409 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8573de4c-67b9-4249-ac83-82c9c2a299cd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.381933 Jul 01 10:41:31.102900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Going to run 2 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:41:31.106882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:41:31.109312 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1817/3671] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:30 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:31.114966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9eafc487-d27a-4d62-a372-4c9795ab943c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '.version_select at 0x7f6f90880ee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:31.117509 n-d-master-1 devstack@n-api.service[119765]: WARNING oslo_db.sqlalchemy.utils [None req-9eafc487-d27a-4d62-a372-4c9795ab943c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 01 10:41:31.124278 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9eafc487-d27a-4d62-a372-4c9795ab943c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.013814 Jul 01 10:41:31.133367 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1818/3672] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:41:31 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:31.133367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:31.133367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:31.136594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:31.137043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:31.138142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:31.138580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:31.342703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:41:31.344865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:31.353036 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-329eda29-b0e1-4b96-b778-7bae9db9231b tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.226472 Jul 01 10:41:31.355718 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1819/3673] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:31 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:31.362322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1406b6cc-0ca1-4309-833c-e3e158de8a8d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1406b6cc-0ca1-4309-833c-e3e158de8a8d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 HTTP/1.1 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 24 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": ""}} Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86', 'body': {'server': {'name': ''}}} Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '' Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:41:31.366557 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1406b6cc-0ca1-4309-833c-e3e158de8a8d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1406b6cc-0ca1-4309-833c-e3e158de8a8d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "PUT /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 400 len: 108 microversion: 2.1 time: 0.010949 Jul 01 10:41:31.373259 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1820/3674] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:41:31 2022] PUT /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:41:31.380016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1707943169", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-key-970883441", "networks": [{"uuid": "9025d00e-6ad8-47ef-80bc-484168809931"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:31.471508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:41:31.564785 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3eff2900-ba9a-4093-8a07-d4c34af8a2af tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.052400 Jul 01 10:41:31.567516 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1855/3675] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:41:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:41:31.577728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:31.578747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:31.590674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:31.592044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:31.593590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:31.594376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:31.948528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:31.960327 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fbd3ca99-e381-4a27-87cc-a0fb34d6465a tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1506 microversion: 2.1 time: 0.391170 Jul 01 10:41:31.960943 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1856/3676] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:31 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:31.977483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:31.992994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:31.998559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Searching by: {'deleted': False, 'project_id': 'f49749e42dfc4e57907fa26c055b206a'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:41:32.029103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:32.029679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:32.031547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:32.032524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:32.062873 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93eba80c-efde-4ef7-a9cb-ae9a5edc44e8 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.089176 Jul 01 10:41:32.064291 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1857/3677] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:41:31 2022] GET /compute/v2.1/servers => generated 677 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:32.089084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-963328c1-1d71-4d38-b842-5276732cd1b9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:32.089737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-963328c1-1d71-4d38-b842-5276732cd1b9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:32.202265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-963328c1-1d71-4d38-b842-5276732cd1b9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:32.220873 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-963328c1-1d71-4d38-b842-5276732cd1b9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1220 microversion: 2.1 time: 0.141729 Jul 01 10:41:32.221594 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1858/3678] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:32 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:32.385821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:32.386997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:32.404035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:32.404522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:32.407086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:32.408550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:32.411006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:41:32.411495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:41:32.412795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:41:32.413349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:41:32.413874 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:41:32.428053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:32.428978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:32.430403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:32.431139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:32.472033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:41:32.484738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:41:32.523010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:41:32.538367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:41:32.666750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:32.678768 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d2110610-4edc-4659-a9b4-1aece4be7ae1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.300541 Jul 01 10:41:32.690620 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1859/3679] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:32 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:32.763119 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5439137-702a-45df-a15f-8def32895074 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.390891 Jul 01 10:41:32.765192 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1821/3680] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:41:32.776211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c7536f60-2786-42ad-b57f-f86ff1bb4e4a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:32.777366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c7536f60-2786-42ad-b57f-f86ff1bb4e4a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:32.891977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c7536f60-2786-42ad-b57f-f86ff1bb4e4a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:32.899876 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c7536f60-2786-42ad-b57f-f86ff1bb4e4a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1228 microversion: 2.1 time: 0.128878 Jul 01 10:41:32.900474 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1860/3681] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:32 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1228 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:33.245799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03306242-a98b-443f-86be-9fcc7d5e0ca4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:33.246424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03306242-a98b-443f-86be-9fcc7d5e0ca4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:33.371229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03306242-a98b-443f-86be-9fcc7d5e0ca4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:33.383357 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03306242-a98b-443f-86be-9fcc7d5e0ca4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1220 microversion: 2.1 time: 0.147311 Jul 01 10:41:33.384758 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1822/3682] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:33 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:33.696560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:33.698708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:33.726440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:33.726914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:33.744355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:33.746286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:33.916915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63e70006-6bbd-4467-9da3-59a13cd9cc16 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:33.917799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63e70006-6bbd-4467-9da3-59a13cd9cc16 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:33.985100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:33.997630 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7c7d0faf-dc2d-495b-85e9-3ce0f31dc4ef tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.304751 Jul 01 10:41:34.001221 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1861/3683] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:33 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:34.051822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-63e70006-6bbd-4467-9da3-59a13cd9cc16 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:34.069834 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63e70006-6bbd-4467-9da3-59a13cd9cc16 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1228 microversion: 2.1 time: 0.156554 Jul 01 10:41:34.071010 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1823/3684] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:33 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1228 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:34.402326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e2a86c9-53de-4094-9422-51da5693d8bf tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:34.403212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2e2a86c9-53de-4094-9422-51da5693d8bf tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:34.497320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2e2a86c9-53de-4094-9422-51da5693d8bf tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:34.514932 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e2a86c9-53de-4094-9422-51da5693d8bf tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1220 microversion: 2.1 time: 0.116396 Jul 01 10:41:34.516287 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1862/3685] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:34 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:35.016459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:35.017949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:35.031925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:35.035785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:35.036826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:35.037482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:35.088144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:35.088893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:35.133473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:35.135125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:35.145850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:35.147686 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:35.359223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:35.378166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0c2f4c4-7070-4134-9b31-7ed31a9a0c84 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1280 microversion: 2.1 time: 0.294058 Jul 01 10:41:35.379292 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1863/3686] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:35 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1280 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:35.464054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:35.470083 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86eb4a1f-e759-46cb-8879-e2e111229914 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.458075 Jul 01 10:41:35.486534 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1824/3687] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:35 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:35.534355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:35.534929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:35.545097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:35.546976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:35.546976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:35.546976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:35.632981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:35.639097 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b1efe88d-1086-430d-8963-153822188b66 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1272 microversion: 2.1 time: 0.109907 Jul 01 10:41:35.648956 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1864/3688] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:35 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:36.401559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:36.402169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:36.409553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:36.410028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:36.410767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:36.411198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:36.526702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:36.527900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:36.528022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:36.528110 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-547e461b-5354-42b4-b08e-e80d202dae38 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1298 microversion: 2.1 time: 0.099304 Jul 01 10:41:36.528110 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1825/3689] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:36 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:36.528270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:36.528270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:36.528270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:36.528270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:36.659078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:36.659078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:36.665761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:36.666215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:36.667630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:36.668082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:36.692488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:36.703511 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a0566fab-79d7-4fe7-9990-086e3b46aa79 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1505 microversion: 2.1 time: 0.220355 Jul 01 10:41:36.705173 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1865/3690] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:36 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:36.782496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:36.792460 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2bb17707-cacf-4e0b-b2d3-e6b0d60946c0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1272 microversion: 2.1 time: 0.139231 Jul 01 10:41:36.793310 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1826/3691] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:36 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:37.543468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:37.544345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:37.567603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:37.572343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:37.574467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:37.576022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:37.724680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:37.726015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:37.745671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:37.746611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:37.752703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:37.753217 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:38.383687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:38.397669 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d62da5a8-6781-4f48-a778-fcbfa7342e01 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1286 microversion: 2.1 time: 0.859747 Jul 01 10:41:38.407375 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1866/3692] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:37 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1286 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:38.412527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:38.418105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:38.428581 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:38.431425 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:38.432870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:38.433579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:38.439765 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:38.618383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:38.633669 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1f913c8d-d592-4282-a57d-d663be39ea4d tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1278 microversion: 2.1 time: 0.224975 Jul 01 10:41:38.636304 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1867/3693] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:38 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:38.852685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:38.869325 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5474c855-2429-4644-b14a-d2ec307f12d3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1485 microversion: 2.1 time: 1.146689 Jul 01 10:41:38.870939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1827/3694] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:37 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1485 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:39.036465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-32883569", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:39.134910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] validate_networks() for [('2006e634-1434-4f2b-944c-5a4cb509d23a', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:41:39.419139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:39.419895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:39.430410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:39.433697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:39.434648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:39.435253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:40.242259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:40.256076 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a09c762d-2608-4489-9613-3d630aacf8e0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.840947 Jul 01 10:41:40.263593 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1828/3695] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:39 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:40.268766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:40.276226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:40.289451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:40.291864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:40.291864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:40.291864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:40.495115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:40.504592 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-70fbd7b2-1eae-469e-8cc1-0c6e9a0839cc tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1278 microversion: 2.1 time: 0.239826 Jul 01 10:41:40.514665 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1829/3696] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:40 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:41.279847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:41.280415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:41.290666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.291159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:41.292450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.292936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:41.708976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:41.723901 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9510dedb-855e-4ac3-94e1-bb55ac6ed37e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.448925 Jul 01 10:41:41.728629 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1830/3697] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:41 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:41.736169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:41.738522 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:41.743515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:41:41.745273 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:41:41.745919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:41:41.746525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:41:41.747122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:41:41.768286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.768286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:41.768286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.768286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:41.777076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.779811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:41.782333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.782980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:41.837808 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:41.840839 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Getting quotas for project 2182bc6e5f9d439a8a146dc2b8aa1219. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 HTTP/1.1 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '76313d67-6ebf-4f72-af57-70281a063492'} Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:41.846004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:41.851023 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:41:41.872136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:41.883457 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f699f92a-73ab-436b-919a-f9ba36c54e71 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 404 len: 111 microversion: 2.1 time: 0.148968 Jul 01 10:41:41.884291 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1831/3698] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:41:41 2022] DELETE /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:41.903514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Getting quotas for user 1787c6f2f7c84dfc9c1ba94d4a04432e and project 2182bc6e5f9d439a8a146dc2b8aa1219. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:41:41.909709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:41.929810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:41.977732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:41:41.983794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:41:41.984389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.985108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:41.991644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:41.995428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:42.207122 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c98232d-1bdb-4b1b-a8e0-e9d00198d23c tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.175269 Jul 01 10:41:42.208444 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1868/3699] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:41:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:41:42.214135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:42.215064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 76313d67-6ebf-4f72-af57-70281a063492] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:42.222962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:42.225481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:42.230495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:42.230495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:42.255428 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 HTTP/1.1 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '76313d67-6ebf-4f72-af57-70281a063492'} Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:42.257176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 76313d67-6ebf-4f72-af57-70281a063492 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-624815f0-95fb-40bd-92c3-dc4342f92edd tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492" status: 404 len: 111 microversion: 2.1 time: 0.049345 Jul 01 10:41:42.264979 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1869/3700] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:42 2022] GET /compute/v2.1/servers/76313d67-6ebf-4f72-af57-70281a063492 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:42.272608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58012fc3-076d-4913-9d54-821358b1aa9d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:42.273944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-58012fc3-076d-4913-9d54-821358b1aa9d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:42.446422 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:42.705189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-58012fc3-076d-4913-9d54-821358b1aa9d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:42.726637 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58012fc3-076d-4913-9d54-821358b1aa9d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1212 microversion: 2.1 time: 0.462474 Jul 01 10:41:42.729599 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1870/3701] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:42 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1212 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:42.738469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:42.747264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:42.777660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:42.778702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:42.780136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:42.782446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:42.860270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:41:43.263616 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d8343f53-4f7a-4422-bf8f-aaa7bef83481 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 204 len: 0 microversion: 2.1 time: 0.528765 Jul 01 10:41:43.264780 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1871/3702] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:41:42 2022] DELETE /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:41:43.276888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:43.282480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:43.306511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:43.310851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:43.312373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:43.312987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:43.585850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:43.598561 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aea9f851-6199-48cf-93c1-c2bc8f0732a1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 1.709791 Jul 01 10:41:43.633969 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1832/3703] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:41 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:43.650646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:43.653240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:43.681194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:43.681660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:43.684733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:43.685390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:43.734603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:43.749935 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d642236d-1f76-40d6-9bab-6af5467768c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.476787 Jul 01 10:41:43.759194 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1872/3704] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:43 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:43.799734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:43.800287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:43.833311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:43.834300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:43.838753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:43.840054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:44.058395 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=14 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:44.099740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:44.111769 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80dae4d9-db65-4530-9f09-422451af9f50 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1216 microversion: 2.1 time: 0.357219 Jul 01 10:41:44.114925 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1873/3705] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:43 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1216 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:44.215183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-83a04a34-97b6-4262-acd3-e83f34727e48 req-29af5f7e-ad34-4eb6-a97a-f0a2d91e114f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1f0d64-97f2-4620-8784-a16be944e4b8", "tag": "0e16ea84-eee0-4ae7-945f-0e883d0ac7b8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:44.224981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83a04a34-97b6-4262-acd3-e83f34727e48 req-29af5f7e-ad34-4eb6-a97a-f0a2d91e114f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:44.225471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83a04a34-97b6-4262-acd3-e83f34727e48 req-29af5f7e-ad34-4eb6-a97a-f0a2d91e114f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:44.253308 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-83a04a34-97b6-4262-acd3-e83f34727e48 req-29af5f7e-ad34-4eb6-a97a-f0a2d91e114f service nova] Creating event network-changed:0e16ea84-eee0-4ae7-945f-0e883d0ac7b8 for instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 on n-h1-master-1 Jul 01 10:41:44.263876 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-83a04a34-97b6-4262-acd3-e83f34727e48 req-29af5f7e-ad34-4eb6-a97a-f0a2d91e114f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053443 Jul 01 10:41:44.267783 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1874/3706] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:41:44.337825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:44.348704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d250969-65c9-4427-bdba-972fd0a29de0 tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.708266 Jul 01 10:41:44.349314 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1833/3707] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:43 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:44.618123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:44.618914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:44.625048 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:44.632729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:44.633523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:44.635822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:44.635822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:44.767417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:44.768835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:44.784626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:44.784960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:44.785778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:44.786213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:44.926808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:44.939524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef1921b4-2dae-455c-8cbc-f1f643ff9bb0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 0.325930 Jul 01 10:41:44.950386 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1875/3708] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:44 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:45.132149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:45.133014 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:45.143023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:45.146693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:45.147708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:45.148426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:45.328067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:45.342263 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bbf097b-e4e5-4582-931b-fd2b8238ae81 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.578820 Jul 01 10:41:45.343214 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1834/3709] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:44 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:45.380284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:45.387393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:45.388580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:45.390962 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1ca05228-e8b8-4300-8152-cbb4be84c418 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1264 microversion: 2.1 time: 0.262994 Jul 01 10:41:45.391212 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1876/3710] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:45 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:45.418039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:45.419849 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:45.423004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:45.427853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:45.956524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:45.957105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:45.981421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:45.981421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:45.981421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:45.981421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:46.044477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03374f49b3444ffabc5a22d82c07854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b024145714e4a88443e0a6d1d9a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:46.054888 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0826c7b-7a44-4fb5-a535-8ad91acdf05e tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 200 len: 1512 microversion: 2.1 time: 0.685919 Jul 01 10:41:46.078159 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1835/3711] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:45 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 1512 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:46.578012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2747e099-7ebb-41da-94bd-832c75471b50 req-50fa0cb6-d6c5-4eed-ac7c-74c6371d3c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90661f1e-ecda-4ea8-99c9-ca7fe1434b86", "name": "network-vif-deleted", "tag": "800ffdd2-a08c-47ca-9832-cd3ac49ad796"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:46.594665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2747e099-7ebb-41da-94bd-832c75471b50 req-50fa0cb6-d6c5-4eed-ac7c-74c6371d3c94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:46.595078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2747e099-7ebb-41da-94bd-832c75471b50 req-50fa0cb6-d6c5-4eed-ac7c-74c6371d3c94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:46.630163 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2747e099-7ebb-41da-94bd-832c75471b50 req-50fa0cb6-d6c5-4eed-ac7c-74c6371d3c94 service nova] Creating event network-vif-deleted:800ffdd2-a08c-47ca-9832-cd3ac49ad796 for instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 on n-h1-master-1 Jul 01 10:41:46.636187 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2747e099-7ebb-41da-94bd-832c75471b50 req-50fa0cb6-d6c5-4eed-ac7c-74c6371d3c94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.556828 Jul 01 10:41:46.640141 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1836/3712] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:46.645704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d877224c-22a4-485c-94c4-d3540da9e5c0 req-1faf6ec7-c7d1-4bcb-93d4-2eaac338504e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e", "tag": "b0205847-eb57-4537-9335-429283badf76"}, {"name": "network-changed", "server_uuid": "9108d85c-2c65-44f6-b0a0-b7b144e2affa", "tag": "53d8768a-caad-4655-9fa5-0fb610d77aaf"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:46.670892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d877224c-22a4-485c-94c4-d3540da9e5c0 req-1faf6ec7-c7d1-4bcb-93d4-2eaac338504e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:46.674114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d877224c-22a4-485c-94c4-d3540da9e5c0 req-1faf6ec7-c7d1-4bcb-93d4-2eaac338504e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:46.702741 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:46.712756 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d877224c-22a4-485c-94c4-d3540da9e5c0 req-1faf6ec7-c7d1-4bcb-93d4-2eaac338504e service nova] Creating event network-changed:b0205847-eb57-4537-9335-429283badf76 for instance 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e on n-h1-master-1 Jul 01 10:41:46.712756 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d877224c-22a4-485c-94c4-d3540da9e5c0 req-1faf6ec7-c7d1-4bcb-93d4-2eaac338504e service nova] Creating event network-changed:53d8768a-caad-4655-9fa5-0fb610d77aaf for instance 9108d85c-2c65-44f6-b0a0-b7b144e2affa on n-h2-master-1 Jul 01 10:41:46.717462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d877224c-22a4-485c-94c4-d3540da9e5c0 req-1faf6ec7-c7d1-4bcb-93d4-2eaac338504e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075644 Jul 01 10:41:46.718412 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1837/3713] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:46.724137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:46.725119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:46.733000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:46.733773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:46.734794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:46.735458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:47.076603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:47.089288 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b652543-b238-4ea6-9372-724127c43fda tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 1.137116 Jul 01 10:41:47.091103 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1877/3714] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:45 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:47.108736 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:47.109489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:47.116435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:47.128080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:47.128080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:47.128080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:47.226698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:47.234926 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79b76015-6e4f-4870-88f8-358ecd7cf2df tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1270 microversion: 2.1 time: 0.141533 Jul 01 10:41:47.246281 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1878/3715] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:47 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:47.251276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:47.254553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] [instance: 90661f1e-ecda-4ea8-99c9-ca7fe1434b86] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:47.260613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:47.261101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:47.262355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:47.262965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:47.297310 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] HTTP exception thrown: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 could not be found. Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Request method failure captured: Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 HTTP/1.1 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs6C2VwZzVSby9rrsVdmeMw0sWj_aadCH3dpW1BLnIn3aXTgjJ5s4flYMC55w8XTBOCfCZd8bSlCMEIkWs64b-oNN8AbjcjUXD01NUQavLJBC-feAKeaKg5yUgLLICQkiv8mrJdU3IJsWUJdc-SGgQsbteNfPlIR0wPXj-wzMxNiHGA Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_450b024145714e4a88443e0a6d1d9a49", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/450b024145714e4a88443e0a6d1d9a49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 450b024145714e4a88443e0a6d1d9a49 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1068871567 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: a03374f49b3444ffabc5a22d82c07854 Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1068871567-project Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 could not be found. Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '90661f1e-ecda-4ea8-99c9-ca7fe1434b86'} Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 could not be found. Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 could not be found. Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:41:47.299269 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:47.303842 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:41:47.303842 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:41:47.303842 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:41:47.303842 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:41:47.303842 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:41:47.303842 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 could not be found. Jul 01 10:41:47.303842 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:41:47.307252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] Returning 404 to user: Instance 90661f1e-ecda-4ea8-99c9-ca7fe1434b86 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:41:47.308793 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-34190c0f-aab8-4ed7-8928-f0a4b228424d tempest-ServersNegativeTestJSON-1068871567 tempest-ServersNegativeTestJSON-1068871567-project] 10.222.0.23 "GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86" status: 404 len: 111 microversion: 2.1 time: 0.061442 Jul 01 10:41:47.309599 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1879/3716] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:47 2022] GET /compute/v2.1/servers/90661f1e-ecda-4ea8-99c9-ca7fe1434b86 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:41:47.343935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:47.357215 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1845418-6e2a-4724-b967-533d666ef737 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.637191 Jul 01 10:41:47.358296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1838/3717] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:46 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:48.111059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:48.111059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:48.120515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:48.120971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:48.121817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:48.122256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:48.254127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:48.254819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:48.266335 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:48.267261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:48.268037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:48.269381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:48.307339 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:48.316739 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5bfb1875-45ac-4da0-93d4-1f2de76fa7de tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 0.212712 Jul 01 10:41:48.317407 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1880/3718] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:48 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:48.379340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:48.380311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:48.397540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:48.398451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:48.399436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:48.400051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:48.527834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:48.538062 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de9be40f-6f26-416a-b2db-835e58574f57 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 0.289940 Jul 01 10:41:48.545035 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1839/3719] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:48 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:48.779166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:48.784283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-32718730-ae3f-476e-9820-437ab6fba0aa tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.410210 Jul 01 10:41:48.787057 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1881/3720] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:48 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:49.343292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:49.343929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:49.360917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:49.364534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:49.365402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:49.365849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:49.392857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:49.393767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:49.405602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:49.406057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:49.406844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:49.411956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:49.516249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:41:49.715202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:49.723212 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb0c4ef8-5c7f-49ff-b23f-365f4c07633e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 0.389095 Jul 01 10:41:49.724364 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1882/3721] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:49 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:49.736617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:49.738086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:49.754025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:49.754778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:49.755758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:49.756364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.016413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:50.026279 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-44be5cc8-30d8-4287-b1e1-7b35e87a08cd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 0.299891 Jul 01 10:41:50.037485 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1883/3722] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:49 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:50.044647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:50.045655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:50.052836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:50.053548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.054523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:50.055126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.108729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eab4d2c5-b717-4221-8744-4ec8f7ee09fa tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "DELETE /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 204 len: 0 microversion: 2.42 time: 1.028293 Jul 01 10:41:50.110157 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1840/3723] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:41:49 2022] DELETE /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:41:50.120228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:50.121692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:50.136126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:50.137016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.138103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:50.139589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.528602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:50.544688 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f02601c7-4a97-417b-a189-66029eb1d8ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.505213 Jul 01 10:41:50.555108 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1884/3724] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:50 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:50.611494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:50.635997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:50.645720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:50.649272 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-199991a0-83b0-43b9-bb9e-a58c99e2dae1 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2959 microversion: 2.42 time: 0.532619 Jul 01 10:41:50.650401 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1841/3725] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:41:50 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2959 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:41:50.740401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:50.740949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:50.747729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:50.748182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.748959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:50.749419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.817982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e923888a-0d7d-45e5-b0e2-652ac0444ed6 req-df5d0cfc-a73b-4ae6-ad71-4636d4cd10d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e08071f-b890-40d7-9eee-f249864936f9", "tag": "f16f4e29-6e0a-4906-b3b7-df3d6a3cc9a9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:50.847411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e923888a-0d7d-45e5-b0e2-652ac0444ed6 req-df5d0cfc-a73b-4ae6-ad71-4636d4cd10d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:50.848003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e923888a-0d7d-45e5-b0e2-652ac0444ed6 req-df5d0cfc-a73b-4ae6-ad71-4636d4cd10d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:50.878831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e923888a-0d7d-45e5-b0e2-652ac0444ed6 req-df5d0cfc-a73b-4ae6-ad71-4636d4cd10d8 service nova] Creating event network-changed:f16f4e29-6e0a-4906-b3b7-df3d6a3cc9a9 for instance 0e08071f-b890-40d7-9eee-f249864936f9 on n-h2-master-1 Jul 01 10:41:50.899683 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e923888a-0d7d-45e5-b0e2-652ac0444ed6 req-df5d0cfc-a73b-4ae6-ad71-4636d4cd10d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098825 Jul 01 10:41:50.903700 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1842/3726] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:51.067065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:51.068073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:51.086836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:51.087676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:51.091187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:51.092420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:51.195919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:51.196546 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:51.204684 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b372b3c-c905-44ab-9a4f-def8795a6dc1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 0.465568 Jul 01 10:41:51.208385 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1885/3727] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:50 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:51.573747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:51.574595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:51.590502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:51.592272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:51.595341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:51.596352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:51.814963 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:52.342520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:52.356718 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a892521-a1f7-4cad-9158-81d96e0ca451 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 1.313190 Jul 01 10:41:52.358063 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1843/3728] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:51 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:52.367085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:52.371829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:52.389643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:52.390186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:52.391243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:52.392490 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:52.504795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:52.515995 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d739ffd0-c37d-4ccd-b1ca-090ffcc2072c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.947319 Jul 01 10:41:52.527342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1886/3729] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:51 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:52.539800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:52.542689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:52.550723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:52.551525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:52.552670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:52.553114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:52.719549 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=20 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:53.031824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:53.039259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:53.043277 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e55716e0-0761-42a9-b6ad-f9c53cb1f8d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 0.509698 Jul 01 10:41:53.052818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:53.052818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:53.052818 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6105d7d6-ecba-4df8-a061-1c8ccf80a52e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2959 microversion: 2.42 time: 0.692008 Jul 01 10:41:53.053847 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1887/3730] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:52 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:53.065324 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1844/3731] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:41:52 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2959 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:41:53.281941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5c7d324b-d57b-49a1-877e-ecf47b46a6e5 req-4b717535-d354-40a9-bb62-409db054e01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9108d85c-2c65-44f6-b0a0-b7b144e2affa", "name": "network-vif-plugged", "status": "completed", "tag": "53d8768a-caad-4655-9fa5-0fb610d77aaf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:53.298125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5c7d324b-d57b-49a1-877e-ecf47b46a6e5 req-4b717535-d354-40a9-bb62-409db054e01c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:53.298908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5c7d324b-d57b-49a1-877e-ecf47b46a6e5 req-4b717535-d354-40a9-bb62-409db054e01c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:53.321407 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5c7d324b-d57b-49a1-877e-ecf47b46a6e5 req-4b717535-d354-40a9-bb62-409db054e01c service nova] Creating event network-vif-plugged:53d8768a-caad-4655-9fa5-0fb610d77aaf for instance 9108d85c-2c65-44f6-b0a0-b7b144e2affa on n-h2-master-1 Jul 01 10:41:53.335547 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5c7d324b-d57b-49a1-877e-ecf47b46a6e5 req-4b717535-d354-40a9-bb62-409db054e01c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278774 Jul 01 10:41:53.337077 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1888/3732] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:53.378568 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:53.379224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:53.393258 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:53.396415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:53.397304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:53.398204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:53.535415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:53.536398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:53.558133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:53.558904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:53.562037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:53.564625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:54.396685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:54.406834 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5ad511b2-5e4e-4ef0-9a53-3e23d84a0f03 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 1.037468 Jul 01 10:41:54.407766 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1845/3733] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:53 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:54.412691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1720135303", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e95a279c-448a-4371-a9e0-60c5b05d38a7"}], "block_device_mapping_v2": [{"uuid": "3050b2fb-f153-4156-bf2d-83ca528b47ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:54.433279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:54.444759 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-130499e7-0959-4741-bcd8-b0b65baeb1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.914312 Jul 01 10:41:54.456011 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1889/3734] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:53 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:54.470060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:54.470755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:54.478034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] validate_networks() for [('e95a279c-448a-4371-a9e0-60c5b05d38a7', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:41:54.478952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:54.481477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:54.481477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:54.481477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:54.998700 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:55.009718 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f762136-81cc-47cd-bb06-f148257a22f7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1320 microversion: 2.1 time: 0.544687 Jul 01 10:41:55.010431 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1890/3735] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:54 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1320 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:55.015263 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:55.015875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:55.021921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:55.022514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:55.023293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:55.023736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:55.909700 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:55.930472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:55.932350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:55.934853 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a51e072a-62cf-4809-b795-d29028c4570c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2959 microversion: 2.42 time: 0.923056 Jul 01 10:41:55.936472 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1891/3736] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:41:55 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2959 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:41:55.942731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a940ad14-9a68-4275-90cc-7098087165bc req-3303b8ce-f45c-4090-851f-fac8c42b260b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e", "name": "network-vif-plugged", "status": "completed", "tag": "b0205847-eb57-4537-9335-429283badf76"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:55.957057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a940ad14-9a68-4275-90cc-7098087165bc req-3303b8ce-f45c-4090-851f-fac8c42b260b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:55.958059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a940ad14-9a68-4275-90cc-7098087165bc req-3303b8ce-f45c-4090-851f-fac8c42b260b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:55.978031 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a940ad14-9a68-4275-90cc-7098087165bc req-3303b8ce-f45c-4090-851f-fac8c42b260b service nova] Creating event network-vif-plugged:b0205847-eb57-4537-9335-429283badf76 for instance 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e on n-h1-master-1 Jul 01 10:41:55.986641 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a940ad14-9a68-4275-90cc-7098087165bc req-3303b8ce-f45c-4090-851f-fac8c42b260b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047219 Jul 01 10:41:55.987935 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1892/3737] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:55.995771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:56.001451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:56.008473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.009444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.011231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.011880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.186936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:41:56.187459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:41:56.187797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:41:56.188431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:41:56.189025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:41:56.204375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.205705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.206833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.207463 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.230695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:41:56.237586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Getting quotas for user e3ce54f4c29540dc8f7077c2717f6451 and project 5d91a3501ad3469f8dbafaa816b883d0. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:41:56.250741 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:41:56.517528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:56.532994 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0058eb27-a360-4fa7-96c0-67756e8387f5 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 0.541785 Jul 01 10:41:56.535271 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1893/3738] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:55 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:56.544915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:56.544915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:56.555405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.556052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.557023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.557886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.653205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:41:56.655448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3050b2fb-f153-4156-bf2d-83ca528b47ab',volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:41:56.725879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:56.734593 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-726be63b-bc8e-4861-81ff-cd475c927fb9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.197937 Jul 01 10:41:56.735423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1894/3739] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:56 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:56.740280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:56.740887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:56.747942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.748391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.749339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.749776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.963558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:56.973910 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1047096c-54e5-4b65-9944-1e462b9065c1 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 200 len: 1507 microversion: 2.1 time: 0.237254 Jul 01 10:41:56.974667 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1895/3740] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:56 2022] GET /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:56.980914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:56.982075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:56.991109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.992103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:56.993284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:56.994604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:57.242624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f9fb0770-f3e3-45ef-8e05-9e88e145ae66 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.832613 Jul 01 10:41:57.242624 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1846/3741] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:41:57.247733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:57.257337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:57.275983 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:57.277884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:57.279222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:57.282383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:57.497743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:57.507305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:57.512789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:57.512789 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f0e6001-87b8-42d4-9f05-f54d66352702 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2938 microversion: 2.42 time: 0.534980 Jul 01 10:41:57.523888 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1896/3742] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:41:56 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2938 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:41:57.540023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc18d2fc-0eae-4dc6-ad01-db7b8f008958 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:57.543748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc18d2fc-0eae-4dc6-ad01-db7b8f008958 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:57.836386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc18d2fc-0eae-4dc6-ad01-db7b8f008958 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:57.847911 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc18d2fc-0eae-4dc6-ad01-db7b8f008958 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1053 microversion: 2.1 time: 0.320738 Jul 01 10:41:57.849331 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1897/3743] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:57 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1053 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:57.856770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:57.867917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3189db4-8aa2-4bf0-bf67-a142a9a01019 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e" status: 200 len: 1320 microversion: 2.1 time: 0.623157 Jul 01 10:41:57.870305 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1847/3744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:57 2022] GET /compute/v2.1/servers/5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:57.887031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:57.887641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:57.905270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:57.910784 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:57.913054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:57.913900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:57.914740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:57.916211 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:57.941637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:57.942097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:57.942901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:57.949362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:58.364878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:58.375013 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0da7e31a-4873-4d40-b48e-77ab6d9c608a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 0.485393 Jul 01 10:41:58.381968 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1898/3745] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:57 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:58.391140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1f0d64-97f2-4620-8784-a16be944e4b8", "name": "network-vif-plugged", "status": "completed", "tag": "0e16ea84-eee0-4ae7-945f-0e883d0ac7b8"}, {"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-unplugged", "status": "completed", "tag": "b1283c20-2b14-4147-b47c-03424c3b0288"}, {"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-unplugged", "status": "completed", "tag": "e2f849d1-280e-494f-9238-6812479d0556"}, {"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-unplugged", "status": "completed", "tag": "2c8619a3-cc50-4ef2-b76b-3af83b3d15d0"}, {"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-unplugged", "status": "completed", "tag": "c25a26fa-0f48-4280-aafb-da9333b6647c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:41:58.413444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:58.414509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:58.438732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Creating event network-vif-plugged:0e16ea84-eee0-4ae7-945f-0e883d0ac7b8 for instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 on n-h1-master-1 Jul 01 10:41:58.448680 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Creating event network-vif-unplugged:b1283c20-2b14-4147-b47c-03424c3b0288 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:41:58.451934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Creating event network-vif-unplugged:e2f849d1-280e-494f-9238-6812479d0556 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:41:58.452791 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Creating event network-vif-unplugged:2c8619a3-cc50-4ef2-b76b-3af83b3d15d0 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:41:58.456093 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] Creating event network-vif-unplugged:c25a26fa-0f48-4280-aafb-da9333b6647c for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:41:58.465874 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e76ba0a5-9afe-4282-a358-2bc46ea0bb2a req-c7987325-6464-4128-b7b9-041b7bb8634f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 875 microversion: 2.1 time: 0.082293 Jul 01 10:41:58.473512 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1899/3746] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 875 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:41:58.532307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:58.533005 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:58.540366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:58.542614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:58.542614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:58.542614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:58.585034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:58.596255 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-835a4298-83a6-4bfe-938f-af5283c6c2e4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.723511 Jul 01 10:41:58.597194 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1848/3747] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:57 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:58.878113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:58.878113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:58.879778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:58.880482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:58.881692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:58.882298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:58.991576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:59.014467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:59.016012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:59.023313 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7fe988e5-aebc-4173-99b6-4673f9f81128 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2917 microversion: 2.42 time: 0.489510 Jul 01 10:41:59.026751 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1900/3748] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:41:58 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2917 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:41:59.035815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:59.038335 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:59.062247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.063177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:59.064568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.065252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:59.099997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:59.124619 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d909ce35-4cb2-49bb-9ed3-24a0482162e7 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1103 microversion: 2.1 time: 0.260138 Jul 01 10:41:59.137837 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1849/3749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:58 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1103 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:41:59.401879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:59.404708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:59.419527 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.420454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:59.421855 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.424654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:59.433317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:59.452989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95980695-5eca-4987-82bf-5da39b228bcb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e" status: 200 len: 1508 microversion: 2.1 time: 0.424634 Jul 01 10:41:59.455396 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1901/3750] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:59 2022] GET /compute/v2.1/servers/5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:59.478603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:59.479560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:59.488747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.494977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:59.501432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.501432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:59.565021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:41:59.826128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:41:59.834398 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bbcd651b-b88c-4431-a105-6f67d38f28ce tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 0.437591 Jul 01 10:41:59.844370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1850/3751] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:59 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:41:59.850440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:41:59.851345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:41:59.858396 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.859073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:41:59.860722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:41:59.861367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.030107 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c35e516-6210-4ea9-b220-16e8e2fbe729 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e" status: 204 len: 0 microversion: 2.1 time: 0.556624 Jul 01 10:42:00.033340 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1902/3752] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:41:59 2022] DELETE /compute/v2.1/servers/5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:00.048362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4c218fd8-d8b4-48f6-9494-3ea68f69ee77 req-b374c96b-e848-473c-a44a-a9b481f762c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-deleted", "tag": "e2f849d1-280e-494f-9238-6812479d0556"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:00.090002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4c218fd8-d8b4-48f6-9494-3ea68f69ee77 req-b374c96b-e848-473c-a44a-a9b481f762c3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.091725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4c218fd8-d8b4-48f6-9494-3ea68f69ee77 req-b374c96b-e848-473c-a44a-a9b481f762c3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.120686 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4c218fd8-d8b4-48f6-9494-3ea68f69ee77 req-b374c96b-e848-473c-a44a-a9b481f762c3 service nova] Creating event network-vif-deleted:e2f849d1-280e-494f-9238-6812479d0556 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:42:00.137067 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4c218fd8-d8b4-48f6-9494-3ea68f69ee77 req-b374c96b-e848-473c-a44a-a9b481f762c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101337 Jul 01 10:42:00.138519 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1903/3753] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:00.143192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:00.143688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:00.168271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.168750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.169599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.170034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.220701 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:00.252984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9108d85c-2c65-44f6-b0a0-b7b144e2affa] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:42:00.322565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:00.331353 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d8f8e05-e104-4531-a564-26a0f293b371 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1328 microversion: 2.1 time: 0.485372 Jul 01 10:42:00.342131 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1851/3754] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:41:59 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1328 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:00.348823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:00.350440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:00.358746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.359491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.360439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.361213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.690276 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20840340-3b25-4b8e-a927-54f40cc1e54b tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa" status: 204 len: 0 microversion: 2.1 time: 0.551093 Jul 01 10:42:00.706255 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1904/3755] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:00 2022] DELETE /compute/v2.1/servers/9108d85c-2c65-44f6-b0a0-b7b144e2affa => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:00.722831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:00.724094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:00.732090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.732903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.735893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.736613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.774490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:00.815824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:00.819477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:00.823000 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f55413a6-f96d-4c1a-9da2-a7daea9067d2 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2870 microversion: 2.42 time: 0.478187 Jul 01 10:42:00.823917 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1852/3756] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:00 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2870 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:00.832852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ddad0dcb-af48-4123-95f5-29c567d99d62 req-2edee7ff-96e2-4808-b73d-5638ca2a916f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-unplugged", "status": "completed", "tag": "fcb9df67-3668-4e82-bce6-cff941b7bead"}, {"server_uuid": "0e08071f-b890-40d7-9eee-f249864936f9", "name": "network-vif-plugged", "status": "completed", "tag": "f16f4e29-6e0a-4906-b3b7-df3d6a3cc9a9"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:00.866652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ddad0dcb-af48-4123-95f5-29c567d99d62 req-2edee7ff-96e2-4808-b73d-5638ca2a916f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.874035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ddad0dcb-af48-4123-95f5-29c567d99d62 req-2edee7ff-96e2-4808-b73d-5638ca2a916f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.896105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:00.907571 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-139b9163-4e13-4e7b-bcb2-02e30d8ba248 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1151 microversion: 2.1 time: 0.199090 Jul 01 10:42:00.919382 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1905/3757] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:00 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1151 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:00.922569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:00.923795 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ddad0dcb-af48-4123-95f5-29c567d99d62 req-2edee7ff-96e2-4808-b73d-5638ca2a916f service nova] Creating event network-vif-unplugged:fcb9df67-3668-4e82-bce6-cff941b7bead for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:42:00.924167 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:00.924314 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ddad0dcb-af48-4123-95f5-29c567d99d62 req-2edee7ff-96e2-4808-b73d-5638ca2a916f service nova] Creating event network-vif-plugged:f16f4e29-6e0a-4906-b3b7-df3d6a3cc9a9 for instance 0e08071f-b890-40d7-9eee-f249864936f9 on n-h2-master-1 Jul 01 10:42:00.946048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.946048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.946048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:00.946048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:00.964912 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ddad0dcb-af48-4123-95f5-29c567d99d62 req-2edee7ff-96e2-4808-b73d-5638ca2a916f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.136926 Jul 01 10:42:00.967010 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1853/3758] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:01.020670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1291325203", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a0eddd1e-04be-490b-be44-3374d41f6aa1"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:01.085608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] validate_networks() for [('a0eddd1e-04be-490b-be44-3374d41f6aa1', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:42:01.977410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:01.989298 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aaf12ce7-5eea-45b3-8a4b-9d9ab1f847f8 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1312 microversion: 2.1 time: 1.076096 Jul 01 10:42:01.990139 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1906/3759] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:00 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1312 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:02.000289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:02.000909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:02.021500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:02.021967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:02.022773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:02.023215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:03.000730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:03.010583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fff92d5c-e0b2-47b4-8875-9083580d0658 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1509 microversion: 2.1 time: 1.019052 Jul 01 10:42:03.012036 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1907/3760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:01 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1509 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:03.017576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:03.018467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:03.026709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:03.027428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:03.028285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:03.028972 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.066058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:42:04.066058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:42:04.066058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:42:04.066058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:42:04.066058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:42:04.084886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.085668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.086650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.087345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.123574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:04.134103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Getting quotas for project f49749e42dfc4e57907fa26c055b206a. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:42:04.142047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:04.143655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:04.146378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Getting quotas for user d14bb96f0a004412a4a41baa22f15ad8 and project f49749e42dfc4e57907fa26c055b206a. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:42:04.148978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4188466-8bbd-4660-8286-48bf8e44734f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2710 microversion: 2.42 time: 1.135585 Jul 01 10:42:04.150696 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1908/3761] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:03 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2710 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:04.176474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:04.178717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:04.179443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Going to run 2 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:42:04.187584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: e5626ce2-103f-47ca-9096-b20ea3b6fb46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:42:04.194308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.195307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.203836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.203836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.353178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:04.357905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=e5626ce2-103f-47ca-9096-b20ea3b6fb46,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:42:04.361440 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95befcdb-004b-41f2-861a-dc1edc8fcda6 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1169 microversion: 2.1 time: 0.194319 Jul 01 10:42:04.366762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1909/3762] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:04 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1169 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:04.376016 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3033ef6b-4867-4367-870d-01a7778359e7 req-4938ca55-854d-4099-9105-d7a7a75073ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-deleted", "tag": "b1283c20-2b14-4147-b47c-03424c3b0288"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:04.397266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3033ef6b-4867-4367-870d-01a7778359e7 req-4938ca55-854d-4099-9105-d7a7a75073ed service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.398719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3033ef6b-4867-4367-870d-01a7778359e7 req-4938ca55-854d-4099-9105-d7a7a75073ed service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.428832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3033ef6b-4867-4367-870d-01a7778359e7 req-4938ca55-854d-4099-9105-d7a7a75073ed service nova] Creating event network-vif-deleted:b1283c20-2b14-4147-b47c-03424c3b0288 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:42:04.447512 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3033ef6b-4867-4367-870d-01a7778359e7 req-4938ca55-854d-4099-9105-d7a7a75073ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076272 Jul 01 10:42:04.449133 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1910/3763] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:04.459376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:04.462083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:04.497292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.502393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.502393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.502652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.541765 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b12ac281-061e-425d-a222-97c8f2b10ed0 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.527166 Jul 01 10:42:04.546145 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1854/3764] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:42:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 3533 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 01 10:42:04.562939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:04.565624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:04.575696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.586074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.587111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:04.588307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:04.635162 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:05.287741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:05.305822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:05.311940 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c147510b-06f9-409e-92a1-640e84ef1046 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1509 microversion: 2.1 time: 0.764289 Jul 01 10:42:05.325186 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1855/3765] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:04 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:05.330036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-67e75b5a-0e33-4915-9432-944836801ead req-86fbba9d-6a87-46e2-a1b9-8a198ad94def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e", "name": "network-vif-deleted", "tag": "b0205847-eb57-4537-9335-429283badf76"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:05.333349 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ca196bf0-9692-45b5-8636-1e0effbaa8fa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1498 microversion: 2.1 time: 0.872938 Jul 01 10:42:05.334432 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1911/3766] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:04 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1498 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:05.359742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:05.365097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-67e75b5a-0e33-4915-9432-944836801ead req-86fbba9d-6a87-46e2-a1b9-8a198ad94def service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:05.378100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:05.379482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-67e75b5a-0e33-4915-9432-944836801ead req-86fbba9d-6a87-46e2-a1b9-8a198ad94def service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:05.382334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Searching by: {'deleted': False, 'project_id': 'f49749e42dfc4e57907fa26c055b206a'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:42:05.405541 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-67e75b5a-0e33-4915-9432-944836801ead req-86fbba9d-6a87-46e2-a1b9-8a198ad94def service nova] Creating event network-vif-deleted:b0205847-eb57-4537-9335-429283badf76 for instance 5302cddb-38b4-4c0c-8cf9-7eaaa3d94e3e on n-h1-master-1 Jul 01 10:42:05.417667 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-67e75b5a-0e33-4915-9432-944836801ead req-86fbba9d-6a87-46e2-a1b9-8a198ad94def service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101443 Jul 01 10:42:05.423607 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1856/3767] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:05.425030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:05.425516 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:05.433158 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:05.433734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:05.442189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:05.442984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:05.460014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:05.465466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:05.466609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:05.467213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:05.514827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:42:05.618317 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1cb21e57-6f5d-4d05-991a-8d38ec488cec tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1005 microversion: 2.1 time: 0.275537 Jul 01 10:42:05.619906 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1912/3768] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:42:05 2022] GET /compute/v2.1/servers => generated 1005 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:05.634588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:05.639102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:05.654891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:05.658801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:05.659761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:05.661405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:05.752884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:42:06.204208 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-46aa81bc-99d7-489f-985c-76842b80c163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 204 len: 0 microversion: 2.1 time: 0.579085 Jul 01 10:42:06.209177 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1913/3769] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:05 2022] DELETE /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:06.215142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:06.217920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:06.225535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:06.225977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:06.226757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:06.227189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:06.255250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lazy-loading 'flavor' on Instance uuid 0e08071f-b890-40d7-9eee-f249864936f9 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:42:06.674207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:06.698327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:06.709916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:06.713524 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4017b2b6-b189-4b58-8ef6-76dd8e824983 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2549 microversion: 2.42 time: 1.286778 Jul 01 10:42:06.725266 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1857/3770] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:05 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2549 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:06.734100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-217d652e-5e43-489c-b194-f7623befafc1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "POST /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9/action" status: 200 len: 32 microversion: 2.1 time: 0.526919 Jul 01 10:42:06.734659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1914/3771] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:42:06 2022] POST /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9/action => generated 32 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:42:06.740113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:06.740755 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:06.751928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5c61691-f370-4341-9f07-ecc3b7a0b41e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:06.754062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e5c61691-f370-4341-9f07-ecc3b7a0b41e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:06.762200 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:06.764538 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:06.766081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:06.770633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:06.771141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:07.276573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5c61691-f370-4341-9f07-ecc3b7a0b41e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:07.286795 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5c61691-f370-4341-9f07-ecc3b7a0b41e tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1218 microversion: 2.1 time: 0.550585 Jul 01 10:42:07.298409 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1915/3772] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:06 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1218 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:07.303682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:07.304358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:07.360212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:07.360652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:07.377619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:07.379164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:08.269682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:08.281912 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f4984b0-e602-4b05-8da4-50bdbe72c9d2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1211 microversion: 2.1 time: 1.561366 Jul 01 10:42:08.282520 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1858/3773] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:06 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1211 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:08.302656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:08.303580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:08.325642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:08.326086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:08.326876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:08.327316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:08.575274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:08.583023 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b174fc7-eb83-4f61-a52d-e6ecfdaa44d7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1515 microversion: 2.1 time: 1.283226 Jul 01 10:42:08.589101 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1916/3774] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:07 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1515 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:08.596933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4235e691-cfb7-4362-91aa-460ac2b08926 req-fee5548c-243b-4b62-a139-3ef434e8c457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-deleted", "tag": "2c8619a3-cc50-4ef2-b76b-3af83b3d15d0"}, {"server_uuid": "9108d85c-2c65-44f6-b0a0-b7b144e2affa", "name": "network-vif-deleted", "tag": "53d8768a-caad-4655-9fa5-0fb610d77aaf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:08.621812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4235e691-cfb7-4362-91aa-460ac2b08926 req-fee5548c-243b-4b62-a139-3ef434e8c457 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:08.622414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4235e691-cfb7-4362-91aa-460ac2b08926 req-fee5548c-243b-4b62-a139-3ef434e8c457 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:08.633445 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:08.692790 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4235e691-cfb7-4362-91aa-460ac2b08926 req-fee5548c-243b-4b62-a139-3ef434e8c457 service nova] Creating event network-vif-deleted:2c8619a3-cc50-4ef2-b76b-3af83b3d15d0 for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:42:08.695019 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4235e691-cfb7-4362-91aa-460ac2b08926 req-fee5548c-243b-4b62-a139-3ef434e8c457 service nova] Creating event network-vif-deleted:53d8768a-caad-4655-9fa5-0fb610d77aaf for instance 9108d85c-2c65-44f6-b0a0-b7b144e2affa on n-h2-master-1 Jul 01 10:42:08.721223 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4235e691-cfb7-4362-91aa-460ac2b08926 req-fee5548c-243b-4b62-a139-3ef434e8c457 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.130412 Jul 01 10:42:08.729793 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1917/3775] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:08.735842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:08.742372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:08.755657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:08.756226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:08.760723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:08.761354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:09.191603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:09.203647 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e99d346d-8db4-40b5-b338-7f13a8a76091 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.904279 Jul 01 10:42:09.204547 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1859/3776] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:08 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:09.210512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:09.211472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:09.219863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:09.220873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:09.221980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:09.222651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:09.705593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:09.715389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:09.724110 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61479ae9-09cb-47b2-ba2a-67379e4d68c5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1278 microversion: 2.1 time: 0.517496 Jul 01 10:42:09.733683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:09.740212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1860/3777] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:09 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1278 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:09.747289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:09.756272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:09.759662 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd5b6a87-0152-401b-bf2c-e168f5b5832c tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2549 microversion: 2.42 time: 1.025623 Jul 01 10:42:09.760292 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1918/3778] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:08 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2549 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:09.761567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:09.776388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:09.784769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:09.786301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:09.787001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:09.789457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:09.790102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:09.823676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:09.824085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:09.824886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:09.825383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:10.426382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:10.438079 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0bb6456a-3e3c-42c7-803e-375f75cef03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 200 len: 1473 microversion: 2.1 time: 0.667887 Jul 01 10:42:10.450971 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1919/3779] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:09 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 1473 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:10.468585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-efb16f4e-f160-43df-a954-a411fbf24741 req-714429be-970e-49ae-9ff3-ebbf5b2a1fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1f0d64-97f2-4620-8784-a16be944e4b8", "name": "network-vif-deleted", "tag": "0e16ea84-eee0-4ae7-945f-0e883d0ac7b8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:10.485251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-efb16f4e-f160-43df-a954-a411fbf24741 req-714429be-970e-49ae-9ff3-ebbf5b2a1fc6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:10.485967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-efb16f4e-f160-43df-a954-a411fbf24741 req-714429be-970e-49ae-9ff3-ebbf5b2a1fc6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:10.516981 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-efb16f4e-f160-43df-a954-a411fbf24741 req-714429be-970e-49ae-9ff3-ebbf5b2a1fc6 service nova] Creating event network-vif-deleted:0e16ea84-eee0-4ae7-945f-0e883d0ac7b8 for instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 on n-h1-master-1 Jul 01 10:42:10.533454 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-efb16f4e-f160-43df-a954-a411fbf24741 req-714429be-970e-49ae-9ff3-ebbf5b2a1fc6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077810 Jul 01 10:42:10.535393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1920/3780] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:10.544718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:10.545566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:10.552618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:10.553073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:10.554090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:10.554736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:10.982155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:10.993186 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d4d0d7df-a5aa-4cb6-ad3a-fc870c714228 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1211 microversion: 2.1 time: 1.251217 Jul 01 10:42:10.999171 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1861/3781] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:09 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1211 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:11.015023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:11.015023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:11.036112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:11.037432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:11.039275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:11.040418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:11.854248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:11.862472 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4852e1f-adad-425d-9738-86caaca11497 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1276 microversion: 2.1 time: 0.861885 Jul 01 10:42:11.867337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1862/3782] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:10 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1276 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:11.879025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:11.880831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:11.895923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:11.895923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:11.900159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:11.902495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:12.085896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:12.097397 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-776b936e-1f69-45cd-9b13-ae3300d6de7f tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 1.560266 Jul 01 10:42:12.098112 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1921/3783] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:10 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:12.106232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:12.114695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:12.131257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:12.131257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:12.131257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:12.131257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:12.174494 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 HTTP/1.1 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6e1f0d64-97f2-4620-8784-a16be944e4b8'} Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:12.188277 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e3b9cf76-5859-4edb-a957-b3c8b74d6b35 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 404 len: 111 microversion: 2.1 time: 0.090930 Jul 01 10:42:12.198302 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1922/3784] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:12 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:42:12.204881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:12.205537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:12.213884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:12.213884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:12.214658 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:12.220695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:13.380539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:13.394458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:13.401346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:13.406259 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46987047-a731-4ed0-8db3-4d74b1a35467 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 2345 microversion: 2.42 time: 1.533150 Jul 01 10:42:13.407989 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1863/3785] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:11 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 2345 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:13.445384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60fce1a7-2eb8-4bbc-8ab6-8256f6f520c1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '.version_select at 0x7f6f907f2940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:13.635386 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-60fce1a7-2eb8-4bbc-8ab6-8256f6f520c1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-970883441" status: 202 len: 0 microversion: 2.1 time: 0.225110 Jul 01 10:42:13.637740 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1864/3786] 10.222.0.23 () {58 vars in 1205 bytes} [Fri Jul 1 10:42:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-970883441 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:42:13.668096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:13.679819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:13.706430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:13.706883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:13.707680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:13.710324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:13.754416 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:13.768944 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-385b8e1a-4ec1-4c00-a1fc-b6e6335089c5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1211 microversion: 2.1 time: 1.575079 Jul 01 10:42:13.770721 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1923/3787] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:12 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1211 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:13.779227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-833845ea-d844-494c-b8fc-e9b86476cb37 req-1393fba2-cf3b-4991-bbac-3cdba2d11c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-deleted", "tag": "fcb9df67-3668-4e82-bce6-cff941b7bead"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:13.809024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-833845ea-d844-494c-b8fc-e9b86476cb37 req-1393fba2-cf3b-4991-bbac-3cdba2d11c77 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:13.809924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-833845ea-d844-494c-b8fc-e9b86476cb37 req-1393fba2-cf3b-4991-bbac-3cdba2d11c77 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:13.843521 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-833845ea-d844-494c-b8fc-e9b86476cb37 req-1393fba2-cf3b-4991-bbac-3cdba2d11c77 service nova] Creating event network-vif-deleted:fcb9df67-3668-4e82-bce6-cff941b7bead for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:42:13.850689 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-833845ea-d844-494c-b8fc-e9b86476cb37 req-1393fba2-cf3b-4991-bbac-3cdba2d11c77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078432 Jul 01 10:42:13.853651 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1924/3788] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:13.860146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3e3b4d65-6077-4f16-a1cb-2e4c75c7ba87 req-a10e6493-faf9-4eb9-8674-0d6a79790bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5626ce2-103f-47ca-9096-b20ea3b6fb46", "tag": "1b1bffd2-2e49-4970-a01d-342e6f399817"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:13.900652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3e3b4d65-6077-4f16-a1cb-2e4c75c7ba87 req-a10e6493-faf9-4eb9-8674-0d6a79790bb9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:13.907554 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3e3b4d65-6077-4f16-a1cb-2e4c75c7ba87 req-a10e6493-faf9-4eb9-8674-0d6a79790bb9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:13.928541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3e3b4d65-6077-4f16-a1cb-2e4c75c7ba87 req-a10e6493-faf9-4eb9-8674-0d6a79790bb9 service nova] Creating event network-changed:1b1bffd2-2e49-4970-a01d-342e6f399817 for instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 on n-h1-master-1 Jul 01 10:42:13.949667 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3e3b4d65-6077-4f16-a1cb-2e4c75c7ba87 req-a10e6493-faf9-4eb9-8674-0d6a79790bb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093635 Jul 01 10:42:13.956241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1925/3789] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:13.972733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:13.974561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:13.983034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:13.990053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:13.993956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:13.993956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:13.994216 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21a49de8-d2f3-4c26-9a84-504df47185f9 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1276 microversion: 2.1 time: 0.353281 Jul 01 10:42:13.994327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:14.004756 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1865/3790] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:13 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1276 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:14.024368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-378645297", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "9025d00e-6ad8-47ef-80bc-484168809931"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:14.108045 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:14.114336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:42:14.166903 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:14.762155 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:14.776518 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5266bc8c-cfb5-487b-acfe-b02e9130b69a tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.808252 Jul 01 10:42:14.777920 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1926/3791] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:13 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:14.793955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:14.793955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:14.806781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:14.808152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:14.810696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:14.811440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:15.236320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:15.281905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:15.287778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:15.287778 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17b4d263-1faf-4f2b-8195-0e18af0d586d tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1985 microversion: 2.42 time: 0.508073 Jul 01 10:42:15.289840 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1927/3792] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:14 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1985 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:15.306795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:15.309705 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:15.324671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:15.327996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:15.329184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:15.332467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:15.462949 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:16.762776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:16.777402 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64e61a0f-e041-433b-81f7-61bec9dd3b65 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1199 microversion: 2.1 time: 1.483496 Jul 01 10:42:16.778706 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1928/3793] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:15 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1199 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:16.791127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:16.794504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:16.801372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:16.802092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:16.805833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:16.809182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:16.890154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:42:16.891073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:42:16.891730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:42:16.895395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:42:16.896919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:42:16.909004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:16.909621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:16.910417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:16.910850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:16.949009 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:42:16.978796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:42:17.033168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:42:17.038224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:42:17.230266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:17.235348 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-119b39f0-ff6c-4b5e-9197-df2deada2376 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.229268 Jul 01 10:42:17.238094 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1866/3794] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:42:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:42:17.244778 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9c69e62-62c8-4810-942d-6fe8a4a4a9ee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 0.464676 Jul 01 10:42:17.246923 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1929/3795] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:16 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:17.251678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:17.254139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:17.268452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:17.268624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:17.269096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:17.271819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:17.272691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:17.286940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:17.288459 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:17.290257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:17.291342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:17.292330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:17.292784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:17.498065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:17.513893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:17.515408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:17.522094 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87bf7b1d-fbfd-413f-b4d2-0c93b33b125f tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.273952 Jul 01 10:42:17.525623 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1930/3796] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:17 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:17.539497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4c97e006-29b4-49ad-a729-731920c0b3d7 req-4060b337-09a5-43ad-b601-7e88d4846110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47e826f-87c6-4c86-beef-55e82abae372", "tag": "e18171f3-347d-4856-94e0-51a4475176b8"}, {"server_uuid": "852bcb41-f421-4a4b-8ae7-2f905f4be9ad", "name": "network-vif-deleted", "tag": "c25a26fa-0f48-4280-aafb-da9333b6647c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:17.564657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4c97e006-29b4-49ad-a729-731920c0b3d7 req-4060b337-09a5-43ad-b601-7e88d4846110 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:17.565353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4c97e006-29b4-49ad-a729-731920c0b3d7 req-4060b337-09a5-43ad-b601-7e88d4846110 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:17.598534 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4c97e006-29b4-49ad-a729-731920c0b3d7 req-4060b337-09a5-43ad-b601-7e88d4846110 service nova] Creating event network-changed:e18171f3-347d-4856-94e0-51a4475176b8 for instance a47e826f-87c6-4c86-beef-55e82abae372 on n-h1-master-1 Jul 01 10:42:17.601318 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4c97e006-29b4-49ad-a729-731920c0b3d7 req-4060b337-09a5-43ad-b601-7e88d4846110 service nova] Creating event network-vif-deleted:c25a26fa-0f48-4280-aafb-da9333b6647c for instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad on n-h1-master-1 Jul 01 10:42:17.621386 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4c97e006-29b4-49ad-a729-731920c0b3d7 req-4060b337-09a5-43ad-b601-7e88d4846110 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.090178 Jul 01 10:42:17.622514 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1931/3797] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:17.635833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e8d09bd-19d0-442a-92a5-24351602d295 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:17.636965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2e8d09bd-19d0-442a-92a5-24351602d295 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:17.912340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2e8d09bd-19d0-442a-92a5-24351602d295 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:17.926827 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e8d09bd-19d0-442a-92a5-24351602d295 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1208 microversion: 2.1 time: 0.301955 Jul 01 10:42:17.931503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1932/3798] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:17 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1208 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:17.943949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:17.949832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:17.959583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:17.979435 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c143fc06-0e84-457f-a08f-184705395456 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.740390 Jul 01 10:42:18.000411 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1867/3799] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:17 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:18.000644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:18.000644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:18.000644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:18.000644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:18.274119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:18.275482 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:18.290535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:18.296911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:18.297794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:18.298222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:18.480569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:18.487103 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9ae458c-c3ee-491a-b8f2-dbd8019c8a7c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1199 microversion: 2.1 time: 0.551330 Jul 01 10:42:18.501755 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1933/3800] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:17 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1199 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:18.535171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-29462b54-d51b-492d-9e4b-9dc9fbefd803 req-13f1281a-df42-43ea-af4d-c33de0c595ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5626ce2-103f-47ca-9096-b20ea3b6fb46", "name": "network-vif-plugged", "status": "completed", "tag": "1b1bffd2-2e49-4970-a01d-342e6f399817"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:18.557523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-29462b54-d51b-492d-9e4b-9dc9fbefd803 req-13f1281a-df42-43ea-af4d-c33de0c595ea service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:18.558244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-29462b54-d51b-492d-9e4b-9dc9fbefd803 req-13f1281a-df42-43ea-af4d-c33de0c595ea service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:18.578907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-29462b54-d51b-492d-9e4b-9dc9fbefd803 req-13f1281a-df42-43ea-af4d-c33de0c595ea service nova] Creating event network-vif-plugged:1b1bffd2-2e49-4970-a01d-342e6f399817 for instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 on n-h1-master-1 Jul 01 10:42:18.589236 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-29462b54-d51b-492d-9e4b-9dc9fbefd803 req-13f1281a-df42-43ea-af4d-c33de0c595ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070695 Jul 01 10:42:18.591244 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1934/3801] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:18.601136 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:18.604115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:18.614434 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:18.615197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:18.616294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:18.616956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:19.047921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:19.063865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:19.066923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:19.066923 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c6718b4-496a-4a4b-9375-8f36a47a2dbf tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.473142 Jul 01 10:42:19.072030 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1935/3802] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:18 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:19.086227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:19.086994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:19.116065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:19.116535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:19.124479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:19.125299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:19.304591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:19.318266 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc05e370-1d22-45dd-88f6-bf5ecf20dc47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 1.060116 Jul 01 10:42:19.319780 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1868/3803] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:18 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:19.324970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:19.325825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:19.335184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:19.335852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:19.337582 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:19.338298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:19.341043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:19.365104 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5100dc3a-136a-435f-bfa7-8b6b7122526c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1212 microversion: 2.1 time: 0.291663 Jul 01 10:42:19.371039 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1936/3804] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:19 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1212 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:19.507923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:19.508559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:19.525872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:19.526410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:19.527381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:19.527829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.063615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:20.074414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cdb62c11-9d9f-46d3-8985-9f1727d3d7ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1199 microversion: 2.1 time: 0.573723 Jul 01 10:42:20.089452 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1937/3805] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:19 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1199 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:20.090947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8b18f263-ec18-4e20-b350-a07bd3738320 req-09d8384f-9390-4f4d-906e-1caeb5de032f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecd879e-8b72-4eb1-9dcb-6af213cf18db", "tag": "e14390c2-bc55-44fe-9650-b719248685bb"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:20.114724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8b18f263-ec18-4e20-b350-a07bd3738320 req-09d8384f-9390-4f4d-906e-1caeb5de032f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:20.114724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8b18f263-ec18-4e20-b350-a07bd3738320 req-09d8384f-9390-4f4d-906e-1caeb5de032f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.131499 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8b18f263-ec18-4e20-b350-a07bd3738320 req-09d8384f-9390-4f4d-906e-1caeb5de032f service nova] Creating event network-changed:e14390c2-bc55-44fe-9650-b719248685bb for instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db on n-h2-master-1 Jul 01 10:42:20.143890 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8b18f263-ec18-4e20-b350-a07bd3738320 req-09d8384f-9390-4f4d-906e-1caeb5de032f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061358 Jul 01 10:42:20.148229 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1938/3806] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:20.159000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:20.160024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:20.167895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:20.168828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.169923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:20.171231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.184656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:20.197693 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4093d2ae-4850-4136-9557-289ff87df3f9 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.876449 Jul 01 10:42:20.205591 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1869/3807] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:19 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:20.337374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:20.338912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:20.346976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:20.347825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.348909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:20.349621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.516599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:20.537801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:20.543012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:20.548753 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af3a3804-8a5e-426b-9c32-a1a4adfd3689 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.399189 Jul 01 10:42:20.551664 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1939/3808] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:20 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:20.570740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:20.572207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:20.579933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:20.580644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.581635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:20.582240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:20.614718 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:20.768589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:20.779890 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-518c5de2-2e52-4b63-8d7d-b578d0ef2032 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1260 microversion: 2.1 time: 0.214255 Jul 01 10:42:20.780479 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1940/3809] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:20 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:20.955959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:20.969723 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f105e7d2-a25b-4d94-8de4-19a2d883c138 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 0.638448 Jul 01 10:42:20.971088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1870/3810] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:20 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:21.098004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:21.099335 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:21.110879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:21.115570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:21.119841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:21.120630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:21.222892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:21.223667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:21.245026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:21.245026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:21.245026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:21.245601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:21.917234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:21.929069 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66f26fc8-644d-447b-bed1-0f34800f5fa1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.710203 Jul 01 10:42:21.945343 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1871/3811] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:21 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:21.954622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:21.955668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:21.966330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:21.967134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:21.968882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:21.969709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:21.992812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:22.005563 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cf88390a-9939-4607-8e8a-cd4e40aa8140 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1199 microversion: 2.1 time: 0.912680 Jul 01 10:42:22.014644 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1941/3812] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:21 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1199 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:22.032012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:22.034750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:22.060035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:22.060035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:22.060035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:22.060035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:22.156668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:22.176098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:22.177617 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:22.178831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a98a7a1a-9704-4b7c-888f-5e9e28dd2c8a tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.231410 Jul 01 10:42:22.183518 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1872/3813] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:21 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:22.189283 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:22.195597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:22.209232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:22.215562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:22.215562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:22.215562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:22.327033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:22.345430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0312cae1-72f4-45e6-9ca2-114dca53e6d5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1266 microversion: 2.1 time: 0.329355 Jul 01 10:42:22.347233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1942/3814] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:22 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:22.491001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:22.509361 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb787830-bfd3-4395-9444-700f932db825 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 0.323031 Jul 01 10:42:22.517410 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1873/3815] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:22 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:22.949234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:22.950482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:22.962539 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:22.963355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:22.965089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:22.965793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:23.029387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:23.029387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:23.036570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:23.037290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:23.038660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:23.062834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:23.121035 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:24.330558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:24.367528 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ed9f6c3-587d-498b-bc18-a6c4a1980911 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 1.424170 Jul 01 10:42:24.371686 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1943/3816] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:22 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:24.380758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:24.392090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:24.409622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:24.410078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:24.420687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:24.421170 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:24.451187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:24.460010 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-453c1e2d-90c0-4e55-9407-d4f7aba4d8c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1199 microversion: 2.1 time: 1.441057 Jul 01 10:42:24.469997 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1874/3817] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:23 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1199 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:24.480257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:24.480881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:24.505901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:24.509580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:24.510408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:24.510863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:24.656301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:24.711356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:24.721400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:24.723777 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ba23210-993e-45c1-96ef-cf2654c5bcc7 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.349774 Jul 01 10:42:24.727360 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1944/3818] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:24 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:24.738612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:24.742601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:24.762721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:24.764666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:24.765392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:24.765835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:25.567950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:25.585577 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-15f6a19a-1913-45e0-bebe-cb08403eb67b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1308 microversion: 2.1 time: 1.114742 Jul 01 10:42:25.596956 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1875/3819] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:24 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1308 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:25.612622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:25.618504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:25.657520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:25.659583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:25.662718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:25.663425 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:25.737678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:25.747789 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a63c93cf-5bfb-41d8-b890-4a67a66c8c00 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 1.018848 Jul 01 10:42:25.765818 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1945/3820] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:24 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:25.776108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:25.777442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:25.786219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:25.787174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:25.788196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:25.788777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:26.327695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:26.344638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31adc076-8766-4f54-9112-7d0a3fffdadd tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.745010 Jul 01 10:42:26.346283 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1876/3821] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:25 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:26.357306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:26.364806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:26.368943 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:26.391543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:26.392160 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:26.399739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:26.401298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:26.600651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:26.614761 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c504c841-ce30-45e3-8190-27baf0f37e4c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1199 microversion: 2.1 time: 0.845152 Jul 01 10:42:26.616539 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1946/3822] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:25 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1199 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:26.653033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:26.659081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:26.668512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:26.668968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:26.679503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:26.679957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:26.682473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:26.695103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:26.706064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:26.718214 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-edad783a-56b3-47c1-a86b-a5fb82ebad00 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.364529 Jul 01 10:42:26.719598 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1877/3823] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:26 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:26.772573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:26.773232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:26.786948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:26.791695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:26.793232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:26.793683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:26.930030 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:27.006029 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:27.534403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:27.548130 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2572d3a5-241b-41cb-a892-3ea3dd4554d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1308 microversion: 2.1 time: 0.928396 Jul 01 10:42:27.570340 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1947/3824] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:26 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1308 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:27.609075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:27.627239 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31529aa4-9696-4d1e-b7dd-6ab2705741eb tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 0.866624 Jul 01 10:42:27.633265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f44807c7-39d2-4f04-9fa0-82658b80f4c5 req-b8164c63-1c82-4c21-b6b2-733dab70cfca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9542320-9b9a-42dc-952e-2147380c8fbd", "tag": "0e49db62-c56c-4b22-a813-c6af0619af6b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:27.634024 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1878/3825] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:26 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:27.643404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ed5b3378-3d29-48d3-a56c-776db11575f2 req-c9e76b4b-6b03-4a4b-baf2-166df1cb77a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e826f-87c6-4c86-beef-55e82abae372", "name": "network-vif-plugged", "status": "completed", "tag": "e18171f3-347d-4856-94e0-51a4475176b8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:27.667332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ed5b3378-3d29-48d3-a56c-776db11575f2 req-c9e76b4b-6b03-4a4b-baf2-166df1cb77a1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:27.667965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ed5b3378-3d29-48d3-a56c-776db11575f2 req-c9e76b4b-6b03-4a4b-baf2-166df1cb77a1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:27.672793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f44807c7-39d2-4f04-9fa0-82658b80f4c5 req-b8164c63-1c82-4c21-b6b2-733dab70cfca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:27.673301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f44807c7-39d2-4f04-9fa0-82658b80f4c5 req-b8164c63-1c82-4c21-b6b2-733dab70cfca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:27.699134 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f44807c7-39d2-4f04-9fa0-82658b80f4c5 req-b8164c63-1c82-4c21-b6b2-733dab70cfca service nova] Creating event network-changed:0e49db62-c56c-4b22-a813-c6af0619af6b for instance f9542320-9b9a-42dc-952e-2147380c8fbd on n-h1-master-1 Jul 01 10:42:27.702016 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ed5b3378-3d29-48d3-a56c-776db11575f2 req-c9e76b4b-6b03-4a4b-baf2-166df1cb77a1 service nova] Creating event network-vif-plugged:e18171f3-347d-4856-94e0-51a4475176b8 for instance a47e826f-87c6-4c86-beef-55e82abae372 on n-h1-master-1 Jul 01 10:42:27.716610 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f44807c7-39d2-4f04-9fa0-82658b80f4c5 req-b8164c63-1c82-4c21-b6b2-733dab70cfca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133451 Jul 01 10:42:27.717192 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ed5b3378-3d29-48d3-a56c-776db11575f2 req-c9e76b4b-6b03-4a4b-baf2-166df1cb77a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081658 Jul 01 10:42:27.717832 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1879/3826] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:27.718365 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1948/3827] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:27.747413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:27.748141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:27.792691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:27.793193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:27.794006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:27.798795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:27.996107 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1462686416", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "c1dfa131-5b60-4d4e-8891-287c6963cf05"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:28.095163 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] validate_networks() for [('c1dfa131-5b60-4d4e-8891-287c6963cf05', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:42:28.359791 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:28.386406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:28.396364 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0364ead-bd7c-44aa-9320-c806f94066a1 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.676677 Jul 01 10:42:28.397284 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1880/3828] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:27 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:28.418077 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:28.418077 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:28.429391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:28.435120 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:28.435663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:28.436113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:28.715367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:28.724654 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2ae5e94f-3bcb-491f-aa29-8ef5d2b3284b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1199 microversion: 2.1 time: 0.312756 Jul 01 10:42:28.725441 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1881/3829] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:28 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1199 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:28.730729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:28.731628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:28.739163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:28.740095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:28.741081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:28.742884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:28.922983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:28.933636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:28.935344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:28.936624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72613205-5c7c-444c-a42c-e5e5476d7735 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.210430 Jul 01 10:42:28.947373 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1882/3830] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:28 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:28.947373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:28.947373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:28.949138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:28.949588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:28.950412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:28.950960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:29.860236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:29.872545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-800fdfa5-dba9-452f-9f7d-151ca1f6c9b9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1308 microversion: 2.1 time: 0.933903 Jul 01 10:42:29.873773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1883/3831] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:28 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1308 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:29.878478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:29.879284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:29.886890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:29.887639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:29.888727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:29.889440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:29.913806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:42:29.914321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:42:29.914800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:42:29.915209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:42:29.915621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:42:29.950771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:29.964108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:29.966112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:29.966565 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:30.103751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Getting quotas for project 0ccdc55c4b7a4d33932f5d6a54743cb7. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:42:30.111508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Getting quotas for user c4037055b02c4296a537e2c995511443 and project 0ccdc55c4b7a4d33932f5d6a54743cb7. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:42:30.131093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:42:30.131982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:42:30.392258 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb4c162e-5f79-49b3-9e74-ee5cd84e430a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.672493 Jul 01 10:42:30.401179 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1949/3832] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:42:30.421283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:30.427483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:30.458266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:30.460313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:30.465425 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:30.466244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:30.882266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:30.895841 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c35fd0d8-d97e-4ccd-990b-0239fae8be47 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 1.020819 Jul 01 10:42:30.898803 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1884/3833] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:29 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:30.903997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:30.904607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:30.916682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:30.925093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:30.925582 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:30.926379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:30.926815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:30.933082 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9f46ad34-9daf-4e39-b9c6-68b2346ff1bf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1484 microversion: 2.1 time: 0.523246 Jul 01 10:42:30.934996 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1950/3834] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:30 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1484 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:30.954450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:30.955093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:30.966654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:30.969344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:30.969344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:30.969344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:31.098511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:31.116231 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:31.119065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:31.121180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8cb21fa-641b-4a99-bc8e-f6989f170c07 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.183336 Jul 01 10:42:31.123238 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1951/3835] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:30 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:31.129779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-76128048-0f20-4fcc-939e-21ed24405b3b req-76541844-0632-4a4c-af77-912464ddc006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecd879e-8b72-4eb1-9dcb-6af213cf18db", "name": "network-vif-plugged", "status": "completed", "tag": "e14390c2-bc55-44fe-9650-b719248685bb"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:31.172882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-76128048-0f20-4fcc-939e-21ed24405b3b req-76541844-0632-4a4c-af77-912464ddc006 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:31.173398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-76128048-0f20-4fcc-939e-21ed24405b3b req-76541844-0632-4a4c-af77-912464ddc006 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:31.207941 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-76128048-0f20-4fcc-939e-21ed24405b3b req-76541844-0632-4a4c-af77-912464ddc006 service nova] Creating event network-vif-plugged:e14390c2-bc55-44fe-9650-b719248685bb for instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db on n-h2-master-1 Jul 01 10:42:31.215954 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-76128048-0f20-4fcc-939e-21ed24405b3b req-76541844-0632-4a4c-af77-912464ddc006 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091145 Jul 01 10:42:31.217171 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1952/3836] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:31.230940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f79e19f1-f107-490f-8467-6b5127023338 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:31.232062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f79e19f1-f107-490f-8467-6b5127023338 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:31.254134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:31.269582 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-19155267-7d62-44ed-a4c1-50fdd1168133 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1381 microversion: 2.1 time: 0.369059 Jul 01 10:42:31.270813 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1885/3837] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:30 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1381 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:31.285446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:31.286733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:31.296819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:31.297601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:31.298580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:31.299175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:31.491035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f79e19f1-f107-490f-8467-6b5127023338 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:31.499392 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f79e19f1-f107-490f-8467-6b5127023338 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1228 microversion: 2.1 time: 0.280871 Jul 01 10:42:31.500338 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1953/3838] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:31 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1228 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:31.506490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d10ef53c-9c98-4701-b682-95ee1e7123de tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:31.507285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d10ef53c-9c98-4701-b682-95ee1e7123de tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:31.516564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d10ef53c-9c98-4701-b682-95ee1e7123de tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:31.517328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d10ef53c-9c98-4701-b682-95ee1e7123de tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:31.518543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d10ef53c-9c98-4701-b682-95ee1e7123de tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:31.519200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d10ef53c-9c98-4701-b682-95ee1e7123de tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:31.699747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:31.708055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6989b66b-6997-4a6b-a40d-107add277eb3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1308 microversion: 2.1 time: 0.435984 Jul 01 10:42:31.719826 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1886/3839] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:31 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:31.923410 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d10ef53c-9c98-4701-b682-95ee1e7123de tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "POST /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9/action" status: 202 len: 0 microversion: 2.1 time: 0.421141 Jul 01 10:42:31.924490 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1954/3840] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:42:31 2022] POST /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:42:31.933249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:31.936090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:31.943403 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:31.946568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:31.947019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:31.948298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:31.948901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.058520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b5081d1-bb93-4765-8473-f3c04f1ddd6c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:32.059835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b5081d1-bb93-4765-8473-f3c04f1ddd6c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:32.071564 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b5081d1-bb93-4765-8473-f3c04f1ddd6c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.072142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b5081d1-bb93-4765-8473-f3c04f1ddd6c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.072862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b5081d1-bb93-4765-8473-f3c04f1ddd6c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.073328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b5081d1-bb93-4765-8473-f3c04f1ddd6c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.172170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:32.189200 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d9de3ff-3f7d-4e5e-aed5-b13e0de08eee tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1318 microversion: 2.1 time: 0.262727 Jul 01 10:42:32.191107 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1955/3841] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:31 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:32.205047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:32.208602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:32.217111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.217921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.219377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.220273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.406584 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b5081d1-bb93-4765-8473-f3c04f1ddd6c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1532 microversion: 2.1 time: 0.692383 Jul 01 10:42:32.408160 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1887/3842] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:31 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1532 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:32.421031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:32.422151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:32.428873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.429583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.430392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.431070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.439716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:32.448934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a402c92-354a-4742-80ab-82cb149726aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1492 microversion: 2.1 time: 0.254487 Jul 01 10:42:32.450215 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1956/3843] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:32 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1492 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:32.455227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-13481ad0-f83e-458d-96f6-4ebb86b666ad tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:32.455932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-13481ad0-f83e-458d-96f6-4ebb86b666ad tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:32.462735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13481ad0-f83e-458d-96f6-4ebb86b666ad tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.463256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13481ad0-f83e-458d-96f6-4ebb86b666ad tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.464145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13481ad0-f83e-458d-96f6-4ebb86b666ad tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.464654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13481ad0-f83e-458d-96f6-4ebb86b666ad tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.607275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:32.630199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:32.631973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:32.633966 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-60f5cbac-a54a-4f43-a5ae-2ff32c1c9ce3 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.219047 Jul 01 10:42:32.645594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1888/3844] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:32 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:32.651916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:32.657714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:32.665793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.666531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.667555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.668055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.797915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:32.810674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-13481ad0-f83e-458d-96f6-4ebb86b666ad tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1532 microversion: 2.1 time: 0.355988 Jul 01 10:42:32.811640 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1957/3845] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:32 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1532 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:32.825291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:32.825779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:32.837436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.837436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.837436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.837888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.841701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e690c6e-5445-4bf9-bbd0-cb5e6bc9546d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1232 microversion: 2.1 time: 0.188335 Jul 01 10:42:32.848486 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1889/3846] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:32 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1232 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:32.867014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a911ec1a-f908-4c8a-98e4-63703fddd15c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:32.869410 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:42:32.869410 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:42:32.872642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a911ec1a-f908-4c8a-98e4-63703fddd15c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.873435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a911ec1a-f908-4c8a-98e4-63703fddd15c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.874798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a911ec1a-f908-4c8a-98e4-63703fddd15c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.876249 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a911ec1a-f908-4c8a-98e4-63703fddd15c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.910228 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a911ec1a-f908-4c8a-98e4-63703fddd15c tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052536 Jul 01 10:42:32.911899 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1890/3847] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 10:42:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:32.934354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:32.937816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:32.954148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.958597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:32.961022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:32.962992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:33.027442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lazy-loading 'flavor' on Instance uuid a47e826f-87c6-4c86-beef-55e82abae372 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:42:33.063124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Going to try to live migrate instance to n-h2-master-1 {{(pid=119765) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:42:33.132017 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:33.193722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:33.199479 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:33.206554 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c507a8cb-d9c7-481a-8f6e-030010403945 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1308 microversion: 2.1 time: 0.393153 Jul 01 10:42:33.218114 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1958/3848] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:32 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:33.228163 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:33.228163 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:33.233895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:33.234713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:33.235789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:33.236500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:33.491478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:33.504683 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8eb5eca0-adc3-4e0b-9e35-7ee0ec1497ba tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1506 microversion: 2.1 time: 0.283632 Jul 01 10:42:33.518720 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1959/3849] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:33 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:33.524577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:33.525293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:33.537393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:33.537393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:33.537393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:33.537393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:33.782202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:33.791548 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43008974-754f-4791-9b93-3a5a41a5c69d tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1492 microversion: 2.1 time: 0.271472 Jul 01 10:42:33.792142 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1960/3850] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:33 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1492 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:33.797380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:33.812925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: e5626ce2-103f-47ca-9096-b20ea3b6fb46] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:33.812925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:33.812925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:33.812925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:33.812925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.041632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:34.050894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43d9acbf-110a-4f7c-b423-4041766863b5 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46" status: 200 len: 1506 microversion: 2.1 time: 0.257357 Jul 01 10:42:34.055825 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1961/3851] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:33 2022] GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:34.057509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:34.058534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:34.069183 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.069683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.070467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.071079 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.144042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:34.154566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:34.156107 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:34.157530 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43834cc5-3f3c-4473-a45b-e1b0052b6d77 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.104749 Jul 01 10:42:34.158467 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1962/3852] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:34 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:34.162961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:34.163578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:34.170240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.170678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.171466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.171890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.243974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:34.254713 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c84cdc79-efe3-4616-8e8e-fc8410a75232 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1288 microversion: 2.1 time: 0.095176 Jul 01 10:42:34.264712 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1963/3853] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:34 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:34.270074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:34.270074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: e5626ce2-103f-47ca-9096-b20ea3b6fb46] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:34.275842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.276292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.277066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.277656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.315812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: e5626ce2-103f-47ca-9096-b20ea3b6fb46] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:42:34.731138 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e96f7b2-d5fc-4172-9398-7411eecb9dea tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46" status: 204 len: 0 microversion: 2.1 time: 0.470515 Jul 01 10:42:34.731948 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1964/3854] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:34 2022] DELETE /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:34.737547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:34.738242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:34.744264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.744711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.745568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.746001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.911905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:34.921166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3500624-abfe-40b7-af0c-8b1ba39d7916 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1308 microversion: 2.1 time: 0.187796 Jul 01 10:42:34.922189 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1965/3855] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:34 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:34.937227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-cc0a1833-2650-4194-ba8d-c1a0669f2b87 req-7684aceb-d9f7-4e32-9e95-4b0e1ec52826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9542320-9b9a-42dc-952e-2147380c8fbd", "name": "network-vif-plugged", "status": "completed", "tag": "0e49db62-c56c-4b22-a813-c6af0619af6b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:34.948318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cc0a1833-2650-4194-ba8d-c1a0669f2b87 req-7684aceb-d9f7-4e32-9e95-4b0e1ec52826 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.949213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cc0a1833-2650-4194-ba8d-c1a0669f2b87 req-7684aceb-d9f7-4e32-9e95-4b0e1ec52826 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.963390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-cc0a1833-2650-4194-ba8d-c1a0669f2b87 req-7684aceb-d9f7-4e32-9e95-4b0e1ec52826 service nova] Creating event network-vif-plugged:0e49db62-c56c-4b22-a813-c6af0619af6b for instance f9542320-9b9a-42dc-952e-2147380c8fbd on n-h1-master-1 Jul 01 10:42:34.969880 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-cc0a1833-2650-4194-ba8d-c1a0669f2b87 req-7684aceb-d9f7-4e32-9e95-4b0e1ec52826 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046326 Jul 01 10:42:34.975722 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1966/3856] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:34.976283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:34.976383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:34.983016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.983503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:34.984282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:34.984915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:35.014675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:42:35.401331 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8363adc5-5241-44db-9f50-a10ca68a7c25 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 204 len: 0 microversion: 2.1 time: 0.428792 Jul 01 10:42:35.401926 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1967/3857] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:34 2022] DELETE /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:35.409745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:35.410677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:35.429693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:35.430082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:35.430870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:35.431364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:35.673694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:35.685038 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae9b6fcf-06ab-4e23-9a82-fa30f201b6cf tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1492 microversion: 2.1 time: 0.281565 Jul 01 10:42:35.686246 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1968/3858] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:35 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1492 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:35.691836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:35.692572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:35.701005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:35.704005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:35.704005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:35.704005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:35.806811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:35.820256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:35.822575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:35.830669 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7c9b9fa8-9029-406e-945a-f54619853b5e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.136577 Jul 01 10:42:35.832183 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1969/3859] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:35 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:35.838164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:35.839086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:35.846045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:35.846306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:35.847231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:35.847717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:35.982178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:35.991181 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c8c7f64-e5eb-4efd-b640-55924396624d tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1286 microversion: 2.1 time: 0.157865 Jul 01 10:42:35.993211 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1970/3860] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:35 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:35.998310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:35.999229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: e5626ce2-103f-47ca-9096-b20ea3b6fb46] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:36.007112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:36.007801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:36.014197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:36.014197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:36.250804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:36.268674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-18119d03-a8b2-4255-be04-7b224c015654 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46" status: 200 len: 1512 microversion: 2.1 time: 0.274012 Jul 01 10:42:36.278901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1971/3861] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:35 2022] GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46 => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:36.293394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:36.294438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:36.301923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:36.302753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:36.303925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:36.304609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:36.581956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:36.586671 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:36.596379 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d6b0f83c-19fa-4158-99ba-43d69a34bfc2 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1308 microversion: 2.1 time: 0.315950 Jul 01 10:42:36.597041 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1972/3862] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:36 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:36.705602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:36.706556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:36.722697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:36.732996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:36.736215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:36.739095 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:37.123714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:37.134467 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6fc86b95-6c48-4050-9e68-f1f5f60c993e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1498 microversion: 2.1 time: 0.434720 Jul 01 10:42:37.137785 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1973/3863] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:36 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1498 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:37.145355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:37.159626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:37.173102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:37.189987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:37.194746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:37.194746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:37.325484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:37.345838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:37.345838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b9e074fc3d5413eb57dbff4066ba93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcaf85c309407abc034a0c937fb49e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:37.350066 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-287d5066-677a-4cf2-9501-39ca09dcc767 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 200 len: 1603 microversion: 2.42 time: 0.208633 Jul 01 10:42:37.350652 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1974/3864] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:37 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 1603 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:42:37.360219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:37.360834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:37.372234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:37.372757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:37.373630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:37.374276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:37.726221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:37.734147 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-152f6611-2add-4def-b352-2137dc02f9c6 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 0.377749 Jul 01 10:42:37.734479 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1975/3865] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:37 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:37.739900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:37.739900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:37.758786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:37.759213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:37.759995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:37.760429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:37.800914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:42:38.232291 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce5513e3-3b87-4da7-9fb6-032bcf93f6f2 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 204 len: 0 microversion: 2.1 time: 0.496308 Jul 01 10:42:38.236304 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1976/3866] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:37 2022] DELETE /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:38.243377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-da81b481-688e-41e8-b75c-180641eb9fc8 req-eb3503c1-af0f-4d86-934c-c9955cc0bf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5626ce2-103f-47ca-9096-b20ea3b6fb46", "name": "network-vif-deleted", "tag": "1b1bffd2-2e49-4970-a01d-342e6f399817"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:38.269910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-da81b481-688e-41e8-b75c-180641eb9fc8 req-eb3503c1-af0f-4d86-934c-c9955cc0bf34 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.270474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-da81b481-688e-41e8-b75c-180641eb9fc8 req-eb3503c1-af0f-4d86-934c-c9955cc0bf34 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.299947 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-da81b481-688e-41e8-b75c-180641eb9fc8 req-eb3503c1-af0f-4d86-934c-c9955cc0bf34 service nova] Creating event network-vif-deleted:1b1bffd2-2e49-4970-a01d-342e6f399817 for instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 on n-h1-master-1 Jul 01 10:42:38.314804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-da81b481-688e-41e8-b75c-180641eb9fc8 req-eb3503c1-af0f-4d86-934c-c9955cc0bf34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072521 Jul 01 10:42:38.321498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1977/3867] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:38.339026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:38.339026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: e5626ce2-103f-47ca-9096-b20ea3b6fb46] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:38.349677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.353913 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.355832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.356985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.391206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.392571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.393232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lazy-loading 'fault' on Instance uuid e5626ce2-103f-47ca-9096-b20ea3b6fb46 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:42:38.494683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:38.507725 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-274bfe71-e37a-4494-8d4b-eb80dbc48e8f tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46" status: 200 len: 1308 microversion: 2.1 time: 0.181603 Jul 01 10:42:38.511143 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1978/3868] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:38 2022] GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:38.529784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:38.529784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:38.560561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.561503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.562696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.563391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.797731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:38.808747 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa6560e9-5322-4187-93ec-7b010e3db7a9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1490 microversion: 2.1 time: 0.296137 Jul 01 10:42:38.809543 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1979/3869] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:38 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1490 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:38.819828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:38.819828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:38.826123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.826761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.828810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:38.830339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:38.994904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:39.002425 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-babc2cab-3e15-40a8-80e1-e6dfe058b4ed tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.191548 Jul 01 10:42:39.003007 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1980/3870] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:38 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:39.007720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1d6ce792-5a11-4b08-b94c-621f1d03d4b2 req-a5a472e0-9940-4c43-92e4-fe5383615e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecd879e-8b72-4eb1-9dcb-6af213cf18db", "name": "network-vif-deleted", "tag": "e14390c2-bc55-44fe-9650-b719248685bb"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:39.017094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1d6ce792-5a11-4b08-b94c-621f1d03d4b2 req-a5a472e0-9940-4c43-92e4-fe5383615e39 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:39.017573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1d6ce792-5a11-4b08-b94c-621f1d03d4b2 req-a5a472e0-9940-4c43-92e4-fe5383615e39 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:39.029929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1d6ce792-5a11-4b08-b94c-621f1d03d4b2 req-a5a472e0-9940-4c43-92e4-fe5383615e39 service nova] Creating event network-vif-deleted:e14390c2-bc55-44fe-9650-b719248685bb for instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db on n-h2-master-1 Jul 01 10:42:39.034938 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1d6ce792-5a11-4b08-b94c-621f1d03d4b2 req-a5a472e0-9940-4c43-92e4-fe5383615e39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030534 Jul 01 10:42:39.035546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1981/3871] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:39.042475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:39.043188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:39.052197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:39.052670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:39.053777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:39.054398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:39.069395 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] HTTP exception thrown: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Request method failure captured: Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad HTTP/1.1 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Nv45ajKz5vn7gVxAwokZ2ninz0A-2vmxJ2RmB1RVZeNublKP-HMSzvCGpzSUB5iSWOiuGhyHAwjHycbQno32OoGnziPjbziJj6ktMPH2DTmpOVza5eXyDbW0d4jYi1kU6cdT6IhlYs7Dz0c1Ll_SCXOTmE_i-NsQOgCQjTNQIPyw Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.42 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: d1fcaf85c309407abc034a0c937fb49e Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d1fcaf85c309407abc034a0c937fb49e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: d1fcaf85c309407abc034a0c937fb49e Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TaggedBootDevicesTest_v242-497250602-project Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9b9e074fc3d5413eb57dbff4066ba93b Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TaggedBootDevicesTest_v242-497250602-project Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '852bcb41-f421-4a4b-8ae7-2f905f4be9ad'} Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:39.071104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Returning 404 to user: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b57d3d7-81a7-41f5-aff4-d2895656b9d5 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 404 len: 111 microversion: 2.42 time: 0.035824 Jul 01 10:42:39.076666 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1982/3872] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:39 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:42:39.082695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:39.082695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:39.088348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:39.088801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:39.089598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:39.090040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:39.140179 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86871b7a-d3a3-4cc0-8821-c6456ed92034 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372/action" status: 202 len: 0 microversion: 2.1 time: 6.219985 Jul 01 10:42:39.140947 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1891/3873] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:42:32 2022] POST /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372/action => generated 0 bytes in 6221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:42:39.146454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-378645297", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "9025d00e-6ad8-47ef-80bc-484168809931"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:39.220354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:42:39.331989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:39.341688 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-452ed319-76f9-46af-b08b-82f0c8e56605 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 0.263978 Jul 01 10:42:39.342495 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1983/3874] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:39 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:39.360726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-334ec834-f6d7-44cf-94f7-31d8a491f21e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '.version_select at 0x7f6f970feee0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:39.603862 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-334ec834-f6d7-44cf-94f7-31d8a491f21e tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-334252367" status: 204 len: 0 microversion: 2.42 time: 0.246907 Jul 01 10:42:39.604705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1984/3875] 10.222.0.23 () {60 vars in 1258 bytes} [Fri Jul 1 10:42:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-334252367 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:42:39.613347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:39.613347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:39.617350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:39.618071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:39.618865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:39.619467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.004551 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:40.120016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:42:40.120465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:42:40.121124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:42:40.121755 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:42:40.122351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:42:40.131604 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.132050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.133616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.134349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.154025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:42:40.159684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:42:40.173040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:40.178998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:42:40.178998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:42:40.186289 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad699e18-6a34-4a63-94c5-1f116ba3449d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.580244 Jul 01 10:42:40.187276 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1985/3876] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:39 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:40.193047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:40.193815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: e5626ce2-103f-47ca-9096-b20ea3b6fb46] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:40.201747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.202953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.203892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.204553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.223038 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] HTTP exception thrown: Instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 could not be found. Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Request method failure captured: Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46 HTTP/1.1 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs9ZTbBy9bgbOy6My_9y_nl1QsPcpYOufyVPDfb0nhU1Zxsn2dOkKf_W0Q3duGwROnp7G_a-ejTKn8BqsmPwmLTMLqHNIQZcgTBMxqeawiDMIg1rZblsORH0f_IGcSO0BXBbYkBgOnAFEdgt8_ggEUdQoDJLpzX1jANm5XGYdoqdOrc Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f49749e42dfc4e57907fa26c055b206a Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-MultipleCreateTestJSON-971174076 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f49749e42dfc4e57907fa26c055b206a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f49749e42dfc4e57907fa26c055b206a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f49749e42dfc4e57907fa26c055b206a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f49749e42dfc4e57907fa26c055b206a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-MultipleCreateTestJSON-971174076 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f49749e42dfc4e57907fa26c055b206a Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-MultipleCreateTestJSON-971174076 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-MultipleCreateTestJSON-971174076-project Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: d14bb96f0a004412a4a41baa22f15ad8 Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-MultipleCreateTestJSON-971174076-project Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: exception: Instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 could not be found. Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'e5626ce2-103f-47ca-9096-b20ea3b6fb46'} Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 could not be found. Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 could not be found. Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:40.225099 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:40.230442 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:40.230442 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:40.230442 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:40.230442 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:40.230442 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:40.230442 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 could not be found. Jul 01 10:42:40.230442 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:40.231701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Returning 404 to user: Instance e5626ce2-103f-47ca-9096-b20ea3b6fb46 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:40.232954 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-061cb4b6-7a3c-4ebc-8d49-5ccd8ecaaf03 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46" status: 404 len: 111 microversion: 2.1 time: 0.044259 Jul 01 10:42:40.234042 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1986/3877] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:40 2022] GET /compute/v2.1/servers/e5626ce2-103f-47ca-9096-b20ea3b6fb46 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:42:40.239521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:40.240486 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:40.250982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.254260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.254260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.254260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.357462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72325d7b-6786-4264-815e-d2b57594bc80 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215139 Jul 01 10:42:40.358368 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1892/3878] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:42:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:42:40.366137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:40.366939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:40.374544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.380298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.380298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.380298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.474021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:40.491291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:40.491472 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76b1ac62-e7eb-478e-aff9-b1d50f829fd4 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1470 microversion: 2.1 time: 0.131551 Jul 01 10:42:40.494570 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1893/3879] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:40 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1470 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:40.500656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:40.501631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:40.503870 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0fe3338-a705-4a42-bc8e-b43ede0db748 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.268349 Jul 01 10:42:40.508732 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1987/3880] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:40 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:40.519390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec249af5-5c84-475f-9350-7b0375eb0518 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:40.520293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec249af5-5c84-475f-9350-7b0375eb0518 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:40.522117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.522577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.523431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:40.523917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:40.589919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ec249af5-5c84-475f-9350-7b0375eb0518 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:40.614262 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec249af5-5c84-475f-9350-7b0375eb0518 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1208 microversion: 2.1 time: 0.096965 Jul 01 10:42:40.614262 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1988/3881] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:40 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:40.777843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:40.789792 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b58bbcf7-f414-411c-a0fe-e27e219220c3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 0.290347 Jul 01 10:42:40.789792 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1894/3882] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:40 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:41.056139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ba117b82-f50b-42e0-bd9a-02b7edf7988b req-7876df78-4804-4be4-9204-352398f65df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c", "tag": "7937f72e-733d-459f-a706-983aed767ba0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:41.071836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ba117b82-f50b-42e0-bd9a-02b7edf7988b req-7876df78-4804-4be4-9204-352398f65df9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.075889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ba117b82-f50b-42e0-bd9a-02b7edf7988b req-7876df78-4804-4be4-9204-352398f65df9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.088538 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ba117b82-f50b-42e0-bd9a-02b7edf7988b req-7876df78-4804-4be4-9204-352398f65df9 service nova] Creating event network-changed:7937f72e-733d-459f-a706-983aed767ba0 for instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c on n-h2-master-1 Jul 01 10:42:41.096820 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ba117b82-f50b-42e0-bd9a-02b7edf7988b req-7876df78-4804-4be4-9204-352398f65df9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044854 Jul 01 10:42:41.099868 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1989/3883] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:41.204446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:41.205178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:41.223747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.224298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.225173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.225692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.514628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:41.515747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:41.538746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.540381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.541853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.542513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.607771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.609135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.610340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lazy-loading 'fault' on Instance uuid 9ecd879e-8b72-4eb1-9dcb-6af213cf18db {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:42:41.671622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:41.677056 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-692c6be4-3fd1-4fec-92d6-f21a943fb426 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.476326 Jul 01 10:42:41.678220 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1895/3884] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:41 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:41.684816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:41.685681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:41.693800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.694517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.696075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.696696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.785066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd14bb96f0a004412a4a41baa22f15ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49749e42dfc4e57907fa26c055b206a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:41.793832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fece0b49-1e4b-42d7-8ad5-46b242855649 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 200 len: 1308 microversion: 2.1 time: 0.284295 Jul 01 10:42:41.795169 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1990/3885] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:41 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:41.809379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:41.810345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:41.819142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.820119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:41.822215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:41.822893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:42.122095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:42.131387 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4fd61e45-f573-4b5e-bb7a-66c55dfa429b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1212 microversion: 2.1 time: 0.334430 Jul 01 10:42:42.137618 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1991/3886] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:41 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1212 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:42.146321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:42.154242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:42.157245 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:42.163002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:42.163927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:42.165716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:42.167285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:42.205754 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:42.390302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:42.399826 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-23ce92cb-8290-418a-b9a3-197ffec99340 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1504 microversion: 2.1 time: 0.720235 Jul 01 10:42:42.411946 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1896/3887] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:41 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1504 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:42.697292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:42.698036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:42.716775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:42.722545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:42.722832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:42.723072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:42.723072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:42.734422 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86f556e7-1293-416f-b151-beb26d5ea958 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 0.591636 Jul 01 10:42:42.735373 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1992/3888] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:42 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:42.822035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:42.823711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] [instance: 9ecd879e-8b72-4eb1-9dcb-6af213cf18db] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:42.833533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:42.840654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:42.843064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:42.843860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:42.871606 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] HTTP exception thrown: Instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db could not be found. Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Request method failure captured: Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db HTTP/1.1 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs9ZTbBy9bgbOy6My_9y_nl1QsPcpYOufyVPDfb0nhU1Zxsn2dOkKf_W0Q3duGwROnp7G_a-ejTKn8BqsmPwmLTMLqHNIQZcgTBMxqeawiDMIg1rZblsORH0f_IGcSO0BXBbYkBgOnAFEdgt8_ggEUdQoDJLpzX1jANm5XGYdoqdOrc Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: f49749e42dfc4e57907fa26c055b206a Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-MultipleCreateTestJSON-971174076 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f49749e42dfc4e57907fa26c055b206a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f49749e42dfc4e57907fa26c055b206a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f49749e42dfc4e57907fa26c055b206a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f49749e42dfc4e57907fa26c055b206a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-MultipleCreateTestJSON-971174076 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: f49749e42dfc4e57907fa26c055b206a Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-MultipleCreateTestJSON-971174076 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-MultipleCreateTestJSON-971174076-project Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: d14bb96f0a004412a4a41baa22f15ad8 Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-MultipleCreateTestJSON-971174076-project Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db could not be found. Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '9ecd879e-8b72-4eb1-9dcb-6af213cf18db'} Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db could not be found. Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db could not be found. Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:42.874809 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:42.881634 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:42.881634 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:42.881634 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:42.881634 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:42.881634 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:42.881634 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db could not be found. Jul 01 10:42:42.881634 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:42.886523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] Returning 404 to user: Instance 9ecd879e-8b72-4eb1-9dcb-6af213cf18db could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:42.887685 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4201e6ab-6dd9-4caf-b593-c5a7264f12d7 tempest-MultipleCreateTestJSON-971174076 tempest-MultipleCreateTestJSON-971174076-project] 10.222.0.23 "GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db" status: 404 len: 111 microversion: 2.1 time: 0.078781 Jul 01 10:42:42.893003 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1993/3889] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:42 2022] GET /compute/v2.1/servers/9ecd879e-8b72-4eb1-9dcb-6af213cf18db => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:42:43.026902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-de462336-be9d-435e-95b5-5ff64d122080 req-5176164b-871f-44bb-958a-04e1c18653ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e08071f-b890-40d7-9eee-f249864936f9", "name": "network-vif-deleted", "tag": "f16f4e29-6e0a-4906-b3b7-df3d6a3cc9a9"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:43.037887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-de462336-be9d-435e-95b5-5ff64d122080 req-5176164b-871f-44bb-958a-04e1c18653ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.038471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-de462336-be9d-435e-95b5-5ff64d122080 req-5176164b-871f-44bb-958a-04e1c18653ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.052957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-de462336-be9d-435e-95b5-5ff64d122080 req-5176164b-871f-44bb-958a-04e1c18653ca service nova] Creating event network-vif-deleted:f16f4e29-6e0a-4906-b3b7-df3d6a3cc9a9 for instance 0e08071f-b890-40d7-9eee-f249864936f9 on n-h2-master-1 Jul 01 10:42:43.059476 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-de462336-be9d-435e-95b5-5ff64d122080 req-5176164b-871f-44bb-958a-04e1c18653ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036629 Jul 01 10:42:43.060582 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1994/3890] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:42:43.159817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:43.162310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:43.170254 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.170964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.171969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.173241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.263887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:43.273520 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98811b8f-f6a0-4d9a-9779-7402b3fd33fa tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.581318 Jul 01 10:42:43.274450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1897/3891] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:42 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:43.330692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:43.343714 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4932092e-58a4-46bf-87b7-a23e840e1dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1268 microversion: 2.1 time: 0.197738 Jul 01 10:42:43.345053 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1995/3892] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:43 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:43.420408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:43.438592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:43.457689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.458148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.458953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.459389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.509705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.510058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.510716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lazy-loading 'fault' on Instance uuid 0e08071f-b890-40d7-9eee-f249864936f9 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:42:43.754095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:43.754726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:43.767024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.767024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.767024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:43.767024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:43.884972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:43.910292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e13b3ab-5298-4c4a-83e3-317fb479db87 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 200 len: 1302 microversion: 2.1 time: 0.494694 Jul 01 10:42:43.928312 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1898/3893] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:43 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 1302 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:44.161049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:44.200485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d601dd53-2f33-4774-9cad-30aa1beaa679 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 0.449317 Jul 01 10:42:44.205606 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1996/3894] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:43 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:44.293527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:44.294535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:44.304512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:44.306024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:44.307388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:44.308262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:44.366459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:44.368575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:44.391148 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:44.391702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:44.393300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:44.393910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:44.548024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:44.561162 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6248a872-b3dd-4866-ab52-e366e0001fc7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1266 microversion: 2.1 time: 0.197758 Jul 01 10:42:44.570806 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1997/3895] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:44 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:44.675611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:44.691065 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f1e4728c-95b7-4919-b9ef-9230c201665d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.403474 Jul 01 10:42:44.696172 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1899/3896] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:44 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:44.940171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:44.942055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 0e08071f-b890-40d7-9eee-f249864936f9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:44.954057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:44.955108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:44.958090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:44.960917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.013229 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] HTTP exception thrown: Instance 0e08071f-b890-40d7-9eee-f249864936f9 could not be found. Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Request method failure captured: Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 HTTP/1.1 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8hRYi7EmIXYjoyVR5a9hrUc42cSINSRpDDNXzivDm7X37FcTX9_Vbbs2QKvsxXJujVzS1F4hA8snMnDjtEg6tBYAttgkpb3BRry8CiymIJEXDNPKTG9NIUjGCRQh-SbZQgRgu3ZcfIAEToZk2SJVAY9-CTL1KZEKDAqY0PUb5jhd4 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2182bc6e5f9d439a8a146dc2b8aa1219 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerRescueTestJSON-155021810 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2182bc6e5f9d439a8a146dc2b8aa1219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2182bc6e5f9d439a8a146dc2b8aa1219"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2182bc6e5f9d439a8a146dc2b8aa1219", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2182bc6e5f9d439a8a146dc2b8aa1219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerRescueTestJSON-155021810 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2182bc6e5f9d439a8a146dc2b8aa1219 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerRescueTestJSON-155021810 Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerRescueTestJSON-155021810-project Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1787c6f2f7c84dfc9c1ba94d4a04432e Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerRescueTestJSON-155021810-project Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 0e08071f-b890-40d7-9eee-f249864936f9 could not be found. Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '0e08071f-b890-40d7-9eee-f249864936f9'} Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e08071f-b890-40d7-9eee-f249864936f9 could not be found. Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e08071f-b890-40d7-9eee-f249864936f9 could not be found. Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:45.018998 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:45.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:45.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:45.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:45.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:45.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:45.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e08071f-b890-40d7-9eee-f249864936f9 could not be found. Jul 01 10:42:45.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:45.028621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Returning 404 to user: Instance 0e08071f-b890-40d7-9eee-f249864936f9 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:45.029750 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-756f6cec-e511-4722-9fc7-d1548f7a6c98 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9" status: 404 len: 111 microversion: 2.1 time: 0.097163 Jul 01 10:42:45.030975 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1998/3897] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:44 2022] GET /compute/v2.1/servers/0e08071f-b890-40d7-9eee-f249864936f9 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:42:45.042502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:45.043307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:45.050584 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.051622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.052796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.053836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.092749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:42:45.220704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:45.221418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:45.242708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.244544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.248051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.248520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.512380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:45.529773 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79c540a7-0923-49a8-a3f2-061848590353 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 0.313061 Jul 01 10:42:45.532126 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 1999/3898] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:45 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:45.582328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:45.583209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:45.601210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.602558 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.603489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.607544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.659357 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9a888fbd-6373-4834-a4d0-f72b12fcccb3 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 204 len: 0 microversion: 2.1 time: 0.621211 Jul 01 10:42:45.659357 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1900/3899] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:45 2022] DELETE /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:45.671051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:45.687941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:45.712212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.718402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.719253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:45.719696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:45.955743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:45.970899 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b0f1054-067a-443d-93b6-eb8f10643bc6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1308 microversion: 2.1 time: 0.388719 Jul 01 10:42:45.974787 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2000/3900] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:45 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:45.986989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:45.990540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:46.006684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:46.010974 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:46.012269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:46.014126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:46.428130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:46.437884 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31b58b3f-15bf-48da-93b0-a550705e32dd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.463906 Jul 01 10:42:46.448127 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2001/3901] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:45 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:46.551095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:46.551939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:46.569645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:46.572198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:46.587692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:46.587692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:47.021635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:47.029798 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd09cad2-73aa-4b08-9e87-f49a33b5c6d6 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1491 microversion: 2.1 time: 1.367309 Jul 01 10:42:47.040666 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1901/3902] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:45 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1491 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:47.045603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:47.046412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:47.057351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:47.058002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:47.070837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:47.072932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:47.180316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:47.199237 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-caa7b6c7-3168-4b50-9dcf-bf6b51b38efa tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 0.649148 Jul 01 10:42:47.206896 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2002/3903] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:46 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:47.455930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:47.456602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:47.474099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:47.474556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:47.475412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:47.475842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:48.056884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:48.073332 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc58bb05-4a75-4314-af7b-15c43032fd60 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.621278 Jul 01 10:42:48.078104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2003/3904] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:47 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:48.096219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:48.096848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:48.121886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:48.122346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:48.123150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:48.131254 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:48.441672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:48.461920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ebf6143c-a5d6-4305-abfe-7a9cf0a49db1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1308 microversion: 2.1 time: 1.416795 Jul 01 10:42:48.465476 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1902/3905] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:47 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1308 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:48.481181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:48.483758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:48.521496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:48.529283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:48.530957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:48.531566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:49.832903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:49.858851 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-52151a19-464f-4d8f-8731-cbf33910e28e tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1491 microversion: 2.1 time: 1.774754 Jul 01 10:42:49.861464 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2004/3906] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:48 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1491 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:49.877518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:49.880088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:49.904625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:49.905348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:49.907622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:49.911711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:50.067511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:50.092830 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-36fb9210-95d8-4f09-9778-a7618f205b8f tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 1.625638 Jul 01 10:42:50.099333 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1903/3907] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:48 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:50.107165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:50.115953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:50.130209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:50.130656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:50.131473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:50.131906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:50.191810 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:50.192555 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:50.602669 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:51.000809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:51.010546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4fe5e134-2c7e-4196-a9ed-1cfdaa777934 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 1.146826 Jul 01 10:42:51.011141 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2005/3908] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:49 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:51.021301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ea86f625-a4bb-4d8f-acdd-ae48fdec0c64 req-5905080e-9b44-4f6d-84a1-83d16eba98d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7", "tag": "8b7d4bdc-c327-457d-b433-fa19f704ea24"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:51.044111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ea86f625-a4bb-4d8f-acdd-ae48fdec0c64 req-5905080e-9b44-4f6d-84a1-83d16eba98d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.044566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ea86f625-a4bb-4d8f-acdd-ae48fdec0c64 req-5905080e-9b44-4f6d-84a1-83d16eba98d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.080004 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ea86f625-a4bb-4d8f-acdd-ae48fdec0c64 req-5905080e-9b44-4f6d-84a1-83d16eba98d4 service nova] Creating event network-changed:8b7d4bdc-c327-457d-b433-fa19f704ea24 for instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 on n-h1-master-1 Jul 01 10:42:51.092978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ea86f625-a4bb-4d8f-acdd-ae48fdec0c64 req-5905080e-9b44-4f6d-84a1-83d16eba98d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080404 Jul 01 10:42:51.094548 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2006/3909] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:51.100619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:51.115050 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a9a5ace-67a4-47c1-8d0c-8e545bae2e61 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1308 microversion: 2.1 time: 1.014085 Jul 01 10:42:51.118806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9f3395b6-ebd7-4bba-bab3-75bb13611f31 req-58616680-922a-45d4-a635-e85a145380fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c", "name": "network-vif-plugged", "status": "completed", "tag": "7937f72e-733d-459f-a706-983aed767ba0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:51.120611 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1904/3910] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:50 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1308 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:51.139597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:51.140099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:51.152625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9f3395b6-ebd7-4bba-bab3-75bb13611f31 req-58616680-922a-45d4-a635-e85a145380fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.153768 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.154705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9f3395b6-ebd7-4bba-bab3-75bb13611f31 req-58616680-922a-45d4-a635-e85a145380fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.157489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.158486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.159110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.183496 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9f3395b6-ebd7-4bba-bab3-75bb13611f31 req-58616680-922a-45d4-a635-e85a145380fb service nova] Creating event network-vif-plugged:7937f72e-733d-459f-a706-983aed767ba0 for instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c on n-h2-master-1 Jul 01 10:42:51.194415 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9f3395b6-ebd7-4bba-bab3-75bb13611f31 req-58616680-922a-45d4-a635-e85a145380fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097056 Jul 01 10:42:51.196888 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2007/3911] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:51.198190 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] HTTP exception thrown: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Request method failure captured: Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad HTTP/1.1 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs3Nv45ajKz5vn7gVxAwokZ2ninz0A-2vmxJ2RmB1RVZeNublKP-HMSzvCGpzSUB5iSWOiuGhyHAwjHycbQno32OoGnziPjbziJj6ktMPH2DTmpOVza5eXyDbW0d4jYi1kU6cdT6IhlYs7Dz0c1Ll_SCXOTmE_i-NsQOgCQjTNQIPyw Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.42 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: d1fcaf85c309407abc034a0c937fb49e Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d1fcaf85c309407abc034a0c937fb49e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: d1fcaf85c309407abc034a0c937fb49e Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TaggedBootDevicesTest_v242-497250602-project Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9b9e074fc3d5413eb57dbff4066ba93b Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TaggedBootDevicesTest_v242-497250602-project Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '852bcb41-f421-4a4b-8ae7-2f905f4be9ad'} Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:51.204143 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Returning 404 to user: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:51.215507 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-317b3d33-1429-49c1-88bd-6955adccc7fd tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "DELETE /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 404 len: 111 microversion: 2.42 time: 0.084126 Jul 01 10:42:51.221171 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1905/3912] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:42:51 2022] DELETE /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:42:51.222264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:51.223203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:51.230242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:51.232886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:51.239154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.241474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.242517 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.243422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.250643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.253294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.254287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:51.254885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:51.307015 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:52.264356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:52.279887 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-796f915a-ede5-44e8-988a-7524ed86b3e7 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1491 microversion: 2.1 time: 1.078857 Jul 01 10:42:52.283121 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2008/3913] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:51 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1491 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:52.295817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:52.300824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] [instance: 852bcb41-f421-4a4b-8ae7-2f905f4be9ad] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:52.302435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:52.311540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:52.312000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:52.312792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:52.313256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:52.317458 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-117e4a1b-2268-44cb-9247-a397ad9eb602 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1328 microversion: 2.1 time: 1.096425 Jul 01 10:42:52.322688 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1906/3914] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:51 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1328 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:52.351003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:52.354725 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] HTTP exception thrown: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:52.358433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Request method failure captured: Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad HTTP/1.1 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs3Nv45ajKz5vn7gVxAwokZ2ninz0A-2vmxJ2RmB1RVZeNublKP-HMSzvCGpzSUB5iSWOiuGhyHAwjHycbQno32OoGnziPjbziJj6ktMPH2DTmpOVza5eXyDbW0d4jYi1kU6cdT6IhlYs7Dz0c1Ll_SCXOTmE_i-NsQOgCQjTNQIPyw Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.42 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: d1fcaf85c309407abc034a0c937fb49e Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d1fcaf85c309407abc034a0c937fb49e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d1fcaf85c309407abc034a0c937fb49e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: d1fcaf85c309407abc034a0c937fb49e Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-497250602 Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TaggedBootDevicesTest_v242-497250602-project Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9b9e074fc3d5413eb57dbff4066ba93b Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TaggedBootDevicesTest_v242-497250602-project Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '852bcb41-f421-4a4b-8ae7-2f905f4be9ad'} Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:52.358718 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] Returning 404 to user: Instance 852bcb41-f421-4a4b-8ae7-2f905f4be9ad could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-719a0b84-4749-4eec-85f5-b5a9156f5d28 tempest-TaggedBootDevicesTest_v242-497250602 tempest-TaggedBootDevicesTest_v242-497250602-project] 10.222.0.23 "GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad" status: 404 len: 111 microversion: 2.42 time: 0.073595 Jul 01 10:42:52.363632 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2009/3915] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:42:52 2022] GET /compute/v2.1/servers/852bcb41-f421-4a4b-8ae7-2f905f4be9ad => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:42:52.365928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:52.366499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:52.380793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:52.388069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:52.388069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:52.388069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:52.391248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:52.395256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:52.396671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:52.397129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:53.072046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:53.080329 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9e7923e1-4b4b-41d4-8122-df475fde3ebd tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.735698 Jul 01 10:42:53.081811 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1907/3916] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:52 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:53.087807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5df8f062-2c9e-4a0f-91e1-38f6205c3fcb req-4843a122-e0fd-4dbd-824e-7057841981ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e89a17-8291-460c-9a92-cbe07e990961", "name": "network-vif-deleted", "tag": "9bc08b81-8205-450f-9451-29239f13b73c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:53.090026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:53.100845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a433eafd-7d43-4d63-b6e5-24f5f1d0b4f0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1308 microversion: 2.1 time: 0.740740 Jul 01 10:42:53.104767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5df8f062-2c9e-4a0f-91e1-38f6205c3fcb req-4843a122-e0fd-4dbd-824e-7057841981ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:53.105639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5df8f062-2c9e-4a0f-91e1-38f6205c3fcb req-4843a122-e0fd-4dbd-824e-7057841981ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:53.118840 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5df8f062-2c9e-4a0f-91e1-38f6205c3fcb req-4843a122-e0fd-4dbd-824e-7057841981ca service nova] Creating event network-vif-deleted:9bc08b81-8205-450f-9451-29239f13b73c for instance 72e89a17-8291-460c-9a92-cbe07e990961 on n-h2-master-1 Jul 01 10:42:53.121452 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2010/3917] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:52 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:53.125451 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5df8f062-2c9e-4a0f-91e1-38f6205c3fcb req-4843a122-e0fd-4dbd-824e-7057841981ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042236 Jul 01 10:42:53.126489 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1908/3918] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:53.301138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:53.301801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:53.313955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:53.313955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:53.313955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:53.313955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:53.340172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:53.343390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:53.354421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:53.354724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:53.355495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:53.355914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:53.737035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1787c6f2f7c84dfc9c1ba94d4a04432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2182bc6e5f9d439a8a146dc2b8aa1219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:53.752539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7555bd25-cc58-415f-8c23-4a3b78bbd8a4 tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 200 len: 1285 microversion: 2.1 time: 0.452037 Jul 01 10:42:53.758941 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2011/3919] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:53 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 1285 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:53.840138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:53.865653 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3fddb980-2474-4505-a12e-9aa5c18ae29a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1528 microversion: 2.1 time: 0.530251 Jul 01 10:42:53.876843 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1909/3920] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:53 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1528 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:42:53.888218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:53.889484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:53.915567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:53.916526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:53.927387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:53.928007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:54.101714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:54.102063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:54.111771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:54.112219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:54.116015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:54.116503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:54.208760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:54.221037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4acf4e4-7cb5-490d-9b41-d3b6ac12c5e8 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1528 microversion: 2.1 time: 0.340732 Jul 01 10:42:54.223715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2012/3921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:53 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1528 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:54.249319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:54.251259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:54.276545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:54.277440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:54.280130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:54.280930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:54.352787 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:54.599086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:54.612371 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed206277-a9a0-49e3-915e-59ddda19aceb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.515592 Jul 01 10:42:54.613689 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1910/3922] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:54 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:54.720218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:54.730723 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c7a18ec1-f625-41b1-ac1f-14b9c7f965a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1308 microversion: 2.1 time: 0.503929 Jul 01 10:42:54.732785 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2013/3923] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:54 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:54.779963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:54.780628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] [instance: 72e89a17-8291-460c-9a92-cbe07e990961] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:54.794171 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:54.794624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:54.800569 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:54.818012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:54.871932 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] HTTP exception thrown: Instance 72e89a17-8291-460c-9a92-cbe07e990961 could not be found. Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Request method failure captured: Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 HTTP/1.1 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8hRYi7EmIXYjoyVR5a9hrUc42cSINSRpDDNXzivDm7X37FcTX9_Vbbs2QKvsxXJujVzS1F4hA8snMnDjtEg6tBYAttgkpb3BRry8CiymIJEXDNPKTG9NIUjGCRQh-SbZQgRgu3ZcfIAEToZk2SJVAY9-CTL1KZEKDAqY0PUb5jhd4 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2182bc6e5f9d439a8a146dc2b8aa1219 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerRescueTestJSON-155021810 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2182bc6e5f9d439a8a146dc2b8aa1219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2182bc6e5f9d439a8a146dc2b8aa1219"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2182bc6e5f9d439a8a146dc2b8aa1219", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2182bc6e5f9d439a8a146dc2b8aa1219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerRescueTestJSON-155021810 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2182bc6e5f9d439a8a146dc2b8aa1219 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerRescueTestJSON-155021810 Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerRescueTestJSON-155021810-project Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1787c6f2f7c84dfc9c1ba94d4a04432e Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerRescueTestJSON-155021810-project Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 72e89a17-8291-460c-9a92-cbe07e990961 could not be found. Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '72e89a17-8291-460c-9a92-cbe07e990961'} Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e89a17-8291-460c-9a92-cbe07e990961 could not be found. Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e89a17-8291-460c-9a92-cbe07e990961 could not be found. Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:54.875336 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:54.879867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:54.879867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:54.879867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:54.879867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:54.879867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:54.879867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e89a17-8291-460c-9a92-cbe07e990961 could not be found. Jul 01 10:42:54.879867 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:42:54.883968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] Returning 404 to user: Instance 72e89a17-8291-460c-9a92-cbe07e990961 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:54.889626 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7da43d5b-5c8e-4032-889c-de0fcb6166aa tempest-ServerRescueTestJSON-155021810 tempest-ServerRescueTestJSON-155021810-project] 10.222.0.23 "GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961" status: 404 len: 111 microversion: 2.1 time: 0.113243 Jul 01 10:42:54.890690 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2014/3924] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:54 2022] GET /compute/v2.1/servers/72e89a17-8291-460c-9a92-cbe07e990961 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:42:55.024187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:55.024982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:55.034096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.034886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.036075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.036814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.055187 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] HTTP exception thrown: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Request method failure captured: Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c HTTP/1.1 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs-Ta99kih-3R-7QQgIFtWdtl-SNUM0Xy1yCvejCIceEGsP06LBjudu1JfizaK4y0DmTUVSqRTCGerp8XB_s6KkW57tqSC-EstL5iI9-sBhT_hGn38DqhXV4Uaee8rEiXdEv2U5gMymmIc8HoBI_o8rC-B7PU3L2HzNUuyJW_MYrl6M Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0a65874b980642dd87605f2bb906b1f3 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-986744980 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a65874b980642dd87605f2bb906b1f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0a65874b980642dd87605f2bb906b1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0a65874b980642dd87605f2bb906b1f3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a65874b980642dd87605f2bb906b1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-986744980 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0a65874b980642dd87605f2bb906b1f3 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-986744980 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestMultiTenantJSON-986744980-project Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 905e66775b244357a4d26cbe9a71b915 Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-986744980-project Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c'} Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:55.058302 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Returning 404 to user: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0732d26a-6b42-4f9b-bbd8-947570adcd62 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 404 len: 111 microversion: 2.1 time: 0.445179 Jul 01 10:42:55.067468 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1911/3925] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:54 2022] DELETE /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 111 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:42:55.073356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:55.073983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:55.082189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.083093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.084160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.084829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.586115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:55.594059 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fd741d6b-5a89-45b2-8bff-cd6ed29cf89a tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1528 microversion: 2.1 time: 0.524852 Jul 01 10:42:55.595303 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2015/3926] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:55 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1528 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:55.611058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Action: 'update', calling method: >, body: {"server": {"name": "0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c_new"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:55.612405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:55.629983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:55.630696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:55.631565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.632512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.633740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.634430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.647007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.647521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.648542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.648978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.659314 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] HTTP exception thrown: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Request method failure captured: Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: request: PUT /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c HTTP/1.1 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 64 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs-Ta99kih-3R-7QQgIFtWdtl-SNUM0Xy1yCvejCIceEGsP06LBjudu1JfizaK4y0DmTUVSqRTCGerp8XB_s6KkW57tqSC-EstL5iI9-sBhT_hGn38DqhXV4Uaee8rEiXdEv2U5gMymmIc8HoBI_o8rC-B7PU3L2HzNUuyJW_MYrl6M Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0a65874b980642dd87605f2bb906b1f3 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-986744980 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a65874b980642dd87605f2bb906b1f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0a65874b980642dd87605f2bb906b1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0a65874b980642dd87605f2bb906b1f3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a65874b980642dd87605f2bb906b1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-986744980 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0a65874b980642dd87605f2bb906b1f3 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-986744980 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestMultiTenantJSON-986744980-project Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 905e66775b244357a4d26cbe9a71b915 Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-986744980-project Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c_new"}} Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c', 'body': {'server': {'name': '0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c_new'}}} Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 01 10:42:55.661757 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] Returning 404 to user: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b60b196-f1eb-4c89-b99b-12356dc85c68 tempest-ServersNegativeTestMultiTenantJSON-986744980 tempest-ServersNegativeTestMultiTenantJSON-986744980-project] 10.222.0.23 "PUT /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 404 len: 111 microversion: 2.1 time: 0.056399 Jul 01 10:42:55.674522 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1912/3927] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:42:55 2022] PUT /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:42:55.677442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:55.677956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:55.688114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.688805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.689813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.690440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.745055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:42:55.888296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:55.897869 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0d1d54d5-c45b-4d1c-93bc-93b93bfe50da tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.271578 Jul 01 10:42:55.911492 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2016/3928] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:55 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:55.919357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:55.931474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:55.947153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.948131 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:55.949181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:55.949870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:56.016701 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:42:56.147559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:56.156806 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-030d0fae-d46b-432c-837a-9f86d2c32c6c tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 204 len: 0 microversion: 2.1 time: 0.486258 Jul 01 10:42:56.157178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-76c14266-af96-432d-812a-d85a02e9cda6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1308 microversion: 2.1 time: 0.244052 Jul 01 10:42:56.159569 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1913/3929] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:42:55 2022] DELETE /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:42:56.160158 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2017/3930] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:55 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:56.166140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:56.167017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:56.174405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:56.175190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:56.176500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:56.177211 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:56.369002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:56.385403 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e93c532c-433e-4b9b-abd1-c835e4e0abb0 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1534 microversion: 2.1 time: 0.220708 Jul 01 10:42:56.387202 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2018/3931] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:56 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1534 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:56.578793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6c718ac8-313e-4747-aef1-ee051a0d6442 req-0ec196ee-cc02-47aa-923e-ce26bf74c76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7", "name": "network-vif-plugged", "status": "completed", "tag": "8b7d4bdc-c327-457d-b433-fa19f704ea24"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:56.587894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6c718ac8-313e-4747-aef1-ee051a0d6442 req-0ec196ee-cc02-47aa-923e-ce26bf74c76d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:56.588610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6c718ac8-313e-4747-aef1-ee051a0d6442 req-0ec196ee-cc02-47aa-923e-ce26bf74c76d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:56.604882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6c718ac8-313e-4747-aef1-ee051a0d6442 req-0ec196ee-cc02-47aa-923e-ce26bf74c76d service nova] Creating event network-vif-plugged:8b7d4bdc-c327-457d-b433-fa19f704ea24 for instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 on n-h1-master-1 Jul 01 10:42:56.610585 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6c718ac8-313e-4747-aef1-ee051a0d6442 req-0ec196ee-cc02-47aa-923e-ce26bf74c76d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 Jul 01 10:42:56.614518 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1914/3932] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:56.917897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:56.919176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:56.939668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:56.940137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:56.940930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:56.941422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:57.161672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:57.174766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:57.175756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:57.182136 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f5dcdf4-e5c8-4f1e-8d04-611d6ea2ecb1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.268607 Jul 01 10:42:57.183300 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2019/3933] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:56 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:57.189941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:57.190701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:57.191880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:57.192538 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:57.403890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:57.404894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:57.409972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:57.411475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:57.412222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:57.413268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:57.413971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:57.423290 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-272a691c-887a-4499-baee-aba3a5a7be37 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1308 microversion: 2.1 time: 0.253242 Jul 01 10:42:57.427982 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1915/3934] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:57 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:57.664478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:57.684712 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56c24eb4-89f2-4f52-95b8-28d875d312f3 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1534 microversion: 2.1 time: 0.282359 Jul 01 10:42:57.684712 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2020/3935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:57 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1534 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:58.205554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:58.207634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:58.227574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:58.228532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:58.232594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:58.233258 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:58.446547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:58.447265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:58.472739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:58.494663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:58.494789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:58.495137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:58.617418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:58.640955 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2756ca12-b150-4f8e-901b-cebf0ea280e1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.435409 Jul 01 10:42:58.646227 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1916/3936] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:58 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:58.670474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-1215942b-7ea0-4e2a-98c4-4873d0515253 req-72b2c1fb-e630-4535-8623-c5d2302b7eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c", "name": "network-vif-deleted", "tag": "7937f72e-733d-459f-a706-983aed767ba0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:42:58.712294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1215942b-7ea0-4e2a-98c4-4873d0515253 req-72b2c1fb-e630-4535-8623-c5d2302b7eef service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:58.713010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1215942b-7ea0-4e2a-98c4-4873d0515253 req-72b2c1fb-e630-4535-8623-c5d2302b7eef service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:58.757995 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-1215942b-7ea0-4e2a-98c4-4873d0515253 req-72b2c1fb-e630-4535-8623-c5d2302b7eef service nova] Creating event network-vif-deleted:7937f72e-733d-459f-a706-983aed767ba0 for instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c on n-h2-master-1 Jul 01 10:42:58.778337 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-1215942b-7ea0-4e2a-98c4-4873d0515253 req-72b2c1fb-e630-4535-8623-c5d2302b7eef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126438 Jul 01 10:42:58.783293 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1917/3937] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:42:58.797591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:58.799171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:58.817446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:58.818072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:58.820697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:58.821949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:59.010336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4037055b02c4296a537e2c995511443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccdc55c4b7a4d33932f5d6a54743cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:59.023570 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9dad1788-ce0e-4719-bdf9-e2ab2fec3916 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 200 len: 1313 microversion: 2.1 time: 0.236701 Jul 01 10:42:59.027349 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1918/3938] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:58 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:59.149025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:59.157778 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a3a5b49-f2c5-4964-83fa-34891d9a8d11 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1490 microversion: 2.1 time: 0.715966 Jul 01 10:42:59.163852 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2021/3939] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:58 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1490 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:59.181199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:59.181882 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:59.200851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:59.201333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:59.202311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:59.202925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:59.471433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:42:59.480998 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa34e664-f4d8-4da3-a211-8ec55e7a8492 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1490 microversion: 2.1 time: 0.305367 Jul 01 10:42:59.516827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:59.518779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:59.520172 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1919/3940] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:59 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1490 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:42:59.546736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:59.547836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:59.552438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:59.557478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:59.661258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:42:59.662405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:42:59.675055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:59.678421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:59.680453 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:42:59.681139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:42:59.987743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:00.004671 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-954d51aa-6064-4100-b8d9-c22ddd288139 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1490 microversion: 2.1 time: 0.508346 Jul 01 10:43:00.006306 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2022/3941] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:59 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1490 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:00.022046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:00.029437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f912acbf-a65c-448a-9b52-a894b1218a61 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.373579 Jul 01 10:43:00.031905 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1920/3942] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:42:59 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:00.034981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:00.035567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:00.045965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:00.049896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] [instance: 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:00.053662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:00.055108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:00.055633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:00.056275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:00.057260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:00.057603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:00.058324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:00.059376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:00.078495 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] HTTP exception thrown: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Request method failure captured: Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c HTTP/1.1 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs-DmwK-Mwt6kT0vN4kK-H-xAaWzxDoVsYhefL6s_csLFRSmqO1b5v67l47zb6dahVbyGggJchFdwvRjaXyPX5HsTZyNqUQBo3K6-BUza6ywCUZteo7AeloaM7BHWv6YbhSAZNhGsCcA69haNjR2tJ1IJ-ut_EDmxwY5ayv10cl-3gg Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 0ccdc55c4b7a4d33932f5d6a54743cb7 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1676985569 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ccdc55c4b7a4d33932f5d6a54743cb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ccdc55c4b7a4d33932f5d6a54743cb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ccdc55c4b7a4d33932f5d6a54743cb7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ccdc55c4b7a4d33932f5d6a54743cb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1676985569 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 0ccdc55c4b7a4d33932f5d6a54743cb7 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1676985569 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1676985569-project Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c4037055b02c4296a537e2c995511443 Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1676985569-project Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c'} Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:43:00.079004 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. Jul 01 10:43:00.083836 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:00.086582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] Returning 404 to user: Instance 0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:00.087657 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eeded4e3-564a-4329-a1b7-568f6ad7bf89 tempest-ServersNegativeTestMultiTenantJSON-1676985569 tempest-ServersNegativeTestMultiTenantJSON-1676985569-project] 10.222.0.23 "GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c" status: 404 len: 111 microversion: 2.1 time: 0.046661 Jul 01 10:43:00.088743 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1921/3943] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:00 2022] GET /compute/v2.1/servers/0a3d6c96-ae4a-4e3e-98aa-a60c68af9d6c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:43:00.137942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:43:00.763457 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8af9e07-3c23-4aa9-842c-df7785ce31cc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 204 len: 0 microversion: 2.1 time: 0.741317 Jul 01 10:43:00.764396 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2023/3944] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:43:00 2022] DELETE /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:43:00.774980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:00.775591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:00.793313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:00.794982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:00.802742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:00.802742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:01.051391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:01.052096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:01.062406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:01.063545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:01.064720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:01.066648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:01.453648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:01.462666 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-791568d6-291b-4dc8-a1b4-ad5090a8f354 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1496 microversion: 2.1 time: 0.694180 Jul 01 10:43:01.478829 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1922/3945] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:00 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1496 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:01.838783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:01.855907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7c63a912-62f4-42d1-b267-23a9780d485c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.809031 Jul 01 10:43:01.867470 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2024/3946] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:01 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:02.004869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9c29de50-f098-431b-a01c-0dd30024b027 req-b1977780-bf34-4443-8d8f-a91760327c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e826f-87c6-4c86-beef-55e82abae372", "name": "network-vif-unplugged", "status": "completed", "tag": "e18171f3-347d-4856-94e0-51a4475176b8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:02.044299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9c29de50-f098-431b-a01c-0dd30024b027 req-b1977780-bf34-4443-8d8f-a91760327c87 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:02.045878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9c29de50-f098-431b-a01c-0dd30024b027 req-b1977780-bf34-4443-8d8f-a91760327c87 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:02.076036 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9c29de50-f098-431b-a01c-0dd30024b027 req-b1977780-bf34-4443-8d8f-a91760327c87 service nova] Creating event network-vif-unplugged:e18171f3-347d-4856-94e0-51a4475176b8 for instance a47e826f-87c6-4c86-beef-55e82abae372 on n-h1-master-1 Jul 01 10:43:02.085983 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9c29de50-f098-431b-a01c-0dd30024b027 req-b1977780-bf34-4443-8d8f-a91760327c87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083507 Jul 01 10:43:02.087681 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1923/3947] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:02.571405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:02.572181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:02.584240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:02.584707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:02.592683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:02.594690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:02.883146 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:02.884889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:02.915590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:02.916470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:02.923356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:02.925423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:03.427701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:03.446516 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-096da4d9-d895-4095-b4a5-661d9a36562a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1496 microversion: 2.1 time: 0.879771 Jul 01 10:43:03.447121 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2025/3948] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:02 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1496 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:03.993192 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:04.006281 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a4604f60-5b4e-45ae-aadc-48ae90381b55 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 1.131757 Jul 01 10:43:04.017386 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1924/3949] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:02 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:04.138623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9ff58795-277a-42b5-a951-743830eff3f4 req-aac82831-4782-4a55-94ab-0ab4ac79510a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47e826f-87c6-4c86-beef-55e82abae372", "tag": "e18171f3-347d-4856-94e0-51a4475176b8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:04.180008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9ff58795-277a-42b5-a951-743830eff3f4 req-aac82831-4782-4a55-94ab-0ab4ac79510a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:04.180008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9ff58795-277a-42b5-a951-743830eff3f4 req-aac82831-4782-4a55-94ab-0ab4ac79510a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:04.206564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0700668a-48e6-482f-a6f7-197da663e75d req-469c0cdb-2cd6-429f-85d9-40a882cbc044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7", "name": "network-vif-deleted", "tag": "8b7d4bdc-c327-457d-b433-fa19f704ea24"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:04.212115 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9ff58795-277a-42b5-a951-743830eff3f4 req-aac82831-4782-4a55-94ab-0ab4ac79510a service nova] Creating event network-changed:e18171f3-347d-4856-94e0-51a4475176b8 for instance a47e826f-87c6-4c86-beef-55e82abae372 on n-h1-master-1 Jul 01 10:43:04.225730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0700668a-48e6-482f-a6f7-197da663e75d req-469c0cdb-2cd6-429f-85d9-40a882cbc044 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:04.226770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0700668a-48e6-482f-a6f7-197da663e75d req-469c0cdb-2cd6-429f-85d9-40a882cbc044 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:04.239806 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9ff58795-277a-42b5-a951-743830eff3f4 req-aac82831-4782-4a55-94ab-0ab4ac79510a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109457 Jul 01 10:43:04.241223 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2026/3950] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:04.264456 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0700668a-48e6-482f-a6f7-197da663e75d req-469c0cdb-2cd6-429f-85d9-40a882cbc044 service nova] Creating event network-vif-deleted:8b7d4bdc-c327-457d-b433-fa19f704ea24 for instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 on n-h1-master-1 Jul 01 10:43:04.284785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0700668a-48e6-482f-a6f7-197da663e75d req-469c0cdb-2cd6-429f-85d9-40a882cbc044 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070971 Jul 01 10:43:04.285895 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1925/3951] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:43:04.466006 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:04.477399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:04.501184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:04.503918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:04.507957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:04.510545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:04.789083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:04.799743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f345932-9dc6-48e1-a663-fc71ad7787df tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1293 microversion: 2.1 time: 0.339450 Jul 01 10:43:04.803089 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2027/3952] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:04 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1293 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:05.026797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:05.028364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:05.039628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:05.040403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:05.041572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:05.042229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:05.828577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:05.833958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:05.848913 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:05.857116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:05.857116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:05.857116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:05.953832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:05.954632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:05.955855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lazy-loading 'fault' on Instance uuid 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:43:06.379448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:06.390020 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c6c4bc2-856c-4d8a-9c76-a126d0230ef3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 200 len: 1298 microversion: 2.1 time: 0.571472 Jul 01 10:43:06.391572 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2028/3953] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:05 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 1298 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:06.822111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:06.832648 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:06.837654 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c54a1022-add6-47b0-91ae-b351e861ba45 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 1.817521 Jul 01 10:43:06.841308 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1926/3954] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:05 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:07.408981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:07.410333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:07.420476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:07.423885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:07.426025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:07.429775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:07.453101 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:07.468749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 HTTP/1.1 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7'} Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:07.473505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:07.482674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:07.482674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:07.482674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:07.482674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:07.482674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:43:07.482674 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:07.484188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:07.486965 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-63f9ec70-00fa-4664-971b-379f7c1a25c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 404 len: 111 microversion: 2.1 time: 0.083246 Jul 01 10:43:07.492377 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2029/3955] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:07 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:43:07.498133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:07.498723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:07.522191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:07.522736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:07.523711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:07.528025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:07.659892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:43:07.858255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:07.859454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:07.875947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:07.878795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:07.881437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:07.881437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:08.284301 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f7eb5c6-48fc-4392-a290-822adf6f5163 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 204 len: 0 microversion: 2.1 time: 0.790433 Jul 01 10:43:08.285259 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1927/3956] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:43:07 2022] DELETE /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:43:08.304910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:08.305657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:08.336228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:08.336706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:08.341054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:08.345446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:08.452571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:08.467344 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c55525ae-272e-44a4-a2d1-0b129e450702 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.613367 Jul 01 10:43:08.468564 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2030/3957] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:07 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:09.205136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:09.216716 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b9e7a30-2623-444e-93a9-f8be0b336e09 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1496 microversion: 2.1 time: 0.917294 Jul 01 10:43:09.217779 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1928/3958] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:08 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1496 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:09.483980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:09.485592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:09.511874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:09.511874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:09.511874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:09.511874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:10.143028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:10.151713 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d060cb30-8388-49f2-ae08-33b73b76f483 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.671563 Jul 01 10:43:10.160806 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2031/3959] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:09 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:10.240448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:10.247533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:10.267389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:10.275681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:10.277726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:10.279238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:10.782667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:10.791657 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc94eec1-c11c-4d8d-ad68-df139d732d76 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1496 microversion: 2.1 time: 0.555274 Jul 01 10:43:10.798141 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1929/3960] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:10 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1496 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:10.911622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-24b806a7-cc59-4acb-8741-703f7c31330c req-5d2988ee-91d4-4daa-88b9-e3d7985f80c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e826f-87c6-4c86-beef-55e82abae372", "name": "network-vif-unplugged", "status": "completed", "tag": "e18171f3-347d-4856-94e0-51a4475176b8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:10.931330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-24b806a7-cc59-4acb-8741-703f7c31330c req-5d2988ee-91d4-4daa-88b9-e3d7985f80c2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:10.933072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-24b806a7-cc59-4acb-8741-703f7c31330c req-5d2988ee-91d4-4daa-88b9-e3d7985f80c2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:10.955528 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-24b806a7-cc59-4acb-8741-703f7c31330c req-5d2988ee-91d4-4daa-88b9-e3d7985f80c2 service nova] Creating event network-vif-unplugged:e18171f3-347d-4856-94e0-51a4475176b8 for instance a47e826f-87c6-4c86-beef-55e82abae372 on n-h1-master-1 Jul 01 10:43:10.964767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-24b806a7-cc59-4acb-8741-703f7c31330c req-5d2988ee-91d4-4daa-88b9-e3d7985f80c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057288 Jul 01 10:43:10.965617 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2032/3961] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:11.178381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:11.179583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:11.191142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:11.191618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:11.192367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:11.192796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:11.500800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ea9ebae1-46d0-4412-9908-813171716701 req-21b2385f-fd91-4faf-b0b4-9189524937a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9542320-9b9a-42dc-952e-2147380c8fbd", "name": "network-vif-deleted", "tag": "0e49db62-c56c-4b22-a813-c6af0619af6b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:11.516371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ea9ebae1-46d0-4412-9908-813171716701 req-21b2385f-fd91-4faf-b0b4-9189524937a8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:11.524616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ea9ebae1-46d0-4412-9908-813171716701 req-21b2385f-fd91-4faf-b0b4-9189524937a8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:11.551464 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ea9ebae1-46d0-4412-9908-813171716701 req-21b2385f-fd91-4faf-b0b4-9189524937a8 service nova] Creating event network-vif-deleted:0e49db62-c56c-4b22-a813-c6af0619af6b for instance f9542320-9b9a-42dc-952e-2147380c8fbd on n-h1-master-1 Jul 01 10:43:11.562514 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ea9ebae1-46d0-4412-9908-813171716701 req-21b2385f-fd91-4faf-b0b4-9189524937a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066220 Jul 01 10:43:11.565170 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2033/3962] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:11.816687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:11.817587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:11.832926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:11.840135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:11.841615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:11.846637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:12.581601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:12.591918 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11fe5dd6-6f17-4b8e-918e-baa2221bb283 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 200 len: 1293 microversion: 2.1 time: 0.777930 Jul 01 10:43:12.592549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2034/3963] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:11 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 1293 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:13.264065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:13.283755 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5eb38db8-55e8-4785-8c75-9fa2a3b920bf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 2.106086 Jul 01 10:43:13.287374 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1930/3964] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:11 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:13.459198 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-755469082", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "71d41e2f-808e-4884-b791-1f2509078158"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:13.530288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] validate_networks() for [('71d41e2f-808e-4884-b791-1f2509078158', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:43:13.609607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:13.610513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:13.618450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:13.623938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:13.631749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:13.631749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:13.660379 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd HTTP/1.1 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: exception: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'f9542320-9b9a-42dc-952e-2147380c8fbd'} Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:13.663416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:13.672997 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:13.672997 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:13.672997 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:13.672997 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:13.672997 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:43:13.672997 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:13.676975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:13.676975 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-df2e6d5f-2381-4728-822c-5b61df0ebc1e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 404 len: 111 microversion: 2.1 time: 0.069942 Jul 01 10:43:13.683656 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1931/3965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:13 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:43:13.865516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1160402152", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "9025d00e-6ad8-47ef-80bc-484168809931"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:13.931625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:43:16.385791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:43:16.385791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:43:16.385791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:43:16.385791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:43:16.385791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:43:16.385791 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:16.404927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:16.410909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:16.410909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:16.410909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:16.459459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Getting quotas for project 54f5a466fd584a4fa942be7ad9254fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:43:16.470234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Getting quotas for user 9ab94891ca6f4f63994bd7083e092da0 and project 54f5a466fd584a4fa942be7ad9254fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:43:16.487747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:43:16.490629 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:43:16.679857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ff13ac33-8078-4186-8eed-0b47525ea53a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.367849 Jul 01 10:43:16.684066 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2035/3966] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:43:16.697122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:16.698173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:16.719012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:16.719902 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:16.723168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:16.726851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:16.878762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:43:16.879282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:43:16.879816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:43:16.880393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:43:16.880912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:43:16.892996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:16.894077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:16.895833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:16.896354 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:16.939521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:43:16.966659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:43:16.998330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:43:17.004398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:43:17.290528 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-37f2858c-553c-429b-a6a1-b1aeb64c4397 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.429820 Jul 01 10:43:17.300981 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1932/3967] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:43:17.312605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52a1c41b-eed6-48d9-a2e6-f9a418ef460a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:17.315003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-52a1c41b-eed6-48d9-a2e6-f9a418ef460a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:17.504667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52a1c41b-eed6-48d9-a2e6-f9a418ef460a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:17.518461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52a1c41b-eed6-48d9-a2e6-f9a418ef460a tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1224 microversion: 2.1 time: 0.216023 Jul 01 10:43:17.547973 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1933/3968] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:17 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1224 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:17.550292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bbf19446-b12d-4ca8-ae28-b0568603b3d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:17.552622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bbf19446-b12d-4ca8-ae28-b0568603b3d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:18.538999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:18.548088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-16ca07a0-a86a-4007-b72d-853a0b01fecf tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 1.862671 Jul 01 10:43:18.550311 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2036/3969] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:16 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:18.592151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:18.593135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:18.608200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:18.610653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:18.611919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:18.612636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:18.773702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bbf19446-b12d-4ca8-ae28-b0568603b3d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:18.796962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bbf19446-b12d-4ca8-ae28-b0568603b3d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1209 microversion: 2.1 time: 1.263156 Jul 01 10:43:18.799568 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1934/3970] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:17 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1209 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:18.862203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:18.880764 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b756f8d-1063-44ef-b413-5a05d92b6497 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1228 microversion: 2.1 time: 0.316740 Jul 01 10:43:18.885880 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2037/3971] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:18 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1228 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:19.566583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:19.568354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:19.586433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:19.586889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:19.587673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:19.588292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:19.817452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:19.819405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:19.829507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:19.830351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:19.832700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:19.833744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:20.080843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:20.099539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-189c128c-997f-413c-8331-6345d1cce809 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1205 microversion: 2.1 time: 0.279528 Jul 01 10:43:20.101346 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2038/3972] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:19 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1205 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:20.107986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:20.108600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:20.125088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:20.131346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:20.132477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:20.132929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:20.343476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:20.361164 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-47f4f267-ad8f-48fd-a66d-239c40647b68 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1276 microversion: 2.1 time: 0.256756 Jul 01 10:43:20.361891 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2039/3973] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:20 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:20.462785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:20.504902 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8aecfeb3-3e62-4bed-b208-8d2dc746ee54 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 0.940285 Jul 01 10:43:20.505841 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1935/3974] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:19 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:21.137704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:21.137704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:21.156818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:21.163500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:21.163500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:21.163500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:21.355060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:21.366743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cac1af77-6cc0-499a-871d-1e00386990bd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1269 microversion: 2.1 time: 0.251563 Jul 01 10:43:21.370060 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2040/3975] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:21 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1269 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:21.380460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:21.381063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:21.398524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:21.399043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:21.403615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:21.404104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:21.524491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:21.525879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:21.539032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:21.540396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:21.549904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:21.549904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:22.021270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:22.034030 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3813c543-d07d-4ab5-9572-fb2e40d019fb tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1282 microversion: 2.1 time: 0.657998 Jul 01 10:43:22.035191 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1936/3976] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:21 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1282 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:22.385914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:22.386724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:22.402493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:22.404899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:22.405759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:22.409299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:22.722132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:22.741792 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b64c555-21d4-4c5c-869e-b7de6b918008 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1267 microversion: 2.1 time: 0.361743 Jul 01 10:43:22.753613 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1937/3977] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:22 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1267 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:22.951476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:22.963825 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bb0f477d-e1fa-44c6-88c2-58d61606f939 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1391 microversion: 2.1 time: 1.445441 Jul 01 10:43:22.970734 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2041/3978] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:21 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1391 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:23.052572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:23.054291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:23.065552 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:23.067150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:23.070386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:23.072625 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:23.357893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:23.370414 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-458857ed-ddd5-4ebb-8ace-3daf1bf5d2a3 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1282 microversion: 2.1 time: 0.322420 Jul 01 10:43:23.371759 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1938/3979] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:23 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1282 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:23.762052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:23.762680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:23.780905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:23.781386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:23.790355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:23.791206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:23.987981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:23.988871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:23.998612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:23.999576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:24.000590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:24.001088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:24.514068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:24.537086 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7721dcae-1c30-4e94-a37c-6c56a2214bdf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 0.781140 Jul 01 10:43:24.538837 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2042/3980] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:23 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:24.553059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:24.554275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:24.563562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:24.564029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:24.564979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:24.565500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:24.653389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:24.663855 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35ec6dca-9a6a-4e30-93e2-51390c9f45bb tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1381 microversion: 2.1 time: 0.680063 Jul 01 10:43:24.682447 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1939/3981] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:23 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1381 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:24.701162 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08f8cc33-27a1-4c48-a416-fc8d097c2385 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '.version_select at 0x7f6f907879d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:24.706534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08f8cc33-27a1-4c48-a416-fc8d097c2385 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:24.711030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08f8cc33-27a1-4c48-a416-fc8d097c2385 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:24.742677 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-08f8cc33-27a1-4c48-a416-fc8d097c2385 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.055861 Jul 01 10:43:24.760071 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1940/3982] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 10:43:24 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:24.772860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74e68825-efc3-483d-a48e-bae173223e54 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:24.774946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-74e68825-efc3-483d-a48e-bae173223e54 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:24.783518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74e68825-efc3-483d-a48e-bae173223e54 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:24.784244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74e68825-efc3-483d-a48e-bae173223e54 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:24.792958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74e68825-efc3-483d-a48e-bae173223e54 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:24.793717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74e68825-efc3-483d-a48e-bae173223e54 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:24.997418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:25.007888 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6407c619-739a-43d2-8bc8-33ee02bd5ef7 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.465122 Jul 01 10:43:25.008490 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2043/3983] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:24 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:25.563822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:25.566190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:25.580630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:25.581093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:25.583284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:25.583739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:26.049736 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74e68825-efc3-483d-a48e-bae173223e54 tempest-LiveMigrationTest-141603254 tempest-LiveMigrationTest-141603254-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1532 microversion: 2.1 time: 1.281070 Jul 01 10:43:26.050329 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1941/3984] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:24 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1532 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:26.083601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:26.085106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:26.095426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:26.097719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:26.103108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:26.103947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:26.409596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:26.419505 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-83f8e78d-d8c5-4785-a6bb-bd84e508689a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 0.867226 Jul 01 10:43:26.420103 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2044/3985] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:25 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:26.437926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:26.442959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:26.443767 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:26.446440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:26.446895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:26.447690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:26.448139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:26.480933 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:26.486474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:43:26.675326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:26.696019 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0779aef4-1999-4f07-a94e-8056f8faf061 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.628615 Jul 01 10:43:26.700462 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1942/3986] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:26 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:26.911592 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-42e5fe39-f95b-48ac-98ff-e68efd16b58a tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 204 len: 0 microversion: 2.1 time: 0.490026 Jul 01 10:43:26.913854 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2045/3987] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:43:26 2022] DELETE /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:43:26.923090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:26.923955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:26.934804 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:26.939013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:26.939598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:26.941769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:26.943544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:27.439466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:27.440182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:27.453035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:27.453512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:27.457375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:27.457835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:27.493767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:27.503476 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-664f10ea-2f4a-46e5-a7a6-a1c85b3441ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1387 microversion: 2.1 time: 0.584193 Jul 01 10:43:27.507289 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1943/3988] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:26 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1387 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:27.610295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7e783383-da55-45b4-9005-e1d17a9fc6cb req-a07098f4-318f-4e35-9b12-d0d17a944473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac4fd96-1f2a-4f2d-86d4-e2eeb2479505", "tag": "9fa3394f-6197-4052-8938-a7393e15cbc1"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:27.626269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7e783383-da55-45b4-9005-e1d17a9fc6cb req-a07098f4-318f-4e35-9b12-d0d17a944473 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:27.626657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7e783383-da55-45b4-9005-e1d17a9fc6cb req-a07098f4-318f-4e35-9b12-d0d17a944473 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:27.675118 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7e783383-da55-45b4-9005-e1d17a9fc6cb req-a07098f4-318f-4e35-9b12-d0d17a944473 service nova] Creating event network-changed:9fa3394f-6197-4052-8938-a7393e15cbc1 for instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 on n-h2-master-1 Jul 01 10:43:27.698810 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7e783383-da55-45b4-9005-e1d17a9fc6cb req-a07098f4-318f-4e35-9b12-d0d17a944473 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092061 Jul 01 10:43:27.704490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1944/3989] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:43:27.715991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:27.716713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:27.732447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:27.732912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:27.742553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:27.742553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:28.171656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:28.184972 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:28.184972 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1291099-f9b2-443f-8c60-25307d1e8dbf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 0.752112 Jul 01 10:43:28.196670 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2046/3990] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:27 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:28.497557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:28.508645 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6465f2a3-feef-4c69-b455-82d955a2c648 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.796824 Jul 01 10:43:28.513794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1945/3991] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:27 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:28.518195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-830174067", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:28.526913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:28.526913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:28.539871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:28.543649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:28.543649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:28.543649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:28.592920 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:28.598158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] validate_networks() for [('81cfd39e-e91b-47c9-9811-e1b5b0a1bd44', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:43:28.790224 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:29.644774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:29.669208 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5eb38c97-dc4b-41e2-8fb9-08c85f448c4b tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1387 microversion: 2.1 time: 1.151199 Jul 01 10:43:29.675685 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1946/3992] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:28 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1387 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:29.686335 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f1796f31-a36e-4701-b2ea-54baf6684689 req-1fc3a8ed-0e82-45cb-88de-7650614bf194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cdb63d-950d-4a38-b08a-8412f29a41b7", "tag": "1571dc8e-ca35-4f71-884e-7de8edfcabb5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:29.705549 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:29.709328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f1796f31-a36e-4701-b2ea-54baf6684689 req-1fc3a8ed-0e82-45cb-88de-7650614bf194 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:29.712165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f1796f31-a36e-4701-b2ea-54baf6684689 req-1fc3a8ed-0e82-45cb-88de-7650614bf194 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:29.775055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f1796f31-a36e-4701-b2ea-54baf6684689 req-1fc3a8ed-0e82-45cb-88de-7650614bf194 service nova] Creating event network-changed:1571dc8e-ca35-4f71-884e-7de8edfcabb5 for instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 on n-h2-master-1 Jul 01 10:43:29.791435 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f1796f31-a36e-4701-b2ea-54baf6684689 req-1fc3a8ed-0e82-45cb-88de-7650614bf194 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114129 Jul 01 10:43:29.794490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1947/3993] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:29.816827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:29.821546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:29.836584 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:29.837053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:29.840762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:29.841280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.254445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:43:31.255883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:43:31.257982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:43:31.258668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:43:31.259341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:43:31.280004 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:31.284695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.288882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:31.289693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.315307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for project 86ca97adc659431ea83b0703369d0c50. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:43:31.323174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for user 2979fb250468450aa9ba8a032a4ab90f and project 86ca97adc659431ea83b0703369d0c50. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:43:31.351982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:43:31.355222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:43:31.381159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:31.392490 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42ec61f4-6fd7-42af-bd5a-e506bab8c826 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 1.594486 Jul 01 10:43:31.397828 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1948/3994] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:29 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:31.414824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:31.417431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:31.434672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:31.437575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.437575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:31.438867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.613613 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eaf6751b-af59-4de4-92c1-36b504059c1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.336886 Jul 01 10:43:31.619562 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2047/3995] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:43:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:43:31.625953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ce7a2672-2ac7-4258-bde2-7ae8b6065c62 req-ee570c5a-dc60-4bdd-a071-eb16a43297ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e826f-87c6-4c86-beef-55e82abae372", "name": "network-vif-deleted", "tag": "e18171f3-347d-4856-94e0-51a4475176b8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:31.688589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ce7a2672-2ac7-4258-bde2-7ae8b6065c62 req-ee570c5a-dc60-4bdd-a071-eb16a43297ef service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:31.689056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ce7a2672-2ac7-4258-bde2-7ae8b6065c62 req-ee570c5a-dc60-4bdd-a071-eb16a43297ef service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.731174 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ce7a2672-2ac7-4258-bde2-7ae8b6065c62 req-ee570c5a-dc60-4bdd-a071-eb16a43297ef service nova] Creating event network-vif-deleted:e18171f3-347d-4856-94e0-51a4475176b8 for instance a47e826f-87c6-4c86-beef-55e82abae372 on n-h2-master-1 Jul 01 10:43:31.739551 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ce7a2672-2ac7-4258-bde2-7ae8b6065c62 req-ee570c5a-dc60-4bdd-a071-eb16a43297ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118318 Jul 01 10:43:31.740795 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2048/3996] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:31.747548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:31.748591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:31.770103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:31.771535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.775950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:31.777646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:31.967401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:31.978684 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f08b0419-3cd0-4a94-9631-5fc3ee69cb0c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1184 microversion: 2.1 time: 0.236217 Jul 01 10:43:31.983825 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2049/3997] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:31 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1184 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:31.994761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b86cc090-159b-4284-88e9-6ec1016c9ddf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:31.995488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b86cc090-159b-4284-88e9-6ec1016c9ddf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:32.085676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:32.096111 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82935af0-2244-421c-81ee-da85084245ad tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.696719 Jul 01 10:43:32.101551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1949/3998] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:31 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:32.185350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b86cc090-159b-4284-88e9-6ec1016c9ddf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:32.197897 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b86cc090-159b-4284-88e9-6ec1016c9ddf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1221 microversion: 2.1 time: 0.212614 Jul 01 10:43:32.198641 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2050/3999] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:31 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:32.416327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-538871826", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:32.419977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:32.421462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:32.439248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:32.440177 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:32.441288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:32.446413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:32.576970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] validate_networks() for [('81cfd39e-e91b-47c9-9811-e1b5b0a1bd44', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:43:32.970720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:32.985693 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3e20e26-d5ba-428d-aa86-6f6e8b84e5a5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 0.575882 Jul 01 10:43:32.987286 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1950/4000] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:32 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:33.003208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:33.004289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:33.028597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:33.028597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:33.028597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:33.028597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:33.141376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:33.164086 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d679b4f-6145-4e66-a2c7-f54d2d048b5c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1184 microversion: 2.1 time: 0.165421 Jul 01 10:43:33.167397 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1951/4001] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:32 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1184 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:33.178905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:33.180138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:33.187116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:33.187892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:33.188913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:33.189599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:33.506059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:43:33.507406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:43:33.507904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:43:33.510864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:43:33.511345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:43:33.532364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:33.533392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:33.534214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:33.538152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:33.682506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for project 86ca97adc659431ea83b0703369d0c50. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:43:33.688998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:33.716665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for user 2979fb250468450aa9ba8a032a4ab90f and project 86ca97adc659431ea83b0703369d0c50. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:43:33.718838 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9fb93b79-b91b-499f-9ae5-de3d81046f11 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.539565 Jul 01 10:43:33.725259 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1952/4002] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:33 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:33.769132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:43:33.773168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:43:33.971398 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-681cd04b-f035-42e7-8ade-850eae7e0eae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.559202 Jul 01 10:43:33.976004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2051/4003] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:43:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:43:33.989535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a1b338b-7058-4706-a6aa-55ca3695ec51 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:33.989535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6a1b338b-7058-4706-a6aa-55ca3695ec51 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:34.004701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:34.005348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:34.017768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:34.018347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:34.019166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:34.024068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:34.088926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a1b338b-7058-4706-a6aa-55ca3695ec51 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:34.096301 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a1b338b-7058-4706-a6aa-55ca3695ec51 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1221 microversion: 2.1 time: 0.114398 Jul 01 10:43:34.096894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1953/4004] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:33 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:34.186046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:34.186046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:34.196546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:34.197449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:34.198509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:34.199073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:34.342752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:34.352297 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e749bb57-0e67-4f09-9eae-e49767d240a0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 0.351285 Jul 01 10:43:34.357046 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2052/4005] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:33 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:34.378585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:34.387713 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03e81848-6c47-4bae-8a7b-e94872c929c8 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1184 microversion: 2.1 time: 0.207192 Jul 01 10:43:34.393190 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1954/4006] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:34 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1184 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:34.742660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:34.743892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:34.755245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:34.757263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:34.763003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:34.763816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:35.114115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c9d2451-4d49-47f1-9c4a-ec22ba73fb55 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:35.115207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c9d2451-4d49-47f1-9c4a-ec22ba73fb55 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:35.239045 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c9d2451-4d49-47f1-9c4a-ec22ba73fb55 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:35.248516 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c9d2451-4d49-47f1-9c4a-ec22ba73fb55 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1221 microversion: 2.1 time: 0.138477 Jul 01 10:43:35.249478 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1955/4007] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:35 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:35.372520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:35.373521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:35.382875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:35.383703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:35.384709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:35.385417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:35.401231 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:35.415657 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-59a26475-827c-4012-85ac-6aa3c2e8fc54 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.677591 Jul 01 10:43:35.416572 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2053/4008] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:34 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:35.421100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:35.421732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:35.429328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:35.430135 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:35.431143 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:35.431803 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:35.686113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:35.709816 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08a59d7f-2f7c-4704-85d6-5db4f7b982ba tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1184 microversion: 2.1 time: 0.291582 Jul 01 10:43:35.718418 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2054/4009] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:35 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1184 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:36.268953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:36.270851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:36.285792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:36.289831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:36.291126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:36.293243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:36.918216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:36.926952 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-023ead86-4a6f-4bb4-b829-7627dcccc657 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 1.558172 Jul 01 10:43:36.932373 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1956/4010] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:35 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:36.941523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:36.945189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:36.960866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:36.961344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:36.962431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:36.962866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:37.023578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:37.032903 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d88b705d-7ca0-4a95-9a3b-71e616c82b91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1225 microversion: 2.1 time: 0.769542 Jul 01 10:43:37.038370 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2055/4011] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:36 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1225 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:37.053727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:37.053727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:37.063523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:37.064734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:37.066922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:37.067717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:37.372638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:37.384831 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-790d6266-b0bf-4153-8255-80d9b3b392f0 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1184 microversion: 2.1 time: 0.344869 Jul 01 10:43:37.395353 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2056/4012] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:37 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1184 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:37.556852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:37.576219 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eae1e901-b78b-43bf-bffa-78917bc2db59 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.641891 Jul 01 10:43:37.579435 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1957/4013] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:36 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:37.949990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:37.951118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:37.962789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:37.963629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:37.965066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:37.969906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.058289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:38.059589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:38.081817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.081817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.081817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.089415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.335306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:38.346264 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef436aac-d57d-4ba7-a0cf-83dbdd34eee3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1279 microversion: 2.1 time: 0.294160 Jul 01 10:43:38.348212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1958/4014] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:38 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:38.508681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:38.520736 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d2d06e3c-4fc0-4dd9-8bdc-95bbe99ad40c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 0.575507 Jul 01 10:43:38.524718 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2057/4015] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:37 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:38.543376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:38.544721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:38.557712 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.558490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.560353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.560808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.668718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:38.677132 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b4962ca-20e1-422d-a04c-590b79de56ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1184 microversion: 2.1 time: 0.151317 Jul 01 10:43:38.677799 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2058/4016] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:38 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1184 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:38.711508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9a02870b-40ec-4565-b386-ea89e0c506cf req-e76f85ff-5b19-4984-9d91-ed20dc92bd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdb63d-950d-4a38-b08a-8412f29a41b7", "name": "network-vif-plugged", "status": "completed", "tag": "1571dc8e-ca35-4f71-884e-7de8edfcabb5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:38.747260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9a02870b-40ec-4565-b386-ea89e0c506cf req-e76f85ff-5b19-4984-9d91-ed20dc92bd43 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.751700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9a02870b-40ec-4565-b386-ea89e0c506cf req-e76f85ff-5b19-4984-9d91-ed20dc92bd43 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.792478 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9a02870b-40ec-4565-b386-ea89e0c506cf req-e76f85ff-5b19-4984-9d91-ed20dc92bd43 service nova] Creating event network-vif-plugged:1571dc8e-ca35-4f71-884e-7de8edfcabb5 for instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 on n-h2-master-1 Jul 01 10:43:38.824629 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9a02870b-40ec-4565-b386-ea89e0c506cf req-e76f85ff-5b19-4984-9d91-ed20dc92bd43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142366 Jul 01 10:43:38.827489 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2059/4017] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:38.846840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:38.846840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:38.861327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.862104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.863094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.874556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.904716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] Calling method '.version_select at 0x7f6f90787ee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:38.905858 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:43:38.905858 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:43:38.907380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.908002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:38.964984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:38.968308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.005093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.008723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.027762 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-60db773a-0450-455a-82f2-6f301a505c8a tempest-PortsAdminExtendedAttrsTestJSON-54424499 tempest-PortsAdminExtendedAttrsTestJSON-54424499-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.677691 Jul 01 10:43:39.031344 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1959/4018] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:43:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:39.364642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:39.366036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:39.375984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.379472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.382295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.383599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.482066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:39.492565 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9117f5fe-c37e-4e19-82d2-73daf6df51f1 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.662423 Jul 01 10:43:39.500363 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2060/4019] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:38 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:39.540067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:39.540689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:39.551340 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:39.553527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.553986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.554775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.555220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.590246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:39.603988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35aa1177-bf95-4656-9d5b-0c69ebd22f4b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1279 microversion: 2.1 time: 0.238259 Jul 01 10:43:39.605091 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1960/4020] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:39 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:39.695830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:39.696867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:39.706670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.711121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.711121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.711121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.795030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:39.795599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:39.796130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lazy-loading 'fault' on Instance uuid a47e826f-87c6-4c86-beef-55e82abae372 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:43:40.087945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:40.095779 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad6fe647-842e-49fd-9cca-234f4d301d08 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 200 len: 1189 microversion: 2.1 time: 0.405276 Jul 01 10:43:40.096364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1961/4021] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:39 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 1189 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:40.289786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:40.299200 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb9c91b7-b940-4e54-a34b-a0ba05ece91e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 0.763151 Jul 01 10:43:40.301392 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2061/4022] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:39 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:40.516499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:40.518630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:40.534832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:40.534832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:40.534832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:40.534832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:40.622763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:40.623924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:40.635556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:40.636338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:40.637865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:40.638627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:41.042511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:41.053323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c711cd8d-5669-4b77-ae19-aca236cb18ea tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1321 microversion: 2.1 time: 0.435497 Jul 01 10:43:41.064728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2062/4023] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:40 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:41.074116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:41.075581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-65efcc99-5474-4fa1-bde2-be3790e36720 req-438a6eb6-199f-4d3a-a2cc-cef981667614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac4fd96-1f2a-4f2d-86d4-e2eeb2479505", "name": "network-vif-plugged", "status": "completed", "tag": "9fa3394f-6197-4052-8938-a7393e15cbc1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:41.086800 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77fbe989-6b5a-4e60-be76-7799f5bc73fc tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1324 microversion: 2.1 time: 0.571984 Jul 01 10:43:41.094564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-65efcc99-5474-4fa1-bde2-be3790e36720 req-438a6eb6-199f-4d3a-a2cc-cef981667614 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:41.097749 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1962/4024] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:40 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:41.101919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-65efcc99-5474-4fa1-bde2-be3790e36720 req-438a6eb6-199f-4d3a-a2cc-cef981667614 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:41.123697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:41.124632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: a47e826f-87c6-4c86-beef-55e82abae372] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:41.124942 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-65efcc99-5474-4fa1-bde2-be3790e36720 req-438a6eb6-199f-4d3a-a2cc-cef981667614 service nova] Creating event network-vif-plugged:9fa3394f-6197-4052-8938-a7393e15cbc1 for instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 on n-h2-master-1 Jul 01 10:43:41.134141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:41.138301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:41.138301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:41.138301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:41.139350 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-65efcc99-5474-4fa1-bde2-be3790e36720 req-438a6eb6-199f-4d3a-a2cc-cef981667614 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070814 Jul 01 10:43:41.141885 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2063/4025] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:41.170596 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] HTTP exception thrown: Instance a47e826f-87c6-4c86-beef-55e82abae372 could not be found. Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Request method failure captured: Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 HTTP/1.1 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs46XmVWDjcgrJ6UqEs-I3-FiWLrigPp-A8_uVw5M7yiZxxx-NR34_rbHBYzvh4J2if_dpONuaiYNab1Kt3za5p77VnJ4lnQ5P4B7aAlp3u3AQwsSYoPOmzKR0YiE0uCfN05YTPLDQYk0Ja6dIoIq_TB7FAPJVZYdXIariByecPCYM4 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d91a3501ad3469f8dbafaa816b883d0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveMigrationTest-989202008 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveMigrationTest-989202008-project Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: e3ce54f4c29540dc8f7077c2717f6451 Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveMigrationTest-989202008-project Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: exception: Instance a47e826f-87c6-4c86-beef-55e82abae372 could not be found. Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'a47e826f-87c6-4c86-beef-55e82abae372'} Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47e826f-87c6-4c86-beef-55e82abae372 could not be found. Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47e826f-87c6-4c86-beef-55e82abae372 could not be found. Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:41.172360 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47e826f-87c6-4c86-beef-55e82abae372 could not be found. Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Returning 404 to user: Instance a47e826f-87c6-4c86-beef-55e82abae372 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa92f8b9-d2cd-45f7-b2ea-9bc0aebf212d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372" status: 404 len: 111 microversion: 2.1 time: 0.060514 Jul 01 10:43:41.178731 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1963/4026] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:41 2022] GET /compute/v2.1/servers/a47e826f-87c6-4c86-beef-55e82abae372 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:43:41.318893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:41.319989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:41.341307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:41.343178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:41.344264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:41.347769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:42.073608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:42.075125 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:42.084035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:42.089937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:42.091406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:42.094218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:42.975336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:42.990196 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d4e0ca6-bcfa-419e-bff2-e283fabbd1d1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1309 microversion: 2.1 time: 1.675438 Jul 01 10:43:42.992137 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2064/4027] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:41 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1309 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:43.007048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:43.008267 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:43.019612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:43.024014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:43.024014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:43.024014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:43.464942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:43.482556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0bed2cda-2b3f-46f7-87ba-900802528639 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1321 microversion: 2.1 time: 1.408914 Jul 01 10:43:43.487282 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1964/4028] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:42 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1321 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:43.503314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5befb08c-3db7-4960-a5de-d4d0c05083de req-552f93da-c6db-43ce-8797-f76390d4b093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904d49ed-eae4-4e0e-b31b-1172222ced70", "tag": "c360d821-bd19-4829-8b88-75b13071c99e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:43.545654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5befb08c-3db7-4960-a5de-d4d0c05083de req-552f93da-c6db-43ce-8797-f76390d4b093 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:43.557634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5befb08c-3db7-4960-a5de-d4d0c05083de req-552f93da-c6db-43ce-8797-f76390d4b093 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:43.572165 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5befb08c-3db7-4960-a5de-d4d0c05083de req-552f93da-c6db-43ce-8797-f76390d4b093 service nova] Creating event network-changed:c360d821-bd19-4829-8b88-75b13071c99e for instance 904d49ed-eae4-4e0e-b31b-1172222ced70 on n-h1-master-1 Jul 01 10:43:43.583318 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5befb08c-3db7-4960-a5de-d4d0c05083de req-552f93da-c6db-43ce-8797-f76390d4b093 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091805 Jul 01 10:43:43.583318 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1965/4029] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:43.661656 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:43.750215 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=14 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:43.907016 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:43.940261 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a7322313-5e95-4421-8c81-ad9a5c8b0d01 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1521 microversion: 2.1 time: 0.946887 Jul 01 10:43:43.940839 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2065/4030] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:42 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1521 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:43.959706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:43.960627 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:43.968808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:43.969485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:43.970587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:43.971241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:43.998893 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] HTTP exception thrown: Instance is not a member of specified network Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Request method failure captured: Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7/ips/invalid HTTP/1.1 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_BpXqGJEVsOCB_xUaBe4MbGXbD1ljR0EiEWTAbVO6kpabQsyVwXxQpw1PPy-lUuWjVMES-o3mdCO8Bkh-R9c1YM3TyJ_sDBaMCP8gQCyugtYYJgkrdtS--9JeHPpK21V5WghL_ZiL4iEYAY7uKrlhuVa3OhcfPnsDX2tHMgkO6qZ0 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 54f5a466fd584a4fa942be7ad9254fb6 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54f5a466fd584a4fa942be7ad9254fb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 54f5a466fd584a4fa942be7ad9254fb6 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerAddressesNegativeTestJSON-2000303853-project Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9ab94891ca6f4f63994bd7083e092da0 Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2000303853-project Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: exception: Instance is not a member of specified network Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '16cdb63d-950d-4a38-b08a-8412f29a41b7', 'id': 'invalid'} Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 01 10:43:44.006161 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.015042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:44.015137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:44.015925 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-397142e3-2dfa-487d-83a8-fb0eb5c4ac2e tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.054499 Jul 01 10:43:44.015925 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1966/4031] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:43:43 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7/ips/invalid => generated 91 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:43:44.016445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:44.022099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.025791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.028173 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2498f950-7cc5-4ba9-b849-997a499397d6 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:44.028910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.029410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.029901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2498f950-7cc5-4ba9-b849-997a499397d6 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Failed to fetch instance by id 999 {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 01 10:43:44.030820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2498f950-7cc5-4ba9-b849-997a499397d6 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] HTTP exception thrown: Instance 999 could not be found. Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2498f950-7cc5-4ba9-b849-997a499397d6 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Request method failure captured: Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_BpXqGJEVsOCB_xUaBe4MbGXbD1ljR0EiEWTAbVO6kpabQsyVwXxQpw1PPy-lUuWjVMES-o3mdCO8Bkh-R9c1YM3TyJ_sDBaMCP8gQCyugtYYJgkrdtS--9JeHPpK21V5WghL_ZiL4iEYAY7uKrlhuVa3OhcfPnsDX2tHMgkO6qZ0 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 54f5a466fd584a4fa942be7ad9254fb6 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54f5a466fd584a4fa942be7ad9254fb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 54f5a466fd584a4fa942be7ad9254fb6 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerAddressesNegativeTestJSON-2000303853-project Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9ab94891ca6f4f63994bd7083e092da0 Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2000303853-project Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 999 could not be found. Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '999'} Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 01 10:43:44.033913 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:43:44.046047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2498f950-7cc5-4ba9-b849-997a499397d6 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:44.047209 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2498f950-7cc5-4ba9-b849-997a499397d6 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.029167 Jul 01 10:43:44.051455 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1967/4032] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:43:44 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:43:44.061746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:44.063723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:44.088359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.089371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.090868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.094365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.156934 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:44.170599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:43:44.678872 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3583d44-5d3e-4dc2-ace7-0f4d7db3e959 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "DELETE /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 204 len: 0 microversion: 2.1 time: 0.623351 Jul 01 10:43:44.683843 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1968/4033] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:43:44 2022] DELETE /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:43:44.690726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-40a347de-fb5c-43b9-b0ff-cc9bb43a8510 req-a0a9a39d-e5c6-44dc-b50d-8f4cd34f0bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e86e169-88e7-4094-9f19-014a424b87d6", "tag": "bbf841da-6bf8-441a-b482-7bd94085c086"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:44.714560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-40a347de-fb5c-43b9-b0ff-cc9bb43a8510 req-a0a9a39d-e5c6-44dc-b50d-8f4cd34f0bfd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.714998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-40a347de-fb5c-43b9-b0ff-cc9bb43a8510 req-a0a9a39d-e5c6-44dc-b50d-8f4cd34f0bfd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.748517 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-40a347de-fb5c-43b9-b0ff-cc9bb43a8510 req-a0a9a39d-e5c6-44dc-b50d-8f4cd34f0bfd service nova] Creating event network-changed:bbf841da-6bf8-441a-b482-7bd94085c086 for instance 3e86e169-88e7-4094-9f19-014a424b87d6 on n-h1-master-1 Jul 01 10:43:44.754043 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-40a347de-fb5c-43b9-b0ff-cc9bb43a8510 req-a0a9a39d-e5c6-44dc-b50d-8f4cd34f0bfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068618 Jul 01 10:43:44.754935 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1969/4034] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:44.761053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:44.761778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:44.768404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.768854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.769828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.770262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.797903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:44.826202 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d37e592d-982e-4d34-90cd-cbc7049b16ca tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1490 microversion: 2.1 time: 0.823360 Jul 01 10:43:44.827202 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2066/4035] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:44 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1490 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:44.834644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:44.835411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:44.851335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.852801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:44.853737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:44.854387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:45.186037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:45.196101 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd5f4ff6-6d80-4d4c-b53d-3ef29dc87458 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1321 microversion: 2.1 time: 0.438995 Jul 01 10:43:45.205282 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1970/4036] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:44 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:45.211116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3533a75c-00e8-4804-a921-5a4a2d9099ab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:45.215677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3533a75c-00e8-4804-a921-5a4a2d9099ab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:45.233798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3533a75c-00e8-4804-a921-5a4a2d9099ab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:45.234429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3533a75c-00e8-4804-a921-5a4a2d9099ab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:45.235280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3533a75c-00e8-4804-a921-5a4a2d9099ab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:45.235843 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3533a75c-00e8-4804-a921-5a4a2d9099ab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:45.254908 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:45.303562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:45.308224 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:45.312909 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-89cd55ba-6ef3-4a72-b0a2-19013ef26937 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1527 microversion: 2.1 time: 0.484651 Jul 01 10:43:45.331132 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2067/4037] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:44 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1527 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:45.449234 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3533a75c-00e8-4804-a921-5a4a2d9099ab tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "PUT /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1085 microversion: 2.1 time: 0.242535 Jul 01 10:43:45.450530 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1971/4038] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:43:45 2022] PUT /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1085 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:45.466883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:45.469169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:45.475322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:45.476080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:45.476982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:45.477570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:46.129869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:46.144739 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1bb8a2b1-c291-4a43-ac45-ff1b5227c57f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1511 microversion: 2.1 time: 0.677979 Jul 01 10:43:46.144739 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2068/4039] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:45 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1511 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:46.160828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:46.161474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:46.181647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:46.182390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:46.183710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:46.186908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:46.221546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:46.222504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:46.235288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:46.235885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:46.236740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:46.237213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:46.943038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:46.969746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-333cc20c-1476-43cc-926d-2e37598fed47 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1511 microversion: 2.1 time: 0.807746 Jul 01 10:43:46.986206 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1972/4040] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:46 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1511 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:46.999135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:47.000081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:47.032194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:47.057639 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-052d5bb1-24b0-4a49-84d3-2039276669f4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1321 microversion: 2.1 time: 0.827833 Jul 01 10:43:47.063553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:47.065551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:47.067458 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2069/4041] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:46 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1321 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:47.070408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:47.071070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:47.081696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:47.082205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:47.106413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:47.106877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:47.107672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:47.108122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:47.171348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:43:47.607552 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5151068e-f461-43ec-bc3c-b339d97444a5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 204 len: 0 microversion: 2.1 time: 0.533271 Jul 01 10:43:47.613209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2070/4042] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:43:47 2022] DELETE /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:43:47.615835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:47.616713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:47.634851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:47.637481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:47.638565 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:47.639224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:47.717554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:43:48.002317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:48.025437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a077273f-21d3-4cb7-852c-63ab973f11b9 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1527 microversion: 2.1 time: 1.032965 Jul 01 10:43:48.026540 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1973/4043] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:46 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1527 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:48.051354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:48.051823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:48.064944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:48.066970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:48.067866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:48.068393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:48.147933 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9bb330e0-c7bc-45ef-9afc-8972819ab838 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 204 len: 0 microversion: 2.1 time: 0.538184 Jul 01 10:43:48.149613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2071/4044] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:43:47 2022] DELETE /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:43:48.155476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:48.164933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:48.173562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:48.180782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:48.182176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:48.183236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:48.757593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:48.776914 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-010fca6f-9759-45bc-b342-02c3f05f67db tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1665 microversion: 2.1 time: 0.747522 Jul 01 10:43:48.778929 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1974/4045] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:48 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1665 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:48.797853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:48.799862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:48.813935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:48.815068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:48.816139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:48.819122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:49.322276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:49.332990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e2c29edc-d282-46a5-9226-834e94fe4985 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1321 microversion: 2.1 time: 1.181656 Jul 01 10:43:49.334640 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2072/4046] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:48 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1321 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:49.343629 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-286eb5f5-c23a-4c3a-b3ff-dc88f4d0a597 req-d95da4cb-1ded-43ab-9868-3578ac9ef8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdb63d-950d-4a38-b08a-8412f29a41b7", "name": "network-vif-deleted", "tag": "1571dc8e-ca35-4f71-884e-7de8edfcabb5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:49.359935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-286eb5f5-c23a-4c3a-b3ff-dc88f4d0a597 req-d95da4cb-1ded-43ab-9868-3578ac9ef8d3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:49.360435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-286eb5f5-c23a-4c3a-b3ff-dc88f4d0a597 req-d95da4cb-1ded-43ab-9868-3578ac9ef8d3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:49.375662 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-286eb5f5-c23a-4c3a-b3ff-dc88f4d0a597 req-d95da4cb-1ded-43ab-9868-3578ac9ef8d3 service nova] Creating event network-vif-deleted:1571dc8e-ca35-4f71-884e-7de8edfcabb5 for instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 on n-h2-master-1 Jul 01 10:43:49.381914 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-286eb5f5-c23a-4c3a-b3ff-dc88f4d0a597 req-d95da4cb-1ded-43ab-9868-3578ac9ef8d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046021 Jul 01 10:43:49.383053 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2073/4047] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:49.389873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ac4e0edb-d044-479b-9962-ceb4a3d2f146 req-696c1aee-2454-465c-abeb-ed826700c003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904d49ed-eae4-4e0e-b31b-1172222ced70", "name": "network-vif-plugged", "status": "completed", "tag": "c360d821-bd19-4829-8b88-75b13071c99e"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:49.400987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ac4e0edb-d044-479b-9962-ceb4a3d2f146 req-696c1aee-2454-465c-abeb-ed826700c003 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:49.400987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ac4e0edb-d044-479b-9962-ceb4a3d2f146 req-696c1aee-2454-465c-abeb-ed826700c003 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:49.419502 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ac4e0edb-d044-479b-9962-ceb4a3d2f146 req-696c1aee-2454-465c-abeb-ed826700c003 service nova] Creating event network-vif-plugged:c360d821-bd19-4829-8b88-75b13071c99e for instance 904d49ed-eae4-4e0e-b31b-1172222ced70 on n-h1-master-1 Jul 01 10:43:49.426021 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ac4e0edb-d044-479b-9962-ceb4a3d2f146 req-696c1aee-2454-465c-abeb-ed826700c003 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041121 Jul 01 10:43:49.426961 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2074/4048] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:49.435668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:49.443867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:49.445515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:49.446198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:49.447307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:49.448123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:49.660341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab94891ca6f4f63994bd7083e092da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f5a466fd584a4fa942be7ad9254fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:49.669125 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28831ec8-68d8-41ca-bcd4-86442650d2e0 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 200 len: 1485 microversion: 2.1 time: 0.239326 Jul 01 10:43:49.670189 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2075/4049] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:49 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 1485 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:49.799813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:49.800822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:49.811295 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:49.812814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:49.814648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:49.815379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:49.893758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:49.904775 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ba23283-ab62-4a1a-b3fd-f1e7337cce2b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1517 microversion: 2.1 time: 1.124469 Jul 01 10:43:49.906168 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1975/4050] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:48 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1517 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:50.351800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:50.352515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:50.369857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:50.370309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:50.372030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:50.372534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:50.665389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:50.675866 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be92ae7e-7c7e-48f2-b0b3-1b023f3e7731 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1665 microversion: 2.1 time: 0.882646 Jul 01 10:43:50.688203 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2076/4051] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:49 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1665 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:50.696148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:50.697117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] [instance: 16cdb63d-950d-4a38-b08a-8412f29a41b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:50.706216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:50.706943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:50.709604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:50.710271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:50.729996 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] HTTP exception thrown: Instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 could not be found. Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Request method failure captured: Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 HTTP/1.1 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs_BpXqGJEVsOCB_xUaBe4MbGXbD1ljR0EiEWTAbVO6kpabQsyVwXxQpw1PPy-lUuWjVMES-o3mdCO8Bkh-R9c1YM3TyJ_sDBaMCP8gQCyugtYYJgkrdtS--9JeHPpK21V5WghL_ZiL4iEYAY7uKrlhuVa3OhcfPnsDX2tHMgkO6qZ0 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 54f5a466fd584a4fa942be7ad9254fb6 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54f5a466fd584a4fa942be7ad9254fb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54f5a466fd584a4fa942be7ad9254fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 54f5a466fd584a4fa942be7ad9254fb6 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2000303853 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerAddressesNegativeTestJSON-2000303853-project Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9ab94891ca6f4f63994bd7083e092da0 Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2000303853-project Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 could not be found. Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '16cdb63d-950d-4a38-b08a-8412f29a41b7'} Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 could not be found. Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 could not be found. Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:50.733676 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 could not be found. Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] Returning 404 to user: Instance 16cdb63d-950d-4a38-b08a-8412f29a41b7 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:50.738310 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81609c08-67f1-4b5d-9095-3342426c6513 tempest-ServerAddressesNegativeTestJSON-2000303853 tempest-ServerAddressesNegativeTestJSON-2000303853-project] 10.222.0.23 "GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7" status: 404 len: 111 microversion: 2.1 time: 0.046155 Jul 01 10:43:50.743047 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2077/4052] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:50 2022] GET /compute/v2.1/servers/16cdb63d-950d-4a38-b08a-8412f29a41b7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:43:50.935505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:50.937568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:50.958815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:50.959684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:50.963772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:50.964713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:51.050103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:51.063283 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef33f3ad-521d-49b4-acc3-a9ca804ae408 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1321 microversion: 2.1 time: 0.716692 Jul 01 10:43:51.064564 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1976/4053] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:50 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1321 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:51.402524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-13bca9d3-a6a4-4390-a0a9-14dcda9af6e5 req-5c1b35b8-fd93-47ab-8dc1-c7bb63205cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde88491-5e85-4abb-8121-4cde61f444f4", "name": "network-vif-deleted", "tag": "bb53c117-d46a-4008-ad58-e45ee05b55f4"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:51.412708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-13bca9d3-a6a4-4390-a0a9-14dcda9af6e5 req-5c1b35b8-fd93-47ab-8dc1-c7bb63205cf4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:51.413687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-13bca9d3-a6a4-4390-a0a9-14dcda9af6e5 req-5c1b35b8-fd93-47ab-8dc1-c7bb63205cf4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:51.426161 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-13bca9d3-a6a4-4390-a0a9-14dcda9af6e5 req-5c1b35b8-fd93-47ab-8dc1-c7bb63205cf4 service nova] Creating event network-vif-deleted:bb53c117-d46a-4008-ad58-e45ee05b55f4 for instance cde88491-5e85-4abb-8121-4cde61f444f4 on n-h1-master-1 Jul 01 10:43:51.434513 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-13bca9d3-a6a4-4390-a0a9-14dcda9af6e5 req-5c1b35b8-fd93-47ab-8dc1-c7bb63205cf4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035367 Jul 01 10:43:51.435719 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1977/4054] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:51.446497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-edcd2110-4298-4b4b-9a3b-edf2aecd2129 req-3880babd-06e9-483d-9429-476b844b8919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac4fd96-1f2a-4f2d-86d4-e2eeb2479505", "name": "network-vif-unplugged", "status": "completed", "tag": "9fa3394f-6197-4052-8938-a7393e15cbc1"}, {"server_uuid": "3e86e169-88e7-4094-9f19-014a424b87d6", "name": "network-vif-plugged", "status": "completed", "tag": "bbf841da-6bf8-441a-b482-7bd94085c086"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:51.459252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:51.470935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-edcd2110-4298-4b4b-9a3b-edf2aecd2129 req-3880babd-06e9-483d-9429-476b844b8919 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:51.471377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-edcd2110-4298-4b4b-9a3b-edf2aecd2129 req-3880babd-06e9-483d-9429-476b844b8919 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:51.473767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50055485-60c6-45fa-8003-d1a7cfab54b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1517 microversion: 2.1 time: 0.553009 Jul 01 10:43:51.476742 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2078/4055] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:50 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:51.504177 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-edcd2110-4298-4b4b-9a3b-edf2aecd2129 req-3880babd-06e9-483d-9429-476b844b8919 service nova] Creating event network-vif-unplugged:9fa3394f-6197-4052-8938-a7393e15cbc1 for instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 on n-h2-master-1 Jul 01 10:43:51.504612 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-edcd2110-4298-4b4b-9a3b-edf2aecd2129 req-3880babd-06e9-483d-9429-476b844b8919 service nova] Creating event network-vif-plugged:bbf841da-6bf8-441a-b482-7bd94085c086 for instance 3e86e169-88e7-4094-9f19-014a424b87d6 on n-h1-master-1 Jul 01 10:43:51.545363 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-edcd2110-4298-4b4b-9a3b-edf2aecd2129 req-3880babd-06e9-483d-9429-476b844b8919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.105232 Jul 01 10:43:51.546448 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1978/4056] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:51.697958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:51.701483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:51.718139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:51.718822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:51.732616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:51.733094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:51.887604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:51.899696 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a6831c46-3b46-45cd-8bd3-37db5823d2c3 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1319 microversion: 2.1 time: 0.207838 Jul 01 10:43:51.913107 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2079/4057] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:51 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:52.084432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:52.085894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:52.103482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.105286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.111542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.112367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.158937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7c03ef2c-feb9-4a5e-987f-f26cb9f90b99 req-1b45a2ea-f9ce-42cd-8457-7d04d794df0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac4fd96-1f2a-4f2d-86d4-e2eeb2479505", "name": "network-vif-deleted", "tag": "9fa3394f-6197-4052-8938-a7393e15cbc1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:52.199477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c03ef2c-feb9-4a5e-987f-f26cb9f90b99 req-1b45a2ea-f9ce-42cd-8457-7d04d794df0a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.519501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c03ef2c-feb9-4a5e-987f-f26cb9f90b99 req-1b45a2ea-f9ce-42cd-8457-7d04d794df0a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.519501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7c03ef2c-feb9-4a5e-987f-f26cb9f90b99 req-1b45a2ea-f9ce-42cd-8457-7d04d794df0a service nova] Creating event network-vif-deleted:9fa3394f-6197-4052-8938-a7393e15cbc1 for instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 on n-h2-master-1 Jul 01 10:43:52.519501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7c03ef2c-feb9-4a5e-987f-f26cb9f90b99 req-1b45a2ea-f9ce-42cd-8457-7d04d794df0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127316 Jul 01 10:43:52.519501 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2080/4058] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:43:52.519501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:52.519501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:52.533321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.533321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.534250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.534966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.610373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:52.622324 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14c4164e-2e27-401d-907d-a751db341f8e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1514 microversion: 2.1 time: 0.542645 Jul 01 10:43:52.622983 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1979/4059] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:52 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1514 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:52.642024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:52.643401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:52.661516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.662580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.664701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.665524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.687260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:52.698568 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29085179-9b15-4250-9633-c0697f18e1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1315 microversion: 2.1 time: 0.209650 Jul 01 10:43:52.703593 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2081/4060] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:52 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:52.732310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lazy-loading 'flavor' on Instance uuid 904d49ed-eae4-4e0e-b31b-1172222ced70 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:43:52.918732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:52.920160 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:52.927917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.928540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:52.929607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:52.930337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:53.013412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:53.014076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:53.014732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lazy-loading 'fault' on Instance uuid cde88491-5e85-4abb-8121-4cde61f444f4 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:43:53.088443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:53.090311 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d466087c-25bc-4d23-a7f8-36936262cd39 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action" status: 200 len: 32 microversion: 2.1 time: 0.453254 Jul 01 10:43:53.093592 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1980/4061] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:43:52 2022] POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action => generated 32 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:43:53.117646 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5fe0211-2cd4-4bcb-9059-2fc8b2d60804 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 200 len: 1324 microversion: 2.1 time: 0.196471 Jul 01 10:43:53.118307 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2082/4062] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:52 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:53.122574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:53.123863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:53.164155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:53.164882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:53.166002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:53.166832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:53.728582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:53.730359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:53.750766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:53.751217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:53.752210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:53.761516 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:53.819582 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:53.869886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:53.872809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:53.873432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lazy-loading 'fault' on Instance uuid dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:43:54.079494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:54.079703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:54.083937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b26bf07-659d-46a3-b8eb-279c48b856f6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 200 len: 1320 microversion: 2.1 time: 0.366672 Jul 01 10:43:54.085609 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2083/4063] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:53 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 1320 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:54.100654 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d01900f-b538-4a1d-9f02-00a0da09eeb7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.988753 Jul 01 10:43:54.102353 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1981/4064] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:53 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:54.154466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:54.155363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: cde88491-5e85-4abb-8121-4cde61f444f4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:54.164987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:54.165666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:54.166656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:54.167137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:54.183386 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] HTTP exception thrown: Instance cde88491-5e85-4abb-8121-4cde61f444f4 could not be found. Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Request method failure captured: Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 HTTP/1.1 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs46XmVWDjcgrJ6UqEs-I3-FiWLrigPp-A8_uVw5M7yiZxxx-NR34_rbHBYzvh4J2if_dpONuaiYNab1Kt3za5p77VnJ4lnQ5P4B7aAlp3u3AQwsSYoPOmzKR0YiE0uCfN05YTPLDQYk0Ja6dIoIq_TB7FAPJVZYdXIariByecPCYM4 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d91a3501ad3469f8dbafaa816b883d0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-LiveMigrationTest-989202008 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-LiveMigrationTest-989202008-project Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: e3ce54f4c29540dc8f7077c2717f6451 Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-LiveMigrationTest-989202008-project Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: exception: Instance cde88491-5e85-4abb-8121-4cde61f444f4 could not be found. Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'cde88491-5e85-4abb-8121-4cde61f444f4'} Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde88491-5e85-4abb-8121-4cde61f444f4 could not be found. Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde88491-5e85-4abb-8121-4cde61f444f4 could not be found. Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:54.185354 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde88491-5e85-4abb-8121-4cde61f444f4 could not be found. Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Returning 404 to user: Instance cde88491-5e85-4abb-8121-4cde61f444f4 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d060b7d-2f73-4b19-a2a8-0527ab6a35ea tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4" status: 404 len: 111 microversion: 2.1 time: 0.036635 Jul 01 10:43:54.192371 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2084/4065] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:54 2022] GET /compute/v2.1/servers/cde88491-5e85-4abb-8121-4cde61f444f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:43:54.196826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-24b7bd4b-e9d0-4a18-8162-f072c737a603 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '.version_select at 0x7f6f907e2790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:54.331257 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-24b7bd4b-e9d0-4a18-8162-f072c737a603 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835621191" status: 202 len: 0 microversion: 2.1 time: 0.139452 Jul 01 10:43:54.336249 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1982/4066] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835621191 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:43:55.106985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:55.107586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:55.115451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:55.115922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:55.116709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:55.117702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:55.132957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:55.132957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:55.138900 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:43:55.139928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 HTTP/1.1 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: exception: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'dac4fd96-1f2a-4f2d-86d4-e2eeb2479505'} Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:55.140925 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:43:55.144176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:43:55.144176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:43:55.144176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:43:55.144176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:43:55.144176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:43:55.144176 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:43:55.145056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:55.145888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:43:55.146359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:55.146509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:55.147809 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7bb92dfa-4aaf-424d-a444-381958488b8a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 404 len: 111 microversion: 2.1 time: 0.048720 Jul 01 10:43:55.148957 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2085/4067] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:55 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:43:55.205077 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:55.331881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-68039288", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "9025d00e-6ad8-47ef-80bc-484168809931"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:55.410733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] validate_networks() for [('9025d00e-6ad8-47ef-80bc-484168809931', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:43:55.794727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:55.806645 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d43e330e-e64f-4fcb-a364-6528f2cd3afd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.686027 Jul 01 10:43:55.808468 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1983/4068] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:55 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:43:56.286429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:56.288300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:56.300342 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:56.300801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:56.301633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:56.302292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:56.331345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:43:56.555237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:43:56.556194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:43:56.557774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:43:56.558453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:43:56.559095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:43:56.582429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:56.582875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:56.584823 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:56.585293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:56.605015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:43:56.610531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Getting quotas for user 750a266b0e2e40febfb239888894069a and project 3b39fd7bcc7b4a668ec1d7990a69a52b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:43:56.624771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:43:56.627158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:43:56.643542 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a43fb37-15d4-4c52-b39e-25502a376c3c tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 204 len: 0 microversion: 2.1 time: 0.360825 Jul 01 10:43:56.644139 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1984/4069] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:43:56 2022] DELETE /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:43:56.659201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:56.660167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:56.667150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:56.667595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:56.668358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:56.668785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:56.770680 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d085264-66bd-487b-af14-65453e45a22f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444465 Jul 01 10:43:56.771554 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2086/4070] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:43:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:43:56.793472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b232af68-4656-46c7-b03f-d105ff50c5c5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:56.794398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b232af68-4656-46c7-b03f-d105ff50c5c5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:57.040419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:57.051676 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81eb61f8-46f1-42d0-8569-6fd50e8336ef tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1483 microversion: 2.1 time: 0.394104 Jul 01 10:43:57.064219 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1985/4071] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:56 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1483 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:57.072065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:57.072976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:57.080537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:57.081237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:57.081847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b232af68-4656-46c7-b03f-d105ff50c5c5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:57.082528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:57.083199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:57.091014 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b232af68-4656-46c7-b03f-d105ff50c5c5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1207 microversion: 2.1 time: 0.307750 Jul 01 10:43:57.093614 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2087/4072] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:56 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1207 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:57.503442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:57.522010 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9b36174c-08cf-4920-9a75-82b9bc7a20de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.455385 Jul 01 10:43:57.532382 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1986/4073] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:57 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:58.071380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:58.071926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:58.079067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:58.079788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:58.080746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:58.081410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:58.111411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:58.112032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:58.114391 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:43:58.128829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:58.129232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:58.130007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:58.130472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:58.274609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:58.290422 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d744648c-d5da-4690-a986-7b65c613c81b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1211 microversion: 2.1 time: 0.182859 Jul 01 10:43:58.291025 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1987/4074] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:58 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1211 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:58.545638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:58.549406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:58.551261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:58.569684 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bd26f871-7bfc-425c-95fc-ba5d32dc53ac tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1483 microversion: 2.1 time: 0.499184 Jul 01 10:43:58.570401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:58.572035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:58.579082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:58.580280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:58.582067 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2088/4075] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:58 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1483 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:58.967731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:58.991184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-62e10c07-dd28-42c2-9ff1-5b923a08934c req-f9581b27-2e0a-45f7-88f2-004431dfd0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beb1734-a4f4-42f6-a108-197964bde936", "name": "network-vif-deleted", "tag": "08309fee-bc21-46d1-9d77-48c1be296251"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:43:59.011590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-62e10c07-dd28-42c2-9ff1-5b923a08934c req-f9581b27-2e0a-45f7-88f2-004431dfd0bd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:59.012433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-62e10c07-dd28-42c2-9ff1-5b923a08934c req-f9581b27-2e0a-45f7-88f2-004431dfd0bd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:59.031350 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee4ec875-3329-400f-af43-54b4052f3e1c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.494920 Jul 01 10:43:59.037118 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1988/4076] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:58 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:59.051598 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-62e10c07-dd28-42c2-9ff1-5b923a08934c req-f9581b27-2e0a-45f7-88f2-004431dfd0bd service nova] Creating event network-vif-deleted:08309fee-bc21-46d1-9d77-48c1be296251 for instance 6beb1734-a4f4-42f6-a108-197964bde936 on n-h1-master-1 Jul 01 10:43:59.066139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-62e10c07-dd28-42c2-9ff1-5b923a08934c req-f9581b27-2e0a-45f7-88f2-004431dfd0bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080724 Jul 01 10:43:59.072480 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2089/4077] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:43:59.314352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:59.315339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:59.333177 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:59.336777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:59.336777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:59.336777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:59.500633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:59.510591 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e5a9259e-4cf8-4494-b83e-86f66add0337 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1259 microversion: 2.1 time: 0.205915 Jul 01 10:43:59.521706 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1989/4078] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:59 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:43:59.590725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:43:59.591744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:43:59.602914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:59.603620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:59.605421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:59.606086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:59.672941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:43:59.673683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:43:59.674392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lazy-loading 'fault' on Instance uuid 6beb1734-a4f4-42f6-a108-197964bde936 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:43:59.983230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:43:59.998662 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e6b6e383-4c96-493f-89bb-90e42db4fda5 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 200 len: 1300 microversion: 2.1 time: 0.407474 Jul 01 10:44:00.000023 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2090/4079] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:43:59 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 1300 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:00.060061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:00.063179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:00.082611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:00.083810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:00.085426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:00.086044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:00.533386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:00.534654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:00.543753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:00.544369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:00.545296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:00.545927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:00.577041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:00.593816 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e04c820-fa0e-42b2-a2bb-6f685e8a8a26 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.541126 Jul 01 10:44:00.596245 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1990/4080] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:00 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:00.715564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:00.727184 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1860224a-da0d-459d-a343-37d43a7194ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1265 microversion: 2.1 time: 0.202930 Jul 01 10:44:00.727999 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2091/4081] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:00 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:01.022774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:01.023669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 6beb1734-a4f4-42f6-a108-197964bde936] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:01.047001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.049317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:01.050989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.051434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:01.118248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] HTTP exception thrown: Instance 6beb1734-a4f4-42f6-a108-197964bde936 could not be found. Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Request method failure captured: Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 HTTP/1.1 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs46XmVWDjcgrJ6UqEs-I3-FiWLrigPp-A8_uVw5M7yiZxxx-NR34_rbHBYzvh4J2if_dpONuaiYNab1Kt3za5p77VnJ4lnQ5P4B7aAlp3u3AQwsSYoPOmzKR0YiE0uCfN05YTPLDQYk0Ja6dIoIq_TB7FAPJVZYdXIariByecPCYM4 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d91a3501ad3469f8dbafaa816b883d0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveMigrationTest-989202008 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveMigrationTest-989202008-project Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: e3ce54f4c29540dc8f7077c2717f6451 Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveMigrationTest-989202008-project Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 6beb1734-a4f4-42f6-a108-197964bde936 could not be found. Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '6beb1734-a4f4-42f6-a108-197964bde936'} Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beb1734-a4f4-42f6-a108-197964bde936 could not be found. Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beb1734-a4f4-42f6-a108-197964bde936 could not be found. Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:01.122794 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:01.126855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:01.126855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:01.126855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:01.126855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:01.126855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beb1734-a4f4-42f6-a108-197964bde936 could not be found. Jul 01 10:44:01.126855 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:01.132157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Returning 404 to user: Instance 6beb1734-a4f4-42f6-a108-197964bde936 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:01.142315 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f82b8f29-5a9c-4b9b-be64-964451924a21 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936" status: 404 len: 111 microversion: 2.1 time: 0.122393 Jul 01 10:44:01.142950 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1991/4082] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:01 2022] GET /compute/v2.1/servers/6beb1734-a4f4-42f6-a108-197964bde936 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:44:01.155535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:01.166322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:01.181053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.190468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:01.192050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.194754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:01.254519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:44:01.615974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:01.617036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:01.642932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.643406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:01.644208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.644700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:01.726918 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:01.872531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68ca4d41-d227-4bd9-8470-8300132de45d tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 204 len: 0 microversion: 2.1 time: 0.723416 Jul 01 10:44:01.877212 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2092/4083] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:01 2022] DELETE /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:44:01.884295 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:01.886142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:01.914568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.920350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:01.921452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:01.924160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:02.214447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:02.226248 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dccee06f-7765-4a41-9d1e-2de3abd186b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1265 microversion: 2.1 time: 0.346587 Jul 01 10:44:02.226248 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2093/4084] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:01 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:02.280249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:02.281507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:02.305808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:02.325957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:02.327244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:02.327935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:03.116083 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:03.133195 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63e97895-6859-4883-99e5-6296f3f54368 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 1.522147 Jul 01 10:44:03.136336 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1992/4085] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:01 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:03.248008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:03.249963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:03.277905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:03.278953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:03.284675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:03.285630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:03.441353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:03.481627 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-85fbcd35-8cbc-4780-a28a-f4ae25f930b2 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1499 microversion: 2.1 time: 1.241416 Jul 01 10:44:03.482611 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2094/4086] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:02 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1499 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:03.958184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:03.967908 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ee69a92-5f92-457c-81ea-6af63e0d415a tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.727009 Jul 01 10:44:03.977295 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1993/4087] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:03 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:04.154662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:04.155571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:04.166981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:04.167976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:04.169582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:04.170251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:04.456368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-464409405", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "e32ddfd9-e576-4f03-b9da-056b95b2f137"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:04.521940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] validate_networks() for [('e32ddfd9-e576-4f03-b9da-056b95b2f137', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:44:04.705438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:04.715178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-61f95767-3861-4d32-8ca7-bc31609084e0 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.565128 Jul 01 10:44:04.719691 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2095/4088] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:04 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:04.730270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:04.730896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:04.739559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:04.740056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:04.743684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:04.748834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:05.322190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:05.337083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-34f40590-dd83-458b-8309-bba2521c9317 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1499 microversion: 2.1 time: 0.610632 Jul 01 10:44:05.338110 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2096/4089] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:04 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1499 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:05.350286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:05.351181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:05.364072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:05.366169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:05.368071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:05.370916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:05.969725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:05.980612 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56f2f4d8-d9d2-4e68-8a84-d68420597c6d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.641181 Jul 01 10:44:05.981228 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2097/4090] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:05 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:05.989754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:05.990598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:06.008434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:44:06.009365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:44:06.012042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:44:06.012713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:44:06.014281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:44:06.022872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.023552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.029424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.036277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.037587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.045751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.045751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.046041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.092083 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Getting quotas for project 1756cea9fed0440da392929c10924cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:44:06.115612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Getting quotas for user 5486f8d5ebed4807a89deb962c392f1a and project 1756cea9fed0440da392929c10924cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:44:06.143608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:44:06.146885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:44:06.331492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9e193ea9-db69-4d63-b5b2-b851bdc6b269 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126496 Jul 01 10:44:06.340569 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1994/4091] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:44:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:44:06.350740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-85507ec8-eeb6-42cf-b224-8509ff390edf req-e5be96b9-e591-4248-89b9-a755bc5ca2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7936ef-c268-4341-9600-35a8ae142d02", "name": "network-vif-deleted", "tag": "294f2323-eac6-4183-8f01-0a4b656c265f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:06.385134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-85507ec8-eeb6-42cf-b224-8509ff390edf req-e5be96b9-e591-4248-89b9-a755bc5ca2c7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.388254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-85507ec8-eeb6-42cf-b224-8509ff390edf req-e5be96b9-e591-4248-89b9-a755bc5ca2c7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.426181 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-85507ec8-eeb6-42cf-b224-8509ff390edf req-e5be96b9-e591-4248-89b9-a755bc5ca2c7 service nova] Creating event network-vif-deleted:294f2323-eac6-4183-8f01-0a4b656c265f for instance 8b7936ef-c268-4341-9600-35a8ae142d02 on n-h2-master-1 Jul 01 10:44:06.446608 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-85507ec8-eeb6-42cf-b224-8509ff390edf req-e5be96b9-e591-4248-89b9-a755bc5ca2c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103328 Jul 01 10:44:06.448894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1995/4092] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:06.462824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2bac429b-76c1-4072-9da2-dc110f65a0be tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:06.465393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2bac429b-76c1-4072-9da2-dc110f65a0be tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:06.596631 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:06.786482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:06.806446 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33013cf6-892a-4469-8547-52dcb0b0c489 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.824070 Jul 01 10:44:06.811691 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2098/4093] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:05 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:06.816454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:06.829074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2bac429b-76c1-4072-9da2-dc110f65a0be tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:06.830928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:06.853939 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2bac429b-76c1-4072-9da2-dc110f65a0be tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1217 microversion: 2.1 time: 0.390824 Jul 01 10:44:06.854597 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1996/4094] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:06 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1217 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:06.873962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.874777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.876334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.876879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.963924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:06.964672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:06.966447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lazy-loading 'fault' on Instance uuid 8b7936ef-c268-4341-9600-35a8ae142d02 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:44:06.997946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:07.000067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:07.013980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:07.023363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:07.025393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:07.027154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:07.090526 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:07.138272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ce54f4c29540dc8f7077c2717f6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d91a3501ad3469f8dbafaa816b883d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:07.149239 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aebc126f-dae6-4da7-85b9-424de7d3e8fe tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 200 len: 1300 microversion: 2.1 time: 0.336336 Jul 01 10:44:07.152089 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2099/4095] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:06 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 1300 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:07.324852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:07.332809 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1587f726-11a6-4a8e-a2cd-8cae0d8329ac tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.339139 Jul 01 10:44:07.335318 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1997/4096] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:06 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:07.827697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:07.828224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:07.842992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:07.843641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:07.844438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:07.845508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:07.872475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d412c114-954f-47bf-82fb-1bc8a766e626 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:07.873607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d412c114-954f-47bf-82fb-1bc8a766e626 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:08.175561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d412c114-954f-47bf-82fb-1bc8a766e626 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:08.190081 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d412c114-954f-47bf-82fb-1bc8a766e626 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1217 microversion: 2.1 time: 0.322206 Jul 01 10:44:08.192098 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1998/4097] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:07 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1217 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:08.210917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:08.211820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] [instance: 8b7936ef-c268-4341-9600-35a8ae142d02] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:08.238856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:08.239692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:08.240839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:08.256580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:08.311035 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] HTTP exception thrown: Instance 8b7936ef-c268-4341-9600-35a8ae142d02 could not be found. Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Request method failure captured: Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 HTTP/1.1 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs46XmVWDjcgrJ6UqEs-I3-FiWLrigPp-A8_uVw5M7yiZxxx-NR34_rbHBYzvh4J2if_dpONuaiYNab1Kt3za5p77VnJ4lnQ5P4B7aAlp3u3AQwsSYoPOmzKR0YiE0uCfN05YTPLDQYk0Ja6dIoIq_TB7FAPJVZYdXIariByecPCYM4 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d91a3501ad3469f8dbafaa816b883d0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d91a3501ad3469f8dbafaa816b883d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-LiveMigrationTest-989202008 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5d91a3501ad3469f8dbafaa816b883d0 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-LiveMigrationTest-989202008 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-LiveMigrationTest-989202008-project Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: e3ce54f4c29540dc8f7077c2717f6451 Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-LiveMigrationTest-989202008-project Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 8b7936ef-c268-4341-9600-35a8ae142d02 could not be found. Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '8b7936ef-c268-4341-9600-35a8ae142d02'} Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7936ef-c268-4341-9600-35a8ae142d02 could not be found. Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7936ef-c268-4341-9600-35a8ae142d02 could not be found. Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:08.314464 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:08.322363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:08.322363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:08.322363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:08.322363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:08.322363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7936ef-c268-4341-9600-35a8ae142d02 could not be found. Jul 01 10:44:08.322363 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:08.322363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] Returning 404 to user: Instance 8b7936ef-c268-4341-9600-35a8ae142d02 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:08.326345 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea19c1cf-ebb4-4cc4-a1c5-d050fb133ff1 tempest-LiveMigrationTest-989202008 tempest-LiveMigrationTest-989202008-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02" status: 404 len: 111 microversion: 2.1 time: 0.124846 Jul 01 10:44:08.327321 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 1999/4098] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:08 2022] GET /compute/v2.1/servers/8b7936ef-c268-4341-9600-35a8ae142d02 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:08.351400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:08.354738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:08.367364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:08.367812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:08.368819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:08.369428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:08.427735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:08.439136 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.616154 Jul 01 10:44:08.441053 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2100/4099] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:07 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:08.445498 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:08.446815 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004587 Jul 01 10:44:08.447336 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2101/4100] 10.222.0.23 () {56 vars in 885 bytes} [Fri Jul 1 10:44:08 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 01 10:44:08.454082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:08.455408 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001788 Jul 01 10:44:08.456243 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2102/4101] 10.222.0.23 () {54 vars in 1034 bytes} [Fri Jul 1 10:44:08 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 01 10:44:08.462330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:08.463568 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jul 01 10:44:08.463974 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2103/4102] 10.222.0.23 () {54 vars in 1040 bytes} [Fri Jul 1 10:44:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:44:08.471502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:08.472608 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ebe1f15-44b0-4b83-8e57-e35879f403b7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001896 Jul 01 10:44:08.473419 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2104/4103] 10.222.0.23 () {56 vars in 885 bytes} [Fri Jul 1 10:44:08 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 01 10:44:08.486487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a98fb48c-5794-45f5-8298-7e9646557767 req-723c274d-eb4b-4218-9631-630e4080d39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab13833-0763-4ea8-a440-e4217bbdd4b3", "tag": "96de66bd-1c5f-4d24-8c89-a5a7c451d5aa"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:08.503460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a98fb48c-5794-45f5-8298-7e9646557767 req-723c274d-eb4b-4218-9631-630e4080d39e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:08.504607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a98fb48c-5794-45f5-8298-7e9646557767 req-723c274d-eb4b-4218-9631-630e4080d39e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:08.510127 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:08.518310 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a98fb48c-5794-45f5-8298-7e9646557767 req-723c274d-eb4b-4218-9631-630e4080d39e service nova] Creating event network-changed:96de66bd-1c5f-4d24-8c89-a5a7c451d5aa for instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 on n-h2-master-1 Jul 01 10:44:08.527385 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a98fb48c-5794-45f5-8298-7e9646557767 req-723c274d-eb4b-4218-9631-630e4080d39e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046296 Jul 01 10:44:08.532506 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2105/4104] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:44:08.754095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:08.763163 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5337f558-e97b-465d-9e74-ff3d44e0ccbd tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.416305 Jul 01 10:44:08.772409 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2000/4105] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:08 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:09.208672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:09.210002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:09.217452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:09.220215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:09.221028 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:09.221499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:09.294345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:09.303151 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86c1267f-6156-4ec0-a8f4-39006223f702 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1269 microversion: 2.1 time: 0.099210 Jul 01 10:44:09.303745 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2106/4106] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:09 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:09.458897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:09.459529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:09.466831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:09.467286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:09.468066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:09.468496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:09.619156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:09.629952 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-df175479-a5ff-4ab3-a7b6-748b4e0f0c7d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.175638 Jul 01 10:44:09.646009 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2001/4107] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:09 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:09.781774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:09.783013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:09.791990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:09.792626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:09.793721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:09.794363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:10.010733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:10.029531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-342ab0aa-20cf-401d-88f5-ded5a11dd75c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.251743 Jul 01 10:44:10.039546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2107/4108] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:09 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:10.320918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:10.321828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:10.330783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:10.331439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:10.339605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:10.339605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:10.478354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:10.487854 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fcbb9e2-1d8b-4bf6-a78a-1fd7bc72d058 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1269 microversion: 2.1 time: 0.171606 Jul 01 10:44:10.488525 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2002/4109] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:10 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:10.652584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:10.653222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:10.664653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:10.665621 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:10.666688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:10.667133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:11.049409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:11.049409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:11.055044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:11.055497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:11.066228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:11.066697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:11.072244 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:11.347101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:11.368120 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d69238f-b3c7-4b43-af40-28eb13ff411e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.718720 Jul 01 10:44:11.380478 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2108/4110] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:10 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:11.507457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:11.508409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:11.518989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:11.519678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:11.521821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:11.522687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:11.613120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:11.635803 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a04e3034-cb32-4fb1-8cdb-7cf81aaf3c63 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.595110 Jul 01 10:44:11.658526 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2003/4111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:11 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:11.746571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:11.756285 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56738517-4bf8-445a-af77-0600c562bd4e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1275 microversion: 2.1 time: 0.253473 Jul 01 10:44:11.761333 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2109/4112] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:11 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:12.387431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:12.388300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:12.401001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:12.403633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:12.404718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:12.409535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:12.653268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:12.654535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:12.668003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:12.668807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:12.669801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:12.671222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:12.685999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:12.696372 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-560338f0-d879-4212-b0be-374ef7d404df tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.313504 Jul 01 10:44:12.707490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2004/4113] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:12 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:12.778477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:12.779477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:12.786712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:12.787501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:12.788947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:12.789672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:13.444432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:13.457560 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa02ddf7-38a9-4571-8517-a22afa9e8035 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.808099 Jul 01 10:44:13.459214 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2110/4114] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:12 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:13.498648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:13.519900 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc2b00a9-33c0-4cc2-b56e-29aba52b65db tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.749686 Jul 01 10:44:13.532528 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2005/4115] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:12 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:13.723990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:13.724704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:13.732126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:13.733024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:13.734069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:13.734723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:14.370645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-27fcfc77-920a-4183-906c-5bddd56694c6 req-8458bbb6-3242-4a6a-aed2-11495b731d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab13833-0763-4ea8-a440-e4217bbdd4b3", "name": "network-vif-plugged", "status": "completed", "tag": "96de66bd-1c5f-4d24-8c89-a5a7c451d5aa"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:14.385330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-27fcfc77-920a-4183-906c-5bddd56694c6 req-8458bbb6-3242-4a6a-aed2-11495b731d6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:14.388202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-27fcfc77-920a-4183-906c-5bddd56694c6 req-8458bbb6-3242-4a6a-aed2-11495b731d6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:14.413554 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-27fcfc77-920a-4183-906c-5bddd56694c6 req-8458bbb6-3242-4a6a-aed2-11495b731d6d service nova] Creating event network-vif-plugged:96de66bd-1c5f-4d24-8c89-a5a7c451d5aa for instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 on n-h2-master-1 Jul 01 10:44:14.421279 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-27fcfc77-920a-4183-906c-5bddd56694c6 req-8458bbb6-3242-4a6a-aed2-11495b731d6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054275 Jul 01 10:44:14.421889 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2006/4116] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:44:14.464053 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:14.477765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:14.478728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:14.483521 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-df8ed5f5-453b-4409-acdd-b5e2b57cc936 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.763342 Jul 01 10:44:14.488968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:14.492588 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2111/4117] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:13 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:14.499187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:14.500216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:14.502073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:14.538777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:14.539465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:14.555098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:14.561557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:14.562520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:14.563043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:15.136589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:15.146307 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-694363c9-5c09-4680-8f78-08d57c6166c0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.673158 Jul 01 10:44:15.155939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:15.159509 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2007/4118] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:14 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:15.162524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-551895e5-4c75-4148-a414-54991cfaa84b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.627651 Jul 01 10:44:15.163175 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2112/4119] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:14 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:15.527054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:15.527804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:15.550985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:15.552877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:15.555969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:15.556623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:16.064998 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:16.113512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:16.145711 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17ebfb84-9fbf-4bee-a631-5760c493992e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.637035 Jul 01 10:44:16.146745 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2008/4120] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:15 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:16.165521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:16.166769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:16.185213 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:16.186052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:16.190121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:16.190582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:16.191392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:16.194189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:16.201646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:16.202112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:16.203152 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:16.203867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:16.693802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:16.702747 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b631210d-1269-448b-97d4-0f5e71af3214 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1307 microversion: 2.1 time: 0.542830 Jul 01 10:44:16.709343 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2113/4121] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:16 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1307 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:16.719597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0f45c973-3962-4582-816a-3970b74cd004 req-97897b4c-099e-49c5-94a8-7641428438c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65d25cd-6f85-4a63-ac05-0d7380c4954e", "tag": "0688ff0e-a045-49f2-a520-977ecae920ed"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:16.736983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0f45c973-3962-4582-816a-3970b74cd004 req-97897b4c-099e-49c5-94a8-7641428438c3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:16.737474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0f45c973-3962-4582-816a-3970b74cd004 req-97897b4c-099e-49c5-94a8-7641428438c3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:16.763186 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0f45c973-3962-4582-816a-3970b74cd004 req-97897b4c-099e-49c5-94a8-7641428438c3 service nova] Creating event network-changed:0688ff0e-a045-49f2-a520-977ecae920ed for instance a65d25cd-6f85-4a63-ac05-0d7380c4954e on n-h2-master-1 Jul 01 10:44:16.785302 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0f45c973-3962-4582-816a-3970b74cd004 req-97897b4c-099e-49c5-94a8-7641428438c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061321 Jul 01 10:44:16.786281 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2114/4122] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:16.904368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:16.910490 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ecae16f-13a6-48fb-be7c-294131d0a59e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.730256 Jul 01 10:44:16.911328 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2009/4123] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:16 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:17.163418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:17.164381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:17.178625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:17.179240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:17.179799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:17.180245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:17.720900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:17.721548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:17.737726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:17.738444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:17.741110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:17.741819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:17.806854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:17.843272 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b457de8b-bc2d-4d55-aaef-e4937cb1c937 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.684338 Jul 01 10:44:17.844012 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2115/4124] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:17 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:17.932606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:17.934127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:17.944462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:17.945315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:17.946131 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:17.946617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:18.188713 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:18.741736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:18.753381 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0873c401-98f5-4720-9422-6328842d3367 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1488 microversion: 2.1 time: 1.036213 Jul 01 10:44:18.757905 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2010/4125] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:17 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1488 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:18.776177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6b33f2a-d1ed-40e4-8e8b-632e1358d56e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-875818112"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:18.777506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6b33f2a-d1ed-40e4-8e8b-632e1358d56e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:18.789249 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b33f2a-d1ed-40e4-8e8b-632e1358d56e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:18.790001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b33f2a-d1ed-40e4-8e8b-632e1358d56e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:18.790976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b33f2a-d1ed-40e4-8e8b-632e1358d56e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:18.791587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b33f2a-d1ed-40e4-8e8b-632e1358d56e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:18.809819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:18.827894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb2c0e6f-0e45-48e4-aaff-9e570f8c7729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.900493 Jul 01 10:44:18.846318 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2116/4126] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:17 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:18.873378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:18.878407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:18.900871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:18.906101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:18.907279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:18.915804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:19.064400 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6b33f2a-d1ed-40e4-8e8b-632e1358d56e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "PUT /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1074 microversion: 2.1 time: 0.294034 Jul 01 10:44:19.065061 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2011/4127] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:44:18 2022] PUT /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1074 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:19.082212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:19.083645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:19.091774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:19.092559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:19.093591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:19.094591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:19.357169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:19.368088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f4eab0f-a79d-4e23-a0bd-bd4865df15cf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.510480 Jul 01 10:44:19.368860 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2117/4128] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:18 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:19.571569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:19.579441 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a6a8bbd5-c3b0-4140-954a-830d6e27d2b1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1500 microversion: 2.1 time: 0.502401 Jul 01 10:44:19.580185 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2012/4129] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:19 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1500 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:19.597928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:19.599692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:19.608132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:19.608796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:19.609851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:19.610431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:19.847432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:19.848814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:19.856949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:19.857423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:19.858190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:19.858698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:20.075578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:20.084069 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-48c92dc3-b68b-4e51-8e44-2356a9c86743 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1500 microversion: 2.1 time: 0.491767 Jul 01 10:44:20.089251 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2118/4130] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:19 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1500 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:20.101845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da62272f-afd3-47b9-b925-56c0e5b8b2bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:20.115382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da62272f-afd3-47b9-b925-56c0e5b8b2bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:20.116503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da62272f-afd3-47b9-b925-56c0e5b8b2bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:20.149914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da62272f-afd3-47b9-b925-56c0e5b8b2bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Going to try to stop instance {{(pid=119764) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:44:20.310406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:20.320227 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4b0f6f52-fdd1-44be-8d03-b44ad50466e8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.476886 Jul 01 10:44:20.321208 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2013/4131] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:19 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:20.364959 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da62272f-afd3-47b9-b925-56c0e5b8b2bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "POST /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3/action" status: 202 len: 0 microversion: 2.1 time: 0.267727 Jul 01 10:44:20.383054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:20.384459 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2119/4132] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:20 2022] POST /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:44:20.390143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:20.394321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:20.396884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:20.403591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:20.405517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:20.408375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:20.408830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:20.409640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:20.410082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:20.414969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:20.415562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:20.880684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:20.894929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b132098-716c-4f34-977c-67f1b47a4418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.505466 Jul 01 10:44:20.899728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2120/4133] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:20 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:20.927020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:20.940831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-15d6079f-f978-45af-99ea-3f7adc4f46b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.563793 Jul 01 10:44:20.944999 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2014/4134] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:20 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:21.338054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:21.338621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:21.347585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:21.349103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:21.350267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:21.350808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:21.673428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:21.684253 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-145c08c7-f6ff-4874-9e1c-dcd553a739da tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.347791 Jul 01 10:44:21.685717 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2121/4135] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:21 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:21.912084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:21.913078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:21.925835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:21.928402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:21.929808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:21.931179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:21.960299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:21.960911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:21.988204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:21.988669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:21.989525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:21.996746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:22.082124 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:22.486548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:22.496310 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-29f7c2f7-289e-4fcf-a9ca-88c36e102be5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.588304 Jul 01 10:44:22.499552 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2015/4136] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:21 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:22.554491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:22.580208 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc680edc-5b3d-438e-b4ec-039b9eb9201b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.620310 Jul 01 10:44:22.590066 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2122/4137] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:21 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:22.703164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:22.704044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:22.714324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:22.714774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:22.718265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:22.720804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:23.010751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:23.020923 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e3f5e086-c7fc-4652-9198-0f234f91ec66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.322844 Jul 01 10:44:23.033431 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2016/4138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:22 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:23.517086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:23.517737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:23.532306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:23.532728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:23.541842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:23.542342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:23.596928 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:23.597945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:23.604757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:23.605225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:23.617063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:23.617063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:24.491756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:24.492334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:24.502224 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4e5b01b-d6ba-4f43-b6e3-606cc49282c3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.909068 Jul 01 10:44:24.505477 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2017/4139] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:23 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:24.508984 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10bcedcf-dce9-4673-b54e-beef60974cd8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.990955 Jul 01 10:44:24.509769 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2123/4140] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:23 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:24.511142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:24.511755 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:24.525951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:24.528882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:24.531449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:24.532009 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:24.723018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-58889f22-7bee-4a34-ae11-581a77439bf0 req-92de7444-51ec-4154-91bf-1812148dd030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d25cd-6f85-4a63-ac05-0d7380c4954e", "name": "network-vif-plugged", "status": "completed", "tag": "0688ff0e-a045-49f2-a520-977ecae920ed"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:24.740290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-58889f22-7bee-4a34-ae11-581a77439bf0 req-92de7444-51ec-4154-91bf-1812148dd030 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:24.740740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-58889f22-7bee-4a34-ae11-581a77439bf0 req-92de7444-51ec-4154-91bf-1812148dd030 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:24.770979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-58889f22-7bee-4a34-ae11-581a77439bf0 req-92de7444-51ec-4154-91bf-1812148dd030 service nova] Creating event network-vif-plugged:0688ff0e-a045-49f2-a520-977ecae920ed for instance a65d25cd-6f85-4a63-ac05-0d7380c4954e on n-h2-master-1 Jul 01 10:44:24.779790 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-58889f22-7bee-4a34-ae11-581a77439bf0 req-92de7444-51ec-4154-91bf-1812148dd030 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060404 Jul 01 10:44:24.780290 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2124/4141] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:44:24.860115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:24.874110 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1598621c-db0a-4692-a991-32badecda407 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.365805 Jul 01 10:44:24.875243 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2018/4142] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:24 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:25.526239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:25.527581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:25.527982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:25.528358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:25.540836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:25.541049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:25.541374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:25.544696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:25.545187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:25.545753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:25.546562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:25.559580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:26.150386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:26.158147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:26.167130 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:26.179492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-819b8eb4-d057-426b-8aac-60c22284f74a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.656264 Jul 01 10:44:26.181332 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b33334c3-3c20-4258-8931-574826ac3758 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.658853 Jul 01 10:44:26.184612 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2125/4143] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:25 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:26.186550 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2019/4144] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:25 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:26.219961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:26.226435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:26.245247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:26.247602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:26.248644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:26.252402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:26.555400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:26.573816 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4bc46cf4-3eab-4361-865e-c443e8b407d4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1317 microversion: 2.1 time: 0.386313 Jul 01 10:44:26.574433 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2126/4145] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:26 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:26.872197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0fb0c68-f2e4-4737-8026-f5c9c1efeeb4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'create', calling method: .version_select at 0x7f6f90ce5430>, body: {"keypair": {"name": "tempest-keypair-836801865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsdDDLXH5oEiFmWATvjSkmwVlHwYAv1lsHF55G3Tm8JTRrSApYo5O0eTFP8rWi5cG3Tvg/ieUvSxfg6FSDUHecouLCfMsLty99FCRGEmBkCf0ugVvLvqfPneGtCmX1Adg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:26.934554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c0fb0c68-f2e4-4737-8026-f5c9c1efeeb4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for project dba2af3867524497b17de32361dec716. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:44:26.951415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c0fb0c68-f2e4-4737-8026-f5c9c1efeeb4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for user 83a534c1028048b3af84ce213aad7f15 and project dba2af3867524497b17de32361dec716. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:44:27.108928 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c0fb0c68-f2e4-4737-8026-f5c9c1efeeb4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.421640 Jul 01 10:44:27.114440 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2020/4146] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:44:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:27.208209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:27.208209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:27.209342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:27.211796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:27.214756 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:27.215216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:27.216012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:27.216450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:27.231058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:27.233303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:27.234902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:27.237088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:27.724265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:27.743768 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c7aa5e21-e4d3-4bb0-a336-1d18d499a609 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.545976 Jul 01 10:44:27.746759 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2127/4147] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:27 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:27.777294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:27.780221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:27.787485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:27.787940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:27.788726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:27.794646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:27.844272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:27.854161 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6fe5c36-86b4-44f6-b6b3-5ab544903842 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1520 microversion: 2.1 time: 0.650231 Jul 01 10:44:27.868213 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2021/4148] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:27 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1520 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:28.093621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:28.096100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc50b382-a954-43e6-9f4c-1b40ce7812bc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1505 microversion: 2.1 time: 0.346144 Jul 01 10:44:28.096862 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2128/4149] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:27 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:28.112916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:28.114196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:28.121447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.122091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:28.128847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.128847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:28.323056 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:28.326531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9e2b0fcd-b713-4044-870d-b0ef50c29c2d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1505 microversion: 2.1 time: 0.217818 Jul 01 10:44:28.327103 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2022/4150] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:28 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:28.342622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:28.344401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:28.360189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.360189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:28.360189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.360189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:28.521269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:44:28.521739 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:44:28.522213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:44:28.522632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:44:28.523151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:44:28.763793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:28.764417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:28.786339 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:28.787954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.788404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:28.789256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.792693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:28.938540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:28.948457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.953986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:28.954642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:28.955082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:29.014197 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38506467-337a-4450-bcf4-119d723d5915 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "POST /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e/action" status: 202 len: 1107 microversion: 2.1 time: 0.675412 Jul 01 10:44:29.018648 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2129/4151] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:28 2022] POST /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e/action => generated 1107 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 01 10:44:29.028664 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:29.029236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:29.046241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:29.046945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:29.048158 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:29.062315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:29.444194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:29.469960 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4516017-b78c-4c3a-babf-bc8bb11204fc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.710667 Jul 01 10:44:29.472580 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2023/4152] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:28 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:29.486828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:29.488716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:29.488948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:29.497626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:29.497626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:29.498743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f5344de1-e6ed-43af-a258-5a624a2acb94 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1500 microversion: 2.1 time: 0.482855 Jul 01 10:44:29.498877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:29.499432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:29.499897 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2130/4153] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:29 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1500 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:29.516165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:29.517888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:29.535073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:29.535582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:29.536384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:29.536824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:30.314145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:30.323734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:30.346523 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f93452b-fc1a-41a0-ab92-c101dd97ea13 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1514 microversion: 2.1 time: 0.834114 Jul 01 10:44:30.347712 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc71d034-a17e-46eb-84ad-9d57b4125477 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.872663 Jul 01 10:44:30.360097 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2131/4154] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:29 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1514 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:30.362826 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2024/4155] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:29 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:30.377344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb549014-8ca0-4a69-8592-cf61c3b5ee09 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:30.379782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cb549014-8ca0-4a69-8592-cf61c3b5ee09 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 7445e210-1009-4835-bc78-0735947411af] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:30.391301 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-cb549014-8ca0-4a69-8592-cf61c3b5ee09 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Instance 7445e210-1009-4835-bc78-0735947411af could not be found. Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb549014-8ca0-4a69-8592-cf61c3b5ee09 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/7445e210-1009-4835-bc78-0735947411af/action HTTP/1.1 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 14 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: {"rescue": {}} Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 7445e210-1009-4835-bc78-0735947411af could not be found. Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '7445e210-1009-4835-bc78-0735947411af', 'body': {'rescue': {}}} Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7445e210-1009-4835-bc78-0735947411af could not be found. Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7445e210-1009-4835-bc78-0735947411af could not be found. Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:30.394555 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7445e210-1009-4835-bc78-0735947411af could not be found. Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb549014-8ca0-4a69-8592-cf61c3b5ee09 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 404 to user: Instance 7445e210-1009-4835-bc78-0735947411af could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb549014-8ca0-4a69-8592-cf61c3b5ee09 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/7445e210-1009-4835-bc78-0735947411af/action" status: 404 len: 111 microversion: 2.1 time: 0.036216 Jul 01 10:44:30.406038 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2132/4156] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:30 2022] POST /compute/v2.1/servers/7445e210-1009-4835-bc78-0735947411af/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:30.410843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3c64557-5f1e-43ae-ba1b-4fe3923a2a70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:30.411387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3c64557-5f1e-43ae-ba1b-4fe3923a2a70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:30.418046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3c64557-5f1e-43ae-ba1b-4fe3923a2a70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:30.418499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3c64557-5f1e-43ae-ba1b-4fe3923a2a70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:30.419278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3c64557-5f1e-43ae-ba1b-4fe3923a2a70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:30.419887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3c64557-5f1e-43ae-ba1b-4fe3923a2a70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:30.488462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:30.515745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:30.515745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:30.515745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:30.515745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:30.515745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:30.707773 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3c64557-5f1e-43ae-ba1b-4fe3923a2a70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action" status: 202 len: 0 microversion: 2.1 time: 0.301331 Jul 01 10:44:30.709857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2025/4157] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:30 2022] POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:44:30.728976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:30.730719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:30.739585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:30.745282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:30.745282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:30.745282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:30.771805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:30.780151 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99146078-50fc-41f3-aa28-596f7c88efb6 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.295455 Jul 01 10:44:30.782928 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2133/4158] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:30 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:30.960329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:30.981494 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ee2f686-fd48-4305-b498-a5602374b021 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1519 microversion: 2.1 time: 0.267798 Jul 01 10:44:30.984086 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2026/4159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:30 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:31.325787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1609898921", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6154fccb-0f7e-4e65-9515-90cbac52b9d7"}], "security_groups": [{"name": "tempest-securitygroup--2003904829"}], "key_name": "tempest-keypair-836801865", "user_data": "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:31.366742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:31.367521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:31.377778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:31.377778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:31.378880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:31.379427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:31.548682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] validate_networks() for [('6154fccb-0f7e-4e65-9515-90cbac52b9d7', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:44:31.660728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:31.668313 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6cee1141-f808-4bd6-a838-e09f94662d55 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.305892 Jul 01 10:44:31.680077 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2027/4160] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:31 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:31.798507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:31.799119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:31.808810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:31.810043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:31.812037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:31.812680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.073488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:32.081481 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3d1a6e6-f59e-4e19-b90e-677f62377312 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.286932 Jul 01 10:44:32.082116 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2028/4161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:31 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:32.096887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:32.097618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:32.104158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.104600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.105398 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.105825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.556638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:44:32.557752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:44:32.558694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:44:32.559257 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:44:32.560501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:44:32.571939 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.572768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.573849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.574460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.594067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for project dba2af3867524497b17de32361dec716. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:44:32.601747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:32.603564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for user 83a534c1028048b3af84ce213aad7f15 and project dba2af3867524497b17de32361dec716. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:44:32.610091 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ca75ffc-ff48-47ca-b066-9581461410ed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1499 microversion: 2.1 time: 0.526777 Jul 01 10:44:32.611346 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2029/4162] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:32 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1499 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:32.619899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:44:32.622244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:44:32.636339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:32.646705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:32.653363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.659997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.659997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.659997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.679595 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lazy-loading 'flavor' on Instance uuid 3e86e169-88e7-4094-9f19-014a424b87d6 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:44:32.686010 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:32.693657 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Cannot 'rescue' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state paused Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action HTTP/1.1 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 14 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: {"rescue": {}} Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'rescue' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state paused Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3e86e169-88e7-4094-9f19-014a424b87d6', 'body': {'rescue': {}}} Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 in vm_state paused. Cannot rescue while the instance is in this state. Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state paused Jul 01 10:44:32.695634 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state paused Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 409 to user: Cannot 'rescue' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state paused {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-878b28e1-370d-4adc-ade1-dcb02f1f2c11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action" status: 409 len: 144 microversion: 2.1 time: 0.064962 Jul 01 10:44:32.699825 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2030/4163] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:32 2022] POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action => generated 144 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:44:32.703969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:32.705203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:32.711237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.711689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.712455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.712891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.850745 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d943a17e-469b-481a-94f7-a21c6805927a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.529171 Jul 01 10:44:32.851659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2134/4164] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:44:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:44:32.861438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-02195e80-8c5b-4494-ba89-c2b08db91bdf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:32.862215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-02195e80-8c5b-4494-ba89-c2b08db91bdf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:32.869113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:32.873117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02195e80-8c5b-4494-ba89-c2b08db91bdf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.873678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02195e80-8c5b-4494-ba89-c2b08db91bdf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.874580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02195e80-8c5b-4494-ba89-c2b08db91bdf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:32.875098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-02195e80-8c5b-4494-ba89-c2b08db91bdf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:32.891933 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61fe6809-5473-4a5c-bcdf-66b649d51912 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.193224 Jul 01 10:44:32.908974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2031/4165] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:32 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:32.911756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7530a6fb-5553-4c81-b036-447e6eaf6cb0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:32.912315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7530a6fb-5553-4c81-b036-447e6eaf6cb0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:32.993285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7530a6fb-5553-4c81-b036-447e6eaf6cb0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:33.005885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7530a6fb-5553-4c81-b036-447e6eaf6cb0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1237 microversion: 2.1 time: 0.099413 Jul 01 10:44:33.019668 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2032/4166] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:32 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:33.101275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:33.102417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:33.109977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:33.110426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:33.111182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:33.111606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:33.188732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-02195e80-8c5b-4494-ba89-c2b08db91bdf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action" status: 202 len: 0 microversion: 2.1 time: 0.335693 Jul 01 10:44:33.193116 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2135/4167] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:32 2022] POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:44:33.200366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:33.201620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:33.211506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:33.212948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:33.213961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:33.214410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:33.257772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:33.268907 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1b1e1824-46f7-4ade-b8b6-29df7e338dc5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.173769 Jul 01 10:44:33.279575 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2033/4168] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:33 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:33.383124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:33.392570 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-588e1379-cce7-43a2-bfa6-210fa0293e8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1506 microversion: 2.1 time: 0.197839 Jul 01 10:44:33.393562 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2136/4169] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:33 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:33.920334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:33.920860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:33.935776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:33.936235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:33.937013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:33.937646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:34.039929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d890a6a-8a4c-4e54-b8b6-40028d216cbb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:34.046467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d890a6a-8a4c-4e54-b8b6-40028d216cbb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:34.125607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2d890a6a-8a4c-4e54-b8b6-40028d216cbb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:34.132818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:34.134171 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d890a6a-8a4c-4e54-b8b6-40028d216cbb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1237 microversion: 2.1 time: 0.110707 Jul 01 10:44:34.135622 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2137/4170] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:34 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:34.149751 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-49f0e5b4-a3a5-4043-b8f0-01c071efad08 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.239347 Jul 01 10:44:34.150411 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2034/4171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:33 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:34.286845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:34.287956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:34.306873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:34.307423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:34.311884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:34.312716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:34.411989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:34.412612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:34.419001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:34.419955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:34.420332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:34.420931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:34.513132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:34.528286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-73c83249-5113-46c2-be2b-64cae101c478 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.242938 Jul 01 10:44:34.538342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2138/4172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:34 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:34.645973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:34.653953 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-55a6a650-8f95-49d4-834f-4246a4233299 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1514 microversion: 2.1 time: 0.247394 Jul 01 10:44:34.654527 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2035/4173] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:34 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:35.086940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1434093a-13ec-46a1-88cb-75c5c35ddac8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91c92f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:35.153690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:35.153690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:35.161943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.163562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.168333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.168987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.249592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:35.252947 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c9e1d804-b969-4bb2-a253-3ce41fbd00fd tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1289 microversion: 2.1 time: 0.106025 Jul 01 10:44:35.255366 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2036/4174] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:35 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:35.267149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:35.267771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:35.274032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.274509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.275760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.275895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.295339 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:35.296630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1434093a-13ec-46a1-88cb-75c5c35ddac8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.298670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1434093a-13ec-46a1-88cb-75c5c35ddac8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.299797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1434093a-13ec-46a1-88cb-75c5c35ddac8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.301858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1434093a-13ec-46a1-88cb-75c5c35ddac8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.330871 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:35.457214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:35.467027 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1434093a-13ec-46a1-88cb-75c5c35ddac8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce" status: 200 len: 148 microversion: 2.57 time: 0.581547 Jul 01 10:44:35.467672 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2139/4175] 10.222.0.23 () {62 vars in 1302 bytes} [Fri Jul 1 10:44:34 2022] PUT /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce => generated 148 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:44:35.468326 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b7146f8b-a753-46fa-bc4a-396129f92636 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.210559 Jul 01 10:44:35.469586 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2037/4176] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:35 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:35.491591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-393cecc3-4e56-4102-a359-b082d7475689 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Calling method '.version_select at 0x7f6f970ecc10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:35.547098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:35.547789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:35.560559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.561016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.565572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.566376 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.813026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-393cecc3-4e56-4102-a359-b082d7475689 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.813526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-393cecc3-4e56-4102-a359-b082d7475689 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.814333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-393cecc3-4e56-4102-a359-b082d7475689 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:35.814778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-393cecc3-4e56-4102-a359-b082d7475689 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:35.838974 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-393cecc3-4e56-4102-a359-b082d7475689 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce/detail" status: 200 len: 463 microversion: 2.57 time: 0.365328 Jul 01 10:44:35.839900 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2140/4177] 10.222.0.23 () {60 vars in 1303 bytes} [Fri Jul 1 10:44:35 2022] GET /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce/detail => generated 463 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:44:35.914268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:35.936976 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63fc83ec-8569-445d-8fd1-90a3ca2b4350 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.394501 Jul 01 10:44:35.938251 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2038/4178] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:35 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:36.203846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Action: 'update', calling method: .version_select at 0x7f6f91ace8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:36.278446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:36.279838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:36.288863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.289618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.290669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.292383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.298858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.299670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.300533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.301892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.346452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.347105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.348898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.349661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.411199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:36.427931 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d4f9a44-e006-42a1-bfbd-6dd3a14eb1d0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1295 microversion: 2.1 time: 0.158174 Jul 01 10:44:36.430737 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2039/4179] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:36 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1295 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:36.506925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:36.507547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:36.547339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.547339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.547837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.552851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.590237 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8a6378d6-576d-41e2-ba5c-466d356a92f8 tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce?user_id=837250424fc74f52924865331e5ca079" status: 200 len: 148 microversion: 2.57 time: 0.390773 Jul 01 10:44:36.590901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2141/4180] 10.222.0.23 () {62 vars in 1383 bytes} [Fri Jul 1 10:44:36 2022] PUT /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce?user_id=837250424fc74f52924865331e5ca079 => generated 148 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:44:36.604828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d8c77a2-77a6-4b52-a64c-0b5d845b4dfa tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] Calling method '.version_select at 0x7f6f91b123a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:36.685326 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d8c77a2-77a6-4b52-a64c-0b5d845b4dfa tempest-QuotasAdminTestV257-543428557 tempest-QuotasAdminTestV257-543428557-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce?user_id=837250424fc74f52924865331e5ca079" status: 200 len: 190 microversion: 2.57 time: 0.088149 Jul 01 10:44:36.686016 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2142/4181] 10.222.0.23 () {60 vars in 1363 bytes} [Fri Jul 1 10:44:36 2022] GET /compute/v2.1/os-quota-sets/2d3e7784df3b4166909dc31e9f5ea2ce?user_id=837250424fc74f52924865331e5ca079 => generated 190 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:44:36.909262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:36.918949 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d076fda3-3288-4829-a65a-198732610c66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.435898 Jul 01 10:44:36.919879 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2040/4182] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:36 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:36.960695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:36.961386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:36.982868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.983323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:36.984106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:36.984537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:37.303288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:37.311515 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b29f479-bd1c-4b3d-b11c-59427d4f1f82 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.355505 Jul 01 10:44:37.312523 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2143/4183] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:36 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:37.449784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:37.450391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:37.457916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:37.458360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:37.459290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:37.459873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:37.647981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:37.649779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:37.664300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:37.674362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:37.675694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:37.679703 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:37.727166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lazy-loading 'flavor' on Instance uuid 3e86e169-88e7-4094-9f19-014a424b87d6 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:44:37.800496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:37.809196 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-352709e2-fc85-4f3a-9b6e-d67726cc84df tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.363570 Jul 01 10:44:37.813732 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2041/4184] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:37 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:37.936749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:37.936749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:37.958929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:37.959383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:37.960209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:37.960638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:38.113872 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-469afa9e-5866-4c1f-98e1-60fc07e85d18 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action" status: 200 len: 32 microversion: 2.1 time: 0.477522 Jul 01 10:44:38.113872 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2144/4185] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:37 2022] POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:44:38.144173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:38.146765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:38.154671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:38.155403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:38.156506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:38.157183 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:38.432399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:38.440591 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c882b3d6-ed04-4b2b-885f-b39eef130e09 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.508611 Jul 01 10:44:38.450515 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2042/4186] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:37 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:38.456281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:38.457186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:38.464673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:38.465365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:38.466325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:38.466761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:38.535014 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:38.544007 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc362728-1593-44b0-ba76-a201595d669f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.409960 Jul 01 10:44:38.555313 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2145/4187] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:38 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:38.781046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:38.789706 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bd168bb-4d4e-42c7-aefb-1c17689607dc tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.337398 Jul 01 10:44:38.790283 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2043/4188] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:38 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:38.832452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:38.833618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:38.843752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:38.844554 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:38.845574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:38.846239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:39.242121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:39.255644 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6feb375-84a9-474b-9383-9f7c65babbb5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.428188 Jul 01 10:44:39.256473 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2146/4189] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:38 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:39.460164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:39.463012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:39.479642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:39.481174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:39.482299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:39.483395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:39.562315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:39.563651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:39.571224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:39.572933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:39.574206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:39.574931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:39.919833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:39.929162 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4fa7e853-9104-4c98-b980-0bed257103de tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.370920 Jul 01 10:44:39.931259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:39.934153 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2147/4190] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:39 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:39.939692 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b966ede2-b68b-4c7a-878b-1fb21973ce66 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.485780 Jul 01 10:44:39.947184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:39.947963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:39.952529 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2044/4191] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:39 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:39.965708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:39.966160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:39.967768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:39.968208 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:40.121051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-1c23d0a4-210a-4137-b96b-297ddc4fecb8 req-ed33e0a0-c72f-45a1-a579-36d94b3c08ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11758f07-3b9c-487c-8d96-ac3a93fbfbf8", "tag": "a2330e85-0b72-4a71-8134-6331bba15ab2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:40.133261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1c23d0a4-210a-4137-b96b-297ddc4fecb8 req-ed33e0a0-c72f-45a1-a579-36d94b3c08ad service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:40.133721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1c23d0a4-210a-4137-b96b-297ddc4fecb8 req-ed33e0a0-c72f-45a1-a579-36d94b3c08ad service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:40.161040 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-1c23d0a4-210a-4137-b96b-297ddc4fecb8 req-ed33e0a0-c72f-45a1-a579-36d94b3c08ad service nova] Creating event network-changed:a2330e85-0b72-4a71-8134-6331bba15ab2 for instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 on n-h1-master-1 Jul 01 10:44:40.166456 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-1c23d0a4-210a-4137-b96b-297ddc4fecb8 req-ed33e0a0-c72f-45a1-a579-36d94b3c08ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050185 Jul 01 10:44:40.167416 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2045/4192] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:40.307128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:40.309590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:40.312615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:40.321674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-48fb9349-a5bd-4af7-b609-726b1a4d2679 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.386164 Jul 01 10:44:40.327155 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2148/4193] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:39 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:40.342555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:40.343010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:40.343865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:40.344299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:40.774744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:40.784308 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-19d9c669-08ac-4a8a-99e4-54c60d34f159 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.514658 Jul 01 10:44:40.787317 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2046/4194] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:40 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:40.948237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:40.948758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:40.959243 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:40.959856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:40.965717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:40.965717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:40.965717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:40.967256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:40.967416 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:40.968611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:40.970405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:40.971334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:41.366120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:41.376064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:41.386618 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-972a527e-57ae-4610-8a71-277fbc92f06b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.431761 Jul 01 10:44:41.397111 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a0b2face-4736-4730-b379-5240e7bc35f3 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.445935 Jul 01 10:44:41.397938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2047/4195] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:40 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:41.404980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:41.405721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:41.410841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2149/4196] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:40 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:41.415283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:41.417248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:41.419599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:41.420371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:41.740315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:41.765729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-18620bff-558a-4212-b020-3fd70d8aa1e9 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.366420 Jul 01 10:44:41.778341 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2048/4197] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:41 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:41.807366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:41.809536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:41.824457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:41.829736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:41.831708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:41.834571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:42.068476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:42.077340 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04d86988-1ce2-443c-8797-489997022b8c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.274962 Jul 01 10:44:42.078255 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2150/4198] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:41 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:42.403826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:42.404452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:42.411095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:42.416596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:42.417125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:42.418102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:42.418545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:42.420670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:42.437312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:42.438126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:42.440144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:42.443076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:42.708074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:42.716218 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cbd769c5-3c68-4edb-8d26-a4dfd98151fc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.309273 Jul 01 10:44:42.716795 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2151/4199] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:42 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:42.719187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:42.726871 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e3b6912-af4e-4cf9-b593-526254113ec8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.326844 Jul 01 10:44:42.727457 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2049/4200] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:42 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:42.784280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:42.785200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:42.795752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:42.795752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:42.795752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:42.795752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:42.979904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:42.988968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b84cd426-dd26-4317-b77e-e05a18a82e1b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.207964 Jul 01 10:44:42.990188 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2152/4201] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:42 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:43.095925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:43.101456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:43.103584 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:43.108736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:43.109246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:43.110024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:43.110655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:43.295718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:43.306373 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91c99e8c-0054-4fb0-88a1-1f92c4398743 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.216183 Jul 01 10:44:43.313341 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2050/4202] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:43 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:43.732841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:43.733481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:43.743009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:43.743713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:43.744058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:43.744771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:43.745631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:43.746226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:43.756035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:43.756580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:43.765365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:43.765846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:44.085851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:44.094301 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91f8b25d-9ef4-4814-8f8f-6d114349a50d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.354066 Jul 01 10:44:44.094892 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2051/4203] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:43 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:44.109328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:44.110644 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:44.118633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:44.119368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:44.119666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:44.120598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:44.123803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:44.132760 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-276e7340-ea6b-461b-a159-a7e8816048cd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.403928 Jul 01 10:44:44.142705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2153/4204] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:43 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:44.313856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:44.323759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-55e6a98c-3f02-4ef3-b1cc-fec201562cea tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.218280 Jul 01 10:44:44.324675 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2052/4205] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:44 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:44.334703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:44.334703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:44.339647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:44.340344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:44.341639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:44.343058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:44.592361 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:44.604234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c3dc968d-2e57-4446-b136-c9a341c4f134 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.280512 Jul 01 10:44:44.604941 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2154/4206] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:44 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:45.116271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:45.116898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:45.126141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.126951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.128040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.129481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.157491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:45.158280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:45.166595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.167683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.168629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.169493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.416315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:45.428083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f22ef2c-e57d-431c-838e-2ac344bad295 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.280878 Jul 01 10:44:45.428816 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2155/4207] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:45 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:45.443842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:45.444327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:45.456089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.456307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.457717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.458146 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.458637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:45.477666 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6244fad-6fee-4dfc-8f94-d98f8e7dff7e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.369445 Jul 01 10:44:45.485378 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:45.493775 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2053/4208] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:45 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:45.624981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:45.632981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:45.657420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.662054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.662881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:45.663348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:45.692906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:45.701066 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-988390f8-4250-42a2-b786-6e06698299b5 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1510 microversion: 2.1 time: 0.270897 Jul 01 10:44:45.703499 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2156/4209] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:45 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:46.027139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:46.032193 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:46.037290 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-221f296a-024e-451a-b938-719302591ddc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.419703 Jul 01 10:44:46.037862 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2054/4210] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:45 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:46.458123 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:46.458715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:46.461683 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=11 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:46.483366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:46.485075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:46.486960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:46.487582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:46.498216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:46.498991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:46.524041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:46.525236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:46.528172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:46.529501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:46.679429 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:46.940952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:46.953072 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5b749d4-bdde-45fe-8952-cf8a8e68fb70 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.505676 Jul 01 10:44:46.954551 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2157/4211] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:46 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:46.963265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:46.964285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:46.973578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:46.975275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:46.976324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:46.976968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:47.172701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:47.186408 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5e9bbfdc-9857-40d3-a3d8-a1d75bae122c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.695020 Jul 01 10:44:47.190101 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2055/4212] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:46 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:47.200879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:47.201792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:47.210788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:47.222081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:47.234076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:47.234817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:47.504832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:47.510459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-657a93cc-55bd-40e3-8bbc-f81821512a8c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1487 microversion: 2.1 time: 0.554572 Jul 01 10:44:47.511048 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2158/4213] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:46 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1487 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:47.527488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5625ee40-1798-4810-9d88-ccf423b606fe req-7963d5df-fc93-4333-aa8d-93b2ddd3bbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11758f07-3b9c-487c-8d96-ac3a93fbfbf8", "name": "network-vif-plugged", "status": "completed", "tag": "a2330e85-0b72-4a71-8134-6331bba15ab2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:47.544158 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5625ee40-1798-4810-9d88-ccf423b606fe req-7963d5df-fc93-4333-aa8d-93b2ddd3bbb4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:47.549690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5625ee40-1798-4810-9d88-ccf423b606fe req-7963d5df-fc93-4333-aa8d-93b2ddd3bbb4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:47.572674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5625ee40-1798-4810-9d88-ccf423b606fe req-7963d5df-fc93-4333-aa8d-93b2ddd3bbb4 service nova] Creating event network-vif-plugged:a2330e85-0b72-4a71-8134-6331bba15ab2 for instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 on n-h1-master-1 Jul 01 10:44:47.589357 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5625ee40-1798-4810-9d88-ccf423b606fe req-7963d5df-fc93-4333-aa8d-93b2ddd3bbb4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067853 Jul 01 10:44:47.590415 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2159/4214] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:47.596094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b53d374-f9bf-4801-b103-af7d2b02c697 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1986782730"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:47.597517 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b53d374-f9bf-4801-b103-af7d2b02c697 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:47.616730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b53d374-f9bf-4801-b103-af7d2b02c697 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:47.616730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b53d374-f9bf-4801-b103-af7d2b02c697 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:47.616730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b53d374-f9bf-4801-b103-af7d2b02c697 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:47.617772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b53d374-f9bf-4801-b103-af7d2b02c697 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:47.838949 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b53d374-f9bf-4801-b103-af7d2b02c697 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "PUT /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1061 microversion: 2.1 time: 0.247196 Jul 01 10:44:47.839925 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2160/4215] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:44:47 2022] PUT /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1061 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:47.857929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:47.858561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:47.868728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:47.869529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:47.870467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:47.871092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:48.059146 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:48.075885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f5156c9e-4546-4cad-add4-62bb1b710150 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.881484 Jul 01 10:44:48.077449 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2056/4216] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:47 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:48.084373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:48.085324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:48.095736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:48.096424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:48.098504 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:48.099429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:48.258629 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:48.270511 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-92e4cf19-6600-4b2f-8a14-2b8907a83690 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1488 microversion: 2.1 time: 0.418689 Jul 01 10:44:48.271498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2161/4217] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:47 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1488 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:48.284906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:48.284906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:48.285362 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:48.296667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:48.297444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:48.298510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:48.299670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:49.048308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:49.060260 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f86cd676-c3ca-4cb1-804d-0f32bcee7760 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.980352 Jul 01 10:44:49.062151 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2057/4218] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:48 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:49.089500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:49.090947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:49.100988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:49.101740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:49.102486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:49.103669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:49.154984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:49.171854 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-177155c8-7105-4b25-8c76-1d4caef79da6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.898615 Jul 01 10:44:49.173681 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2162/4219] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:48 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:49.181278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:49.182112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:49.189649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:49.192199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:49.194483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:49.195251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:49.683643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:49.698007 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01fe8600-04f1-404c-85df-0ddef7986520 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.523214 Jul 01 10:44:49.698820 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2163/4220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:49 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:49.780853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:49.792267 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-26bc8fb4-36b1-48ba-aa2a-949551bc3e70 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1488 microversion: 2.1 time: 0.723120 Jul 01 10:44:49.803901 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2058/4221] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:49 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1488 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:49.809412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:49.809914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:49.825871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:49.826557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:49.827607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:49.828200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:49.902601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:44:50.083925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:50.090388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:50.094596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.095332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.101948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.103455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.337187 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-daa8b343-e073-4779-9f94-c18609a5eb8e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 204 len: 0 microversion: 2.1 time: 0.532265 Jul 01 10:44:50.340243 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2164/4222] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:49 2022] DELETE /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:44:50.349698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:50.350703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:50.366180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.366608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.367392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.367834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.444125 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:50.463807 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21c976fb-1882-4d7a-b43a-679ff29c47cc tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.384079 Jul 01 10:44:50.464405 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2059/4223] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:50 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:50.488015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:50.488955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:50.501825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.502774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.504308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.505272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.703726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:50.717415 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8bdfcd82-45d8-4058-9621-3af3a2a69362 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.374760 Jul 01 10:44:50.718396 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2165/4224] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:50 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:50.736044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:50.746552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:50.754285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.754962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.755964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:50.756550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:50.852423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:50.889461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58e0e352-e38e-4098-8aa0-49d02498d168 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1494 microversion: 2.1 time: 0.420523 Jul 01 10:44:50.893493 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2060/4225] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:50 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1494 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:51.190205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:51.205862 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d24f4d77-4f64-4ed5-bc6d-60a28e3fdee6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1363 microversion: 2.1 time: 0.477549 Jul 01 10:44:51.207198 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2166/4226] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:50 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:51.482241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:51.482855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:51.489952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:51.490395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:51.491204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:51.491948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:51.738754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:51.738754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:51.751840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:51.752407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:51.759782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:51.760557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:51.772327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:51.792346 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d03334a-e779-4c0a-99e0-ce23fd326f74 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.306950 Jul 01 10:44:51.793372 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2061/4227] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:51 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:51.910298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:51.910927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:51.921369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:51.921987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:51.922923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:51.924277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:52.407121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:52.435786 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ea2a0ca-2b29-40b0-a7ca-12ac7ff07a8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.692301 Jul 01 10:44:52.447556 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2167/4228] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:51 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:52.450335 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:52.451024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:52.460747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:52.461468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:52.462413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:52.463012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:52.790494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:52.802700 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa6f85f3-24e3-4501-baea-6f7b33034d34 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1494 microversion: 2.1 time: 0.896386 Jul 01 10:44:52.803295 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2062/4229] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:51 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1494 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:52.822965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:52.824441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:52.833580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:52.834334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:52.836118 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:52.836786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.068052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:53.093273 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c97b1a68-9605-402d-a2d3-b6b80b413821 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1549 microversion: 2.1 time: 0.650740 Jul 01 10:44:53.095471 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2168/4230] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:52 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1549 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:53.127158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51d8e03b-9f70-4ce9-98e6-745ca29f360c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:53.127721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-51d8e03b-9f70-4ce9-98e6-745ca29f360c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:53.140394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51d8e03b-9f70-4ce9-98e6-745ca29f360c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.141001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51d8e03b-9f70-4ce9-98e6-745ca29f360c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.141908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51d8e03b-9f70-4ce9-98e6-745ca29f360c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.142348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51d8e03b-9f70-4ce9-98e6-745ca29f360c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.227345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:53.236217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c895a1b-96b1-4fe8-bcc6-25fe794de04c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1500 microversion: 2.1 time: 0.430142 Jul 01 10:44:53.256508 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2063/4231] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:52 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:53.263495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "294db591-64a5-42d1-832d-a20f965672f4"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:53.265068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:53.273911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.274410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.276260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.276701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.316954 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Cannot 'attach_volume' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state rescued Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/os-volume_attachments HTTP/1.1 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 74 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: {"volumeAttachment": {"volumeId": "294db591-64a5-42d1-832d-a20f965672f4"}} Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'attach_volume' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state rescued Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '3e86e169-88e7-4094-9f19-014a424b87d6', 'body': {'volumeAttachment': {'volumeId': '294db591-64a5-42d1-832d-a20f965672f4'}}} Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 01 10:44:53.319186 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state rescued Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state rescued Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:53.324284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 409 to user: Cannot 'attach_volume' instance 3e86e169-88e7-4094-9f19-014a424b87d6 while it is in vm_state rescued {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:53.325227 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e093e00c-e23c-4646-960a-24a99df52083 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066981 Jul 01 10:44:53.325227 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2064/4232] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:44:53 2022] POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:44:53.333951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9bcaf712-92d5-43f8-a9a8-503ff391bd9f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:53.334486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9bcaf712-92d5-43f8-a9a8-503ff391bd9f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:53.341288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcaf712-92d5-43f8-a9a8-503ff391bd9f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.341950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcaf712-92d5-43f8-a9a8-503ff391bd9f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.343127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcaf712-92d5-43f8-a9a8-503ff391bd9f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.343562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bcaf712-92d5-43f8-a9a8-503ff391bd9f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.385188 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51d8e03b-9f70-4ce9-98e6-745ca29f360c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272019 Jul 01 10:44:53.386195 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2169/4233] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:44:53 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:53.461337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:53.461947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:53.469607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.473368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.476469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.477111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.703576 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9bcaf712-92d5-43f8-a9a8-503ff391bd9f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action" status: 202 len: 0 microversion: 2.1 time: 0.373930 Jul 01 10:44:53.704534 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2065/4234] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:44:53 2022] POST /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:44:53.723997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:53.727054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:53.736007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.736826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.739280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.740067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.833303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:53.863507 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af361160-05c5-43b3-9e08-bd24fadd0af5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.408424 Jul 01 10:44:53.864747 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2170/4235] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:53 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:53.872528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a504711d-8d54-4c6c-b81a-f16a4feaf63b req-ab071ae6-6942-4535-9217-1ec5f0422208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab13833-0763-4ea8-a440-e4217bbdd4b3", "name": "network-vif-deleted", "tag": "96de66bd-1c5f-4d24-8c89-a5a7c451d5aa"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:53.885481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a504711d-8d54-4c6c-b81a-f16a4feaf63b req-ab071ae6-6942-4535-9217-1ec5f0422208 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.888818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a504711d-8d54-4c6c-b81a-f16a4feaf63b req-ab071ae6-6942-4535-9217-1ec5f0422208 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.914811 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a504711d-8d54-4c6c-b81a-f16a4feaf63b req-ab071ae6-6942-4535-9217-1ec5f0422208 service nova] Creating event network-vif-deleted:96de66bd-1c5f-4d24-8c89-a5a7c451d5aa for instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 on n-h2-master-1 Jul 01 10:44:53.923484 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a504711d-8d54-4c6c-b81a-f16a4feaf63b req-ab071ae6-6942-4535-9217-1ec5f0422208 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056586 Jul 01 10:44:53.927446 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2171/4236] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:53.932651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:53.933916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:53.943022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.943746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.944746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:53.945396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:53.964309 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:54.099952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:54.108856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8657dee5-fad5-42b3-92a5-d8cefa43b530 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 200 len: 1452 microversion: 2.1 time: 0.182032 Jul 01 10:44:54.119890 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2172/4237] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:53 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:54.360682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:54.377760 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5906b43f-3fb9-46aa-aea9-b96153b19b76 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1508 microversion: 2.1 time: 0.668170 Jul 01 10:44:54.388592 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2066/4238] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:53 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1508 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:54.881788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:54.882669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:54.901628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:54.902403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:54.904073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:54.905846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.126643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.130047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.148892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.149411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.150312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.150808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.184769 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 HTTP/1.1 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7ab13833-0763-4ea8-a440-e4217bbdd4b3'} Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.191385 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.194878 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-061d4ca1-3540-4fc1-ad22-b1da35dd71b8 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 404 len: 111 microversion: 2.1 time: 0.070111 Jul 01 10:44:55.200089 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2067/4239] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:44:55.209411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.209924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.230213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.230677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.231469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.231907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.262937 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 HTTP/1.1 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7ab13833-0763-4ea8-a440-e4217bbdd4b3'} Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.264555 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.269238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6853ddd-eb75-43c6-9a89-eac0b9b61d69 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 404 len: 111 microversion: 2.1 time: 0.061818 Jul 01 10:44:55.276395 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2068/4240] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:44:55.281306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.282152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 7ab13833-0763-4ea8-a440-e4217bbdd4b3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.289100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.289915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.290902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.291482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.307192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:55.308577 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 HTTP/1.1 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7ab13833-0763-4ea8-a440-e4217bbdd4b3'} Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.310429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 7ab13833-0763-4ea8-a440-e4217bbdd4b3 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad9eb00e-01e8-4dd2-93d4-0432278ea2e3 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3" status: 404 len: 111 microversion: 2.1 time: 0.035057 Jul 01 10:44:55.320292 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2069/4241] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/7ab13833-0763-4ea8-a440-e4217bbdd4b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.322058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.325191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.336422 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80f627bc-05e0-4e74-9f09-7a16ce5cf9a5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.459512 Jul 01 10:44:55.349350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2173/4242] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:54 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:55.349696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.349696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.355004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.355607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.374667 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 HTTP/1.1 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: exception: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'dac4fd96-1f2a-4f2d-86d4-e2eeb2479505'} Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.378835 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.382943 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.383787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.384911 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-adef4fca-1444-43b2-9db9-8d8dd5460887 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 404 len: 111 microversion: 2.1 time: 0.066660 Jul 01 10:44:55.385653 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2070/4243] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.396769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.396995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.397975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.399944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: dac4fd96-1f2a-4f2d-86d4-e2eeb2479505] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.406195 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.407217 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.408203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.408869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.410712 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.411181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.415799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.416279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.442658 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 HTTP/1.1 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: exception: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'dac4fd96-1f2a-4f2d-86d4-e2eeb2479505'} Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.444381 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.452490 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-76f1a62d-4e4f-439e-8e74-f8c8c0778b77 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505" status: 404 len: 111 microversion: 2.1 time: 0.054191 Jul 01 10:44:55.461549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2174/4244] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/dac4fd96-1f2a-4f2d-86d4-e2eeb2479505 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.466850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.467356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.487567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.487963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.488757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.489229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.504801 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 HTTP/1.1 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7'} Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.506423 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.510632 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.512140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.513205 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-181d31ff-2398-488e-9e93-76b1fd410ceb tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 404 len: 111 microversion: 2.1 time: 0.050591 Jul 01 10:44:55.514259 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2175/4245] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.523510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.524360 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.540344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.540344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.540344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.540344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.551401 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 HTTP/1.1 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7'} Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.555569 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.560499 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.560499 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.560499 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.560499 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.560499 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. Jul 01 10:44:55.560499 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.566012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.567137 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b86fb3c-9c0c-4e4d-be11-2e922ab4fb32 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7" status: 404 len: 111 microversion: 2.1 time: 0.049020 Jul 01 10:44:55.570206 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2176/4246] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/8d20a8b0-8f57-44cc-b1fb-69c1bf0c25e7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.589967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.591294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.599307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.600691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.601917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.602566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.624098 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd HTTP/1.1 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f9542320-9b9a-42dc-952e-2147380c8fbd'} Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.626476 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.630335 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.632139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.633286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01247200-145b-43f8-97e6-d0ba947aa7b0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 404 len: 111 microversion: 2.1 time: 0.060585 Jul 01 10:44:55.634713 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2177/4247] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.652520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.654778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: f9542320-9b9a-42dc-952e-2147380c8fbd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.662439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.663381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.665860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.667001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.687365 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd HTTP/1.1 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f9542320-9b9a-42dc-952e-2147380c8fbd'} Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.691680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.696279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.696279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.696279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.696279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.696279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. Jul 01 10:44:55.696279 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.699612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance f9542320-9b9a-42dc-952e-2147380c8fbd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.700932 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc7f617a-378d-460d-8f72-f9b605716a4d tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd" status: 404 len: 111 microversion: 2.1 time: 0.058201 Jul 01 10:44:55.702051 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2178/4248] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/f9542320-9b9a-42dc-952e-2147380c8fbd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.710751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.711363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.721495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.722652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.723602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.724153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.740914 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 HTTP/1.1 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6e1f0d64-97f2-4620-8784-a16be944e4b8'} Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.742883 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-810f5393-77d4-4f5d-bf11-7f0712f4ed8b tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 404 len: 111 microversion: 2.1 time: 0.040586 Jul 01 10:44:55.751043 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2179/4249] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:44:55.759398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.760346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 6e1f0d64-97f2-4620-8784-a16be944e4b8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.769011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.769790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.770808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.771505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.791862 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 HTTP/1.1 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6e1f0d64-97f2-4620-8784-a16be944e4b8'} Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.793405 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 6e1f0d64-97f2-4620-8784-a16be944e4b8 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b85f3c96-3a0f-4f4c-ae67-fb49648e31c7 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8" status: 404 len: 111 microversion: 2.1 time: 0.039703 Jul 01 10:44:55.797222 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2180/4250] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/6e1f0d64-97f2-4620-8784-a16be944e4b8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.807728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.808580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.818962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.819614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.820515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.821068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.852684 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 HTTP/1.1 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: exception: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c93ed880-7073-4f2a-bd35-71071fda6bf0'} Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.855316 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.859306 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.862174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.866026 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae913b9b-2dfa-4df8-bb8a-0848da3e70bf tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 404 len: 111 microversion: 2.1 time: 0.064319 Jul 01 10:44:55.867252 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2181/4251] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.875926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.877353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: c93ed880-7073-4f2a-bd35-71071fda6bf0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.884893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.886078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.887717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:55.888654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:55.913783 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 HTTP/1.1 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: exception: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c93ed880-7073-4f2a-bd35-71071fda6bf0'} Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.916325 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance c93ed880-7073-4f2a-bd35-71071fda6bf0 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.922729 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f63d0287-feca-45a2-9eab-f58dbe367ed1 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0" status: 404 len: 111 microversion: 2.1 time: 0.049491 Jul 01 10:44:55.926021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2182/4252] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/c93ed880-7073-4f2a-bd35-71071fda6bf0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:44:55.930820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70bd8b93-a86b-4da1-8577-329bbd3ee18c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.931500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-70bd8b93-a86b-4da1-8577-329bbd3ee18c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: b5ac277d-6723-4d43-a622-abb36c83c23f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.938090 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-70bd8b93-a86b-4da1-8577-329bbd3ee18c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70bd8b93-a86b-4da1-8577-329bbd3ee18c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f HTTP/1.1 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: exception: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'b5ac277d-6723-4d43-a622-abb36c83c23f'} Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.940302 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.943993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.943993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.943993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.943993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.943993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.943993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.943993 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.948578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70bd8b93-a86b-4da1-8577-329bbd3ee18c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.948977 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-70bd8b93-a86b-4da1-8577-329bbd3ee18c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f" status: 404 len: 111 microversion: 2.1 time: 0.021401 Jul 01 10:44:55.958745 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2183/4253] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.964479 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5359cb3-7167-4873-980f-7f7859a3ad2e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.965936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e5359cb3-7167-4873-980f-7f7859a3ad2e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: b5ac277d-6723-4d43-a622-abb36c83c23f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:55.974053 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e5359cb3-7167-4873-980f-7f7859a3ad2e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5359cb3-7167-4873-980f-7f7859a3ad2e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f HTTP/1.1 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: exception: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'b5ac277d-6723-4d43-a622-abb36c83c23f'} Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:44:55.975981 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:44:55.979621 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:44:55.979621 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:44:55.979621 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. Jul 01 10:44:55.979621 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:44:55.981482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5359cb3-7167-4873-980f-7f7859a3ad2e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance b5ac277d-6723-4d43-a622-abb36c83c23f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:44:55.982554 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5359cb3-7167-4873-980f-7f7859a3ad2e tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f" status: 404 len: 111 microversion: 2.1 time: 0.022317 Jul 01 10:44:55.983529 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2184/4254] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/b5ac277d-6723-4d43-a622-abb36c83c23f => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:44:55.994627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:55.995022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:56.009990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:56.010461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:56.011266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:56.011963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:56.047398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:44:56.253558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:56.269937 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2289dbbe-ade3-4e28-8e7d-fc8d06d63c9a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1508 microversion: 2.1 time: 0.877479 Jul 01 10:44:56.270847 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2071/4255] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:55 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1508 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:56.365602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:56.366201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:56.368303 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:56.375961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:56.380623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:56.381534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:56.385973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:56.530941 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2812439f-3c92-4770-85c5-f3c113596d6c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 204 len: 0 microversion: 2.1 time: 0.532255 Jul 01 10:44:56.530941 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2185/4256] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:44:55 2022] DELETE /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:44:56.540333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:56.552701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:56.584552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:56.585772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:56.590538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:56.600327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:57.150233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:57.169479 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-16c297da-9684-4a6a-b9d1-c39ff1e3af1d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1512 microversion: 2.1 time: 0.808482 Jul 01 10:44:57.170091 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2072/4257] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:56 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1512 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:57.181598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e836f2ee-abf1-4cc5-add1-99b3f903f103 req-7fd43179-eb3e-4cba-bc92-514e68c0689b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11758f07-3b9c-487c-8d96-ac3a93fbfbf8", "tag": "a2330e85-0b72-4a71-8134-6331bba15ab2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:44:57.201421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e836f2ee-abf1-4cc5-add1-99b3f903f103 req-7fd43179-eb3e-4cba-bc92-514e68c0689b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:57.201870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e836f2ee-abf1-4cc5-add1-99b3f903f103 req-7fd43179-eb3e-4cba-bc92-514e68c0689b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:57.237814 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e836f2ee-abf1-4cc5-add1-99b3f903f103 req-7fd43179-eb3e-4cba-bc92-514e68c0689b service nova] Creating event network-changed:a2330e85-0b72-4a71-8134-6331bba15ab2 for instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 on n-h1-master-1 Jul 01 10:44:57.261809 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e836f2ee-abf1-4cc5-add1-99b3f903f103 req-7fd43179-eb3e-4cba-bc92-514e68c0689b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080394 Jul 01 10:44:57.262608 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2073/4258] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:44:57.288608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:57.289446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:57.335650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:57.335650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:57.335650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:57.335650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:57.335650 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:44:57.389868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:57.391517 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5a94111-596a-4d74-86e9-bb8c3b6bc6be tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1479 microversion: 2.1 time: 0.861608 Jul 01 10:44:57.393821 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2186/4259] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:56 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1479 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:57.711064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:57.725825 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e72f9e57-ba9a-4a44-b95b-a4f734fe6151 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1508 microversion: 2.1 time: 0.442644 Jul 01 10:44:57.743229 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2074/4260] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:57 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:44:58.196082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:58.197045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:58.236429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:58.237137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:58.238848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:58.239493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:58.409797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:58.410417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:58.430353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:58.430353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:58.430353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:58.430353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:59.466145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:59.480160 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10d1244a-3e3c-4e75-adad-f2b261f54703 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1518 microversion: 2.1 time: 1.293417 Jul 01 10:44:59.484196 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2187/4261] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:58 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1518 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:44:59.490482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:44:59.491127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:44:59.498218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:59.498666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:59.502330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:44:59.504098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:44:59.529514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:44:59.546282 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5ed41ba4-b443-41ec-8b39-3efbc6b034c4 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1479 microversion: 2.1 time: 1.140444 Jul 01 10:44:59.557500 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2075/4262] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:58 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1479 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:00.336514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:00.352170 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f951cfe3-440c-4d24-8890-326dd7590c23 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1514 microversion: 2.1 time: 0.866252 Jul 01 10:45:00.352755 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2188/4263] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:44:59 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1514 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:00.505632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:00.506367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:00.523743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:00.524205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:00.524996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:00.527704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:00.567752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:00.569125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:00.587835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:00.593892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:00.593892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:00.593892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:01.423182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:01.434628 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01a1e282-4652-4164-ad04-9e8eb8e81f2f tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1479 microversion: 2.1 time: 0.871092 Jul 01 10:45:01.437239 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2189/4264] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:00 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1479 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:01.445588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:01.453402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3f5ba879-265b-47cb-8a81-e32839100a61 req-74603b98-e209-4b53-b8fc-c35d7b21375a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3988bb91-b5bb-4f8a-b081-e3368b62d4eb", "name": "network-vif-unplugged", "status": "completed", "tag": "d745fecb-3453-4d1e-b984-1d13f89bdaf1"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:01.458589 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e4d5c67-fe0a-406c-8bd3-affd12c2e2fa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1518 microversion: 2.1 time: 0.954222 Jul 01 10:45:01.462191 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2076/4265] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:00 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1518 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:01.489323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3f5ba879-265b-47cb-8a81-e32839100a61 req-74603b98-e209-4b53-b8fc-c35d7b21375a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:01.490198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3f5ba879-265b-47cb-8a81-e32839100a61 req-74603b98-e209-4b53-b8fc-c35d7b21375a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:01.536860 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3f5ba879-265b-47cb-8a81-e32839100a61 req-74603b98-e209-4b53-b8fc-c35d7b21375a service nova] Creating event network-vif-unplugged:d745fecb-3453-4d1e-b984-1d13f89bdaf1 for instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb on n-h2-master-1 Jul 01 10:45:01.551140 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3f5ba879-265b-47cb-8a81-e32839100a61 req-74603b98-e209-4b53-b8fc-c35d7b21375a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101932 Jul 01 10:45:01.557318 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2190/4266] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:01.658108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-12da79e6-c9d4-4167-9d34-557e09625724 req-0a470517-301d-48e8-aa2d-ba9c8a55c163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3988bb91-b5bb-4f8a-b081-e3368b62d4eb", "name": "network-vif-deleted", "tag": "d745fecb-3453-4d1e-b984-1d13f89bdaf1"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:01.672014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-12da79e6-c9d4-4167-9d34-557e09625724 req-0a470517-301d-48e8-aa2d-ba9c8a55c163 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:01.672515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-12da79e6-c9d4-4167-9d34-557e09625724 req-0a470517-301d-48e8-aa2d-ba9c8a55c163 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:01.687304 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-12da79e6-c9d4-4167-9d34-557e09625724 req-0a470517-301d-48e8-aa2d-ba9c8a55c163 service nova] Creating event network-vif-deleted:d745fecb-3453-4d1e-b984-1d13f89bdaf1 for instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb on n-h2-master-1 Jul 01 10:45:01.693237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-12da79e6-c9d4-4167-9d34-557e09625724 req-0a470517-301d-48e8-aa2d-ba9c8a55c163 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050124 Jul 01 10:45:01.694149 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2077/4267] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:02.454295 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:02.455325 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:02.476574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:02.477299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:02.479228 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:02.479865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:02.480875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:02.481501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:02.489194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:02.489654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:02.491618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:02.492078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:02.560499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:02.564281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:02.564772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lazy-loading 'fault' on Instance uuid 3988bb91-b5bb-4f8a-b081-e3368b62d4eb {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:45:02.698888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750a266b0e2e40febfb239888894069a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b39fd7bcc7b4a668ec1d7990a69a52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:02.709930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d67fd77-3ffc-40bb-aebe-54da12a581d0 tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 200 len: 1282 microversion: 2.1 time: 0.260550 Jul 01 10:45:02.728441 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2191/4268] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:02 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 1282 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:03.573112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4721dc23-3c19-4aa9-9142-437d58bbc8f1 req-3f7e647f-095e-4cd8-8f32-eabfdb1d953b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d25cd-6f85-4a63-ac05-0d7380c4954e", "name": "network-vif-unplugged", "status": "completed", "tag": "0688ff0e-a045-49f2-a520-977ecae920ed"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:03.589095 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4721dc23-3c19-4aa9-9142-437d58bbc8f1 req-3f7e647f-095e-4cd8-8f32-eabfdb1d953b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:03.589876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4721dc23-3c19-4aa9-9142-437d58bbc8f1 req-3f7e647f-095e-4cd8-8f32-eabfdb1d953b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:03.613862 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4721dc23-3c19-4aa9-9142-437d58bbc8f1 req-3f7e647f-095e-4cd8-8f32-eabfdb1d953b service nova] Creating event network-vif-unplugged:0688ff0e-a045-49f2-a520-977ecae920ed for instance a65d25cd-6f85-4a63-ac05-0d7380c4954e on n-h2-master-1 Jul 01 10:45:03.627713 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4721dc23-3c19-4aa9-9142-437d58bbc8f1 req-3f7e647f-095e-4cd8-8f32-eabfdb1d953b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058244 Jul 01 10:45:03.630467 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2192/4269] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:03.720882 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:03.730987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:03.734507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] [instance: 3988bb91-b5bb-4f8a-b081-e3368b62d4eb] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:03.746985 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b22253c-afe4-4e9e-bb7f-2f4549fd61b6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1518 microversion: 2.1 time: 1.274725 Jul 01 10:45:03.757738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:03.758227 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2078/4270] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:02 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1518 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:03.761849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:03.761849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:03.761849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:03.786937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] HTTP exception thrown: Instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb could not be found. Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Request method failure captured: Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb HTTP/1.1 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs8nP7Fjvb73tbQZ9Dn5OLfihlVDRboTyiw9reWBblBffP5DmU6M7pAl5toT_C9Wr_wmvJff1cNbS8ItSqojV_ODMiOG3UaN-TpDllVHZPChhRb2yJN0fwxT7nHhFlliCtgyOvsulBqxcs0CWjSzlBaQL62kjjH67ttfqI88LqM-Fc8 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestJSON-628475128 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b39fd7bcc7b4a668ec1d7990a69a52b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b39fd7bcc7b4a668ec1d7990a69a52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestJSON-628475128 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3b39fd7bcc7b4a668ec1d7990a69a52b Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestJSON-628475128 Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestJSON-628475128-project Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 750a266b0e2e40febfb239888894069a Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestJSON-628475128-project Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb could not be found. Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3988bb91-b5bb-4f8a-b081-e3368b62d4eb'} Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb could not be found. Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb could not be found. Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:45:03.788819 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb could not be found. Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] Returning 404 to user: Instance 3988bb91-b5bb-4f8a-b081-e3368b62d4eb could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb6b082b-296b-49a8-b5f6-e0e20af3c03c tempest-ServersTestJSON-628475128 tempest-ServersTestJSON-628475128-project] 10.222.0.23 "GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb" status: 404 len: 111 microversion: 2.1 time: 0.065888 Jul 01 10:45:03.796839 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2193/4271] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:03 2022] GET /compute/v2.1/servers/3988bb91-b5bb-4f8a-b081-e3368b62d4eb => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:45:04.563085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-941dc803-d755-4150-8eea-fd105a893ce4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'create', calling method: .version_select at 0x7f6f90c96670>, body: {"keypair": {"name": "tempest-keypair-96387054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyo5Q8GqYpSN8PESSGxmVrMX6HGTvaEHU2W5/f73MVLGPLed6LyLxdk+vaLpkeNJTcOBVoi6YU4ZW05AyrLtbp3HRC0M69IqhO4wOkjN9IQPIpnNym6a188S/1UDOWrcA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:04.577899 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-941dc803-d755-4150-8eea-fd105a893ce4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for project 86ca97adc659431ea83b0703369d0c50. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:45:04.583847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-941dc803-d755-4150-8eea-fd105a893ce4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for user 2979fb250468450aa9ba8a032a4ab90f and project 86ca97adc659431ea83b0703369d0c50. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:45:04.691252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-941dc803-d755-4150-8eea-fd105a893ce4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.131439 Jul 01 10:45:04.691864 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2079/4272] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:45:04 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:04.764908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:04.765763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:04.775215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:04.775832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:04.776774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:04.778034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:05.145776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:05.154405 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-892228c0-5cea-4eff-a93e-9be38239598c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1518 microversion: 2.1 time: 0.394162 Jul 01 10:45:05.155158 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2194/4273] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:04 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1518 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:05.697614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-140ad218-5d19-46c7-bb93-e8bddf0b38c8 req-1ac39c82-9d21-4010-befe-12aafee43dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d25cd-6f85-4a63-ac05-0d7380c4954e", "name": "network-vif-plugged", "status": "completed", "tag": "0688ff0e-a045-49f2-a520-977ecae920ed"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:05.710489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-140ad218-5d19-46c7-bb93-e8bddf0b38c8 req-1ac39c82-9d21-4010-befe-12aafee43dec service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:05.711181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-140ad218-5d19-46c7-bb93-e8bddf0b38c8 req-1ac39c82-9d21-4010-befe-12aafee43dec service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:05.725117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-140ad218-5d19-46c7-bb93-e8bddf0b38c8 req-1ac39c82-9d21-4010-befe-12aafee43dec service nova] Creating event network-vif-plugged:0688ff0e-a045-49f2-a520-977ecae920ed for instance a65d25cd-6f85-4a63-ac05-0d7380c4954e on n-h2-master-1 Jul 01 10:45:05.729398 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-140ad218-5d19-46c7-bb93-e8bddf0b38c8 req-1ac39c82-9d21-4010-befe-12aafee43dec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036388 Jul 01 10:45:05.730122 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2080/4274] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:06.171728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:06.172254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:06.185959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:06.186783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:06.191810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:06.196117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:07.018455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:07.053045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6083b34a-4912-4a6f-9553-851f84472dee tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1518 microversion: 2.1 time: 0.885302 Jul 01 10:45:07.054992 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2195/4275] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:06 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1518 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:08.072746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:08.073590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:08.090390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:08.097709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:08.097709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:08.097709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:08.361244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:08.369399 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f16495d-5b83-4b1c-bbc4-225a2b4a3d8b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1503 microversion: 2.1 time: 0.301831 Jul 01 10:45:08.381233 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2081/4276] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:08 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:08.386050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:08.386670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:08.394438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:08.395144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:08.396076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:08.396677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:08.679067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:08.687317 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6af3cd9e-0a17-4ca0-8c4a-7719f96f9628 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 200 len: 1503 microversion: 2.1 time: 0.305108 Jul 01 10:45:08.691279 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2196/4277] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:08 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:08.708711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:08.716489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:08.720113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:08.720826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:08.724615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:08.725264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:08.779092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:45:09.112879 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-efbb7136-0260-4b72-8dca-0200329f818c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 204 len: 0 microversion: 2.1 time: 0.397949 Jul 01 10:45:09.113887 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2082/4278] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:45:08 2022] DELETE /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:45:09.247949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1810611816", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "e32ddfd9-e576-4f03-b9da-056b95b2f137"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:09.356448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] validate_networks() for [('e32ddfd9-e576-4f03-b9da-056b95b2f137', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:45:10.606052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:45:10.606789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:45:10.607300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:45:10.607716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:45:10.608131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:45:10.657483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:10.657941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:10.658752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:10.659229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:10.693547 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:10.721367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Getting quotas for project 1756cea9fed0440da392929c10924cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:45:10.731248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Getting quotas for user 5486f8d5ebed4807a89deb962c392f1a and project 1756cea9fed0440da392929c10924cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:45:10.764967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:45:10.770870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:45:10.947789 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef05c4b1-a831-42fc-899f-327cf05817f2 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.710102 Jul 01 10:45:10.955039 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2197/4279] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:45:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:45:10.966278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c9e6c86c-351c-4cfc-a092-72f8ac9df503 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:10.967891 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c9e6c86c-351c-4cfc-a092-72f8ac9df503 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:10.996960 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:11.017005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8accf57d-03a9-4a2d-9ad6-15fcac9fad0d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Action: 'create', calling method: .version_select at 0x7f6f90ec6ee0>, body: {"keypair": {"name": "tempest-keypair-600372521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKLFWPmfU9bo8sfk6sw5s0En5OxT55jmSsMUbCyVq2y1E9njnCs3zgeC6yf0CHup4QvGmBhtRaqKQKr5UatQGAyJ0hkASu760TRv969HQyd/TyK4DXxdMUEnQvpnil/jg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:11.046940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8accf57d-03a9-4a2d-9ad6-15fcac9fad0d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Getting quotas for project cba33310a3044fa888af16a7e4698065. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:45:11.063639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8accf57d-03a9-4a2d-9ad6-15fcac9fad0d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Getting quotas for user e18cb45b496d47b5b540365fb183427c and project cba33310a3044fa888af16a7e4698065. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:45:11.185613 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8accf57d-03a9-4a2d-9ad6-15fcac9fad0d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.631007 Jul 01 10:45:11.186698 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2083/4280] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:45:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:45:11.198028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1879191323", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81cfd39e-e91b-47c9-9811-e1b5b0a1bd44"}], "security_groups": [{"name": "tempest-securitygroup--1649028040"}], "key_name": "tempest-keypair-96387054", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:11.661443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c9e6c86c-351c-4cfc-a092-72f8ac9df503 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:11.675450 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c9e6c86c-351c-4cfc-a092-72f8ac9df503 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1218 microversion: 2.1 time: 0.714425 Jul 01 10:45:11.676253 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2198/4281] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:10 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1218 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:12.043871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] validate_networks() for [('81cfd39e-e91b-47c9-9811-e1b5b0a1bd44', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:45:12.703613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:12.704877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:12.731610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:12.735157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:12.736223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:12.740197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:13.065558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:13.075365 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08a1506b-0f8b-4024-9352-b074a454cc4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1222 microversion: 2.1 time: 0.383043 Jul 01 10:45:13.089542 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2199/4282] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:12 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1222 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:13.372997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e9d5c323-d072-4cc0-a036-1ffb3186447e req-570f8a3f-8c13-4676-b8fa-142ac49e7578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d25cd-6f85-4a63-ac05-0d7380c4954e", "name": "network-vif-deleted", "tag": "0688ff0e-a045-49f2-a520-977ecae920ed"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:13.411342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e9d5c323-d072-4cc0-a036-1ffb3186447e req-570f8a3f-8c13-4676-b8fa-142ac49e7578 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:13.414388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e9d5c323-d072-4cc0-a036-1ffb3186447e req-570f8a3f-8c13-4676-b8fa-142ac49e7578 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:13.451367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e9d5c323-d072-4cc0-a036-1ffb3186447e req-570f8a3f-8c13-4676-b8fa-142ac49e7578 service nova] Creating event network-vif-deleted:0688ff0e-a045-49f2-a520-977ecae920ed for instance a65d25cd-6f85-4a63-ac05-0d7380c4954e on n-h2-master-1 Jul 01 10:45:13.460572 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e9d5c323-d072-4cc0-a036-1ffb3186447e req-570f8a3f-8c13-4676-b8fa-142ac49e7578 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092498 Jul 01 10:45:13.461458 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2200/4283] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:13.555241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:45:13.555889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:45:13.556471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:45:13.557187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:45:13.569474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:45:13.605650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:13.611717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:13.616888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:13.616888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:13.654003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for project 86ca97adc659431ea83b0703369d0c50. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:45:13.691972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Getting quotas for user 2979fb250468450aa9ba8a032a4ab90f and project 86ca97adc659431ea83b0703369d0c50. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:45:13.723536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:45:13.730692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:45:13.979669 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e189670-dc6e-4ee6-b5e8-b3eb73aa9dd2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.791801 Jul 01 10:45:13.980816 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2084/4284] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:45:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 2794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:45:13.994777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-617f0765-db3c-44a9-a436-11204c3cb18e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:13.995497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-617f0765-db3c-44a9-a436-11204c3cb18e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:14.098560 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:14.100874 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:14.116835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:14.119974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:14.124621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:14.126744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:14.427960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-617f0765-db3c-44a9-a436-11204c3cb18e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:14.433984 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-617f0765-db3c-44a9-a436-11204c3cb18e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1244 microversion: 2.1 time: 0.445216 Jul 01 10:45:14.434659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2201/4285] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:13 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1244 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:14.460437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:14.485559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5e505487-01ab-4b74-aafe-e8f0a50b3c37 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1278 microversion: 2.1 time: 0.387389 Jul 01 10:45:14.486517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2085/4286] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:14 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1278 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:15.452181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5bf2f702-0dde-48c2-b18a-92244b20456d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:15.452862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5bf2f702-0dde-48c2-b18a-92244b20456d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:15.504042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:15.504666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:15.517697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:15.519540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:15.520380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:15.522614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:15.610558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5bf2f702-0dde-48c2-b18a-92244b20456d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:15.624845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5bf2f702-0dde-48c2-b18a-92244b20456d tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1244 microversion: 2.1 time: 0.176534 Jul 01 10:45:15.626033 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2202/4287] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:15 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1244 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:15.650929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:15.663962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ff80f89-4e60-496a-a52f-abc5331544cb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1276 microversion: 2.1 time: 0.164748 Jul 01 10:45:15.678109 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2086/4288] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:15 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:16.198690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2c38f70-f355-4215-985f-7cd7c159c807 tempest-ExtensionsTest-1368834737 tempest-ExtensionsTest-1368834737-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:16.200439 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2c38f70-f355-4215-985f-7cd7c159c807 tempest-ExtensionsTest-1368834737 tempest-ExtensionsTest-1368834737-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.184069 Jul 01 10:45:16.200954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2203/4289] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Jul 1 10:45:16 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:16.213211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d09f4ad-6459-4e43-9908-26863d26f39f tempest-ExtensionsTest-1368834737 tempest-ExtensionsTest-1368834737-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:16.215968 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d09f4ad-6459-4e43-9908-26863d26f39f tempest-ExtensionsTest-1368834737 tempest-ExtensionsTest-1368834737-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008818 Jul 01 10:45:16.216802 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2087/4290] 10.222.0.23 () {58 vars in 1133 bytes} [Fri Jul 1 10:45:16 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:45:16.656677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:16.658617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:16.666687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:16.667140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:16.667931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:16.681823 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:16.683551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:16.685467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:16.706737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:16.711049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:16.720057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:16.720057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:16.851665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:16.865466 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce6ddde4-fb2b-4090-9680-0d2c081f39a4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1296 microversion: 2.1 time: 0.227443 Jul 01 10:45:16.866376 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2204/4291] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:16 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:17.170412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:17.206801 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42e5a4ff-1742-4f86-b192-097b7dd0a589 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.528263 Jul 01 10:45:17.207502 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2088/4292] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:16 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:17.284734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-505419082", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "a29b7b86-adc6-4e8b-85d7-b6d427fe417a"}], "security_groups": [{"name": "tempest-securitygroup--1957917011"}], "key_name": "tempest-keypair-600372521", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:17.840040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] validate_networks() for [('a29b7b86-adc6-4e8b-85d7-b6d427fe417a', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:45:17.884831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:17.885660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:17.893564 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:17.894347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:17.895415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:17.898565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:18.162953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:18.171047 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2054fc38-c21d-4c84-8cf5-3441f8ddd21b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1302 microversion: 2.1 time: 0.290384 Jul 01 10:45:18.171933 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2089/4293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:17 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1302 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:18.225626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:18.226579 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:18.235100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:18.235674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:18.236537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:18.237115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:18.741988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:18.754851 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eaad1025-a953-4367-ac89-ec014cb0183c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.534318 Jul 01 10:45:18.764109 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2090/4294] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:18 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:19.201453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:19.205200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:19.226082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:19.227317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:19.236444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:19.236444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:19.241845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:45:19.242399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:45:19.244840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:45:19.245595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:45:19.246135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:45:19.273495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:19.274262 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:19.275234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:19.278204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:19.336032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Getting quotas for project cba33310a3044fa888af16a7e4698065. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:45:19.345193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Getting quotas for user e18cb45b496d47b5b540365fb183427c and project cba33310a3044fa888af16a7e4698065. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:45:19.371145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:45:19.382067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:45:19.453352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:19.464703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bf205f1-4ee1-4e29-9e5b-90edfc41b202 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1302 microversion: 2.1 time: 0.271687 Jul 01 10:45:19.474589 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2091/4295] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:19 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1302 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:19.602335 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99fbeaf8-0261-4eec-a255-c3d221949f93 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.323836 Jul 01 10:45:19.603358 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2205/4296] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:45:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:45:19.613705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-40c0ba4d-0912-4bd4-91a2-eff817f706c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:19.614326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-40c0ba4d-0912-4bd4-91a2-eff817f706c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:19.772588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:19.773226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:19.801494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-40c0ba4d-0912-4bd4-91a2-eff817f706c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:19.809288 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-40c0ba4d-0912-4bd4-91a2-eff817f706c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1240 microversion: 2.1 time: 0.199398 Jul 01 10:45:19.812186 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2092/4297] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:19 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:19.819811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:19.820314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:19.821175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:19.821665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:20.059433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:20.068414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b7aae2e-edc4-4c7c-a8b5-13183ee6bf92 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.300473 Jul 01 10:45:20.078838 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2206/4298] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:19 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:20.123676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d4c51135-e4d8-4166-979c-847576aaf011 req-69b20e6f-52f8-44cc-ba13-afd59d4a3391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be7b572-b120-4967-825f-677b8e80ae6b", "tag": "e6c66ab9-345a-457e-bb9c-ad51b472da14"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:20.134755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d4c51135-e4d8-4166-979c-847576aaf011 req-69b20e6f-52f8-44cc-ba13-afd59d4a3391 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:20.136512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d4c51135-e4d8-4166-979c-847576aaf011 req-69b20e6f-52f8-44cc-ba13-afd59d4a3391 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:20.150660 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d4c51135-e4d8-4166-979c-847576aaf011 req-69b20e6f-52f8-44cc-ba13-afd59d4a3391 service nova] Creating event network-changed:e6c66ab9-345a-457e-bb9c-ad51b472da14 for instance 0be7b572-b120-4967-825f-677b8e80ae6b on n-h2-master-1 Jul 01 10:45:20.162217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d4c51135-e4d8-4166-979c-847576aaf011 req-69b20e6f-52f8-44cc-ba13-afd59d4a3391 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042863 Jul 01 10:45:20.165200 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2093/4299] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:20.484457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:20.485669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:20.496598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:20.497055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:20.500831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:20.501335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:20.840023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c031d26-49e3-4011-9bc7-e1a3841e5cc0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:20.840023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c031d26-49e3-4011-9bc7-e1a3841e5cc0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:20.946321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c031d26-49e3-4011-9bc7-e1a3841e5cc0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:20.954485 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c031d26-49e3-4011-9bc7-e1a3841e5cc0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1240 microversion: 2.1 time: 0.129572 Jul 01 10:45:20.955349 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2094/4300] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:20 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:20.978422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:20.988785 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8eda7dfb-8574-4915-92a6-7f4bbdeae129 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.507744 Jul 01 10:45:20.999053 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2207/4301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:20 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:21.086189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:21.090969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:21.102994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:21.104028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:21.104932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:21.105453 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:21.917016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:21.932098 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee674102-b727-4182-9da9-17734305c966 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.842787 Jul 01 10:45:21.932098 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2095/4302] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:21 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:21.973332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:21.974626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:21.983476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:21.984006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:21.985133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:21.985672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:22.006192 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:22.006923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:22.016020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:22.018903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:22.023547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:22.024437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:22.135305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:22.146144 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef426ca9-af79-4462-a7f7-6f9b1ee45dcb tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1292 microversion: 2.1 time: 0.176802 Jul 01 10:45:22.157307 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2208/4303] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:21 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1292 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:22.554876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:22.562085 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:22.567446 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86b70964-8d37-4ef6-a720-594aa2752570 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.564712 Jul 01 10:45:22.567802 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2096/4304] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:22 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:22.944809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:22.946040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:22.955194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:22.957411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:22.958672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:22.959945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:23.101304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2450cf2f-b7d8-43be-b0f7-9369d0b52c9e req-b22710e1-4083-4baa-be3c-23079d77f29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97681ece-9530-48a6-bab2-033fabe477f6", "tag": "a954f825-4fb7-4aaf-a651-0ea1f5b580c8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:23.134514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2450cf2f-b7d8-43be-b0f7-9369d0b52c9e req-b22710e1-4083-4baa-be3c-23079d77f29c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:23.135022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2450cf2f-b7d8-43be-b0f7-9369d0b52c9e req-b22710e1-4083-4baa-be3c-23079d77f29c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:23.150360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2450cf2f-b7d8-43be-b0f7-9369d0b52c9e req-b22710e1-4083-4baa-be3c-23079d77f29c service nova] Creating event network-changed:a954f825-4fb7-4aaf-a651-0ea1f5b580c8 for instance 97681ece-9530-48a6-bab2-033fabe477f6 on n-h2-master-1 Jul 01 10:45:23.159685 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2450cf2f-b7d8-43be-b0f7-9369d0b52c9e req-b22710e1-4083-4baa-be3c-23079d77f29c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064358 Jul 01 10:45:23.161637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2097/4305] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:45:23.168303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:23.169667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:23.182742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:23.184133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:23.185305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:23.186166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:23.327418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:23.337342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:23.345508 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1821ab59-7557-4b33-b7a9-4fcdb5127795 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.406105 Jul 01 10:45:23.346852 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2209/4306] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:22 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:23.349844 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07809723-5b6c-4458-9527-2c701a25e423 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1310 microversion: 2.1 time: 0.186467 Jul 01 10:45:23.352371 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2098/4307] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:23 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:23.589573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:23.594324 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:23.614870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:23.616338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:23.619271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:23.619899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:24.256080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:24.266902 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3851744-808c-4b57-9bbd-04e6c55a1022 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.686477 Jul 01 10:45:24.267444 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2210/4308] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:23 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:24.373174 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:24.384179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:24.387984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:24.404044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:24.404044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:24.418504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:24.421981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:24.422805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:24.428535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:24.429013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:24.431638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:24.433726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:24.436183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:24.620923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:24.635679 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a11075bd-db62-4ffe-9242-dd4b937efb99 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1298 microversion: 2.1 time: 0.266785 Jul 01 10:45:24.636308 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2211/4309] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:24 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1298 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:25.284017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:25.284620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:25.294308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:25.294749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:25.295965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:25.296177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:25.412554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:25.432019 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81a41a64-6b53-457a-bc4f-ce278b2045a1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 1.061299 Jul 01 10:45:25.445674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2099/4310] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:24 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:25.654108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:25.654625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:25.654625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:25.656373 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:25.663824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec8196cf-8884-4a66-a3f9-fb8e75b7090c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.383719 Jul 01 10:45:25.673857 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2212/4311] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:25 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:25.676817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:25.677280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:25.678283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:25.678736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:26.220218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:26.230993 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-912e14fa-bebb-4ed3-81d7-2a51b42ed4d6 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.578645 Jul 01 10:45:26.231623 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2100/4312] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:25 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:26.451955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:26.453670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:26.464726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:26.467400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:26.470281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:26.470862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:26.682536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:26.684046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:26.691994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:26.697052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:26.701039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:26.702780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:26.960071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:26.968775 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2a998409-638c-4fd6-a69f-42b3207bf900 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.520763 Jul 01 10:45:26.971564 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2213/4313] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:26 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:27.045712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:27.054564 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66293b34-38db-45ad-812e-f786829fba91 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.376795 Jul 01 10:45:27.065515 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2101/4314] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:26 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:27.188655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7a1680aa-6e53-4458-98d3-d59baa4e7c31 req-6594e996-cec7-4b47-8456-548c4dad7a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5e5269-0b37-467f-bf0f-7e45f5ff738b", "tag": "cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:27.201460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7a1680aa-6e53-4458-98d3-d59baa4e7c31 req-6594e996-cec7-4b47-8456-548c4dad7a28 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:27.202605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7a1680aa-6e53-4458-98d3-d59baa4e7c31 req-6594e996-cec7-4b47-8456-548c4dad7a28 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:27.224983 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7a1680aa-6e53-4458-98d3-d59baa4e7c31 req-6594e996-cec7-4b47-8456-548c4dad7a28 service nova] Creating event network-changed:cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78 for instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b on n-h2-master-1 Jul 01 10:45:27.231809 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7a1680aa-6e53-4458-98d3-d59baa4e7c31 req-6594e996-cec7-4b47-8456-548c4dad7a28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054127 Jul 01 10:45:27.234104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2214/4315] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:27.248218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:27.251677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:27.272209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:27.272976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:27.275214 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:27.275998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:27.650938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:27.661437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2b3aefd-85b6-47f4-93a5-de4add14314d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.417266 Jul 01 10:45:27.671524 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2102/4316] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:27 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:27.993102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:27.993719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:28.004132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:28.008038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:28.008038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:28.008543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:28.071836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:28.073334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:28.081378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:28.082219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:28.083025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:28.083804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:28.348723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:28.349032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:28.349135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0bddd2a-4a73-439a-9139-b119b3358b69 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.355205 Jul 01 10:45:28.349259 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b887e239-e84e-4eb4-9012-02c0b2deda20 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.277936 Jul 01 10:45:28.349259 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2103/4317] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:28 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:28.349436 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2215/4318] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:27 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:28.678975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:28.679592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:28.691673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:28.692124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:28.692914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:28.697535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:29.154820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-bf1bc67a-b168-463b-984a-6f332d41a04b req-51f4ca0c-8645-40cc-a776-bf0abc01b71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be7b572-b120-4967-825f-677b8e80ae6b", "name": "network-vif-plugged", "status": "completed", "tag": "e6c66ab9-345a-457e-bb9c-ad51b472da14"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:29.170386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-bf1bc67a-b168-463b-984a-6f332d41a04b req-51f4ca0c-8645-40cc-a776-bf0abc01b71b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:29.171160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-bf1bc67a-b168-463b-984a-6f332d41a04b req-51f4ca0c-8645-40cc-a776-bf0abc01b71b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:29.190603 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-bf1bc67a-b168-463b-984a-6f332d41a04b req-51f4ca0c-8645-40cc-a776-bf0abc01b71b service nova] Creating event network-vif-plugged:e6c66ab9-345a-457e-bb9c-ad51b472da14 for instance 0be7b572-b120-4967-825f-677b8e80ae6b on n-h2-master-1 Jul 01 10:45:29.197696 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-bf1bc67a-b168-463b-984a-6f332d41a04b req-51f4ca0c-8645-40cc-a776-bf0abc01b71b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048395 Jul 01 10:45:29.206241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2216/4319] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:45:29.261753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:29.271221 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-561dfd46-56dd-4cbf-93ea-1794d25f270a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.596424 Jul 01 10:45:29.275475 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2104/4320] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:28 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:29.359713 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:29.361083 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=18 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:29.366179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:29.367268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:29.374133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:29.374769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:29.393540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:29.394412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:29.395195 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:29.395316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:29.396011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:29.396124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:29.396469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:29.396595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:30.071154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:30.083539 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99ab5b0f-0c49-4654-8a3f-b1d5190aad88 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.722164 Jul 01 10:45:30.084927 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2105/4321] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:29 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:30.295228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:30.296868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:30.310477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:30.311321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:30.312469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:30.314486 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:30.321359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:30.338064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a3e1d4a-22ab-492a-b653-8d6a4969ccf7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.979174 Jul 01 10:45:30.339558 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2217/4322] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:29 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:30.451774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dab7e5f0-1cf4-4584-acf5-4f597c510727 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:30.451774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dab7e5f0-1cf4-4584-acf5-4f597c510727 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:30.465842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dab7e5f0-1cf4-4584-acf5-4f597c510727 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:30.477932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dab7e5f0-1cf4-4584-acf5-4f597c510727 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:30.479207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dab7e5f0-1cf4-4584-acf5-4f597c510727 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:30.479855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dab7e5f0-1cf4-4584-acf5-4f597c510727 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:30.522617 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dab7e5f0-1cf4-4584-acf5-4f597c510727 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/ips" status: 200 len: 145 microversion: 2.1 time: 0.084924 Jul 01 10:45:30.525320 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2218/4323] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:45:30 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/ips => generated 145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:45:30.833861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:30.850843 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9b1d8bad-a2da-4066-b5b5-3c275e64181a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.559138 Jul 01 10:45:30.850843 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2106/4324] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:30 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:31.111358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:31.115349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:31.128994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:31.132485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:31.135918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:31.138019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:31.358096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:31.358602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:31.365881 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=18 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:31.382410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:31.386392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:31.387633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:31.389696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:31.984267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:31.993425 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d9108a0d-f4eb-47d9-adf9-74a0326f361a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1318 microversion: 2.1 time: 0.639758 Jul 01 10:45:31.998047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:32.008262 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2107/4325] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:31 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:32.009990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3cd62716-405d-48d4-9450-7b125ad4f418 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.909840 Jul 01 10:45:32.012879 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2219/4326] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:31 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:32.014233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:32.014921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:32.026659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:32.027115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:32.027915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:32.032270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:32.290893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:32.303970 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-69868a3c-fdfa-42a3-8ea4-c4de38a86813 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.291900 Jul 01 10:45:32.303970 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2108/4327] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:32 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:33.018425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:33.019047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:33.030289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.030779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.035327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.035441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:33.037355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:33.037769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.059111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.059846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.061040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.063379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.379251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a1580b0d-c2a8-47c8-bb33-b11c321d6b45 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.362699 Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2109/4328] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:33 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.478370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.479261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:33.479261 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cee400ab-e0a6-4bc8-8018-85f8f9f6a876 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1507 microversion: 2.1 time: 0.442946 Jul 01 10:45:33.479261 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2220/4329] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:33 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:33.482518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:33.488935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:33.496817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.497658 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.499125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.499563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.561992 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:33.827866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:33.851320 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e64e2bcb-89a0-438e-93cf-6308a9246939 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.455724 Jul 01 10:45:33.853355 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2110/4330] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:33 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:33.922091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:33.932183 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ff8f16f3-c637-4b60-9f07-b0005afa820e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1507 microversion: 2.1 time: 0.455765 Jul 01 10:45:33.935702 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2221/4331] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:33 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:33.956732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-655e0e66-a113-4a75-b126-6a192e14794b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:33.958148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-655e0e66-a113-4a75-b126-6a192e14794b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:33.984202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-655e0e66-a113-4a75-b126-6a192e14794b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.985529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-655e0e66-a113-4a75-b126-6a192e14794b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:33.989728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-655e0e66-a113-4a75-b126-6a192e14794b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:33.990413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-655e0e66-a113-4a75-b126-6a192e14794b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:34.231741 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-655e0e66-a113-4a75-b126-6a192e14794b tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "PUT /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1079 microversion: 2.1 time: 0.279670 Jul 01 10:45:34.232707 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2222/4332] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:45:33 2022] PUT /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1079 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:34.238092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-98678176-d59f-41f6-afde-ef42e827133e req-81c76e80-763f-43c3-8d9d-486738a6b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97681ece-9530-48a6-bab2-033fabe477f6", "name": "network-vif-plugged", "status": "completed", "tag": "a954f825-4fb7-4aaf-a651-0ea1f5b580c8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:34.247655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-98678176-d59f-41f6-afde-ef42e827133e req-81c76e80-763f-43c3-8d9d-486738a6b5d1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:34.248108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-98678176-d59f-41f6-afde-ef42e827133e req-81c76e80-763f-43c3-8d9d-486738a6b5d1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:34.263418 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-98678176-d59f-41f6-afde-ef42e827133e req-81c76e80-763f-43c3-8d9d-486738a6b5d1 service nova] Creating event network-vif-plugged:a954f825-4fb7-4aaf-a651-0ea1f5b580c8 for instance 97681ece-9530-48a6-bab2-033fabe477f6 on n-h2-master-1 Jul 01 10:45:34.280019 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-98678176-d59f-41f6-afde-ef42e827133e req-81c76e80-763f-43c3-8d9d-486738a6b5d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045881 Jul 01 10:45:34.280939 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2223/4333] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:34.303151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:34.308741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:34.359636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:34.361168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:34.367220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:34.368061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:34.780902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:34.789842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-40f76c39-4b9b-48cf-9754-f4eb70ed2c3b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'create', calling method: .version_select at 0x7f6f91ed13a0>, body: {"keypair": {"name": "tempest-keypair-1333839250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6UceE0o7/kbvDx0shvvApddG2fCMlkYn9dm/+5Jew9T6v12Amue7XglYi956poslMAOd3uv++avPIsaLNMlfMfEOe/XqXkie8fDCGD7F1ePtB1fe22bEowrxexi2DJxw=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:34.795179 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-16815fc3-6eb2-43f2-949f-58e686defcc3 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1505 microversion: 2.1 time: 0.511524 Jul 01 10:45:34.801057 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2224/4334] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:34 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:34.807884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:34.823488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:34.823488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:34.823488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:34.823488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:34.823488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:34.836861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-40f76c39-4b9b-48cf-9754-f4eb70ed2c3b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for project e18843e9062a4e72a41c2ed4b433341a. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:45:34.857441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-40f76c39-4b9b-48cf-9754-f4eb70ed2c3b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for user 899c57c8434e49d08e5c73a1baf5069b and project e18843e9062a4e72a41c2ed4b433341a. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:45:34.982178 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-40f76c39-4b9b-48cf-9754-f4eb70ed2c3b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.121811 Jul 01 10:45:34.982178 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2111/4335] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:45:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:45:34.999126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:34.999699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:35.027401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.032285 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.033394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.034347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.162035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:35.182370 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8e191f7a-a8e1-4df4-8ae0-f6ec9b8b1f7c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1370 microversion: 2.1 time: 0.379880 Jul 01 10:45:35.182864 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2225/4336] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:34 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:35.194070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:35.194974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:35.214617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.214617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.217505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.218043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.324955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:35.335680 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee6c4a26-2d6e-4ff9-b344-ef6fd0ef2036 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1505 microversion: 2.1 time: 0.354650 Jul 01 10:45:35.336278 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2112/4337] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:34 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:35.355537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:35.355819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:35.364869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.365542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.366520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.367116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.499718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:45:35.500759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:45:35.501453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:45:35.502230 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:45:35.502813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:45:35.563623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:35.590991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fd8a6222-ba76-4ddf-96ed-3e6cdd3777b5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.406395 Jul 01 10:45:35.601088 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2226/4338] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:35 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:35.727823 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:35.806453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:35.813424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.813855 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.815862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.816613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.889696 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c43afc65-3086-44c7-b0f7-19f5fb8ccc6e tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "POST /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b/action" status: 202 len: 1111 microversion: 2.1 time: 0.537945 Jul 01 10:45:35.894830 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2113/4339] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:45:35 2022] POST /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b/action => generated 1111 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 01 10:45:35.911795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8598a791-2f1a-4d35-876f-a4fb0353abc4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f507285f-c5c8-4a02-8f3f-2abede02c399"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:35.913344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8598a791-2f1a-4d35-876f-a4fb0353abc4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:35.914016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:35.934265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8598a791-2f1a-4d35-876f-a4fb0353abc4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.934970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:35.935200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8598a791-2f1a-4d35-876f-a4fb0353abc4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.935200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8598a791-2f1a-4d35-876f-a4fb0353abc4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.935200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8598a791-2f1a-4d35-876f-a4fb0353abc4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.977310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.978224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:35.979231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:35.979826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:36.277098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:36.285963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63576cdc-3f57-407d-8a82-cc885c877b42 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.376004 Jul 01 10:45:36.293627 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2114/4340] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:35 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:36.300988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:36.306415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:36.317817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:36.318034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:36.318902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:36.319649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:36.645798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:36.654767 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5763cbc4-39aa-4f6e-95f7-544b617683fb tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1564 microversion: 2.1 time: 0.358391 Jul 01 10:45:36.656225 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2115/4341] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:36 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1564 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:36.694239 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:36.694881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:36.711116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:36.711739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:36.712334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:36.734683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:36.980978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:36.990717 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5002ac85-2104-4fd8-80f8-269f24a12c55 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.332795 Jul 01 10:45:36.991298 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2116/4342] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:36 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:36.996865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd3629b7-50df-4f6b-ae34-536b3a45502e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:36.997401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd3629b7-50df-4f6b-ae34-536b3a45502e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:37.004785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd3629b7-50df-4f6b-ae34-536b3a45502e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.005659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd3629b7-50df-4f6b-ae34-536b3a45502e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.007080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd3629b7-50df-4f6b-ae34-536b3a45502e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.008089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd3629b7-50df-4f6b-ae34-536b3a45502e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.144451 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd3629b7-50df-4f6b-ae34-536b3a45502e tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151420 Jul 01 10:45:37.153296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2117/4343] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:45:36 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:37.206599 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8598a791-2f1a-4d35-876f-a4fb0353abc4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.299155 Jul 01 10:45:37.208109 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2227/4344] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:45:35 2022] POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-volume_attachments => generated 194 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:37.331657 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:37.332556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:37.339764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.340437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.341460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.342051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.685711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] Calling method '.version_select at 0x7f6f91f56940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:37.685711 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 10:45:37.685711 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 10:45:37.686169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.686851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.724667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.724667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.763771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.764638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.779844 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61d57ca1-c74a-4021-93be-d7d859a371ac tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880 tempest-PortsAdminExtendedAttrsIpV6TestJSON-452793880-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.633316 Jul 01 10:45:37.787343 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2118/4345] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:45:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:37.787343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7f1310ff-5e20-4301-832a-92d6d5b37009 req-43ba65f8-e43d-48a4-b9ad-19464f2a5c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5e5269-0b37-467f-bf0f-7e45f5ff738b", "name": "network-vif-plugged", "status": "completed", "tag": "cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:37.818284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7f1310ff-5e20-4301-832a-92d6d5b37009 req-43ba65f8-e43d-48a4-b9ad-19464f2a5c7d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:37.821588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7f1310ff-5e20-4301-832a-92d6d5b37009 req-43ba65f8-e43d-48a4-b9ad-19464f2a5c7d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:37.851104 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7f1310ff-5e20-4301-832a-92d6d5b37009 req-43ba65f8-e43d-48a4-b9ad-19464f2a5c7d service nova] Creating event network-vif-plugged:cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78 for instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b on n-h2-master-1 Jul 01 10:45:37.860052 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7f1310ff-5e20-4301-832a-92d6d5b37009 req-43ba65f8-e43d-48a4-b9ad-19464f2a5c7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077904 Jul 01 10:45:37.863993 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2119/4346] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:38.009302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:38.010738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:38.028972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:38.029565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:38.032848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:38.036036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:38.206012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:38.217632 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8824cd81-6ad5-4909-bcb4-d119101b0f40 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.891779 Jul 01 10:45:38.226569 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2228/4347] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:37 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:38.671776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:38.686089 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-64a6e02c-2ef6-4cc3-a1b5-b591eed001f7 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1366 microversion: 2.1 time: 0.681494 Jul 01 10:45:38.698370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2120/4348] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:38 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1366 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:39.248388 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:39.249622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:39.270936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:39.273019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:39.282370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:39.284668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:39.707424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:39.708053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:39.718543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:39.718543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:39.718543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:39.733203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:40.363731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:40.364826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:40.384123 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02a58765-bded-4cfc-90a6-37921a468dfe tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1556 microversion: 2.1 time: 0.680747 Jul 01 10:45:40.385424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b32457ff-06e0-4df4-9c1e-0c076b270118 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 1.144979 Jul 01 10:45:40.387924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2229/4349] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:39 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:40.393810 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2121/4350] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:39 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1556 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:40.417189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8ca7ed5-8e3a-400a-8b61-5412558c7d12 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:40.417722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c8ca7ed5-8e3a-400a-8b61-5412558c7d12 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:40.431638 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8ca7ed5-8e3a-400a-8b61-5412558c7d12 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:40.432090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8ca7ed5-8e3a-400a-8b61-5412558c7d12 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:40.432868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8ca7ed5-8e3a-400a-8b61-5412558c7d12 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:40.433590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8ca7ed5-8e3a-400a-8b61-5412558c7d12 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:40.587989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8ca7ed5-8e3a-400a-8b61-5412558c7d12 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174606 Jul 01 10:45:40.589233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2230/4351] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:45:40 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:40.763552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-473c8c7a-f643-4340-97e9-2c7a385820d7 req-7ea1946f-f0e1-4036-8068-cef7ad4bcbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97681ece-9530-48a6-bab2-033fabe477f6", "tag": "a954f825-4fb7-4aaf-a651-0ea1f5b580c8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:40.796935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-473c8c7a-f643-4340-97e9-2c7a385820d7 req-7ea1946f-f0e1-4036-8068-cef7ad4bcbd4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:40.799707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-473c8c7a-f643-4340-97e9-2c7a385820d7 req-7ea1946f-f0e1-4036-8068-cef7ad4bcbd4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:40.826253 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-473c8c7a-f643-4340-97e9-2c7a385820d7 req-7ea1946f-f0e1-4036-8068-cef7ad4bcbd4 service nova] Creating event network-changed:a954f825-4fb7-4aaf-a651-0ea1f5b580c8 for instance 97681ece-9530-48a6-bab2-033fabe477f6 on n-h2-master-1 Jul 01 10:45:40.837020 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-473c8c7a-f643-4340-97e9-2c7a385820d7 req-7ea1946f-f0e1-4036-8068-cef7ad4bcbd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077821 Jul 01 10:45:40.839925 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2122/4352] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:45:41.412419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:41.416524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:41.431778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:41.434082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:41.434082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:41.435247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:41.678796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1443870733", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ddca155-c4d6-4a43-bb26-27af9de9ec83"}], "security_groups": [{"name": "tempest-securitygroup--1915395656"}], "key_name": "tempest-keypair-1333839250", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:41.873704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:41.884847 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62ac3c45-4b59-4cdf-be1d-6bffdc9dd0eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.482587 Jul 01 10:45:41.888837 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2231/4353] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:41 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:41.990558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] validate_networks() for [('0ddca155-c4d6-4a43-bb26-27af9de9ec83', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:45:42.874835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b8ae90ec-5fd4-4605-8c2a-4430df54ba9b req-c2b3574a-b785-4202-bbb8-40f24298d2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5e5269-0b37-467f-bf0f-7e45f5ff738b", "tag": "cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:42.891842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b8ae90ec-5fd4-4605-8c2a-4430df54ba9b req-c2b3574a-b785-4202-bbb8-40f24298d2a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:42.893169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b8ae90ec-5fd4-4605-8c2a-4430df54ba9b req-c2b3574a-b785-4202-bbb8-40f24298d2a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:42.917042 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b8ae90ec-5fd4-4605-8c2a-4430df54ba9b req-c2b3574a-b785-4202-bbb8-40f24298d2a6 service nova] Creating event network-changed:cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78 for instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b on n-h2-master-1 Jul 01 10:45:42.929642 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b8ae90ec-5fd4-4605-8c2a-4430df54ba9b req-c2b3574a-b785-4202-bbb8-40f24298d2a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058704 Jul 01 10:45:42.934585 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2232/4354] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:45:42.944801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:42.944983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:45:42.945479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:45:42.946053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:45:42.946322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:42.946467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:45:42.946890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:45:42.953866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:42.959392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:42.959392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:42.959392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:42.964068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:42.964542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:42.973566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:42.974175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:43.016154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for project e18843e9062a4e72a41c2ed4b433341a. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:45:43.030782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for user 899c57c8434e49d08e5c73a1baf5069b and project e18843e9062a4e72a41c2ed4b433341a. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:45:43.051697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:45:43.054360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:45:43.172888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:43.184584 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0fe0827b-7248-4f7c-91b8-376bbbc41c6d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.248493 Jul 01 10:45:43.185924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2233/4355] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:42 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:43.290605 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98caf576-50b7-4075-9f8f-561b73ad5730 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.617198 Jul 01 10:45:43.308201 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2123/4356] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:45:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 01 10:45:43.308565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45c22f5c-8cf8-4aa7-917b-82595aa24891 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:43.308565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45c22f5c-8cf8-4aa7-917b-82595aa24891 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:43.466512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45c22f5c-8cf8-4aa7-917b-82595aa24891 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:43.476903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45c22f5c-8cf8-4aa7-917b-82595aa24891 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:43.483487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45c22f5c-8cf8-4aa7-917b-82595aa24891 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:43.484640 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45c22f5c-8cf8-4aa7-917b-82595aa24891 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1282 microversion: 2.20 time: 0.187305 Jul 01 10:45:43.485229 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2234/4357] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:43 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:45:44.213418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:44.215163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:44.258966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:44.266109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:44.267918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:44.273979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:44.508474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c494f068-07a1-49a8-a279-ae9ff9933b69 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:44.508474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c494f068-07a1-49a8-a279-ae9ff9933b69 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:44.611298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:44.619654 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a5162250-395b-4d7e-86aa-26377f5c654c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.413833 Jul 01 10:45:44.639558 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2124/4358] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:44 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:44.675416 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c494f068-07a1-49a8-a279-ae9ff9933b69 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:44.683930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c494f068-07a1-49a8-a279-ae9ff9933b69 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:44.684788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c494f068-07a1-49a8-a279-ae9ff9933b69 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:44.686185 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c494f068-07a1-49a8-a279-ae9ff9933b69 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1282 microversion: 2.20 time: 0.186812 Jul 01 10:45:44.697004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2235/4359] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:44 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:45.665296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:45.666080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:45.675015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:45.675560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:45.676469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:45.676995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:45.704045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:45.704909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:45.714875 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:45.717659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:45.724007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:45.725042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:45.725719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:45.897979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:45.925960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:45.932239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:45.936835 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17a6d95f-1d47-45a9-84d2-dded8d78391a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1278 microversion: 2.20 time: 0.233495 Jul 01 10:45:45.941345 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2236/4360] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:45 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:45:46.232467 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 10:45:46.232600 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 10:45:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 10:45:46.382680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:46.396088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2351e7cf-3b95-4f3c-aa78-6d4fed6c48dc tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.736219 Jul 01 10:45:46.397118 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2125/4361] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:45 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:46.959768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:46.960496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:46.984742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:46.985466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:46.986949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:46.987545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:47.346106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:47.355328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:47.358195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:47.359537 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-13fc1ed5-fb01-426c-8d4e-fdda234683b9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1340 microversion: 2.20 time: 0.404956 Jul 01 10:45:47.360537 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2237/4362] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:46 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1340 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:47.415853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:47.416467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:47.437773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:47.438694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:47.439531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:47.443711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:47.650396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:47.660373 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6ce6857-b742-4933-9e4e-23678605a382 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.249417 Jul 01 10:45:47.661062 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2126/4363] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:47 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:48.383046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:48.383985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:48.398657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:48.400321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:48.402504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:48.405055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:48.620183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:48.632738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:48.634348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:48.635734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cb603e23-75bc-43a2-8c90-27799378775d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.260711 Jul 01 10:45:48.636500 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2238/4364] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:48 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:48.682039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:48.684708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:48.694221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:48.694760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:48.696071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:48.696639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:48.863804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:48.873245 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6fd29d2b-afef-49b9-8a4b-96f061482355 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.198117 Jul 01 10:45:48.874351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2127/4365] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:48 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:49.657515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:49.661049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:49.676198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:49.676824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:49.677657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:49.678098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:49.843998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5339c3e6-3a4c-4a85-8231-3367ca2d7770 req-cb3a06c5-e156-403d-a05d-0918db328c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:49.868241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5339c3e6-3a4c-4a85-8231-3367ca2d7770 req-cb3a06c5-e156-403d-a05d-0918db328c34 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:49.870889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5339c3e6-3a4c-4a85-8231-3367ca2d7770 req-cb3a06c5-e156-403d-a05d-0918db328c34 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:49.901562 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5339c3e6-3a4c-4a85-8231-3367ca2d7770 req-cb3a06c5-e156-403d-a05d-0918db328c34 service nova] Creating event network-changed:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h2-master-1 Jul 01 10:45:49.914564 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5339c3e6-3a4c-4a85-8231-3367ca2d7770 req-cb3a06c5-e156-403d-a05d-0918db328c34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074049 Jul 01 10:45:49.915582 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2128/4366] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:45:49.931944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:49.934329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:49.950993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:49.952998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:49.955977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:49.956639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:50.412740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:50.417675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:50.424074 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:50.426474 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20961c01-ab20-43ac-8ed9-50a05924b4a8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.507084 Jul 01 10:45:50.427657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2129/4367] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:49 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:50.442407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:50.444185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:50.446008 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99c442be-eb30-4b25-8827-180fb58d9e36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.792715 Jul 01 10:45:50.446913 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2239/4368] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:49 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:51.445891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:51.445891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:51.452458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:51.452906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:51.453703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:51.454136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:51.465405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:51.466106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:51.474888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:51.475423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:51.476260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:51.476779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:51.668931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:51.674932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:51.681706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:51.684619 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b8426354-b047-48ff-b6c5-3e039e0e31f7 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.243998 Jul 01 10:45:51.684806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:51.686775 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2130/4369] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:51 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:51.699898 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9251c3d1-576a-46d2-b510-90c97e20f993 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.238723 Jul 01 10:45:51.700667 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2240/4370] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:51 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:45:51.853819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b7685ab0-0a22-4b78-afad-cb94687d2af7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:51.860258 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7685ab0-0a22-4b78-afad-cb94687d2af7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:51.860740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7685ab0-0a22-4b78-afad-cb94687d2af7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:51.905541 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b7685ab0-0a22-4b78-afad-cb94687d2af7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Going to try to stop instance {{(pid=119765) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:45:52.017811 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:52.113264 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b7685ab0-0a22-4b78-afad-cb94687d2af7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action" status: 202 len: 0 microversion: 2.1 time: 0.264564 Jul 01 10:45:52.114086 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2131/4371] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:45:51 2022] POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:45:52.122457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:52.123066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:52.134387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:52.135145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:52.136199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:52.136797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:52.289556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:52.298168 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ad8331b-04b5-4e89-8904-02190b833de5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.179611 Jul 01 10:45:52.299273 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2241/4372] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:52 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:45:52.703649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:52.704388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:52.713133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:52.713797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:52.714590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:52.715030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:52.718713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:52.719503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:52.727247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:52.727786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:52.728625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:52.729129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:52.974259 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:52.982130 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-24c21bea-5331-4c2e-9c25-a33afc33d12d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.282782 Jul 01 10:45:52.982713 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2132/4373] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:52 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:52.985277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:52.994977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:52.996507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:52.997702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3bca64bb-bb1b-4e0e-a48f-08cc7f954fb2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.282945 Jul 01 10:45:52.998260 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2242/4374] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:52 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:53.317225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:53.317852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:53.323851 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:53.323851 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:53.326503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:53.326958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:53.328016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:53.328460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:53.486043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:53.495409 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a26c5b2-1fd3-4f3d-a4e9-f20cea874ad1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.182675 Jul 01 10:45:53.496070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2133/4375] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:53 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:54.000298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:54.001077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:54.008232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:54.008865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:54.009752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:54.010354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:54.015502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:54.016113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:54.022148 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:54.026830 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:54.027273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:54.028191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:54.028902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:54.256892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:54.266034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:54.273121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:54.280204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:54.281968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-099f5343-0d5d-48b1-953f-6488ff192afa tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.286066 Jul 01 10:45:54.282816 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2243/4376] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:53 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:54.289311 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4bc4ede6-129c-4d40-b049-50c9daca0b07 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.278109 Jul 01 10:45:54.300434 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2134/4377] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:54 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:54.512924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:54.513499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:54.519511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:54.519967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:54.520736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:54.521377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:54.680496 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:45:54.684209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:54.692693 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2f796d2b-2327-4c1f-b99f-1f71374b2c9a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.183689 Jul 01 10:45:54.693292 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2244/4378] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:54 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:55.300792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:55.300792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:55.307648 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:55.308596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:55.309375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:55.310052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:55.311033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:55.311660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:55.321116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:55.324720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:55.325620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:55.326076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:55.568027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:55.575536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:55.580195 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0b98858-37e3-4742-834e-f9133c753d7c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.284504 Jul 01 10:45:55.581404 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2135/4379] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:55 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:55.595701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:55.597512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:55.598990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23aa40ca-39e7-4599-8976-d9ad61cc69a7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.295322 Jul 01 10:45:55.600061 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2245/4380] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:55 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:55.710889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:55.711626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:55.718195 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:55.718650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:55.719759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:55.720230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:55.864386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:55.873976 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ae3af0e-e84b-46be-ae5a-7ca02b9fd178 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.167348 Jul 01 10:45:55.874565 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2136/4381] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:55 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:56.597840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:56.598450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:56.605530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:56.605980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:56.608224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:56.608667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:56.624239 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:56.625463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:56.635854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:56.636558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:56.637774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:56.638384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:56.900626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:56.909672 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0306697-5b17-4db9-8888-cd31a4cb3f06 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.315748 Jul 01 10:45:56.910323 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2246/4382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:56 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:56.927923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:56.928884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:56.938361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:56.940704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:56.941763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:56.942397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:56.946072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:56.957548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:56.964545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:56.982393 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c24881e0-a82f-45e8-a37d-603847e3ec17 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.358868 Jul 01 10:45:56.983027 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2137/4383] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:56 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:57.121572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-17acbb68-2d90-48b3-8a0b-38559ad88784 req-36c54fc9-7624-4c80-86de-ca6800e7ac8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "name": "network-vif-plugged", "status": "completed", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:45:57.132094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-17acbb68-2d90-48b3-8a0b-38559ad88784 req-36c54fc9-7624-4c80-86de-ca6800e7ac8a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:57.132873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-17acbb68-2d90-48b3-8a0b-38559ad88784 req-36c54fc9-7624-4c80-86de-ca6800e7ac8a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:57.146984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:57.155257 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9e88227e-c171-4c9b-ad2e-f79f9c9e107c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.233907 Jul 01 10:45:57.155832 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2247/4384] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:56 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:57.175333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-17acbb68-2d90-48b3-8a0b-38559ad88784 req-36c54fc9-7624-4c80-86de-ca6800e7ac8a service nova] Creating event network-vif-plugged:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h2-master-1 Jul 01 10:45:57.180316 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-17acbb68-2d90-48b3-8a0b-38559ad88784 req-36c54fc9-7624-4c80-86de-ca6800e7ac8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066115 Jul 01 10:45:57.180990 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2138/4385] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:45:57.926996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:57.927616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:57.935492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:57.936054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:57.936922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:57.937457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:58.007609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:58.008875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:58.020119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:58.020572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:58.021385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:58.021847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:58.170646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:58.180894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50952d32-8fb6-472d-8913-107c38c97722 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.257718 Jul 01 10:45:58.194324 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2248/4386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:57 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:58.201492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:58.206181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:58.218172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:58.218859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:58.219957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:58.220550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:58.285457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:58.301210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:58.303457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:58.305738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-865491ea-eff0-49f3-90fb-438155d234bf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1408 microversion: 2.20 time: 0.309081 Jul 01 10:45:58.306910 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2139/4387] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:57 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:45:58.378164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:58.386884 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-495522f8-ae13-4272-a82b-e0a7c94b3c21 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.190840 Jul 01 10:45:58.387753 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2249/4388] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:58 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:59.200060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:59.202840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:59.208073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.208525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:59.209378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.209816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:59.323962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:59.324730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:59.331665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.332212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:59.333082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.333607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:59.640408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:59.650561 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e89e2e1d-6236-47f1-a0fa-063a11e5f771 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.454520 Jul 01 10:45:59.651321 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2140/4389] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:59 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:45:59.658914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:59.659793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:59.666528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.668338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:59.668338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.668338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:59.851765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:59.863709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:59.865999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:45:59.867539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e6d53b76-54d4-4d8b-9ca2-4fe218e9c39a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1600 microversion: 2.20 time: 0.547527 Jul 01 10:45:59.868210 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2250/4390] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:45:59 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1600 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:45:59.888846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-020d5f22-07f8-4d06-b7bf-e13e5c5c2657 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:45:59.889383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-020d5f22-07f8-4d06-b7bf-e13e5c5c2657 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:45:59.896855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-020d5f22-07f8-4d06-b7bf-e13e5c5c2657 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.897891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-020d5f22-07f8-4d06-b7bf-e13e5c5c2657 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:45:59.898848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-020d5f22-07f8-4d06-b7bf-e13e5c5c2657 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:45:59.899441 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-020d5f22-07f8-4d06-b7bf-e13e5c5c2657 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:00.062033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:00.070741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ecd14159-f61c-4a1a-a230-fd9d807bad02 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.417985 Jul 01 10:46:00.071325 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2141/4391] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:45:59 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:00.116024 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-020d5f22-07f8-4d06-b7bf-e13e5c5c2657 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.231834 Jul 01 10:46:00.116703 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2251/4392] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Jul 1 10:45:59 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:46:00.670322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:00.672145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:00.692374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:00.694854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:00.695997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:00.696499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:01.089204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:01.092345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:01.101971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:01.102904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:01.103992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:01.104689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:01.491157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:01.499642 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f332e348-004b-4a11-ad74-c1ddf1363aae tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.834888 Jul 01 10:46:01.500234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2142/4393] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:00 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:01.507751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:01.515876 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-305dbec6-574d-40fb-9379-1f3b4e0c87b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.431801 Jul 01 10:46:01.517626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-02ed706e-28e9-4604-944a-e898b3ca0739 req-7f633caf-b00f-4cf4-980e-36f9ba914484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:01.522664 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2252/4394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:01 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:01.526583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-02ed706e-28e9-4604-944a-e898b3ca0739 req-7f633caf-b00f-4cf4-980e-36f9ba914484 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:01.527028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-02ed706e-28e9-4604-944a-e898b3ca0739 req-7f633caf-b00f-4cf4-980e-36f9ba914484 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:01.541915 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-02ed706e-28e9-4604-944a-e898b3ca0739 req-7f633caf-b00f-4cf4-980e-36f9ba914484 service nova] Creating event network-changed:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h2-master-1 Jul 01 10:46:01.547566 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-02ed706e-28e9-4604-944a-e898b3ca0739 req-7f633caf-b00f-4cf4-980e-36f9ba914484 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045841 Jul 01 10:46:01.548600 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2143/4395] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:02.516024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:02.517786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:02.525048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:02.526977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:02.526977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:02.527543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:02.544679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:02.546370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:02.557660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:02.559558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:02.560691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:02.561401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:02.828912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:02.833672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:02.842345 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-329416d7-622b-4697-a2a8-a888160802e4 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1516 microversion: 2.1 time: 0.330357 Jul 01 10:46:02.843039 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7ed3bbb-461a-4410-be36-75c4b5e63f24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.304410 Jul 01 10:46:02.845455 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2253/4396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:02 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1516 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:02.858929 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2144/4397] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:02 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:03.874926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:03.876940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:03.879115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:03.879518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:03.895406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:03.897553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:03.905882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:03.905882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:03.905882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:03.906193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:03.906193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:03.906193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:04.129190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:04.139824 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d1b2352-089c-4456-bb07-9345788e5cf6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.269167 Jul 01 10:46:04.140758 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2145/4398] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:03 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:04.188286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:04.209077 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06af20a8-ec1a-4c57-9c32-4e8208e0db63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1534 microversion: 2.1 time: 0.337440 Jul 01 10:46:04.214390 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2254/4399] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:03 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1534 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:05.161533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:05.162150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:05.172559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:05.173006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:05.177429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:05.178121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:05.227655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:05.237765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:05.249974 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:05.250490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:05.256827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:05.257386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:05.420751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:05.442997 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa444d27-d74c-4daf-90cf-da9298ad8a85 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.285690 Jul 01 10:46:05.447813 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2146/4400] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:05 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:05.514126 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:05.525570 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04c43852-273e-4da0-a0fc-b06b2d6c7fa1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1522 microversion: 2.1 time: 0.302002 Jul 01 10:46:05.526837 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2255/4401] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:05 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:06.464351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:06.465041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:06.473036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:06.473766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:06.474713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:06.475569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:06.557424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:06.558663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:06.566200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:06.566644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:06.567452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:06.567944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:06.650941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:06.660774 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cab79ea7-f337-4ed2-97ae-5dab57cf82ba tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.200283 Jul 01 10:46:06.661389 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2147/4402] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:06 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:06.718069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:06.720425 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:06.726453 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-799b9a18-d792-4d9f-8889-407c78963feb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1522 microversion: 2.1 time: 0.173072 Jul 01 10:46:06.727034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2256/4403] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:06 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:07.678639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:07.679250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:07.686412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:07.686858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:07.687812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:07.688822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:07.743912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:07.744450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:07.752651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:07.753105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:07.753924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:07.754359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:07.915714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:07.924462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa8267ce-f361-4978-b68e-3273b2a3aa43 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.249831 Jul 01 10:46:07.925037 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2148/4404] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:07 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:07.943972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:07.951600 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-134a5d38-3c19-4007-8c94-c1171159f982 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1522 microversion: 2.1 time: 0.211642 Jul 01 10:46:07.952207 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2257/4405] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:07 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:08.942706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:08.943326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:08.950556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:08.950995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:08.951769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:08.952205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:08.969986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:08.971248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:08.999473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:09.000338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:09.001982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:09.002570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:09.198300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:09.202043 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:09.207616 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14dfef4c-7f99-4f90-b186-d9b01bfb37e6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.269741 Jul 01 10:46:09.208513 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2149/4406] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:08 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:09.212150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:09.228805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6a040047-d34e-4a20-bc83-89f217cb045c req-c487f7a1-0e79-48d3-8af4-4a81f3648914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be7b572-b120-4967-825f-677b8e80ae6b", "name": "network-vif-plugged", "status": "completed", "tag": "e6c66ab9-345a-457e-bb9c-ad51b472da14"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:09.228998 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9fa8faa4-fa97-4251-9cb1-5ecba3144a49 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1522 microversion: 2.1 time: 0.255392 Jul 01 10:46:09.229101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6a040047-d34e-4a20-bc83-89f217cb045c req-c487f7a1-0e79-48d3-8af4-4a81f3648914 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:09.229101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6a040047-d34e-4a20-bc83-89f217cb045c req-c487f7a1-0e79-48d3-8af4-4a81f3648914 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:09.229736 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2258/4407] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:08 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:09.239044 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6a040047-d34e-4a20-bc83-89f217cb045c req-c487f7a1-0e79-48d3-8af4-4a81f3648914 service nova] Creating event network-vif-plugged:e6c66ab9-345a-457e-bb9c-ad51b472da14 for instance 0be7b572-b120-4967-825f-677b8e80ae6b on n-h2-master-1 Jul 01 10:46:09.244124 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6a040047-d34e-4a20-bc83-89f217cb045c req-c487f7a1-0e79-48d3-8af4-4a81f3648914 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034320 Jul 01 10:46:09.244617 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2150/4408] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:10.226106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:10.226734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:10.236476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:10.242848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:10.242848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:10.243384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:10.246172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:10.246797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:10.251387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:10.252114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:10.253135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:10.253743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:10.456665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:10.458438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:10.474583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7fed53c-6628-430b-af64-f823a538e6dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.252176 Jul 01 10:46:10.474825 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2259/4409] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:10 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:10.486128 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9bf63ec1-a614-4d68-aacb-fde4dbe51de1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1522 microversion: 2.1 time: 0.250739 Jul 01 10:46:10.487704 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2151/4410] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:10 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:11.498150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:11.506133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:11.507371 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:11.509855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:11.531829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:11.533069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:11.533773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:11.534888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:11.535768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:11.536816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:11.537548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:11.539224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:11.840056 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:11.843094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:11.849368 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-be6ff4ab-a46f-4a16-9074-421185a28619 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1507 microversion: 2.1 time: 0.348952 Jul 01 10:46:11.851366 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2152/4411] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:11 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:11.852462 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23e8a096-21ea-4f23-add1-568ec6920581 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.360294 Jul 01 10:46:11.856928 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2260/4412] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:11 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:11.869920 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:11.870618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:11.879000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:11.879488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:11.880323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:11.880837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:12.051337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:12.060148 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a7ada9f-4fff-4f1a-a8e2-0d7cc5a86155 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 200 len: 1507 microversion: 2.1 time: 0.195616 Jul 01 10:46:12.060761 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2153/4413] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:11 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:12.095486 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:12.096324 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:12.106804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:12.107528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:12.109133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:12.111725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:12.185369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:46:12.569323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db2570c9-36f8-43e2-a2cb-f8af24aa64d6 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 204 len: 0 microversion: 2.1 time: 0.482687 Jul 01 10:46:12.574725 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2261/4414] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:46:12 2022] DELETE /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:46:12.704990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-196267973", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "e32ddfd9-e576-4f03-b9da-056b95b2f137"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:12.762353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] validate_networks() for [('e32ddfd9-e576-4f03-b9da-056b95b2f137', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:46:12.873944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:12.874871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:12.882831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:12.883500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:12.884828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:12.885859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:13.136865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:13.151313 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb954611-865d-4fdd-90fc-3c57f1d84c6d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.275425 Jul 01 10:46:13.151313 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2262/4415] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:12 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:13.331970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:46:13.332654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:46:13.333390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:46:13.333881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:46:13.334368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:46:13.344790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:13.352514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:13.353434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:13.358804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:13.373720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Getting quotas for project 1756cea9fed0440da392929c10924cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:46:13.379940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Getting quotas for user 5486f8d5ebed4807a89deb962c392f1a and project 1756cea9fed0440da392929c10924cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:46:13.392672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:46:13.394937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:46:13.580327 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8497fd31-1138-44f0-b8e0-702737a68772 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874982 Jul 01 10:46:13.581844 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2154/4416] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:46:13.600176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25c3369a-c91a-4732-be18-638913405e99 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:13.600176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-25c3369a-c91a-4732-be18-638913405e99 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:13.702360 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-25c3369a-c91a-4732-be18-638913405e99 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:13.710735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25c3369a-c91a-4732-be18-638913405e99 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1217 microversion: 2.1 time: 0.122681 Jul 01 10:46:13.713933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2263/4417] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:13 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:14.174177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:14.180114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:14.225724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:14.229640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:14.233089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:14.240264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:14.736449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23e11bf3-5f46-46c0-bff0-c46614a2f019 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:14.738276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23e11bf3-5f46-46c0-bff0-c46614a2f019 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:15.157125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23e11bf3-5f46-46c0-bff0-c46614a2f019 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:15.179168 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23e11bf3-5f46-46c0-bff0-c46614a2f019 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1217 microversion: 2.1 time: 0.452541 Jul 01 10:46:15.182238 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2264/4418] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:14 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1217 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:15.330949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8daa2917-5394-40d0-b7c8-1fd9320f702c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a06589af-1c41-4658-9850-aee903f8b499"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:15.336347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8daa2917-5394-40d0-b7c8-1fd9320f702c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:15.367950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8daa2917-5394-40d0-b7c8-1fd9320f702c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:15.374196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8daa2917-5394-40d0-b7c8-1fd9320f702c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:15.380541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8daa2917-5394-40d0-b7c8-1fd9320f702c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:15.380541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8daa2917-5394-40d0-b7c8-1fd9320f702c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:15.725017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:15.764309 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fcbcb42b-1ba9-4b17-8157-8adb3afa07bf tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 1.598241 Jul 01 10:46:15.767563 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2155/4419] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:14 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:15.778831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c911ca66-2a86-4aeb-83ab-ba561eab4838 req-e4ffd393-0c1c-4c2b-9d11-1eff7df9789f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be7b572-b120-4967-825f-677b8e80ae6b", "name": "network-vif-deleted", "tag": "e6c66ab9-345a-457e-bb9c-ad51b472da14"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:15.800270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c911ca66-2a86-4aeb-83ab-ba561eab4838 req-e4ffd393-0c1c-4c2b-9d11-1eff7df9789f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:15.802811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c911ca66-2a86-4aeb-83ab-ba561eab4838 req-e4ffd393-0c1c-4c2b-9d11-1eff7df9789f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:15.833011 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c911ca66-2a86-4aeb-83ab-ba561eab4838 req-e4ffd393-0c1c-4c2b-9d11-1eff7df9789f service nova] Creating event network-vif-deleted:e6c66ab9-345a-457e-bb9c-ad51b472da14 for instance 0be7b572-b120-4967-825f-677b8e80ae6b on n-h2-master-1 Jul 01 10:46:15.853764 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c911ca66-2a86-4aeb-83ab-ba561eab4838 req-e4ffd393-0c1c-4c2b-9d11-1eff7df9789f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084574 Jul 01 10:46:15.855382 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2156/4420] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:16.201192 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:16.202144 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:16.210296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:16.211197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:16.212404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:16.213086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:16.348245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:16.360574 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-22917381-3e19-4ed6-94b2-26c241e70c0f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1269 microversion: 2.1 time: 0.164470 Jul 01 10:46:16.361294 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2157/4421] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:16 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:16.531622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8daa2917-5394-40d0-b7c8-1fd9320f702c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.209679 Jul 01 10:46:16.533210 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2265/4422] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:46:15 2022] POST /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 194 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:16.786344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:16.788263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:16.806075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:16.809215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:16.812081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:16.814283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:17.149852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:17.158314 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-32f935c5-d817-470a-b156-1bef7880a6e5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1723 microversion: 2.1 time: 0.377004 Jul 01 10:46:17.163032 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2158/4423] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:16 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:17.379975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:17.382040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:17.392524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:17.393393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:17.394957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:17.396659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:17.512834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:17.522949 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8d868d9-22d3-4fe1-8bbb-42d96b7aacca tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1275 microversion: 2.1 time: 0.149238 Jul 01 10:46:17.523667 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2266/4424] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:17 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:18.184264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:18.184264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:18.202376 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:18.202978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:18.204538 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:18.206757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:18.544813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:18.545444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:18.548382 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:18.568290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:18.570940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:18.570940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:18.570940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:18.786352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:18.794550 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b91ff6f3-b0cf-49d8-a45d-4e9dcd376c74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1700 microversion: 2.1 time: 0.619979 Jul 01 10:46:18.795142 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2159/4425] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:18 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1700 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:18.821727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61cdf760-44ea-4a95-9482-98370103a57b tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:18.835912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61cdf760-44ea-4a95-9482-98370103a57b tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:18.838202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61cdf760-44ea-4a95-9482-98370103a57b tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:18.879671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:18.892987 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3350f64-ff5b-4b88-88df-f5e7bdf5af4a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.352894 Jul 01 10:46:18.895358 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2267/4426] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:18 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:18.905022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61cdf760-44ea-4a95-9482-98370103a57b tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Going to try to start instance {{(pid=119765) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 10:46:19.197385 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61cdf760-44ea-4a95-9482-98370103a57b tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action" status: 202 len: 0 microversion: 2.1 time: 0.379201 Jul 01 10:46:19.197385 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2160/4427] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:46:18 2022] POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:46:19.201032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:19.205205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:19.226802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:19.231084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:19.235990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:19.236512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:19.662867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:19.671055 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a2e794f-6c3a-47f4-b363-59420d882601 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1709 microversion: 2.1 time: 0.474230 Jul 01 10:46:19.685528 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2268/4428] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:19 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1709 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:19.912956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:19.913718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:19.933216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:19.934387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:19.938955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:19.939523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:20.338660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:20.366911 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-553e779c-10cc-4d32-a49e-39c56bfd8b02 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.457631 Jul 01 10:46:20.376025 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2161/4429] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:19 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:20.689595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:20.690470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:20.704668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:20.709690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:20.711502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:20.711502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:21.378373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:21.396903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:21.400272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:21.400510 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d8b43b0b-e706-4116-9109-3b4b7b2e00c5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1709 microversion: 2.1 time: 0.714394 Jul 01 10:46:21.400510 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2269/4430] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:20 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1709 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:21.435845 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:21.437718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:21.439099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:21.439550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:21.996866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:22.017033 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-10be24f1-131f-481c-bc0c-aef2c27275b1 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.613659 Jul 01 10:46:22.017755 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2162/4431] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:21 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:22.416246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:22.422025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:22.426446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:22.426909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:22.427805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:22.428240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:22.590737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-553737aa-038b-427b-a8b3-668ddb95f05e req-d5012409-47b5-4616-8550-efb6c0b679a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66147e8a-309d-41df-8b80-4756501b00d2", "tag": "c10ffc5b-3061-4395-95bc-d2baa8dd823c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:22.609066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-553737aa-038b-427b-a8b3-668ddb95f05e req-d5012409-47b5-4616-8550-efb6c0b679a7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:22.612181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-553737aa-038b-427b-a8b3-668ddb95f05e req-d5012409-47b5-4616-8550-efb6c0b679a7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:22.649374 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-553737aa-038b-427b-a8b3-668ddb95f05e req-d5012409-47b5-4616-8550-efb6c0b679a7 service nova] Creating event network-changed:c10ffc5b-3061-4395-95bc-d2baa8dd823c for instance 66147e8a-309d-41df-8b80-4756501b00d2 on n-h1-master-1 Jul 01 10:46:22.661053 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-553737aa-038b-427b-a8b3-668ddb95f05e req-d5012409-47b5-4616-8550-efb6c0b679a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.820043 Jul 01 10:46:22.664489 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2270/4432] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:22.944988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:22.956576 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-afbc7e10-e0d4-4315-82b1-35db4e2e67d7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1709 microversion: 2.1 time: 0.544288 Jul 01 10:46:22.960688 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2163/4433] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:22 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1709 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:23.052241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:23.053296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:23.061973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:23.062666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:23.064888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:23.065606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:23.453057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:23.465339 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-092772f4-a4ab-42b1-b35e-f3e2272e61df tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.424313 Jul 01 10:46:23.467337 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2271/4434] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:23 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:23.514181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e5e7232e-12e7-42de-9490-954642df2c08 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49d705b-ca0e-4c41-a58c-f574019a83e4"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:23.515256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e5e7232e-12e7-42de-9490-954642df2c08 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:23.518147 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:23.518849 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:23.544095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e7232e-12e7-42de-9490-954642df2c08 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:23.552094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e7232e-12e7-42de-9490-954642df2c08 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:23.553178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e7232e-12e7-42de-9490-954642df2c08 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:23.553601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e7232e-12e7-42de-9490-954642df2c08 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:23.980373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:23.980373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:23.987664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:23.998829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:24.000122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:24.001450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:24.206894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:24.216979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11ad2e2b-61b1-420a-a617-c541496ff6c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1713 microversion: 2.1 time: 0.242647 Jul 01 10:46:24.217617 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2272/4435] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:23 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1713 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:24.344774 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e5e7232e-12e7-42de-9490-954642df2c08 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "POST /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834532 Jul 01 10:46:24.348432 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2164/4436] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:46:23 2022] POST /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:24.488806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:24.489554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:24.498278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:24.498726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:24.503669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:24.504149 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:24.509843 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:24.776095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:24.786713 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06c1f3e8-07e1-4423-ab79-b810f49e1452 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.304656 Jul 01 10:46:24.787488 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2273/4437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:24 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:25.808614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:25.809342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:25.819666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:25.820116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:25.820902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:25.821369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:26.032187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:26.043616 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a5158aeb-1201-43e5-bc1e-7ea6967a18ad tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.240723 Jul 01 10:46:26.056674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2165/4438] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:25 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:27.062399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:27.063769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:27.102864 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:27.107665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:27.108119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:27.108903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:27.114244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:27.396146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:27.407137 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-57e21f34-dbe2-4941-a1cd-b453d8448f4c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.349052 Jul 01 10:46:27.408463 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2274/4439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:27 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:28.424829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:28.425472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:28.440453 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:28.442219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:28.444719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:28.449619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:28.450075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:28.477587 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:28.655784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:28.666183 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a820938d-26c2-4642-9c65-6c854f232729 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.244771 Jul 01 10:46:28.678745 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2166/4440] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:28 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:29.332384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4b0b865d-f7bf-43f5-84d5-e4be1b2b4269 req-821dbc3c-4052-4757-bca1-26d3ff0a483d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66147e8a-309d-41df-8b80-4756501b00d2", "name": "network-vif-plugged", "status": "completed", "tag": "c10ffc5b-3061-4395-95bc-d2baa8dd823c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:29.343350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4b0b865d-f7bf-43f5-84d5-e4be1b2b4269 req-821dbc3c-4052-4757-bca1-26d3ff0a483d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:29.343886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4b0b865d-f7bf-43f5-84d5-e4be1b2b4269 req-821dbc3c-4052-4757-bca1-26d3ff0a483d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:29.357638 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4b0b865d-f7bf-43f5-84d5-e4be1b2b4269 req-821dbc3c-4052-4757-bca1-26d3ff0a483d service nova] Creating event network-vif-plugged:c10ffc5b-3061-4395-95bc-d2baa8dd823c for instance 66147e8a-309d-41df-8b80-4756501b00d2 on n-h1-master-1 Jul 01 10:46:29.363100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4b0b865d-f7bf-43f5-84d5-e4be1b2b4269 req-821dbc3c-4052-4757-bca1-26d3ff0a483d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039067 Jul 01 10:46:29.364234 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2275/4441] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:29.684336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:29.685040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:29.694298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:29.694748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:29.695506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:29.701176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:30.005690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:30.020221 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2034ce33-857a-4768-a3ac-83af9a416096 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1317 microversion: 2.1 time: 0.339994 Jul 01 10:46:30.025833 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2167/4442] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:29 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:31.043865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:31.049245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:31.057024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.057497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.058734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.059171 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.325351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:31.334128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5fa9bcfb-077d-4c5a-9ce0-f83a6e7585eb tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1506 microversion: 2.1 time: 0.295090 Jul 01 10:46:31.346302 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2276/4443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:31 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:31.351678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:31.352873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:31.360817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.366577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.366577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.366577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.663614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:31.667185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:31.671168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:31.671465 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42c1fede-c1dc-4f19-b1f8-b84423334099 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1506 microversion: 2.1 time: 0.324307 Jul 01 10:46:31.673240 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2168/4444] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:31 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:31.680427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.681313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.682349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.682975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.690529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-97c3093c-ace2-4e14-9448-cd179ae6045c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:31.692076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-97c3093c-ace2-4e14-9448-cd179ae6045c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:31.700722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c3093c-ace2-4e14-9448-cd179ae6045c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.701595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c3093c-ace2-4e14-9448-cd179ae6045c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.702585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c3093c-ace2-4e14-9448-cd179ae6045c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.703832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c3093c-ace2-4e14-9448-cd179ae6045c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.714675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lazy-loading 'flavor' on Instance uuid 97681ece-9530-48a6-bab2-033fabe477f6 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:46:31.923692 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-97c3093c-ace2-4e14-9448-cd179ae6045c tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "PUT /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1078 microversion: 2.1 time: 0.236708 Jul 01 10:46:31.925526 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2169/4445] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:46:31 2022] PUT /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1078 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:31.944470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:31.945202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:31.960349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.960811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:31.961699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:31.962140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.165244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:32.172458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-744727d7-de05-4553-a193-1570280c8b8a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/action" status: 200 len: 32 microversion: 2.1 time: 0.510129 Jul 01 10:46:32.178473 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2277/4446] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:46:31 2022] POST /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/action => generated 32 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:46:32.182897 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c680e00a-98c4-42e9-852a-ba42865f4e8d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1504 microversion: 2.1 time: 0.247339 Jul 01 10:46:32.183851 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2170/4447] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:31 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:32.185307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:32.186550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:32.193857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.194588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.195536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.196145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.204202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:32.206265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:32.213471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.214157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.215154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.215866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.505665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:32.521494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:32.525609 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33ec0610-4d8c-45a2-b78d-7ed877b5ced9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.345434 Jul 01 10:46:32.526218 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2278/4448] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:32 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:32.545084 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-779e3846-21a2-4226-96e2-b55bb458a25f tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1504 microversion: 2.1 time: 0.347887 Jul 01 10:46:32.553234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2171/4449] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:32 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:32.563550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-14a0a9c3-6bb2-4e56-a87e-febc826ecc87 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:32.564764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-14a0a9c3-6bb2-4e56-a87e-febc826ecc87 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:32.571448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14a0a9c3-6bb2-4e56-a87e-febc826ecc87 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.571900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14a0a9c3-6bb2-4e56-a87e-febc826ecc87 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.572685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14a0a9c3-6bb2-4e56-a87e-febc826ecc87 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.573270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14a0a9c3-6bb2-4e56-a87e-febc826ecc87 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.723792 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-14a0a9c3-6bb2-4e56-a87e-febc826ecc87 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "PUT /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1080 microversion: 2.1 time: 0.165868 Jul 01 10:46:32.733643 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2279/4450] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 10:46:32 2022] PUT /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1080 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:32.739018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:32.739626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:32.747529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.747981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:32.748759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:32.749222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.028960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:33.044487 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b76e164e-5a0f-41c2-8ea1-232952620f4d tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1506 microversion: 2.1 time: 0.309170 Jul 01 10:46:33.045792 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2172/4451] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:32 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:33.061999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:33.062653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:33.075003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.075003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.075003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.075279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.304153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:33.312876 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80250829-31b9-4397-aa6a-8a4e728ab225 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1506 microversion: 2.1 time: 0.255624 Jul 01 10:46:33.313489 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2280/4452] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:33 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:33.334080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:33.347949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:33.347949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.347949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.347949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.347949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.373558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:46:33.546067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:33.547592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:33.554634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.555190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.556347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.556780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.747975 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e82682b-7bff-4895-8d33-09c31b669f73 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "DELETE /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 204 len: 0 microversion: 2.1 time: 0.422846 Jul 01 10:46:33.749904 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2173/4453] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:46:33 2022] DELETE /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:46:33.767602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:33.768355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:33.775630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.776204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.777170 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.777881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.808750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:46:33.928536 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.api [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Instance is already in deleting state, ignoring this request Jul 01 10:46:33.931890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e613c7f2-c223-4d07-88c0-7b4331ee0fea tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "DELETE /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 204 len: 0 microversion: 2.1 time: 0.169352 Jul 01 10:46:33.941604 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2174/4454] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:46:33 2022] DELETE /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:46:33.947773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:33.953652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:33.960818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.961611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:33.962680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:33.963294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:34.010926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:34.021314 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab7eb3ee-ed16-4368-8ec1-f777b4343e47 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.481255 Jul 01 10:46:34.021914 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2281/4455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:33 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:34.166217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:34.174593 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eb082500-5d96-4bf0-b133-f89711e031f0 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1512 microversion: 2.1 time: 0.231746 Jul 01 10:46:34.175390 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2175/4456] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:33 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:35.038235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:35.044647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:35.046450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:35.047704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:35.048704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:35.049391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:35.192975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:35.193753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:35.201312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:35.207111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:35.208043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:35.210275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:35.233175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:35.242745 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-462be54c-0db2-4f54-87d6-605d2c2f2af5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.208328 Jul 01 10:46:35.250428 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2282/4457] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:35 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:35.517720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:35.526818 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f38c2ce2-2b4d-4183-b32f-92a7ced9cdb8 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1512 microversion: 2.1 time: 0.338013 Jul 01 10:46:35.534878 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2176/4458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:35 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:36.049961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-47260d09-de30-4803-9d1c-37cf1d0390fd req-7e30a57e-95f1-4e75-bb72-86e536277d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66147e8a-309d-41df-8b80-4756501b00d2", "name": "network-vif-deleted", "tag": "c10ffc5b-3061-4395-95bc-d2baa8dd823c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:36.060324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-47260d09-de30-4803-9d1c-37cf1d0390fd req-7e30a57e-95f1-4e75-bb72-86e536277d21 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:36.063120 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-47260d09-de30-4803-9d1c-37cf1d0390fd req-7e30a57e-95f1-4e75-bb72-86e536277d21 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:36.075909 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-47260d09-de30-4803-9d1c-37cf1d0390fd req-7e30a57e-95f1-4e75-bb72-86e536277d21 service nova] Creating event network-vif-deleted:c10ffc5b-3061-4395-95bc-d2baa8dd823c for instance 66147e8a-309d-41df-8b80-4756501b00d2 on n-h1-master-1 Jul 01 10:46:36.082704 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-47260d09-de30-4803-9d1c-37cf1d0390fd req-7e30a57e-95f1-4e75-bb72-86e536277d21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037015 Jul 01 10:46:36.088506 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2283/4459] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:36.262038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:36.262825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:36.275102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:36.281101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:36.282940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:36.282940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:36.467773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:36.476654 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a252fac-3208-4599-b2cb-2d76a74f8659 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.219114 Jul 01 10:46:36.496138 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2177/4460] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:36 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:36.553271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:36.554480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:36.561411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:36.562094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:36.563789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:36.564317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:36.600460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:36.601014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:36.601760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lazy-loading 'fault' on Instance uuid 66147e8a-309d-41df-8b80-4756501b00d2 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:46:36.711069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5486f8d5ebed4807a89deb962c392f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1756cea9fed0440da392929c10924cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:36.725781 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f360c9bf-1cde-4f02-bcee-99d7fec4c530 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 200 len: 1307 microversion: 2.1 time: 0.175546 Jul 01 10:46:36.726675 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2284/4461] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:36 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:37.501999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:37.503196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:37.514119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.514668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.519520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.520259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.745274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:37.763263 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-be604813-d3ce-4425-9dea-b79adaa2af40 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.267254 Jul 01 10:46:37.764409 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2178/4462] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:37 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:37.792047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78c9ca81-f061-4122-903b-900ec6153d53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:37.792559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78c9ca81-f061-4122-903b-900ec6153d53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:37.810223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78c9ca81-f061-4122-903b-900ec6153d53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.811116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78c9ca81-f061-4122-903b-900ec6153d53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.812120 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78c9ca81-f061-4122-903b-900ec6153d53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.813672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78c9ca81-f061-4122-903b-900ec6153d53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.818303 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:37.839552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78c9ca81-f061-4122-903b-900ec6153d53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/ips" status: 200 len: 152 microversion: 2.20 time: 0.061146 Jul 01 10:46:37.840819 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2179/4463] 10.222.0.23 () {60 vars in 1288 bytes} [Fri Jul 1 10:46:37 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/ips => generated 152 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:46:37.847774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:37.853562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 66147e8a-309d-41df-8b80-4756501b00d2] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:37.855236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.855778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.856728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.857269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.874380 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] HTTP exception thrown: Instance 66147e8a-309d-41df-8b80-4756501b00d2 could not be found. Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Request method failure captured: Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 HTTP/1.1 Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_zp5MgyYilIv3Qj_oMpt5MPiq8EUTizzrf94YqFkNMz5FplLqaOVOF66wjvbeTv3_Ia0YzdcHrnv7WR-Ira0e127oVVyeR5nuS_ESy5CnwL_yzRrmTCPoiCpMr0__oLPPco3_6j6_7_wY88RMe4s1f3oFc7EzyjYGk87SCdpoaqYo Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1756cea9fed0440da392929c10924cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1756cea9fed0440da392929c10924cfc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5486f8d5ebed4807a89deb962c392f1a Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 66147e8a-309d-41df-8b80-4756501b00d2 could not be found. Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '66147e8a-309d-41df-8b80-4756501b00d2'} Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66147e8a-309d-41df-8b80-4756501b00d2 could not be found. Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66147e8a-309d-41df-8b80-4756501b00d2 could not be found. Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:37.876138 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66147e8a-309d-41df-8b80-4756501b00d2 could not be found. Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Returning 404 to user: Instance 66147e8a-309d-41df-8b80-4756501b00d2 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1b97ec5-06b7-475c-964d-fe89ebdedc0a tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2" status: 404 len: 111 microversion: 2.1 time: 0.035598 Jul 01 10:46:37.880366 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2180/4464] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:37 2022] GET /compute/v2.1/servers/66147e8a-309d-41df-8b80-4756501b00d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:46:37.889264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:37.889753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:37.896421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.896924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.897749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.898259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.913567 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] HTTP exception thrown: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Request method failure captured: Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b HTTP/1.1 Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_zp5MgyYilIv3Qj_oMpt5MPiq8EUTizzrf94YqFkNMz5FplLqaOVOF66wjvbeTv3_Ia0YzdcHrnv7WR-Ira0e127oVVyeR5nuS_ESy5CnwL_yzRrmTCPoiCpMr0__oLPPco3_6j6_7_wY88RMe4s1f3oFc7EzyjYGk87SCdpoaqYo Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1756cea9fed0440da392929c10924cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1756cea9fed0440da392929c10924cfc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5486f8d5ebed4807a89deb962c392f1a Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0be7b572-b120-4967-825f-677b8e80ae6b'} Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:46:37.915133 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Returning 404 to user: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:46:37.919815 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5a97ceb9-2a0a-4708-9cbb-851ac5fd98b5 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 404 len: 111 microversion: 2.1 time: 0.031557 Jul 01 10:46:37.923327 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2181/4465] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:46:37 2022] DELETE /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:46:37.929586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:37.931350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: 0be7b572-b120-4967-825f-677b8e80ae6b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:37.944940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.945533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.946173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.946606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.971443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "47bd8008-07c0-40bc-ad94-601c78d8ef36"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:37.974102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:37.980771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] HTTP exception thrown: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Request method failure captured: Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b HTTP/1.1 Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_zp5MgyYilIv3Qj_oMpt5MPiq8EUTizzrf94YqFkNMz5FplLqaOVOF66wjvbeTv3_Ia0YzdcHrnv7WR-Ira0e127oVVyeR5nuS_ESy5CnwL_yzRrmTCPoiCpMr0__oLPPco3_6j6_7_wY88RMe4s1f3oFc7EzyjYGk87SCdpoaqYo Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1756cea9fed0440da392929c10924cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1756cea9fed0440da392929c10924cfc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5486f8d5ebed4807a89deb962c392f1a Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0be7b572-b120-4967-825f-677b8e80ae6b'} Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:37.982521 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Returning 404 to user: Instance 0be7b572-b120-4967-825f-677b8e80ae6b could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec476995-ff2b-4047-9ca9-56ea283f4968 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b" status: 404 len: 111 microversion: 2.1 time: 0.059512 Jul 01 10:46:37.987391 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2182/4466] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:37 2022] GET /compute/v2.1/servers/0be7b572-b120-4967-825f-677b8e80ae6b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:46:37.988375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.988896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:37.989711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:37.990139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.007381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:38.007872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:38.019281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.024465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.025475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.032224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.053215 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] HTTP exception thrown: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Request method failure captured: Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e HTTP/1.1 Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_zp5MgyYilIv3Qj_oMpt5MPiq8EUTizzrf94YqFkNMz5FplLqaOVOF66wjvbeTv3_Ia0YzdcHrnv7WR-Ira0e127oVVyeR5nuS_ESy5CnwL_yzRrmTCPoiCpMr0__oLPPco3_6j6_7_wY88RMe4s1f3oFc7EzyjYGk87SCdpoaqYo Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1756cea9fed0440da392929c10924cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1756cea9fed0440da392929c10924cfc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5486f8d5ebed4807a89deb962c392f1a Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: exception: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'a65d25cd-6f85-4a63-ac05-0d7380c4954e'} Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:46:38.055056 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.059396 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.060871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Returning 404 to user: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:46:38.061896 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a76223b-90fd-407e-a8f2-17ea7ba48e56 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 404 len: 111 microversion: 2.1 time: 0.058306 Jul 01 10:46:38.063141 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2183/4467] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:46:38 2022] DELETE /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:46:38.075979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:38.082824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] [instance: a65d25cd-6f85-4a63-ac05-0d7380c4954e] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:38.091090 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.096454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.096454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.096454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.114142 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] HTTP exception thrown: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Request method failure captured: Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e HTTP/1.1 Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_zp5MgyYilIv3Qj_oMpt5MPiq8EUTizzrf94YqFkNMz5FplLqaOVOF66wjvbeTv3_Ia0YzdcHrnv7WR-Ira0e127oVVyeR5nuS_ESy5CnwL_yzRrmTCPoiCpMr0__oLPPco3_6j6_7_wY88RMe4s1f3oFc7EzyjYGk87SCdpoaqYo Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1756cea9fed0440da392929c10924cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1756cea9fed0440da392929c10924cfc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1756cea9fed0440da392929c10924cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 1756cea9fed0440da392929c10924cfc Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-841918259 Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5486f8d5ebed4807a89deb962c392f1a Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerDiskConfigTestJSON-841918259-project Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: exception: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'a65d25cd-6f85-4a63-ac05-0d7380c4954e'} Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:38.123147 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] Returning 404 to user: Instance a65d25cd-6f85-4a63-ac05-0d7380c4954e could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:46:38.126896 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d7b524c7-d1c8-4ed7-a88d-b1e2382e4b63 tempest-ServerDiskConfigTestJSON-841918259 tempest-ServerDiskConfigTestJSON-841918259-project] 10.222.0.23 "GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e" status: 404 len: 111 microversion: 2.1 time: 0.057738 Jul 01 10:46:38.131737 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2184/4468] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:38 2022] GET /compute/v2.1/servers/a65d25cd-6f85-4a63-ac05-0d7380c4954e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:46:38.194248 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] HTTP exception thrown: Volume 47bd8008-07c0-40bc-ad94-601c78d8ef36 could not be found. Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Request method failure captured: Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments/a49d705b-ca0e-4c41-a58c-f574019a83e4 HTTP/1.1 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 74 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtA2KwYcsGBuDZqFjuJZ-_bkz7WmvIr98jT_F7riYKTzEv6knc9mbmXoAYO-HqI0Ft1duIcG4tXhuXYQNDzs3iIR07fukM_wpPFw-x0_hyqT_OPBeHbwhKBtM4AyecyvMRAewG4AbKMW-hzMrEEWE2hOp7ZrEq5bYpoVPtKXsQSLmSU Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 269abfe038eb48dfbcf40fe0681e8bb6 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesAdminNegativeTest-1336757080 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/269abfe038eb48dfbcf40fe0681e8bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/269abfe038eb48dfbcf40fe0681e8bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_269abfe038eb48dfbcf40fe0681e8bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/269abfe038eb48dfbcf40fe0681e8bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesAdminNegativeTest-1336757080 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 269abfe038eb48dfbcf40fe0681e8bb6 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1336757080 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesAdminNegativeTest-1336757080-project-admin Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 746c3a3331d645db93a97d1569421338 Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesAdminNegativeTest-1336757080-project-admin Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: {"volumeAttachment": {"volumeId": "47bd8008-07c0-40bc-ad94-601c78d8ef36"}} Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: exception: Volume 47bd8008-07c0-40bc-ad94-601c78d8ef36 could not be found. Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': '9a5e5269-0b37-467f-bf0f-7e45f5ff738b', 'id': 'a49d705b-ca0e-4c41-a58c-f574019a83e4', 'body': {'volumeAttachment': {'volumeId': '47bd8008-07c0-40bc-ad94-601c78d8ef36'}}} Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47bd8008-07c0-40bc-ad94-601c78d8ef36 could not be found. (HTTP 404) (Request-ID: req-09ae1505-52b8-4ca3-bee4-847c22ae66b9) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:46:38.197705 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47bd8008-07c0-40bc-ad94-601c78d8ef36 could not be found. Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 47bd8008-07c0-40bc-ad94-601c78d8ef36 could not be found. Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47bd8008-07c0-40bc-ad94-601c78d8ef36 could not be found. Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Returning 400 to user: Volume 47bd8008-07c0-40bc-ad94-601c78d8ef36 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:46:38.206951 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3de2d0b-bb56-47bb-aac9-bd64fa234cce tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments/a49d705b-ca0e-4c41-a58c-f574019a83e4" status: 400 len: 107 microversion: 2.1 time: 0.664513 Jul 01 10:46:38.212878 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2285/4469] 10.222.0.23 () {60 vars in 1432 bytes} [Fri Jul 1 10:46:37 2022] PUT /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments/a49d705b-ca0e-4c41-a58c-f574019a83e4 => generated 107 bytes in 667 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:46:38.290426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:38.290861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:38.297992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.298445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.299231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.299671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.394014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lazy-loading 'services' on Instance uuid 9a5e5269-0b37-467f-bf0f-7e45f5ff738b {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:46:38.686735 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fdc898fa-d159-4054-a308-f2718d07b442 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments/a49d705b-ca0e-4c41-a58c-f574019a83e4" status: 202 len: 0 microversion: 2.1 time: 0.400100 Jul 01 10:46:38.688971 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2185/4470] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:46:38 2022] DELETE /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments/a49d705b-ca0e-4c41-a58c-f574019a83e4 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:46:38.699239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bfb532f5-a068-4930-b803-f83c772c3005 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:38.700170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bfb532f5-a068-4930-b803-f83c772c3005 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:38.714936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb532f5-a068-4930-b803-f83c772c3005 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.715560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb532f5-a068-4930-b803-f83c772c3005 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.716507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb532f5-a068-4930-b803-f83c772c3005 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.717011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb532f5-a068-4930-b803-f83c772c3005 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.750779 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bfb532f5-a068-4930-b803-f83c772c3005 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056474 Jul 01 10:46:38.755627 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2286/4471] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:38 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:46:38.784770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:38.786135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:38.793790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.795186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:38.796275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:38.797844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:39.093000 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:39.114182 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5578e576-adff-4186-83a1-3511e150ddce tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.336692 Jul 01 10:46:39.115099 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2186/4472] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:38 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:39.768281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8780091-3918-4ba1-8744-e34ac6804241 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:39.770473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8780091-3918-4ba1-8744-e34ac6804241 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:39.799068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8780091-3918-4ba1-8744-e34ac6804241 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:39.801323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8780091-3918-4ba1-8744-e34ac6804241 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:39.803332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8780091-3918-4ba1-8744-e34ac6804241 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:39.806195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8780091-3918-4ba1-8744-e34ac6804241 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:39.888943 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8780091-3918-4ba1-8744-e34ac6804241 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122617 Jul 01 10:46:39.893723 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2287/4473] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:39 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:40.134497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:40.135304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:40.147869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:40.151683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:40.158092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:40.158765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:40.876649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:40.886482 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-129f0931-8185-4ad1-bfa4-3ed5e66ae4dd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.757249 Jul 01 10:46:40.887311 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2187/4474] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:40 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:40.903176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8aa191f8-eef6-49a0-88c7-96070677c965 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:40.904125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8aa191f8-eef6-49a0-88c7-96070677c965 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:40.914761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aa191f8-eef6-49a0-88c7-96070677c965 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:40.915714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aa191f8-eef6-49a0-88c7-96070677c965 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:40.916704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aa191f8-eef6-49a0-88c7-96070677c965 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:40.917399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8aa191f8-eef6-49a0-88c7-96070677c965 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:40.937494 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:40.961461 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8aa191f8-eef6-49a0-88c7-96070677c965 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063912 Jul 01 10:46:40.966434 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2288/4475] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:40 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:41.647553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:41.648695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:41.656373 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:41.663340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:41.666194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:41.670944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:41.763480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lazy-loading 'flavor' on Instance uuid 412c198b-5665-41d2-b3b3-7f4f261bdc4d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:46:41.907466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:41.908301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:41.927016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:41.943801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:41.946525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:41.948467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:42.362372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:42.375336 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-acbf0667-de12-4b6e-9708-153bd5dce64a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.473353 Jul 01 10:46:42.388518 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2289/4476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:41 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:42.406574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e1b394df-1aa7-4dea-8614-dadc51c55573 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:42.410563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e1b394df-1aa7-4dea-8614-dadc51c55573 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:42.432527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1b394df-1aa7-4dea-8614-dadc51c55573 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:42.432980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1b394df-1aa7-4dea-8614-dadc51c55573 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:42.435611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1b394df-1aa7-4dea-8614-dadc51c55573 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:42.436100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1b394df-1aa7-4dea-8614-dadc51c55573 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:42.525581 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e1b394df-1aa7-4dea-8614-dadc51c55573 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133671 Jul 01 10:46:42.526893 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2290/4477] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:42 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:42.735671 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87fd92e9-3b7d-48dd-8c21-81e01c41174c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/action" status: 202 len: 0 microversion: 2.20 time: 1.095454 Jul 01 10:46:42.756027 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:42.756836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:42.767248 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2188/4478] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:46:41 2022] POST /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/action => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:46:42.772885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:42.773580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:42.775266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:42.775919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:43.051965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:43.069377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:43.075162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:43.079815 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-69786fb4-ea4a-4371-875b-6edd79be0de9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.333757 Jul 01 10:46:43.080390 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2291/4479] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:42 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:43.394193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:43.395539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:43.403069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:43.403804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:43.404951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:43.406411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:43.539644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-870ed078-936c-42b7-84ad-c24254b5192d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:43.540835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-870ed078-936c-42b7-84ad-c24254b5192d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:43.548122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-870ed078-936c-42b7-84ad-c24254b5192d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:43.549207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-870ed078-936c-42b7-84ad-c24254b5192d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:43.550185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-870ed078-936c-42b7-84ad-c24254b5192d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:43.550801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-870ed078-936c-42b7-84ad-c24254b5192d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:43.612451 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-870ed078-936c-42b7-84ad-c24254b5192d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077619 Jul 01 10:46:43.614512 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2292/4480] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:43 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:43.638532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:43.656228 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-752ebf5b-ed17-408e-af65-c170e85d0d6a tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.266901 Jul 01 10:46:43.671544 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2189/4481] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:43 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:44.098897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:44.099600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:44.108146 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:44.109442 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:44.110432 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:44.111075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:44.370717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:44.383356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:44.384902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:44.396122 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2163687b-2470-4d41-a757-541f395cd91f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.301513 Jul 01 10:46:44.407180 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2293/4482] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:44 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:44.631159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6aaeaba4-f740-47ec-95d7-393c1b531e17 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:44.632222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6aaeaba4-f740-47ec-95d7-393c1b531e17 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:44.643327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aaeaba4-f740-47ec-95d7-393c1b531e17 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:44.645482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aaeaba4-f740-47ec-95d7-393c1b531e17 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:44.646475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aaeaba4-f740-47ec-95d7-393c1b531e17 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:44.646932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aaeaba4-f740-47ec-95d7-393c1b531e17 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:44.694085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:44.694085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:44.702340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:44.702340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:44.703506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:44.704107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:44.705319 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6aaeaba4-f740-47ec-95d7-393c1b531e17 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078517 Jul 01 10:46:44.709213 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2190/4483] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:44 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:44.924769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:44.950249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86c3848c-0ef5-48c8-aba1-5ec904b2bf0c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.260845 Jul 01 10:46:44.951922 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2294/4484] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:44 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:45.415764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:45.416675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:45.425641 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:45.427466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:45.428864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:45.429488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:45.661754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:45.680372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:45.683013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:45.684518 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f05c249e-4c17-4f74-8538-f69b65649ca5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.273993 Jul 01 10:46:45.689212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2191/4485] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:45 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:45.740047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb0b0e22-c177-43af-a04c-7fb134a9c364 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:45.742389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb0b0e22-c177-43af-a04c-7fb134a9c364 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:45.788017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb0b0e22-c177-43af-a04c-7fb134a9c364 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:45.802961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb0b0e22-c177-43af-a04c-7fb134a9c364 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:45.804073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb0b0e22-c177-43af-a04c-7fb134a9c364 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:45.808151 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb0b0e22-c177-43af-a04c-7fb134a9c364 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:45.959612 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb0b0e22-c177-43af-a04c-7fb134a9c364 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.241976 Jul 01 10:46:45.960205 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2295/4486] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:45 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:45.973405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:45.974317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:45.987256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:45.987718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:45.988522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:45.988970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:46.291730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:46.301674 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a540829-de5d-4619-9bf6-dea525980bed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.336286 Jul 01 10:46:46.304723 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2192/4487] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:45 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:46.705575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:46.706450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:46.713741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:46.714269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:46.715138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:46.715632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:46.921747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:46.932619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:46.934543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:46.935815 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09d6543f-709c-46a5-ac84-1560efbeebe6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.235110 Jul 01 10:46:46.936711 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2296/4488] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:46 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:46.971950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a95015a0-ca30-4e53-809f-b9b3a2e6f816 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:46.972884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a95015a0-ca30-4e53-809f-b9b3a2e6f816 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:46.985027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a95015a0-ca30-4e53-809f-b9b3a2e6f816 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:46.985528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a95015a0-ca30-4e53-809f-b9b3a2e6f816 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:46.987631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a95015a0-ca30-4e53-809f-b9b3a2e6f816 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:46.988073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a95015a0-ca30-4e53-809f-b9b3a2e6f816 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:47.076624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a95015a0-ca30-4e53-809f-b9b3a2e6f816 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108811 Jul 01 10:46:47.081092 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2193/4489] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:46:46 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:46:47.322751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:47.323368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:47.327394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-393536599", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "a29b7b86-adc6-4e8b-85d7-b6d427fe417a"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:47.344021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:47.344509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:47.345413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:47.346120 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:47.406834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] validate_networks() for [('a29b7b86-adc6-4e8b-85d7-b6d427fe417a', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:46:47.656907 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:47.674073 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f800948-3192-4000-81f7-0460237a88ae tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.355556 Jul 01 10:46:47.674864 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2194/4490] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:47 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:47.955120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:47.955828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:47.984158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:47.985382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:47.986187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:47.986617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:48.388459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:48.401609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:48.404100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:48.406507 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7f4471a9-fe49-4b7e-935c-781f642cef08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.455480 Jul 01 10:46:48.411723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:46:48.412568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:46:48.413343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:46:48.414165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:46:48.417895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:46:48.425725 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2195/4491] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:47 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:48.430545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:48.431357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:48.432444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:48.433173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:48.456698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Getting quotas for project cba33310a3044fa888af16a7e4698065. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:46:48.466395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Getting quotas for user e18cb45b496d47b5b540365fb183427c and project cba33310a3044fa888af16a7e4698065. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:46:48.485010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:46:48.487353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:46:48.647429 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1623388a-5b10-43d5-a9a4-534c83ffcdf3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333293 Jul 01 10:46:48.650160 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2297/4492] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:46:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:46:48.664382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-211b584b-fdde-4758-aee4-ed84ac5b6eaf tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:48.664382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-211b584b-fdde-4758-aee4-ed84ac5b6eaf tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:48.702598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:48.708428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:48.719484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:48.722223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:48.723233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:48.723831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:49.236063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-211b584b-fdde-4758-aee4-ed84ac5b6eaf tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:49.255873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-211b584b-fdde-4758-aee4-ed84ac5b6eaf tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1217 microversion: 2.1 time: 0.593464 Jul 01 10:46:49.267366 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2196/4493] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:48 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1217 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:49.324898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:49.342755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b530a430-caf2-46be-a1e4-1e258cb9e133 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.652115 Jul 01 10:46:49.347877 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2298/4494] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:48 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:49.441572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:49.442482 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:49.464711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:49.467869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:49.470292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:49.472803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:49.794606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:49.799067 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:49.806130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:49.808025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:49.810007 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74f575f8-4326-4633-b6e5-286eaf4a83b2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.373733 Jul 01 10:46:49.810796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2197/4495] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:49 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:50.276399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:50.277644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:50.288297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:50.289384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:50.290655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:50.292342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:50.380038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:50.384532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:50.414018 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:50.418704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:50.419740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:50.428202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:50.430643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:50.439976 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-03e57bff-f599-46cb-aacd-1365c532a44d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1221 microversion: 2.1 time: 0.169163 Jul 01 10:46:50.443488 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2299/4496] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:50 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:50.833885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:50.836857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:50.847090 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:50.854615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:50.861274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:50.869706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:50.870544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:50.962602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:50.976651 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7ef3c80-e930-4076-8791-36b51dd3a03b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1734 microversion: 2.1 time: 0.609652 Jul 01 10:46:50.977606 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2198/4497] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:50 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1734 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:51.327307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:51.336146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:51.338706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:51.340327 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e18bb995-eb6b-4c64-bd46-a36866e7de5b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.515281 Jul 01 10:46:51.351217 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2300/4498] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:50 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:51.464758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:51.466692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:51.492112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:51.492573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:51.493500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:51.493939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:51.689502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:51.707354 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9946d52b-1f70-4d4a-bd70-4cf7b059f91a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1277 microversion: 2.1 time: 0.249314 Jul 01 10:46:51.707976 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2199/4499] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:51 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:51.998302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:51.998924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:52.013404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.013864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.014663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.015145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.363662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:52.371632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:52.378299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.378801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.380943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.380943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.425289 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:52.435932 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6cf7391b-e19e-4c64-aead-4d52748bba53 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1714 microversion: 2.1 time: 0.441770 Jul 01 10:46:52.436522 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2301/4500] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:51 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1714 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:52.606534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:52.607021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:52.615248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.615707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.616485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.616923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.740155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:52.750623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:52.754840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:52.757961 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f387c97d-f3e3-4c2a-9708-299ef89a9b6f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.403351 Jul 01 10:46:52.769679 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2200/4501] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:52 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:52.776006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:52.776638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:52.780354 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Cannot 'detach_volume' instance 97681ece-9530-48a6-bab2-033fabe477f6 while it is in vm_state rescued Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments/a06589af-1c41-4658-9850-aee903f8b499 HTTP/1.1 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: exception: Cannot 'detach_volume' instance 97681ece-9530-48a6-bab2-033fabe477f6 while it is in vm_state rescued Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': '97681ece-9530-48a6-bab2-033fabe477f6', 'id': 'a06589af-1c41-4658-9850-aee903f8b499'} Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97681ece-9530-48a6-bab2-033fabe477f6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 97681ece-9530-48a6-bab2-033fabe477f6 while it is in vm_state rescued Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:52.782104 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:46:52.786455 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:46:52.786455 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:46:52.786455 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:46:52.786455 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:46:52.786455 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 97681ece-9530-48a6-bab2-033fabe477f6 while it is in vm_state rescued Jul 01 10:46:52.786455 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:46:52.789396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 409 to user: Cannot 'detach_volume' instance 97681ece-9530-48a6-bab2-033fabe477f6 while it is in vm_state rescued {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:46:52.790260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.790671 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-22c44461-ec80-43bb-b776-e2087171db07 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments/a06589af-1c41-4658-9850-aee903f8b499" status: 409 len: 152 microversion: 2.1 time: 0.187963 Jul 01 10:46:52.790787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.791754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.792359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.795395 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2302/4502] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:46:52 2022] DELETE /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments/a06589af-1c41-4658-9850-aee903f8b499 => generated 152 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:46:52.806415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60d135cc-a04b-4a54-9cce-41e2caf37627 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:52.806415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60d135cc-a04b-4a54-9cce-41e2caf37627 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:52.813430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d135cc-a04b-4a54-9cce-41e2caf37627 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.814055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d135cc-a04b-4a54-9cce-41e2caf37627 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.815055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d135cc-a04b-4a54-9cce-41e2caf37627 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:52.815868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60d135cc-a04b-4a54-9cce-41e2caf37627 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:52.959750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:52.969292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b0195cc-43f0-4bdd-9db4-47bc141a5bb2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1275 microversion: 2.1 time: 0.197817 Jul 01 10:46:52.970979 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2201/4503] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:52 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:53.506678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60d135cc-a04b-4a54-9cce-41e2caf37627 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/action" status: 202 len: 0 microversion: 2.1 time: 0.709214 Jul 01 10:46:53.523012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:53.524213 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:53.524594 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2303/4504] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:46:52 2022] POST /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:46:53.566093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:53.570013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:53.573511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:53.581465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:53.780505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:53.781327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:53.800692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:53.804748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:53.804748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:53.804748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:54.443579 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:54.464325 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a01d573-bf66-4af0-87c0-f4b151d516f9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1722 microversion: 2.1 time: 0.948354 Jul 01 10:46:54.491305 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2202/4505] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:53 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1722 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:54.497566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:54.498999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:54.528432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:54.533308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:54.533308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:54.533308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:54.753669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:54.760007 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:54.767699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:54.773098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:54.773098 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5461227-0cdd-4f85-85de-77629f1a66ae tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.995849 Jul 01 10:46:54.773098 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2304/4506] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:53 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:46:54.884574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:54.894930 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a554a6f5-6ff0-4d13-ba01-9f6f647a2e31 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.401592 Jul 01 10:46:54.895922 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2203/4507] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:54 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:55.495560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:55.497173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:55.513773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:55.521801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:55.521801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:55.521801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:55.798828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:55.798828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:55.807541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:55.808932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:55.809988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:55.810634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:55.855588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:55.873646 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17400589-c1e5-4326-90b9-6ef2866d8207 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1722 microversion: 2.1 time: 0.381892 Jul 01 10:46:55.875266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2305/4508] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:55 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:55.887172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:55.887172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:55.891992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:55.892926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:55.893996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:55.894857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:56.191387 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lazy-loading 'services' on Instance uuid 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:46:56.320871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:56.334220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:56.338583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:56.344812 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48eb0750-75a3-4401-ab17-21b696d0d4a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.557539 Jul 01 10:46:56.347907 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2204/4509] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:55 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:46:56.353887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:56.354823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:56.392042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:56.396343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:56.400366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:56.401041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:56.601526 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23b51935-f991-4081-9290-82e9b5d0b63c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-volume_attachments/f507285f-c5c8-4a02-8f3f-2abede02c399" status: 202 len: 0 microversion: 2.1 time: 0.724562 Jul 01 10:46:56.604507 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2306/4510] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:46:55 2022] DELETE /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-volume_attachments/f507285f-c5c8-4a02-8f3f-2abede02c399 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:46:56.855959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:56.872890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99683778-7639-440e-b9f3-84dced6a090f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.523439 Jul 01 10:46:56.873912 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2205/4511] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:56 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:56.901431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:56.901972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:56.912998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:56.914039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:56.915495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:56.916635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:57.191868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-62f52e66-ad5e-4cc0-93a4-c4a84438349c req-dc100dd9-09c7-4277-a497-80e7fd64089a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82ba9de-ffae-4d12-a24f-6aa79605b854", "tag": "ffc5bd3e-af16-4120-b873-7bea21b944c2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:46:57.209067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-62f52e66-ad5e-4cc0-93a4-c4a84438349c req-dc100dd9-09c7-4277-a497-80e7fd64089a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:57.209924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-62f52e66-ad5e-4cc0-93a4-c4a84438349c req-dc100dd9-09c7-4277-a497-80e7fd64089a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:57.243438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-62f52e66-ad5e-4cc0-93a4-c4a84438349c req-dc100dd9-09c7-4277-a497-80e7fd64089a service nova] Creating event network-changed:ffc5bd3e-af16-4120-b873-7bea21b944c2 for instance c82ba9de-ffae-4d12-a24f-6aa79605b854 on n-h1-master-1 Jul 01 10:46:57.252218 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-62f52e66-ad5e-4cc0-93a4-c4a84438349c req-dc100dd9-09c7-4277-a497-80e7fd64089a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069537 Jul 01 10:46:57.253571 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2206/4512] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:57.379663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:57.382193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:57.387650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:57.401189 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb3c0172-28e6-45ca-85c5-1c7a56d411d5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1728 microversion: 2.1 time: 0.512529 Jul 01 10:46:57.403299 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2307/4513] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:56 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1728 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:46:57.423887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:57.424963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:57.425997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:57.427003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:57.433385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23d19c66-8996-4319-b583-2dd875beb4ec tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:57.433385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23d19c66-8996-4319-b583-2dd875beb4ec tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:57.466936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23d19c66-8996-4319-b583-2dd875beb4ec tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:57.467406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23d19c66-8996-4319-b583-2dd875beb4ec tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:57.476207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23d19c66-8996-4319-b583-2dd875beb4ec tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:57.476687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23d19c66-8996-4319-b583-2dd875beb4ec tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:57.747819 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23d19c66-8996-4319-b583-2dd875beb4ec tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.325837 Jul 01 10:46:57.747819 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2308/4514] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:46:57 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-interface => generated 285 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:46:57.869619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:57.880157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:57.883123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:57.890755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:57.891635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:57.904185 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1e6f93f-f732-4554-9afa-0b1816aa1957 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.543094 Jul 01 10:46:57.904788 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2207/4515] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:57 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:46:57.910708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:57.912154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:57.916856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:57.916856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:58.445440 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:58.479092 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:58.549237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:46:58.573735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56452bfe-4db1-4833-9d3f-207d3f2fcb7a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.677678 Jul 01 10:46:58.573735 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2309/4516] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:57 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:46:58.925806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:58.925806 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:58.942339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:58.949378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:58.949378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:58.949378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:59.248777 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:46:59.582604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:46:59.583984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:46:59.593557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:59.594290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:46:59.595241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:46:59.596132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:00.537462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:00.549973 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cbbf9390-1d7f-48ae-8b78-86a2b8d522a0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.970365 Jul 01 10:47:00.555495 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2310/4517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:46:59 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:00.645361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:00.659148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:00.667090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:00.668388 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4070e8b-b202-4905-9d0a-8c464d000b9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1746 microversion: 2.20 time: 1.749685 Jul 01 10:47:00.671501 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2208/4518] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:46:58 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1746 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:01.570606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:01.571474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:01.604806 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:01.613193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:01.616729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:01.621295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:01.628802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:01.741721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1560699169", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "f604329e-fe1d-4279-bbf1-3bf8052ea452"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:02.105965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:02.120292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d6ae817-3825-4b78-b931-6bef3f86c69a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.554386 Jul 01 10:47:02.130661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2209/4519] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:01 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:02.169620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:02.176564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:02.190710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:02.193385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:02.198143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:02.198143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:03.000145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:03.027354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:03.029582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:03.031959 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-425c9f19-f972-41a9-bf77-212435b4aa04 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.900180 Jul 01 10:47:03.056783 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2210/4520] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:02 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:03.062345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f54d4a65-ff91-4664-a8ad-0ff78e40a923 req-968194d8-d51f-4761-a944-f610580b388a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97681ece-9530-48a6-bab2-033fabe477f6", "tag": "a954f825-4fb7-4aaf-a651-0ea1f5b580c8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:03.073925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f54d4a65-ff91-4664-a8ad-0ff78e40a923 req-968194d8-d51f-4761-a944-f610580b388a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:03.074727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f54d4a65-ff91-4664-a8ad-0ff78e40a923 req-968194d8-d51f-4761-a944-f610580b388a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:03.090505 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f54d4a65-ff91-4664-a8ad-0ff78e40a923 req-968194d8-d51f-4761-a944-f610580b388a service nova] Creating event network-changed:a954f825-4fb7-4aaf-a651-0ea1f5b580c8 for instance 97681ece-9530-48a6-bab2-033fabe477f6 on n-h2-master-1 Jul 01 10:47:03.099576 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f54d4a65-ff91-4664-a8ad-0ff78e40a923 req-968194d8-d51f-4761-a944-f610580b388a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044443 Jul 01 10:47:03.100704 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2211/4521] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:03.142879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:03.144437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:03.205051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:03.211698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:03.216202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:03.217192 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:03.757965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:03.766888 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bae8a8b0-d0c6-4b9e-ab46-cf5bd25b87e8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.631349 Jul 01 10:47:03.767486 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2212/4522] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:03 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:04.055229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:04.059233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:04.108108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:04.108108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:04.108108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:04.108567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:05.083182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:05.101193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:05.102714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:05.108340 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5707bc03-4ddc-4560-b8ad-3b6a6a2a3acd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 1.052779 Jul 01 10:47:05.116938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2213/4523] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:04 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:05.127784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:05.130308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:05.161155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:05.170006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:05.170006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:05.170006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:06.504667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:06.528321 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-171156b8-900d-43e0-81d4-9138abf70f3b tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 1.403881 Jul 01 10:47:06.539967 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2214/4524] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:05 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:06.564235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c0e8b180-f93a-4d41-a6aa-0ce4af43e557 req-6a0fc192-5d5d-47df-8fd9-372af9d12356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97681ece-9530-48a6-bab2-033fabe477f6", "tag": "a954f825-4fb7-4aaf-a651-0ea1f5b580c8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:06.607978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c0e8b180-f93a-4d41-a6aa-0ce4af43e557 req-6a0fc192-5d5d-47df-8fd9-372af9d12356 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:06.611009 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c0e8b180-f93a-4d41-a6aa-0ce4af43e557 req-6a0fc192-5d5d-47df-8fd9-372af9d12356 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:06.688180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c0e8b180-f93a-4d41-a6aa-0ce4af43e557 req-6a0fc192-5d5d-47df-8fd9-372af9d12356 service nova] Creating event network-changed:a954f825-4fb7-4aaf-a651-0ea1f5b580c8 for instance 97681ece-9530-48a6-bab2-033fabe477f6 on n-h2-master-1 Jul 01 10:47:06.731375 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c0e8b180-f93a-4d41-a6aa-0ce4af43e557 req-6a0fc192-5d5d-47df-8fd9-372af9d12356 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185518 Jul 01 10:47:06.731375 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2215/4525] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:06.801063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:06.805990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:06.828005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:06.828452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:06.837038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:06.837796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:06.914182 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:07.336060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:07.353863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:07.367480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:07.371487 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e52a2480-4fd4-4c64-b210-38244006e6ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.629080 Jul 01 10:47:07.375267 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2216/4526] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:06 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:07.558239 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:07.560015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:07.584223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:07.585217 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:07.586479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:07.589295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:08.150466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:08.159624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd87d83b-0fab-448f-9d20-c8dd341e4510 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.607765 Jul 01 10:47:08.169840 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2217/4527] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:07 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:08.395254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:08.396474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:08.415562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:08.489871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:08.489871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:08.489871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:08.689426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:08.706234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:08.706234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:08.714594 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51d44b86-65ab-49f9-a352-449e3f2a0b1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.325703 Jul 01 10:47:08.718092 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2218/4528] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:08 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:09.183090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:09.183437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:09.192436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:09.193896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:09.194968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:09.196158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:09.450506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] validate_networks() for [('f604329e-fe1d-4279-bbf1-3bf8052ea452', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:47:10.051487 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:10.066602 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61e9e7dd-f312-46ff-9359-72cc3bd5091f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.889452 Jul 01 10:47:10.067961 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2219/4529] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:09 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:10.222646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f93dd189-ef2d-4345-840b-be42caa7a20e req-52f92396-a7e7-4a7f-a479-27319ec97d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "name": "network-vif-plugged", "status": "completed", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:10.240232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f93dd189-ef2d-4345-840b-be42caa7a20e req-52f92396-a7e7-4a7f-a479-27319ec97d54 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:10.240724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f93dd189-ef2d-4345-840b-be42caa7a20e req-52f92396-a7e7-4a7f-a479-27319ec97d54 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:10.258473 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f93dd189-ef2d-4345-840b-be42caa7a20e req-52f92396-a7e7-4a7f-a479-27319ec97d54 service nova] Creating event network-vif-plugged:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h2-master-1 Jul 01 10:47:10.264785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f93dd189-ef2d-4345-840b-be42caa7a20e req-52f92396-a7e7-4a7f-a479-27319ec97d54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194062 Jul 01 10:47:10.265447 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2220/4530] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:10.271655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:10.273919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:10.282179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:10.287445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:10.287445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:10.287445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:10.545701 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:10.786889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:47:10.787706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:47:10.788458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:47:10.789098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:47:10.789866 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:47:10.802743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:10.809871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:10.813932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:10.814690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:10.839955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:10.851630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Getting quotas for project a0657638296549cf896fec185a95fe44. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:47:10.859241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Getting quotas for user 1a4213b79f384be5a14462c2f63e3e68 and project a0657638296549cf896fec185a95fe44. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:47:10.869575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:10.877534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:47:10.881451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:10.886897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:47:10.887033 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a339110c-85c8-4a3c-88da-fd5abdaf925f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.615822 Jul 01 10:47:10.887033 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2221/4531] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:10 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:10.905438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d87eed8-dc75-49e5-9fe3-3fa67185c760 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:10.938732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d87eed8-dc75-49e5-9fe3-3fa67185c760 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:10.942330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d87eed8-dc75-49e5-9fe3-3fa67185c760 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:11.015496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4d87eed8-dc75-49e5-9fe3-3fa67185c760 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Going to try to stop instance {{(pid=119765) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:47:11.106593 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8bc4c664-a466-4c3f-9855-f140d6d66889 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 9.858703 Jul 01 10:47:11.120903 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2311/4532] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:47:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 9874 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:47:11.134351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:11.138633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:11.148242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:11.148759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:11.150889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:11.151484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:11.302053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d87eed8-dc75-49e5-9fe3-3fa67185c760 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action" status: 202 len: 0 microversion: 2.1 time: 0.411173 Jul 01 10:47:11.304809 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2222/4533] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:47:10 2022] POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:47:11.314459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-53d3fa86-178c-400b-84e3-474081e2d04f tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:11.315384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-53d3fa86-178c-400b-84e3-474081e2d04f tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:11.519037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53d3fa86-178c-400b-84e3-474081e2d04f tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:11.555265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53d3fa86-178c-400b-84e3-474081e2d04f tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:11.559150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:11.561955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53d3fa86-178c-400b-84e3-474081e2d04f tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:11.574291 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5ae5abf-26a2-4282-a5cc-d37855975cd3 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.451278 Jul 01 10:47:11.575071 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2312/4534] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:11 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:11.584890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-53d3fa86-178c-400b-84e3-474081e2d04f tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1259 microversion: 2.21 time: 0.275774 Jul 01 10:47:11.584890 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2223/4535] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:11 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1259 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:11.604868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:11.607818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:11.633931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:11.634399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:11.635176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:11.635613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:11.901010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:11.903666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:11.920260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:11.924113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:11.925390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:11.926092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:11.927128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:11.959306 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3207571c-f22a-4d9a-b407-296a3ed58c7c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1677 microversion: 2.1 time: 0.375530 Jul 01 10:47:11.966185 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2224/4536] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:11 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1677 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:12.171140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:12.193305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:12.195241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:12.196754 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb2e0754-11dc-47cb-9b7f-0cbf0630b95a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.300006 Jul 01 10:47:12.198912 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2313/4537] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:11 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:12.374795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-06269146-7364-4da1-88aa-5d9a72b4504f req-058f43f7-c766-412a-a329-a95088d5f507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82ba9de-ffae-4d12-a24f-6aa79605b854", "name": "network-vif-plugged", "status": "completed", "tag": "ffc5bd3e-af16-4120-b873-7bea21b944c2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:12.399459 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-06269146-7364-4da1-88aa-5d9a72b4504f req-058f43f7-c766-412a-a329-a95088d5f507 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:12.400205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-06269146-7364-4da1-88aa-5d9a72b4504f req-058f43f7-c766-412a-a329-a95088d5f507 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:12.422219 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-06269146-7364-4da1-88aa-5d9a72b4504f req-058f43f7-c766-412a-a329-a95088d5f507 service nova] Creating event network-vif-plugged:ffc5bd3e-af16-4120-b873-7bea21b944c2 for instance c82ba9de-ffae-4d12-a24f-6aa79605b854 on n-h1-master-1 Jul 01 10:47:12.456583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-06269146-7364-4da1-88aa-5d9a72b4504f req-058f43f7-c766-412a-a329-a95088d5f507 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086250 Jul 01 10:47:12.459778 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2225/4538] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:12.592917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:12.593651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:12.601258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e5cb26a4-e023-4fae-aa73-ce8f28f4591a tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:12.602504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:12.605494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e5cb26a4-e023-4fae-aa73-ce8f28f4591a tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:12.619601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:12.630674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:12.631134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:12.794610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e5cb26a4-e023-4fae-aa73-ce8f28f4591a tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:12.810276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e5cb26a4-e023-4fae-aa73-ce8f28f4591a tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:12.820891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e5cb26a4-e023-4fae-aa73-ce8f28f4591a tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:12.825238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e5cb26a4-e023-4fae-aa73-ce8f28f4591a tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1259 microversion: 2.21 time: 0.228550 Jul 01 10:47:12.829724 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2226/4539] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:12 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:12.988267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:12.989052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:13.028025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:13.028674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:13.029734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:13.030354 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:13.324629 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:13.340530 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-72b2bbc0-6026-4cef-bc3d-c29bceec807e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.752180 Jul 01 10:47:13.341876 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2314/4540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:12 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:13.351137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:13.352147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:13.382412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:13.388857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:13.389010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:13.392297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:13.400240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:13.400702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb0b2363-8ea0-43e6-a63d-a27aee9c61c1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1677 microversion: 2.1 time: 0.420543 Jul 01 10:47:13.402024 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2227/4541] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:12 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1677 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:13.848071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:13.848929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:13.861483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:13.870171 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:13.875788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:13.875788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:14.269590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:14.279997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:14.287825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:14.292726 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca45c7ec-fc33-46f2-925c-f2a4a16bddd3 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1255 microversion: 2.21 time: 0.449318 Jul 01 10:47:14.301437 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2228/4542] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:13 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1255 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:14.362676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:14.363466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:14.391826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:14.397414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:14.399924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:14.403305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:14.792035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:14.808140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:14.810467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:14.814826 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-46d75993-1515-456c-988f-bc4ff3db2e11 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 1.471393 Jul 01 10:47:14.829709 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2315/4543] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:13 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:14.841931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:14.847013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:14.872859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:14.873255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:14.874133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:14.874570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:14.891893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:14.909063 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-640d0b40-186e-43bf-b594-338a2d0ff17e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1317 microversion: 2.1 time: 0.550015 Jul 01 10:47:14.912355 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2229/4544] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:14 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:15.192013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:15.213851 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1e697489-59be-4025-b6bd-7df005740e45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1677 microversion: 2.1 time: 0.382891 Jul 01 10:47:15.217349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2316/4545] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:14 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1677 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:15.312712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:15.313625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:15.338856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:15.339325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:15.347794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:15.348318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:15.556786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:15.566912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:15.568429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:15.573549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93910d0c-8417-4773-8906-a44c509841b9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1329 microversion: 2.21 time: 0.261698 Jul 01 10:47:15.574840 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2230/4546] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:15 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1329 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:15.842285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:15.843411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:15.852711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:15.857798 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:15.861821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:15.862543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:15.926905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:15.927799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:15.943595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:15.944357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:15.945359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:15.947979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:16.226401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.245467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.250741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.250983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.258265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-73a44779-3db5-418d-a5f1-a4e97224f226 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.421033 Jul 01 10:47:16.258886 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2317/4547] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:15 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:16.269767 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f5d0700-b360-429b-b731-42a19a4e17a5 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1508 microversion: 2.1 time: 0.346614 Jul 01 10:47:16.270594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2231/4548] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:15 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:16.279419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:16.284451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:16.315396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:16.317588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:16.318414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:16.318864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:16.593205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:16.593843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:16.614150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:16.617239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:16.618386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:16.619012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:16.664678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.672836 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a9b90c3c-1bec-4c40-9eea-abbc63580468 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1677 microversion: 2.1 time: 0.406814 Jul 01 10:47:16.674115 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2318/4549] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:16 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1677 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:16.766285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.780774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.785868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:16.787432 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a08fde5e-cc45-4caa-ba84-99e9fe1bb4e5 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1317 microversion: 2.21 time: 0.199508 Jul 01 10:47:16.791892 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2232/4550] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:16 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:17.277515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:17.279367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:17.293608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:17.295176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:17.298457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:17.299042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:17.531671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:17.547518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:17.550143 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:17.551414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-14769a2c-f8cd-414c-9d37-c316f94bb1e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.277759 Jul 01 10:47:17.560331 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2319/4551] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:17 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:17.690914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:17.694512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:17.714977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:17.718166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:17.719131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:17.720381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:17.818776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:17.821069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:17.866653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:17.874867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:17.874867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:17.875697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:18.320319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:18.348279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:18.354609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:18.360857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8df326f7-bcc0-485a-938a-ddf43aa84890 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.550503 Jul 01 10:47:18.361013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:18.366104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2320/4552] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:17 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:18.401965 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d6bd879-5c05-4f8b-9efe-07e2073f25f2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1677 microversion: 2.1 time: 0.715481 Jul 01 10:47:18.402692 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2233/4553] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:17 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1677 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:18.578176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:18.578363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:18.589003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:18.596406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:18.598649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:18.601956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:19.205460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:19.218094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:19.227162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:19.228970 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b721ec5e-136f-4bf2-bf31-9d300089436d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.655876 Jul 01 10:47:19.238664 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2321/4554] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:18 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:19.378383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:19.380277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:19.398710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:19.404568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:19.407098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:19.411423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:19.419742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:19.422666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:19.447825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:19.447825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:19.451678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:19.452395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:20.231848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:20.248062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:20.248062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:20.257377 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-448c026a-13c3-4caa-9b9f-ff6015f45ca0 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.882782 Jul 01 10:47:20.271132 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2234/4555] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:19 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:20.283830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:20.287249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:20.302928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:20.304367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:20.307980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:20.307980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:20.387450 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:20.589771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:20.598964 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-193b006d-0348-44c0-8f83-16a2b1d51b45 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1677 microversion: 2.1 time: 1.183267 Jul 01 10:47:20.600227 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2322/4556] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:19 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1677 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:20.734855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c4d3a1a2-d239-4ea2-b6a8-351d2709b8cb req-d6de5e02-ddf5-42e4-8585-f7d49edcb186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0577de-b845-47e2-b61f-4e593fce25e9", "tag": "be569057-1157-4523-92b2-4c4293166aaa"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:20.745745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c4d3a1a2-d239-4ea2-b6a8-351d2709b8cb req-d6de5e02-ddf5-42e4-8585-f7d49edcb186 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:20.746366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c4d3a1a2-d239-4ea2-b6a8-351d2709b8cb req-d6de5e02-ddf5-42e4-8585-f7d49edcb186 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:20.760804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c4d3a1a2-d239-4ea2-b6a8-351d2709b8cb req-d6de5e02-ddf5-42e4-8585-f7d49edcb186 service nova] Creating event network-changed:be569057-1157-4523-92b2-4c4293166aaa for instance 3d0577de-b845-47e2-b61f-4e593fce25e9 on n-h2-master-1 Jul 01 10:47:20.768544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c4d3a1a2-d239-4ea2-b6a8-351d2709b8cb req-d6de5e02-ddf5-42e4-8585-f7d49edcb186 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166934 Jul 01 10:47:20.769442 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2323/4557] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:20.880258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:20.890073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:20.892027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:20.893395 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8ed8ef9b-4e07-41c1-9c9c-628a72d1da93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.618716 Jul 01 10:47:20.897664 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2235/4558] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:20 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:21.027700 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:21.028551 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:21.033322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "bf0844dd-e485-4053-abad-dd30d19a64aa"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:21.035697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:21.044602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.058259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:21.058259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.058259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:21.127755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] HTTP exception thrown: Volume 34e90330-1153-4679-a067-0caf3f67e944 could not be found. Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Request method failure captured: Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: request: PUT /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854/os-volume_attachments/34e90330-1153-4679-a067-0caf3f67e944 HTTP/1.1 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 74 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtA2KwYcsGBuDZqFjuJZ-_bkz7WmvIr98jT_F7riYKTzEv6knc9mbmXoAYO-HqI0Ft1duIcG4tXhuXYQNDzs3iIR07fukM_wpPFw-x0_hyqT_OPBeHbwhKBtM4AyecyvMRAewG4AbKMW-hzMrEEWE2hOp7ZrEq5bYpoVPtKXsQSLmSU Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 269abfe038eb48dfbcf40fe0681e8bb6 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesAdminNegativeTest-1336757080 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/269abfe038eb48dfbcf40fe0681e8bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/269abfe038eb48dfbcf40fe0681e8bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_269abfe038eb48dfbcf40fe0681e8bb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/269abfe038eb48dfbcf40fe0681e8bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesAdminNegativeTest-1336757080 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 269abfe038eb48dfbcf40fe0681e8bb6 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1336757080 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesAdminNegativeTest-1336757080-project-admin Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 746c3a3331d645db93a97d1569421338 Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesAdminNegativeTest-1336757080-project-admin Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: {"volumeAttachment": {"volumeId": "bf0844dd-e485-4053-abad-dd30d19a64aa"}} Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: exception: Volume 34e90330-1153-4679-a067-0caf3f67e944 could not be found. Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': 'c82ba9de-ffae-4d12-a24f-6aa79605b854', 'id': '34e90330-1153-4679-a067-0caf3f67e944', 'body': {'volumeAttachment': {'volumeId': 'bf0844dd-e485-4053-abad-dd30d19a64aa'}}} Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34e90330-1153-4679-a067-0caf3f67e944 could not be found. (HTTP 404) (Request-ID: req-f1d1828a-44ba-45ba-9b51-7808639702ef) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:47:21.129985 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34e90330-1153-4679-a067-0caf3f67e944 could not be found. Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34e90330-1153-4679-a067-0caf3f67e944 could not be found. Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34e90330-1153-4679-a067-0caf3f67e944 could not be found. Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] Returning 404 to user: Volume 34e90330-1153-4679-a067-0caf3f67e944 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86e5fd61-77aa-4240-8ac3-9770bce3eea4 tempest-VolumesAdminNegativeTest-1336757080 tempest-VolumesAdminNegativeTest-1336757080-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854/os-volume_attachments/34e90330-1153-4679-a067-0caf3f67e944" status: 404 len: 109 microversion: 2.1 time: 0.104613 Jul 01 10:47:21.134887 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2324/4559] 10.222.0.23 () {60 vars in 1432 bytes} [Fri Jul 1 10:47:21 2022] PUT /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854/os-volume_attachments/34e90330-1153-4679-a067-0caf3f67e944 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:47:21.277031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:21.278528 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:21.309743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.310318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:21.311212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.319028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:21.618638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:21.620166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:21.635625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.636623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:21.639861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.641240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:21.721995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:21.749231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:21.758484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:21.760174 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1698cb50-33ed-4835-81bc-dc8569017ada tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.487008 Jul 01 10:47:21.761011 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2236/4560] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:21 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:21.914816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:21.915439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:21.933463 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.935307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:21.942062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:21.944994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:22.028750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:22.047399 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d766b230-546c-4a94-a723-7dfc0b8c8927 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1677 microversion: 2.1 time: 0.433878 Jul 01 10:47:22.052722 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2325/4561] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:21 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1677 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:22.278851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:22.295616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:22.299271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:22.308286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-556ec004-8531-46ca-922b-66a483ffabc6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.397602 Jul 01 10:47:22.313320 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2237/4562] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:21 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:22.781176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:22.782597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:22.793650 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:22.805100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:22.806153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:22.807398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:22.808065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:23.068083 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:23.068689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:23.077813 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:23.079452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:23.079911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:23.084635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:23.085096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:23.153714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:23.170567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:23.183909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:23.187291 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e37c8178-2b39-42b8-b4c0-a68f2b3571eb tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.410722 Jul 01 10:47:23.189236 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2326/4563] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:22 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:23.306610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:23.322245 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-089e588f-dc37-4b37-bb83-cc81576ab7ae tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1654 microversion: 2.1 time: 0.258548 Jul 01 10:47:23.332117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:23.333096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:23.338557 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2238/4564] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:23 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1654 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:23.341167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:23.341888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:23.343607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:23.344355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:23.346561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78b34254-7e1a-43dd-83a9-1488b3eef3a7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:23.379669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78b34254-7e1a-43dd-83a9-1488b3eef3a7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:23.380130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78b34254-7e1a-43dd-83a9-1488b3eef3a7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:23.464938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78b34254-7e1a-43dd-83a9-1488b3eef3a7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Going to try to start instance {{(pid=119765) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 10:47:23.781276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:23.791477 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78b34254-7e1a-43dd-83a9-1488b3eef3a7 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action" status: 202 len: 0 microversion: 2.1 time: 0.451552 Jul 01 10:47:23.797411 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2239/4565] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:47:23 2022] POST /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:47:23.814521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:23.816051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:23.817338 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f172f856-2dc2-4b04-804b-3e5af87d621a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.489647 Jul 01 10:47:23.817697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:23.818707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:23.838174 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2327/4566] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:23 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:23.838268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:23.838268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:23.838268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:23.838268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:24.161015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:24.187140 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71838afe-4908-459c-8505-c956c50c9924 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1663 microversion: 2.1 time: 0.379826 Jul 01 10:47:24.187140 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2240/4567] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:23 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1663 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:24.207950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:24.211321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:24.219228 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:24.220022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:24.223363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:24.224182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:24.635888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:24.659341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:24.663766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:24.665117 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2cadd13f-80df-4e27-9e91-1ab0e0884604 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.461006 Jul 01 10:47:24.676229 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2328/4568] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:24 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:24.855481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:24.857181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:24.869846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:24.875535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:24.885101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:24.885626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:25.202962 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:25.204110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:25.235066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:25.235699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:25.237280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:25.240236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:25.243937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:25.260603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:25.260934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:25.267122 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1a8c3b93-e49f-4956-9551-215fe40c915d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.416311 Jul 01 10:47:25.268354 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2241/4569] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:24 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:25.307314 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:25.652605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:25.669838 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58650a1b-a272-40c3-8b01-17ce7f60f0b5 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1663 microversion: 2.1 time: 0.471430 Jul 01 10:47:25.674259 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2329/4570] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:25 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1663 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:25.684993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:25.692347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:25.698838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:25.699715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:25.701896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:25.702578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:25.964384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:25.977178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:25.979501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:25.980881 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-888c69df-e931-4a11-8ee2-7c10f63f0afd tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.300740 Jul 01 10:47:26.005101 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2242/4571] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:25 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:26.299184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:26.300537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:26.318818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:26.319552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:26.322404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:26.322996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:26.628907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:26.647031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:26.648562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:26.649831 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a2c89e9-0217-447e-950e-ff4b4232786f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.355589 Jul 01 10:47:26.650755 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2330/4572] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:26 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:26.691791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:26.692497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:26.715778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:26.720901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:26.721438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:26.722060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.001946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:27.003822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:27.016409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.020281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.031277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.032080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.117037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:27.129641 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f56dafb-ed93-40b3-a25e-d4d847dcf3c4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1667 microversion: 2.1 time: 0.442639 Jul 01 10:47:27.131837 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2243/4573] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:26 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1667 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:27.136516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:27.166279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:27.184955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.202452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.214328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.215154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.288712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:47:27.485671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:27.497600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:27.501528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:27.503311 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd68c4f5-3265-4ba5-abc4-3ad2e69f177d tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.505892 Jul 01 10:47:27.504384 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2331/4574] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:26 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:27.670455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:27.671461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:27.686544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.691120 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.692271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.692920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.899873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fbca7512-af53-45db-9f32-e7373008c62a tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 204 len: 0 microversion: 2.1 time: 0.766669 Jul 01 10:47:27.900727 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2244/4575] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:47:27 2022] DELETE /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:47:27.916511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:27.917706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:27.965274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.965727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:27.971759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:27.973846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:28.738753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:28.752777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:28.754898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:28.757305 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1f98f5d2-36a8-4ab5-b0bc-5bb0a849d00c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 1.091019 Jul 01 10:47:28.769507 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2332/4576] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:27 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:28.774929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:28.775857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:28.783338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:28.783754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:28.784543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:28.784987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:28.811484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:28.820372 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2088293-e70e-4ad5-aefb-af8a236cc9c0 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1514 microversion: 2.1 time: 0.911900 Jul 01 10:47:28.820972 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2245/4577] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:27 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1514 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:28.937921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:28.964207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:28.965807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:28.974442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dfa51b6b-d052-4bbc-b811-cad99a0c3a33 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.203270 Jul 01 10:47:28.975027 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2333/4578] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:28 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:29.717910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5b644048-03bb-4a91-9029-e0fa321c1999 req-3ba7fbb7-9f73-4e86-9704-21b96cac7681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0577de-b845-47e2-b61f-4e593fce25e9", "name": "network-vif-plugged", "status": "completed", "tag": "be569057-1157-4523-92b2-4c4293166aaa"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:29.740976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5b644048-03bb-4a91-9029-e0fa321c1999 req-3ba7fbb7-9f73-4e86-9704-21b96cac7681 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:29.741525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5b644048-03bb-4a91-9029-e0fa321c1999 req-3ba7fbb7-9f73-4e86-9704-21b96cac7681 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:29.766088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5b644048-03bb-4a91-9029-e0fa321c1999 req-3ba7fbb7-9f73-4e86-9704-21b96cac7681 service nova] Creating event network-vif-plugged:be569057-1157-4523-92b2-4c4293166aaa for instance 3d0577de-b845-47e2-b61f-4e593fce25e9 on n-h2-master-1 Jul 01 10:47:29.771494 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5b644048-03bb-4a91-9029-e0fa321c1999 req-3ba7fbb7-9f73-4e86-9704-21b96cac7681 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060860 Jul 01 10:47:29.772640 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2246/4579] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:29.775640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:29.776245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:29.788145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:29.788886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:29.789884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:29.791250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:29.848376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:29.852097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:29.866566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:29.867031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:29.881397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:29.881397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:30.397438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:30.405297 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-01c04c39-527c-4bd7-862b-9bf5e568dd28 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1514 microversion: 2.1 time: 0.569832 Jul 01 10:47:30.405896 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2247/4580] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:29 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1514 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:30.422193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:30.422818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:30.436930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:30.453931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:30.455051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:30.455666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:30.479076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:30.504707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:30.509833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:30.511961 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b48bbb6-98d0-4595-8073-d99dfd7928fa tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.740136 Jul 01 10:47:30.527264 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2334/4581] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:29 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:30.774718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:30.783816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:30.824795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:30.824795 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dab6a440-d87d-4c20-a966-a03da252bd2c tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1359 microversion: 2.21 time: 0.380646 Jul 01 10:47:30.824795 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2248/4582] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:30 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1359 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:31.119426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-dc1bfa32-0e22-4931-b9ac-781f05c63cca req-9bf8a545-151a-4754-9294-19fa8897d833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82ba9de-ffae-4d12-a24f-6aa79605b854", "name": "network-vif-deleted", "tag": "ffc5bd3e-af16-4120-b873-7bea21b944c2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:31.137787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-dc1bfa32-0e22-4931-b9ac-781f05c63cca req-9bf8a545-151a-4754-9294-19fa8897d833 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.141075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-dc1bfa32-0e22-4931-b9ac-781f05c63cca req-9bf8a545-151a-4754-9294-19fa8897d833 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.163775 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-dc1bfa32-0e22-4931-b9ac-781f05c63cca req-9bf8a545-151a-4754-9294-19fa8897d833 service nova] Creating event network-vif-deleted:ffc5bd3e-af16-4120-b873-7bea21b944c2 for instance c82ba9de-ffae-4d12-a24f-6aa79605b854 on n-h1-master-1 Jul 01 10:47:31.178562 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-dc1bfa32-0e22-4931-b9ac-781f05c63cca req-9bf8a545-151a-4754-9294-19fa8897d833 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064481 Jul 01 10:47:31.182942 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2335/4583] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:31.422234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:31.422843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:31.437054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.437054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.437054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.437054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.509265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.509908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.523655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lazy-loading 'fault' on Instance uuid c82ba9de-ffae-4d12-a24f-6aa79605b854 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:47:31.534910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:31.538335 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:31.548270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.549100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.550728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.551357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.643135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:31.647208 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:31.652763 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4b02715-7c80-4895-8280-f726a414bbe2 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 200 len: 1307 microversion: 2.1 time: 0.234727 Jul 01 10:47:31.657179 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2249/4584] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:31 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 1307 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:31.844864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:31.845741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:31.853668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.854116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.867771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:31.870185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:31.888507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:31.895024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:31.896712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:31.898110 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b592e68-cc6d-4e8f-8678-ae801886eb86 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1741 microversion: 2.20 time: 0.370754 Jul 01 10:47:31.908823 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2336/4585] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:31 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1741 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:32.153418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:32.161662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:32.163607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:32.164794 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e181cda-c0db-4de9-9f67-e8ba1c775a1e tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1552 microversion: 2.21 time: 0.326357 Jul 01 10:47:32.165661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2250/4586] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:31 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1552 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:32.187440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:32.188136 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:32.209677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.227693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:32.227693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.227693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:32.282121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:47:32.677750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:32.678295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: c82ba9de-ffae-4d12-a24f-6aa79605b854] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:32.680219 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:32.691466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.692174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:32.693033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.693503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:32.702745 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1709c72f-3312-42de-b524-ec983d174ac9 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 204 len: 0 microversion: 2.21 time: 0.521569 Jul 01 10:47:32.703336 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2337/4587] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:47:32 2022] DELETE /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:47:32.716445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:32.717935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:32.729541 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] HTTP exception thrown: Instance c82ba9de-ffae-4d12-a24f-6aa79605b854 could not be found. Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Request method failure captured: Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 HTTP/1.1 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtAkWhEaNAYbqPIuvbYz_8Lku8XcxzzbiF3LFN-wwZWgQ-jc8yMFj1Dzu1AUEKHKToF32t-1eyvAio3jlHN5aUYSni3WNoshj1ck2DN1T_cM8c_odhQIvaOPcc0dHEGlqqFp9_x3VMmamIUJ1wQkANrGax0U8bXyExyyxnbsSP0Nvuc Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: cba33310a3044fa888af16a7e4698065 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesAdminNegativeTest-639191089 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cba33310a3044fa888af16a7e4698065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cba33310a3044fa888af16a7e4698065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cba33310a3044fa888af16a7e4698065", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cba33310a3044fa888af16a7e4698065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesAdminNegativeTest-639191089 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: cba33310a3044fa888af16a7e4698065 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-639191089 Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesAdminNegativeTest-639191089-project Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: e18cb45b496d47b5b540365fb183427c Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesAdminNegativeTest-639191089-project Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: exception: Instance c82ba9de-ffae-4d12-a24f-6aa79605b854 could not be found. Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c82ba9de-ffae-4d12-a24f-6aa79605b854'} Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82ba9de-ffae-4d12-a24f-6aa79605b854 could not be found. Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82ba9de-ffae-4d12-a24f-6aa79605b854 could not be found. Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:32.732684 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:32.736752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:32.736752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:32.736752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:32.736752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:32.736752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:32.736752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82ba9de-ffae-4d12-a24f-6aa79605b854 could not be found. Jul 01 10:47:32.736752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:32.738400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.738860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:32.739651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.740267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:32.748829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Returning 404 to user: Instance c82ba9de-ffae-4d12-a24f-6aa79605b854 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:32.758977 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3aecdd2c-de65-4d52-b094-1c5aa1f98fb8 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854" status: 404 len: 111 microversion: 2.1 time: 0.082705 Jul 01 10:47:32.760243 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2251/4588] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:32 2022] GET /compute/v2.1/servers/c82ba9de-ffae-4d12-a24f-6aa79605b854 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:47:32.917625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:32.919031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:32.929950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.930408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:32.931215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:32.931677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:33.097210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:33.109462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:33.110994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:33.112436 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a53222e2-988b-4313-bd2e-64d870c175ac tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1558 microversion: 2.21 time: 0.404717 Jul 01 10:47:33.112752 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2338/4589] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:32 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1558 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:33.192079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:33.208660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:33.210424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:33.218823 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f65a55a3-e061-4da4-bb46-a32bce4c4100 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1723 microversion: 2.20 time: 0.306711 Jul 01 10:47:33.219455 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2252/4590] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:32 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:34.136601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:34.140422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:34.160612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:34.161072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:34.161943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:34.162385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:34.239817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:34.240449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:34.260465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:34.260923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:34.261749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:34.262193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:34.943396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:34.959543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:34.961435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:34.962634 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-12df2ffb-7042-40c2-8c78-0fd342526541 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1558 microversion: 2.21 time: 0.835928 Jul 01 10:47:34.966908 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2339/4591] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:34 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1558 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:34.975252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:34.977992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:34.993474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:34.993941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:34.994754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:34.995198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:35.081417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:35.111733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:35.119303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:35.120685 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf199c3f-52c8-4217-87ce-55e2dccd2076 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1723 microversion: 2.20 time: 0.884855 Jul 01 10:47:35.127998 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2253/4592] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:34 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1723 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:35.201872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lazy-loading 'services' on Instance uuid 97681ece-9530-48a6-bab2-033fabe477f6 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:47:35.574356 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f85cb2de-5de5-4048-b61e-1ab21cccbdc7 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments/a06589af-1c41-4658-9850-aee903f8b499" status: 202 len: 0 microversion: 2.1 time: 0.606037 Jul 01 10:47:35.579491 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2340/4593] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:47:34 2022] DELETE /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments/a06589af-1c41-4658-9850-aee903f8b499 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:47:35.601904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-15a17966-5596-4062-8b61-a03f86057396 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:35.604161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-15a17966-5596-4062-8b61-a03f86057396 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:35.614520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15a17966-5596-4062-8b61-a03f86057396 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:35.615363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15a17966-5596-4062-8b61-a03f86057396 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:35.616797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15a17966-5596-4062-8b61-a03f86057396 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:35.618015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15a17966-5596-4062-8b61-a03f86057396 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:35.688304 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-15a17966-5596-4062-8b61-a03f86057396 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091498 Jul 01 10:47:35.689790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2254/4594] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:35 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:35.842530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9072456c-2752-4efb-8080-c3fc391a8c24 req-5d04495b-8f64-438a-bc4c-36614bf6ecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0577de-b845-47e2-b61f-4e593fce25e9", "name": "network-vif-deleted", "tag": "be569057-1157-4523-92b2-4c4293166aaa"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:35.868688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9072456c-2752-4efb-8080-c3fc391a8c24 req-5d04495b-8f64-438a-bc4c-36614bf6ecc3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:35.869641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9072456c-2752-4efb-8080-c3fc391a8c24 req-5d04495b-8f64-438a-bc4c-36614bf6ecc3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:35.884396 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9072456c-2752-4efb-8080-c3fc391a8c24 req-5d04495b-8f64-438a-bc4c-36614bf6ecc3 service nova] Creating event network-vif-deleted:be569057-1157-4523-92b2-4c4293166aaa for instance 3d0577de-b845-47e2-b61f-4e593fce25e9 on n-h2-master-1 Jul 01 10:47:35.893390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9072456c-2752-4efb-8080-c3fc391a8c24 req-5d04495b-8f64-438a-bc4c-36614bf6ecc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055398 Jul 01 10:47:35.894111 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2341/4595] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:35.980314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:35.981065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:35.988993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:35.991107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:35.992724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:35.993424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:36.128017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:36.158124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:36.159913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:36.171915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:36.172476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:36.174102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:36.175236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:36.175945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:36.187650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:36.189333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de107afb-f073-4f88-82b0-add84eb2db72 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1516 microversion: 2.21 time: 0.212918 Jul 01 10:47:36.209586 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2255/4596] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:35 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:36.508685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:36.522824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:36.525305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:36.526735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b1104ef7-bbe1-4021-90db-d087ee4e516d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1723 microversion: 2.20 time: 0.386132 Jul 01 10:47:36.528165 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2342/4597] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:36 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:36.700138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20289fc2-c8c2-49a3-a46b-b3fb0028319f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:36.701761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-20289fc2-c8c2-49a3-a46b-b3fb0028319f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:36.710030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20289fc2-c8c2-49a3-a46b-b3fb0028319f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:36.710720 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20289fc2-c8c2-49a3-a46b-b3fb0028319f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:36.711717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20289fc2-c8c2-49a3-a46b-b3fb0028319f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:36.712687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20289fc2-c8c2-49a3-a46b-b3fb0028319f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:36.763258 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20289fc2-c8c2-49a3-a46b-b3fb0028319f tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065649 Jul 01 10:47:36.764372 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2256/4598] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:36 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:37.214473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:37.217074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:37.231543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.232939 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.234390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.235198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.279996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.281225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.281880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lazy-loading 'fault' on Instance uuid 3d0577de-b845-47e2-b61f-4e593fce25e9 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:47:37.364140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:37.388338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:37.394472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:37.398906 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c49689bf-9200-43fa-bd2d-1969c7956a84 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1349 microversion: 2.21 time: 0.190367 Jul 01 10:47:37.400204 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2343/4599] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:37 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1349 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:37.546552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:37.546552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:37.556065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.558297 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.563268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.563733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.691413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-83f457d2-363d-4b73-912b-9035405bc940 req-e753b0e7-65b1-4549-b837-8683d9a38eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "name": "network-vif-unplugged", "status": "completed", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:37.721678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83f457d2-363d-4b73-912b-9035405bc940 req-e753b0e7-65b1-4549-b837-8683d9a38eba service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.722494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83f457d2-363d-4b73-912b-9035405bc940 req-e753b0e7-65b1-4549-b837-8683d9a38eba service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.764803 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-83f457d2-363d-4b73-912b-9035405bc940 req-e753b0e7-65b1-4549-b837-8683d9a38eba service nova] Creating event network-vif-unplugged:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h2-master-1 Jul 01 10:47:37.782339 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-83f457d2-363d-4b73-912b-9035405bc940 req-e753b0e7-65b1-4549-b837-8683d9a38eba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103146 Jul 01 10:47:37.784103 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2344/4600] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:37.799295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:37.814042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f28156bb-3d68-4f00-b7cf-88aab1c3fa1b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:37.834723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f28156bb-3d68-4f00-b7cf-88aab1c3fa1b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:37.836104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:37.843520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f28156bb-3d68-4f00-b7cf-88aab1c3fa1b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.849058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f28156bb-3d68-4f00-b7cf-88aab1c3fa1b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.849058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f28156bb-3d68-4f00-b7cf-88aab1c3fa1b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.849058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f28156bb-3d68-4f00-b7cf-88aab1c3fa1b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.849395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:37.849395 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71f5cb65-ae16-47a6-ab7d-d28cc385d08b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1726 microversion: 2.20 time: 0.307723 Jul 01 10:47:37.853488 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2257/4601] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:37 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1726 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:37.910800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ab89cdfd-e951-4aa4-9976-d5738c1090f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efba7ea9-8662-4ec8-b326-45231ff95e76"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:37.911952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ab89cdfd-e951-4aa4-9976-d5738c1090f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:37.913978 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:37.940247 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f28156bb-3d68-4f00-b7cf-88aab1c3fa1b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154656 Jul 01 10:47:37.942261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab89cdfd-e951-4aa4-9976-d5738c1090f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.942717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab89cdfd-e951-4aa4-9976-d5738c1090f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.943505 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab89cdfd-e951-4aa4-9976-d5738c1090f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:37.943935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab89cdfd-e951-4aa4-9976-d5738c1090f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:37.944407 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2345/4602] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:37 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:38.417739 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:38.418360 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:38.431269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:38.432064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:38.433016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:38.436332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:38.521039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:38.521520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:38.522054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lazy-loading 'fault' on Instance uuid 3d0577de-b845-47e2-b61f-4e593fce25e9 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:47:38.601312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:38.617831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:38.624607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a4213b79f384be5a14462c2f63e3e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0657638296549cf896fec185a95fe44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:38.637879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5f7ee98-cebd-4791-971e-3d29d4d1e8d4 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 200 len: 1349 microversion: 2.21 time: 0.217105 Jul 01 10:47:38.639408 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2346/4603] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:38 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 1349 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:38.955792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd236f30-0800-483a-8861-b960843a48fa tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:38.957028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd236f30-0800-483a-8861-b960843a48fa tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:38.971125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd236f30-0800-483a-8861-b960843a48fa tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:38.971587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd236f30-0800-483a-8861-b960843a48fa tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:38.973348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd236f30-0800-483a-8861-b960843a48fa tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:38.976530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd236f30-0800-483a-8861-b960843a48fa tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.075478 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd236f30-0800-483a-8861-b960843a48fa tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124336 Jul 01 10:47:39.077552 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2347/4604] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:38 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:39.089798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:39.090707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:39.100722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.101597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.102661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.103753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.149610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:47:39.586486 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ceb8f418-619c-46a1-a09d-870b3e6fe50d tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 204 len: 0 microversion: 2.1 time: 0.504230 Jul 01 10:47:39.590866 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2348/4605] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:47:39 2022] DELETE /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:47:39.598720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:39.599443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:39.625440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.625897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.626704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.634371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.659916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ab89cdfd-e951-4aa4-9976-d5738c1090f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.787735 Jul 01 10:47:39.661528 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2258/4606] 10.222.0.23 () {62 vars in 1363 bytes} [Fri Jul 1 10:47:37 2022] POST /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 188 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:47:39.667488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:39.668299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:39.724760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.725639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.726616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.727221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.742514 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] HTTP exception thrown: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Request method failure captured: Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 HTTP/1.1 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtCkoE6DNW79bly_PKt_uPrsIKupchnnV2DSExP5POnMciMj6Dn1Dh_v03rw1utL01Ng4PLgzlZF8HSK-Ds-ceIzfDmcwF2swoLxbUF4HODSY-A6SxOCvEA93azsG0sNrI1oKwgD3keNAs-F83wPHV8XMyaZrrfoqiJA2zyAzuu8B0M Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.21 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: a0657638296549cf896fec185a95fe44 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0657638296549cf896fec185a95fe44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0657638296549cf896fec185a95fe44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0657638296549cf896fec185a95fe44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0657638296549cf896fec185a95fe44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: a0657638296549cf896fec185a95fe44 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-InstanceActionsV221TestJSON-1964292866-project Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 1a4213b79f384be5a14462c2f63e3e68 Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-InstanceActionsV221TestJSON-1964292866-project Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3d0577de-b845-47e2-b61f-4e593fce25e9'} Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:39.744535 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:39.750025 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:39.752897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Returning 404 to user: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:39.754140 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e4bf9b6-45ce-4959-b77b-aca2f42f0732 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 404 len: 111 microversion: 2.21 time: 0.091507 Jul 01 10:47:39.754894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2259/4607] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:39 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:47:39.771890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d651d21-2aac-4da7-a508-4252adc47346 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '.version_select at 0x7f6f96f090d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:39.772937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d651d21-2aac-4da7-a508-4252adc47346 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:39.792138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d651d21-2aac-4da7-a508-4252adc47346 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.795252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d651d21-2aac-4da7-a508-4252adc47346 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:39.798116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d651d21-2aac-4da7-a508-4252adc47346 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:39.800013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d651d21-2aac-4da7-a508-4252adc47346 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.011492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d651d21-2aac-4da7-a508-4252adc47346 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.249078 Jul 01 10:47:40.014782 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2260/4608] 10.222.0.23 () {60 vars in 1336 bytes} [Fri Jul 1 10:47:39 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9/os-instance-actions => generated 611 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:47:40.027320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f3d0eeb-5fcc-4e7e-9be5-6f2ae3a3b7f3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:40.027900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f3d0eeb-5fcc-4e7e-9be5-6f2ae3a3b7f3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:40.055747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f3d0eeb-5fcc-4e7e-9be5-6f2ae3a3b7f3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.055747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f3d0eeb-5fcc-4e7e-9be5-6f2ae3a3b7f3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.064109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f3d0eeb-5fcc-4e7e-9be5-6f2ae3a3b7f3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.069029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f3d0eeb-5fcc-4e7e-9be5-6f2ae3a3b7f3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.090898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:40.103767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aee8e0a1-9ca9-46cd-b442-780ae974234e tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1681 microversion: 2.1 time: 0.510184 Jul 01 10:47:40.117485 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2349/4609] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:39 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1681 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:40.127478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:40.127978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:40.150288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.150742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.164263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.164737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.217460 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] HTTP exception thrown: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Request method failure captured: Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 HTTP/1.1 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtCkoE6DNW79bly_PKt_uPrsIKupchnnV2DSExP5POnMciMj6Dn1Dh_v03rw1utL01Ng4PLgzlZF8HSK-Ds-ceIzfDmcwF2swoLxbUF4HODSY-A6SxOCvEA93azsG0sNrI1oKwgD3keNAs-F83wPHV8XMyaZrrfoqiJA2zyAzuu8B0M Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.21 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a0657638296549cf896fec185a95fe44 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0657638296549cf896fec185a95fe44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0657638296549cf896fec185a95fe44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0657638296549cf896fec185a95fe44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0657638296549cf896fec185a95fe44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a0657638296549cf896fec185a95fe44 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-InstanceActionsV221TestJSON-1964292866-project Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1a4213b79f384be5a14462c2f63e3e68 Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-InstanceActionsV221TestJSON-1964292866-project Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3d0577de-b845-47e2-b61f-4e593fce25e9'} Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:47:40.219291 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.223811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Returning 404 to user: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:40.226160 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9659185-7d62-4e10-ad4d-6157d3477999 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 404 len: 111 microversion: 2.21 time: 0.102185 Jul 01 10:47:40.228349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2350/4610] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:47:40 2022] DELETE /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:47:40.246388 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c7e67d48-3904-4c2b-8aaf-dec6f32a3420 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:40.250941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c7e67d48-3904-4c2b-8aaf-dec6f32a3420 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:40.269403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7e67d48-3904-4c2b-8aaf-dec6f32a3420 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.273573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7e67d48-3904-4c2b-8aaf-dec6f32a3420 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.274618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7e67d48-3904-4c2b-8aaf-dec6f32a3420 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.276629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7e67d48-3904-4c2b-8aaf-dec6f32a3420 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.352550 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c7e67d48-3904-4c2b-8aaf-dec6f32a3420 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121452 Jul 01 10:47:40.354438 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2351/4611] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:40 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:40.363647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:40.377403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] [instance: 3d0577de-b845-47e2-b61f-4e593fce25e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:40.390408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.392114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.395349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.396080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.428652 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] HTTP exception thrown: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Request method failure captured: Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 HTTP/1.1 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtCkoE6DNW79bly_PKt_uPrsIKupchnnV2DSExP5POnMciMj6Dn1Dh_v03rw1utL01Ng4PLgzlZF8HSK-Ds-ceIzfDmcwF2swoLxbUF4HODSY-A6SxOCvEA93azsG0sNrI1oKwgD3keNAs-F83wPHV8XMyaZrrfoqiJA2zyAzuu8B0M Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.21 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a0657638296549cf896fec185a95fe44 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0657638296549cf896fec185a95fe44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0657638296549cf896fec185a95fe44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0657638296549cf896fec185a95fe44", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0657638296549cf896fec185a95fe44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a0657638296549cf896fec185a95fe44 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1964292866 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-InstanceActionsV221TestJSON-1964292866-project Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1a4213b79f384be5a14462c2f63e3e68 Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-InstanceActionsV221TestJSON-1964292866-project Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3d0577de-b845-47e2-b61f-4e593fce25e9'} Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.434058 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] Returning 404 to user: Instance 3d0577de-b845-47e2-b61f-4e593fce25e9 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:40.439544 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d92ec1ab-5090-40f1-8853-fdce02dddfe6 tempest-InstanceActionsV221TestJSON-1964292866 tempest-InstanceActionsV221TestJSON-1964292866-project] 10.222.0.23 "GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9" status: 404 len: 111 microversion: 2.21 time: 0.076020 Jul 01 10:47:40.444857 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2352/4612] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:40 2022] GET /compute/v2.1/servers/3d0577de-b845-47e2-b61f-4e593fce25e9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:47:40.470051 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f3d0eeb-5fcc-4e7e-9be5-6f2ae3a3b7f3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/action" status: 202 len: 0 microversion: 2.20 time: 0.447206 Jul 01 10:47:40.470938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2261/4613] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:47:40 2022] POST /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:47:40.479023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:40.480206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:40.492306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.492999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:40.495236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:40.508631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:41.132324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:41.133785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:41.171973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:41.175651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:41.175651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:41.175651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:41.385575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:41.399304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:41.402743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:41.408193 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dfdb52b6-d06e-4cab-aafe-d2e9a5c0b588 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1752 microversion: 2.20 time: 0.932946 Jul 01 10:47:41.424827 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2353/4614] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:40 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1752 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:41.432754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd8eb673-7c58-469a-a977-668403c676b8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:41.434076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd8eb673-7c58-469a-a977-668403c676b8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:41.456769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd8eb673-7c58-469a-a977-668403c676b8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:41.457137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd8eb673-7c58-469a-a977-668403c676b8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:41.458189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd8eb673-7c58-469a-a977-668403c676b8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:41.458794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd8eb673-7c58-469a-a977-668403c676b8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:41.501879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd8eb673-7c58-469a-a977-668403c676b8 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080355 Jul 01 10:47:41.520033 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2354/4615] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:41 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:42.383768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:42.394619 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ea76b23-436c-4524-b37f-005083f11d5f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1681 microversion: 2.1 time: 1.271269 Jul 01 10:47:42.405630 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2262/4616] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:41 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1681 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:47:42.428183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:42.429689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:42.443543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:42.444346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:42.445497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:42.449651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:42.515694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8cfb3595-ad8a-4469-b583-b34c4767dc58 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:42.516741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8cfb3595-ad8a-4469-b583-b34c4767dc58 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:42.543582 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfb3595-ad8a-4469-b583-b34c4767dc58 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:42.551674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfb3595-ad8a-4469-b583-b34c4767dc58 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:42.561609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfb3595-ad8a-4469-b583-b34c4767dc58 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:42.562524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8cfb3595-ad8a-4469-b583-b34c4767dc58 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:42.628935 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8cfb3595-ad8a-4469-b583-b34c4767dc58 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118775 Jul 01 10:47:42.630311 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2263/4617] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:42 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:47:42.967319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:42.991949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:42.993574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:43.000088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0601736c-bbb9-4e88-abcb-28017d969e6b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1752 microversion: 2.20 time: 0.574378 Jul 01 10:47:43.002995 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2355/4618] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:42 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1752 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:43.411873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:43.413476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:43.438295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:43.438870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:43.444579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:43.445404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:43.455627 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:43.665897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ef7a2703-c161-47d7-9858-c453d1fc2168 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:43.666977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ef7a2703-c161-47d7-9858-c453d1fc2168 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:43.694792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef7a2703-c161-47d7-9858-c453d1fc2168 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:43.703674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef7a2703-c161-47d7-9858-c453d1fc2168 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:43.706899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef7a2703-c161-47d7-9858-c453d1fc2168 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:43.708787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ef7a2703-c161-47d7-9858-c453d1fc2168 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:43.817440 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ef7a2703-c161-47d7-9858-c453d1fc2168 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169195 Jul 01 10:47:43.819862 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2356/4619] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:43 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:43.961908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:43.991492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81bca894-7e17-48a2-b909-7e0520e74d58 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1681 microversion: 2.1 time: 0.581409 Jul 01 10:47:43.993408 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2264/4620] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:43 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1681 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:44.019154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:44.029522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:44.050159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:44.051511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:44.071470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:44.072502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:44.832206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1791cf60-1446-42b3-b94f-1bc5f2902735 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:44.833416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1791cf60-1446-42b3-b94f-1bc5f2902735 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:44.843607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:44.872299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:44.873079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1791cf60-1446-42b3-b94f-1bc5f2902735 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:44.875068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:44.876577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-abb02f09-4544-4094-b3fc-101637d470d1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1754 microversion: 2.20 time: 0.863488 Jul 01 10:47:44.878771 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2357/4621] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:44 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1754 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:44.889543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1791cf60-1446-42b3-b94f-1bc5f2902735 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:44.890712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1791cf60-1446-42b3-b94f-1bc5f2902735 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:44.891170 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1791cf60-1446-42b3-b94f-1bc5f2902735 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:44.993903 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1791cf60-1446-42b3-b94f-1bc5f2902735 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157246 Jul 01 10:47:44.999909 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2265/4622] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:44 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:47:45.015367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:45.015984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:45.025885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:45.027865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:45.030051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:45.031993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:45.410041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:45.418577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-18cc7e6d-b3e4-4472-97d1-b60d39440c23 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1613 microversion: 2.1 time: 0.408037 Jul 01 10:47:45.420983 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2358/4623] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:45 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1613 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:45.542002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-19a746bb-4069-4d03-957a-4d88e8c6385b req-d2c9b354-b1a6-4ea8-8446-131187399f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5e5269-0b37-467f-bf0f-7e45f5ff738b", "name": "network-vif-deleted", "tag": "cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:45.563094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-19a746bb-4069-4d03-957a-4d88e8c6385b req-d2c9b354-b1a6-4ea8-8446-131187399f28 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:45.565965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-19a746bb-4069-4d03-957a-4d88e8c6385b req-d2c9b354-b1a6-4ea8-8446-131187399f28 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:45.587905 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-19a746bb-4069-4d03-957a-4d88e8c6385b req-d2c9b354-b1a6-4ea8-8446-131187399f28 service nova] Creating event network-vif-deleted:cca0a67b-3f15-46ee-b6f9-5d3f37bf3c78 for instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b on n-h2-master-1 Jul 01 10:47:45.603838 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-19a746bb-4069-4d03-957a-4d88e8c6385b req-d2c9b354-b1a6-4ea8-8446-131187399f28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066083 Jul 01 10:47:45.605496 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2266/4624] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:47:45.902253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:45.903160 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:45.935178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:45.935789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:45.942166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:45.942756 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:46.009051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8959bd5d-f2e6-4d00-89ff-e66f37eee35b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:46.010110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8959bd5d-f2e6-4d00-89ff-e66f37eee35b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:46.030512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8959bd5d-f2e6-4d00-89ff-e66f37eee35b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:46.031615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8959bd5d-f2e6-4d00-89ff-e66f37eee35b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:46.032554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8959bd5d-f2e6-4d00-89ff-e66f37eee35b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:46.033809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8959bd5d-f2e6-4d00-89ff-e66f37eee35b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:46.209185 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8959bd5d-f2e6-4d00-89ff-e66f37eee35b tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203648 Jul 01 10:47:46.215261 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2267/4625] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:46 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:47:46.455695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:46.457429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:46.475189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:46.475673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:46.488064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:46.488528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:46.687675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:46.690515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:46.691582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lazy-loading 'fault' on Instance uuid 9a5e5269-0b37-467f-bf0f-7e45f5ff738b {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:47:47.068863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18cb45b496d47b5b540365fb183427c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba33310a3044fa888af16a7e4698065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:47.086735 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3fdea664-031e-4e45-b239-8461891333e1 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 200 len: 1330 microversion: 2.1 time: 0.647990 Jul 01 10:47:47.109181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2268/4626] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:46 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 1330 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:47.222189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-994e0d8c-b71e-43bb-89bb-b2b8d2807262 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:47.225571 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-994e0d8c-b71e-43bb-89bb-b2b8d2807262 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:47.245907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-994e0d8c-b71e-43bb-89bb-b2b8d2807262 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.248600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-994e0d8c-b71e-43bb-89bb-b2b8d2807262 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.250040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-994e0d8c-b71e-43bb-89bb-b2b8d2807262 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.261464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-994e0d8c-b71e-43bb-89bb-b2b8d2807262 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.365201 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-994e0d8c-b71e-43bb-89bb-b2b8d2807262 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148967 Jul 01 10:47:47.379276 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2269/4627] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:47 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6/os-volume_attachments => generated 25 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:47:47.489983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:47.491682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:47.501718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.501718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.502267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.502951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.560497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:47.564132 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Cannot 'reboot' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action HTTP/1.1 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 28 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: {"reboot": {"type": "HARD"}} Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'reboot' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '904d49ed-eae4-4e0e-b31b-1172222ced70', 'body': {'reboot': {'type': 'HARD'}}} Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:47:47.571676 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 409 to user: Cannot 'reboot' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd08f9b1-7073-4951-93b2-1068caf8db05 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action" status: 409 len: 145 microversion: 2.1 time: 0.088956 Jul 01 10:47:47.576081 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2270/4628] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:47:47 2022] POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action => generated 145 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:47:47.583660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:47.585129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:47.588585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:47.600419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:47.604777 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00ae3480-e17f-4963-8dca-67265a446531 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1754 microversion: 2.20 time: 1.709321 Jul 01 10:47:47.615635 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2359/4629] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:45 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1754 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:47.615916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.615916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.615916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.615916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.681286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Cannot 'rebuild' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action HTTP/1.1 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 65 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: exception: Cannot 'rebuild' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '904d49ed-eae4-4e0e-b31b-1172222ced70', 'body': {'rebuild': {'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e'}}} Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:47:47.682988 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 409 to user: Cannot 'rebuild' instance 904d49ed-eae4-4e0e-b31b-1172222ced70 while it is in vm_state rescued {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3adc6d1-53a1-4477-bcb2-75834832c9b6 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action" status: 409 len: 146 microversion: 2.1 time: 0.105074 Jul 01 10:47:47.687129 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2271/4630] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:47:47 2022] POST /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70/action => generated 146 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:47:47.706485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:47.707023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:47.745407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.745407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.745407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:47.745407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:47.870021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:47:47.923668 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:48.109316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:48.110938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] [instance: 9a5e5269-0b37-467f-bf0f-7e45f5ff738b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:48.150974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:48.151916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:48.157059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:48.158122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:48.193446 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] HTTP exception thrown: Instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b could not be found. Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Request method failure captured: Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b HTTP/1.1 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtAkWhEaNAYbqPIuvbYz_8Lku8XcxzzbiF3LFN-wwZWgQ-jc8yMFj1Dzu1AUEKHKToF32t-1eyvAio3jlHN5aUYSni3WNoshj1ck2DN1T_cM8c_odhQIvaOPcc0dHEGlqqFp9_x3VMmamIUJ1wQkANrGax0U8bXyExyyxnbsSP0Nvuc Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: cba33310a3044fa888af16a7e4698065 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesAdminNegativeTest-639191089 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cba33310a3044fa888af16a7e4698065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cba33310a3044fa888af16a7e4698065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cba33310a3044fa888af16a7e4698065", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cba33310a3044fa888af16a7e4698065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesAdminNegativeTest-639191089 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: cba33310a3044fa888af16a7e4698065 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-639191089 Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesAdminNegativeTest-639191089-project Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: e18cb45b496d47b5b540365fb183427c Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesAdminNegativeTest-639191089-project Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b could not be found. Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '9a5e5269-0b37-467f-bf0f-7e45f5ff738b'} Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b could not be found. Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b could not be found. Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:48.195416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:48.199405 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:48.199405 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:48.199405 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:48.199405 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:48.199405 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:48.199405 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b could not be found. Jul 01 10:47:48.199405 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:47:48.203042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Returning 404 to user: Instance 9a5e5269-0b37-467f-bf0f-7e45f5ff738b could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:48.204332 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8f366bf-1652-451b-9a8a-9c28e07db48f tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b" status: 404 len: 111 microversion: 2.1 time: 0.100442 Jul 01 10:47:48.205425 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2272/4631] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:48 2022] GET /compute/v2.1/servers/9a5e5269-0b37-467f-bf0f-7e45f5ff738b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:47:48.229691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-949e95d9-8ef6-41d0-aba4-c5f61abf6478 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] Calling method '.version_select at 0x7f6f907eb550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:48.364453 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-949e95d9-8ef6-41d0-aba4-c5f61abf6478 tempest-VolumesAdminNegativeTest-639191089 tempest-VolumesAdminNegativeTest-639191089-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-600372521" status: 202 len: 0 microversion: 2.1 time: 0.142657 Jul 01 10:47:48.371470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2273/4632] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:47:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-600372521 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:47:48.401015 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-312a430c-3cef-4df5-af2c-16c9d36b2914 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 204 len: 0 microversion: 2.1 time: 0.709205 Jul 01 10:47:48.403897 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2360/4633] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:47:47 2022] DELETE /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:47:48.439090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:48.442156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:48.503199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:48.505202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:48.511086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:48.514228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:48.624332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:48.625720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:48.644119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:48.644794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:48.645817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:48.650880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:49.356472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:49.364720 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef0ea441-f3ab-49a0-a6a2-7cbed7e454b5 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1688 microversion: 2.1 time: 0.942425 Jul 01 10:47:49.365341 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2274/4634] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:48 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1688 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:49.373210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:49.383518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:49.389316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:49.390427 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3621f3d5-e841-4b7a-9265-d61ecd1847b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1754 microversion: 2.20 time: 0.770881 Jul 01 10:47:49.391007 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2361/4635] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:48 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1754 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:47:50.391582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:50.392924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:50.418425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:50.420455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:50.428578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:50.429262 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:50.430214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:50.435430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:50.447515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:50.447959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:50.448750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:50.464173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:51.006723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:51.017843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:51.019553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:51.034221 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-69987c62-4346-4954-bd54-f6e913f893e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1754 microversion: 2.20 time: 0.628627 Jul 01 10:47:51.046126 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2362/4636] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:50 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1754 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:51.151957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:51.158443 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d3e8685d-665b-4f54-b1c8-b5aa88ef5784 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1688 microversion: 2.1 time: 0.772944 Jul 01 10:47:51.160088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2275/4637] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:50 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1688 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:52.053824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:52.055603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:52.076771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:52.077806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:52.081524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:52.087011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:52.192978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:52.194750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:52.212906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:52.219919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:52.221219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:52.224741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:52.776896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:52.789845 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1009207-3368-4451-97b1-01487f4d5670 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1688 microversion: 2.1 time: 0.600536 Jul 01 10:47:52.790568 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2276/4638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:52 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1688 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:53.007615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:53.031169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:53.033741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:53.035216 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7d78d31a-b127-42ec-8e0e-c1e015e7ce1a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1754 microversion: 2.20 time: 0.985896 Jul 01 10:47:53.036034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2363/4639] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:52 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1754 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:53.814423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:53.823671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:53.833870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:53.837900 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:53.845747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:53.847680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:53.998412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:54.020236 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9598c77c-ad01-47a3-8067-c561c27370c9 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1620 microversion: 2.1 time: 0.202482 Jul 01 10:47:54.021481 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2277/4640] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:53 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1620 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:54.058220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:54.062957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:54.081654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:54.084693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:54.086085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:54.087543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:54.636408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:54.658162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:54.663984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:54.663984 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-810d9780-f002-4ded-9edd-c4c2f124c6c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1754 microversion: 2.20 time: 0.609511 Jul 01 10:47:54.663984 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2364/4641] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:54 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1754 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:54.897538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-59dcbd2c-7bcb-4e86-9179-e6b483cd29e5 req-1587271c-a7db-4918-bdb4-4d127c7a0fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97681ece-9530-48a6-bab2-033fabe477f6", "name": "network-vif-deleted", "tag": "a954f825-4fb7-4aaf-a651-0ea1f5b580c8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:54.912073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-59dcbd2c-7bcb-4e86-9179-e6b483cd29e5 req-1587271c-a7db-4918-bdb4-4d127c7a0fe3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:54.912756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-59dcbd2c-7bcb-4e86-9179-e6b483cd29e5 req-1587271c-a7db-4918-bdb4-4d127c7a0fe3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:54.942974 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-59dcbd2c-7bcb-4e86-9179-e6b483cd29e5 req-1587271c-a7db-4918-bdb4-4d127c7a0fe3 service nova] Creating event network-vif-deleted:a954f825-4fb7-4aaf-a651-0ea1f5b580c8 for instance 97681ece-9530-48a6-bab2-033fabe477f6 on n-h2-master-1 Jul 01 10:47:54.956706 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-59dcbd2c-7bcb-4e86-9179-e6b483cd29e5 req-1587271c-a7db-4918-bdb4-4d127c7a0fe3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063874 Jul 01 10:47:54.959300 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2278/4642] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:47:55.031753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:55.032852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:55.038566 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:55.050502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:55.053434 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:55.062222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:55.063578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:55.218216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:55.227412 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f2f822c-3613-43c1-b95c-20a7143a3079 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1620 microversion: 2.1 time: 0.203483 Jul 01 10:47:55.252139 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2365/4643] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:55 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1620 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:55.688111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:55.688827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:55.712812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:55.713370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:55.714265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:55.716351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:56.002462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:56.017992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:56.021448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:56.023053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-34ff32d9-47b3-4990-8696-00c4cb068cb4 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1754 microversion: 2.20 time: 0.341339 Jul 01 10:47:56.024153 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2279/4644] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:55 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1754 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:56.256807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:56.257984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:56.274320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:56.274957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:56.279469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:56.281540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:56.400487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:56.400487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:56.400846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lazy-loading 'fault' on Instance uuid 97681ece-9530-48a6-bab2-033fabe477f6 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:47:56.511093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:56.527705 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ddb11d3-9b99-4e61-9728-8191e7c01fdd tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 200 len: 1334 microversion: 2.1 time: 0.275205 Jul 01 10:47:56.545614 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2366/4645] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:56 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 1334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:47:57.042764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:57.043324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:57.058189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:57.059221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:57.060681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:57.062722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:57.548603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:57.549260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 97681ece-9530-48a6-bab2-033fabe477f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:57.569741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:57.571778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:57.581006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:57.581006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:57.626125 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Instance 97681ece-9530-48a6-bab2-033fabe477f6 could not be found. Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 HTTP/1.1 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 97681ece-9530-48a6-bab2-033fabe477f6 could not be found. Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '97681ece-9530-48a6-bab2-033fabe477f6'} Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97681ece-9530-48a6-bab2-033fabe477f6 could not be found. Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97681ece-9530-48a6-bab2-033fabe477f6 could not be found. Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:47:57.636165 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:57.640583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:47:57.640583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:47:57.640583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:47:57.640583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:47:57.640583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:47:57.640583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97681ece-9530-48a6-bab2-033fabe477f6 could not be found. Jul 01 10:47:57.640583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:47:57.650735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 404 to user: Instance 97681ece-9530-48a6-bab2-033fabe477f6 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:47:57.650735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-137044f4-d29e-4b32-9222-d082dbe75c12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6" status: 404 len: 111 microversion: 2.1 time: 0.101841 Jul 01 10:47:57.651349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2367/4646] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:57 2022] GET /compute/v2.1/servers/97681ece-9530-48a6-bab2-033fabe477f6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:47:57.663376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f57dcc8-689d-40aa-8645-0b41a02195f2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '.version_select at 0x7f6f90bf0820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:57.828939 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f57dcc8-689d-40aa-8645-0b41a02195f2 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96387054" status: 202 len: 0 microversion: 2.1 time: 0.172217 Jul 01 10:47:57.828939 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2368/4647] 10.222.0.23 () {58 vars in 1214 bytes} [Fri Jul 1 10:47:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96387054 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:47:58.362371 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:58.381460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:58.383003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:58.384223 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-29c3171f-c9ab-4290-aa54-18e4ef60ef48 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 1.346135 Jul 01 10:47:58.401260 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2280/4648] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:57 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:58.458910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-915643614", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": "none"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:47:58.574134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:47:58.574134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:47:58.574134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:47:58.574134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:47:58.574134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:47:58.596033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:58.596957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:58.609132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:58.621359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:58.664464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-be289b73-f40f-4ff1-935f-a199dc4eef65 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:58.667473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-be289b73-f40f-4ff1-935f-a199dc4eef65 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:58.667614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Getting quotas for project c532bd14d63c4f369610180cd9d945d5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:47:58.674704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be289b73-f40f-4ff1-935f-a199dc4eef65 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:58.678444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be289b73-f40f-4ff1-935f-a199dc4eef65 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:58.678444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be289b73-f40f-4ff1-935f-a199dc4eef65 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:58.678444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-be289b73-f40f-4ff1-935f-a199dc4eef65 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:58.685197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Getting quotas for user b0eae5a4667540d0a11c51e567898c05 and project c532bd14d63c4f369610180cd9d945d5. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:47:58.730775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:47:58.733620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:47:58.751287 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-be289b73-f40f-4ff1-935f-a199dc4eef65 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102027 Jul 01 10:47:58.753674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2281/4649] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:47:58 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:47:58.885642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:58.888950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:58.898654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:58.899102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:58.900024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:58.901248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:58.985730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:47:59.088547 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-305fd919-a86b-47c2-aa62-ce5be2d044cc tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.891764 Jul 01 10:47:59.101316 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2369/4650] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:47:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:47:59.128196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a578ca26-a33e-4600-8f7f-af4f4776b747 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:59.134065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a578ca26-a33e-4600-8f7f-af4f4776b747 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:59.250816 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:47:59.534831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d20d727a-6ccc-4484-8b01-eb056fe0461c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 204 len: 0 microversion: 2.1 time: 0.659634 Jul 01 10:47:59.535670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2282/4651] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:47:58 2022] DELETE /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:47:59.551573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:59.560871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:59.580729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:59.581376 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:59.582310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:59.582863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:59.679932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a578ca26-a33e-4600-8f7f-af4f4776b747 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:59.693509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a578ca26-a33e-4600-8f7f-af4f4776b747 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:59.695408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a578ca26-a33e-4600-8f7f-af4f4776b747 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:59.697562 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a578ca26-a33e-4600-8f7f-af4f4776b747 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1280 microversion: 2.47 time: 0.595115 Jul 01 10:47:59.710045 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2370/4652] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:59 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1280 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:47:59.720986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:47:59.721861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:47:59.738128 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:59.739455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:59.741138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:47:59.741813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:47:59.935439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:59.951966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:59.954131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:47:59.957704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d21509e-2c1e-4f0e-af20-9809552791de tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.416883 Jul 01 10:47:59.975679 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2283/4653] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:47:59 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:00.056290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:00.067767 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ee58d448-6b4c-4481-bf43-a27a2a37bd44 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1673 microversion: 2.1 time: 0.354281 Jul 01 10:48:00.071784 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2371/4654] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:47:59 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1673 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:00.453183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-de76a969-f7a0-4c16-aa8a-2422253a2d68 req-c1ff12a8-2b47-44b4-82e7-2947689b0dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:00.465623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-de76a969-f7a0-4c16-aa8a-2422253a2d68 req-c1ff12a8-2b47-44b4-82e7-2947689b0dc1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:00.467991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-de76a969-f7a0-4c16-aa8a-2422253a2d68 req-c1ff12a8-2b47-44b4-82e7-2947689b0dc1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:00.489420 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-de76a969-f7a0-4c16-aa8a-2422253a2d68 req-c1ff12a8-2b47-44b4-82e7-2947689b0dc1 service nova] Creating event network-changed:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h1-master-1 Jul 01 10:48:00.496010 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-de76a969-f7a0-4c16-aa8a-2422253a2d68 req-c1ff12a8-2b47-44b4-82e7-2947689b0dc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053412 Jul 01 10:48:00.503549 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2284/4655] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:00.719188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-82a55061-3881-4230-bd32-b131b9f5c2e7 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:00.720288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-82a55061-3881-4230-bd32-b131b9f5c2e7 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:00.824244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-82a55061-3881-4230-bd32-b131b9f5c2e7 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:00.833580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-82a55061-3881-4230-bd32-b131b9f5c2e7 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:00.835402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-82a55061-3881-4230-bd32-b131b9f5c2e7 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:00.836832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-82a55061-3881-4230-bd32-b131b9f5c2e7 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1280 microversion: 2.47 time: 0.121838 Jul 01 10:48:00.837991 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2372/4656] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:00 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:00.984489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:00.987110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:00.993964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:00.994401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:00.995525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:00.996150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:01.090194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:01.091412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:01.113445 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:01.114874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:01.117107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:01.119441 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:01.445592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:01.464260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:01.466252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:01.467467 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ef73183-5bb5-4611-8697-e9950bbca28e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.487482 Jul 01 10:48:01.468590 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2285/4657] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:00 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:01.527021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:01.541780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6aea5ef3-968a-4c94-997e-11494c1a7a7e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1673 microversion: 2.1 time: 0.457742 Jul 01 10:48:01.543395 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2373/4658] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:01 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1673 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:01.861110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:01.862046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:01.869575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:01.870026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:01.870803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:01.871238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:01.959605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:01.969406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:01.977933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:01.979633 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0bc2945f-58a5-43a0-b719-a5966ec08cd6 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1276 microversion: 2.47 time: 0.126935 Jul 01 10:48:01.980930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2286/4659] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:01 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:02.498809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:02.500379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:02.527617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:02.528323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:02.531128 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:02.532156 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:02.562831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:02.563811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:02.577062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:02.581767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:02.585235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:02.586172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:03.272991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:03.283401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:03.285517 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:03.287039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:03.291889 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-006187f8-c64c-4215-912a-aaba7c8786f8 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1673 microversion: 2.1 time: 0.734481 Jul 01 10:48:03.296967 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2287/4660] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:02 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1673 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:03.302169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:03.309043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:03.312386 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa271381-cc9c-4c12-8fd2-71fa3242c667 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.826609 Jul 01 10:48:03.312982 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2374/4661] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:02 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:03.333110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:03.334076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:03.335016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:03.335611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:03.740379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:03.757039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:03.764975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:03.770356 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fb70c0d7-57a0-4861-aafd-09d58473b80e tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1340 microversion: 2.47 time: 0.471916 Jul 01 10:48:03.776424 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2288/4662] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:03 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1340 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:04.324704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:04.332174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:04.332336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:04.332447 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:04.345714 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:04.346176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:04.349670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:04.350407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:04.354159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:04.355024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:04.361204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:04.366728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:05.111302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:05.131346 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3bf667d5-ea3e-46f1-a489-f90e7f774e61 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 200 len: 1605 microversion: 2.1 time: 0.816813 Jul 01 10:48:05.139002 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2375/4663] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:04 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 1605 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:05.170684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5be98741-71ee-4db7-928e-bf310cc99e96 req-4114f5cf-a0ed-483a-a4c2-9350a19cc9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11758f07-3b9c-487c-8d96-ac3a93fbfbf8", "name": "network-vif-deleted", "tag": "a2330e85-0b72-4a71-8134-6331bba15ab2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:05.234560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5be98741-71ee-4db7-928e-bf310cc99e96 req-4114f5cf-a0ed-483a-a4c2-9350a19cc9fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:05.235188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5be98741-71ee-4db7-928e-bf310cc99e96 req-4114f5cf-a0ed-483a-a4c2-9350a19cc9fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:05.322425 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5be98741-71ee-4db7-928e-bf310cc99e96 req-4114f5cf-a0ed-483a-a4c2-9350a19cc9fb service nova] Creating event network-vif-deleted:a2330e85-0b72-4a71-8134-6331bba15ab2 for instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 on n-h1-master-1 Jul 01 10:48:05.361661 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5be98741-71ee-4db7-928e-bf310cc99e96 req-4114f5cf-a0ed-483a-a4c2-9350a19cc9fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220803 Jul 01 10:48:05.362919 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2376/4664] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:05.378294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:05.380925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:05.422846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:05.425669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:05.443447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:05.443980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:05.961862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:05.978978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:05.984099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:06.000348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:06.003710 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1217834b-83e4-4b75-864d-e6d2b2c33c27 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 1.676100 Jul 01 10:48:06.022707 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2289/4665] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:04 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:06.025426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:06.027608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:06.028886 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c310eae-dd24-45ad-abf9-a42eac724240 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1338 microversion: 2.47 time: 0.664684 Jul 01 10:48:06.040227 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2377/4666] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:05 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1338 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:06.148328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:06.150695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:06.153580 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:06.174704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:06.181329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:06.181984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:06.186274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:06.251182 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] HTTP exception thrown: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Request method failure captured: Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 HTTP/1.1 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtAKzUu3P4sOV3EuKmbG4sl0KNnlOND9QVMWqOY9-NSUh2orEX-e9xRZTXh4GQ5qPhRnnRSPC2upKT_wpr7LbI8kcGv8WJzBZTMo7uhS5iJl4aoXZ4MC2gKAgPg-XuJxQGaCxUH10q6rdBtA3rMlm6UFlOsTyYtw7avTVpRGK5rhcsc Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: dba2af3867524497b17de32361dec716 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dba2af3867524497b17de32361dec716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dba2af3867524497b17de32361dec716", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: dba2af3867524497b17de32361dec716 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 83a534c1028048b3af84ce213aad7f15 Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '11758f07-3b9c-487c-8d96-ac3a93fbfbf8'} Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:06.255212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:06.259429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:06.259429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:06.259429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:06.259429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:48:06.259429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:48:06.259429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:48:06.259429 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:06.264602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Returning 404 to user: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:48:06.266984 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4b8e1201-5077-4fd9-beb4-99bd985600ee tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 404 len: 111 microversion: 2.1 time: 0.122741 Jul 01 10:48:06.277325 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2290/4667] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:06 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:48:06.278911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2dea9605-3faf-4080-a771-f816fca40768 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '.version_select at 0x7f6f90ba3d30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:06.444437 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2dea9605-3faf-4080-a771-f816fca40768 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836801865" status: 202 len: 0 microversion: 2.1 time: 0.170708 Jul 01 10:48:06.445915 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2378/4668] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836801865 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:48:07.025526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:07.027292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:07.058898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:07.059579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:07.086165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:07.087033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:07.087966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:07.092239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:07.092372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:07.092482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:07.092585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:07.100951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:07.609358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:07.624966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:07.630104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:07.631629 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1d22a39-7d02-41db-a3a5-b8c2f93cfba4 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1359 microversion: 2.47 time: 0.577250 Jul 01 10:48:07.635434 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2379/4669] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:07 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1359 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:07.658925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-84b9078d-0ba5-41aa-ab5a-e03039fa20bf tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1089605268"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:07.662166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-84b9078d-0ba5-41aa-ab5a-e03039fa20bf tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:07.672325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84b9078d-0ba5-41aa-ab5a-e03039fa20bf tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:07.674768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84b9078d-0ba5-41aa-ab5a-e03039fa20bf tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:07.680296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84b9078d-0ba5-41aa-ab5a-e03039fa20bf tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:07.686245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84b9078d-0ba5-41aa-ab5a-e03039fa20bf tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:08.485023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:08.527620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:08.545792 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:08.554755 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:08.556073 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-790c71e0-81e4-4654-a1bd-163c8d1d50bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 1.537479 Jul 01 10:48:08.578010 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2291/4670] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:07 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:08.654170 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:08.809200 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-84b9078d-0ba5-41aa-ab5a-e03039fa20bf tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "POST /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae/action" status: 202 len: 52 microversion: 2.47 time: 1.153658 Jul 01 10:48:08.810869 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2380/4671] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:48:07 2022] POST /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae/action => generated 52 bytes in 1157 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:48:08.835577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:08.839406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:08.906578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:08.908190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:08.915874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:08.920897 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:09.013671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:48:09.596134 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d2a7874-bfee-4116-9cbd-866c082e3819 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 204 len: 0 microversion: 2.47 time: 0.770359 Jul 01 10:48:09.596134 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2292/4672] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:48:08 2022] DELETE /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:48:09.598906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:09.600010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:09.602526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:09.603286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:09.628908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:09.629429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:09.634175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:09.635343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:09.635597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:09.643466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:09.651671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:09.652106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:10.044506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:10.062135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:10.063896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:10.065139 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-15713108-9a1a-4d15-8d00-8bb49acc93c5 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1365 microversion: 2.47 time: 0.467175 Jul 01 10:48:10.094736 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2293/4673] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:09 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:10.235905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:10.250999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:10.273957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:10.273957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00626548-f045-4d90-ab16-09ae2f746455 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.671868 Jul 01 10:48:10.273957 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2381/4674] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:09 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:10.911271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-675e6117-7c15-4655-926e-67bf0c7be91d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'create', calling method: .version_select at 0x7f6f9078d9d0>, body: {"keypair": {"name": "tempest-keypair-2000098376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHiyt63UYZM+qKUqWkiNAh5O180xfMTVpNuG7HvxCnY3Y87koaenqi7N7vKJ+5OyW1rA57YTpBA1KpJlu/5YTKEvaiWUlgrQ53IQoAqYIwOZEkmRjd5D0EHfzufkmeCZg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:10.958795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-675e6117-7c15-4655-926e-67bf0c7be91d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for project dba2af3867524497b17de32361dec716. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:48:10.975649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-675e6117-7c15-4655-926e-67bf0c7be91d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for user 83a534c1028048b3af84ce213aad7f15 and project dba2af3867524497b17de32361dec716. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:48:11.101602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:11.105326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:11.107460 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-675e6117-7c15-4655-926e-67bf0c7be91d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200967 Jul 01 10:48:11.108301 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2294/4675] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:48:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:11.127639 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:11.142942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:11.167901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:11.178180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:11.182280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:11.284304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:11.285085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:11.293212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:11.305015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:11.316694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:11.318392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:11.399252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:11.410927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:11.412926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:11.418048 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a33d9bd-6281-40c6-8c25-e1afad91faad tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1365 microversion: 2.47 time: 0.320585 Jul 01 10:48:11.432951 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2382/4676] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:11 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:12.032317 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:12.047096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:12.054458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:12.061545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a665a334-f077-48a5-96fe-d774d991f024 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.777765 Jul 01 10:48:12.062951 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2295/4677] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:11 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:12.438575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:12.439442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:12.462070 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:12.462734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:12.463962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:12.469903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:12.732708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:12.754469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:12.767710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:12.782527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c211f09-e0e0-4b24-9381-913443f751eb tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1365 microversion: 2.47 time: 0.346467 Jul 01 10:48:12.801882 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2383/4678] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:12 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:13.088755 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:13.097703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:13.129821 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:13.133306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:13.135243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:13.138048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:13.774161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:13.797599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:13.797599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:13.797599 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73076aae-50ee-42a0-9764-65a00b830221 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.717560 Jul 01 10:48:13.797599 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2296/4679] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:13 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:13.813811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:13.815349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:13.849754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:13.851766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:13.855017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:13.859395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:13.931921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:13.935797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:13.936846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lazy-loading 'fault' on Instance uuid 46349efc-5cca-4f08-b5c0-0dad99a6baae {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:48:14.201101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:14.212656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:14.216810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0eae5a4667540d0a11c51e567898c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c532bd14d63c4f369610180cd9d945d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:14.220430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77bfbc21-cc37-457d-9efe-04cff52634f3 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 200 len: 1370 microversion: 2.47 time: 0.413338 Jul 01 10:48:14.221815 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2384/4680] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:13 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 1370 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:14.816989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:14.818235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:14.828263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:14.837976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:14.839108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:14.848053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:15.240463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:15.241345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] [instance: 46349efc-5cca-4f08-b5c0-0dad99a6baae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:15.261259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:15.264044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:15.272873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:15.273578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:15.346618 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] HTTP exception thrown: Instance 46349efc-5cca-4f08-b5c0-0dad99a6baae could not be found. Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Request method failure captured: Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae HTTP/1.1 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtDdd5SLHB84r9_HrPLqaxUtMSN6CNkeGveKnKGu7UeKg8ZePfwCsD2atodjvMVJI7IIfVHcJS9aG6nBkl3qNIi_Fs5_b0ok0vxlFu5gkvbDZ1pynPrCduMdzEh9GwBoAas9149sMzjF7dvXYzDu4Hf_-PNOUitFMbz46god-JorUw8 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.47 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c532bd14d63c4f369610180cd9d945d5 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersAaction247Test-1588847333 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c532bd14d63c4f369610180cd9d945d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c532bd14d63c4f369610180cd9d945d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c532bd14d63c4f369610180cd9d945d5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c532bd14d63c4f369610180cd9d945d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersAaction247Test-1588847333 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c532bd14d63c4f369610180cd9d945d5 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersAaction247Test-1588847333 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersAaction247Test-1588847333-project Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b0eae5a4667540d0a11c51e567898c05 Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersAaction247Test-1588847333-project Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 46349efc-5cca-4f08-b5c0-0dad99a6baae could not be found. Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '46349efc-5cca-4f08-b5c0-0dad99a6baae'} Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46349efc-5cca-4f08-b5c0-0dad99a6baae could not be found. Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46349efc-5cca-4f08-b5c0-0dad99a6baae could not be found. Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:15.357194 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46349efc-5cca-4f08-b5c0-0dad99a6baae could not be found. Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] Returning 404 to user: Instance 46349efc-5cca-4f08-b5c0-0dad99a6baae could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a8fbf31e-3ee9-44e5-a236-595ec398b6f2 tempest-ServersAaction247Test-1588847333 tempest-ServersAaction247Test-1588847333-project] 10.222.0.23 "GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae" status: 404 len: 111 microversion: 2.47 time: 0.134859 Jul 01 10:48:15.374266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2385/4681] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:15 2022] GET /compute/v2.1/servers/46349efc-5cca-4f08-b5c0-0dad99a6baae => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:48:15.560462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:15.574060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:15.581448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:15.589190 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f22e77cd-aa76-4ef3-8ba0-7ea77c61d044 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.776623 Jul 01 10:48:15.606045 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2297/4682] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:14 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:16.610621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:16.611930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:16.647646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:16.648363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:16.649505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:16.650308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:16.821068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:16.821650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:16.831713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:16.832172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:16.832956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:16.833425 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:16.932896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:48:17.022731 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:17.369881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:17.386841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:17.388953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:17.395318 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7511c914-0b9a-408b-8fc8-0bcca5115c59 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.789097 Jul 01 10:48:17.405558 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2386/4683] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:16 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:17.808127 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-599eb200-bbb1-4a0b-82c0-57066b18beed tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 204 len: 0 microversion: 2.1 time: 0.991922 Jul 01 10:48:17.809630 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2298/4684] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:48:16 2022] DELETE /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 0 bytes in 996 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:48:17.818529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:17.819153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:17.839599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:17.841056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:17.851656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:17.852365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:18.424905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:18.425686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:18.453500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:18.453953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:18.454773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:18.455218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:18.935464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:18.953075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:18.954719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:18.955978 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62cd7421-de64-4074-b431-0a65fce4943f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.535450 Jul 01 10:48:18.963131 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2299/4685] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:18 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:19.273630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:19.277918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1577220589", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6154fccb-0f7e-4e65-9515-90cbac52b9d7"}], "security_groups": [{"name": "tempest-securitygroup--411275352"}], "key_name": "tempest-keypair-2000098376", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:19.288467 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-163c2208-855a-4cc9-a40f-16cb7e002c22 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1506 microversion: 2.1 time: 1.473661 Jul 01 10:48:19.291997 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2387/4686] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:17 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1506 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:19.980996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:19.981947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:20.030236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:20.030703 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:20.038831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:20.039577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:20.240030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] validate_networks() for [('6154fccb-0f7e-4e65-9515-90cbac52b9d7', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:48:20.899977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:20.928424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:20.945132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:20.946779 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc521d4d-6499-4e4a-b522-a431c7795678 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.972750 Jul 01 10:48:20.954421 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2388/4687] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:19 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:20.964031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:20.978720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:20.994079 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:20.998151 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:21.002488 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:21.007332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:21.007923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:21.526775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:21.537799 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d73bd7f-7fc6-4c38-84a7-a9e9ecb91b48 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1506 microversion: 2.1 time: 0.581796 Jul 01 10:48:21.538265 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2389/4688] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:20 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:22.100461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1349915860", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": "none"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:22.204952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:48:22.205411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:48:22.206139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:48:22.207100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:48:22.209064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:48:22.228671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:22.232744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:22.233914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:22.234647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:22.266000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Getting quotas for project 8a84c1fb654b489589947d75e0181583. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:48:22.276566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Getting quotas for user 0348e01677594557a54d5069aa8a8122 and project 8a84c1fb654b489589947d75e0181583. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:48:22.317291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:48:22.319612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:22.425898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:22.432208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for project dba2af3867524497b17de32361dec716. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:48:22.462240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Getting quotas for user 83a534c1028048b3af84ce213aad7f15 and project dba2af3867524497b17de32361dec716. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:48:22.482499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:48:22.488890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:48:22.867189 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-72f041b3-afd8-4017-892f-89e8de177615 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.316833 Jul 01 10:48:22.868470 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2390/4689] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:48:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:48:22.881602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:22.882575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:22.903755 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:22.904394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:22.908140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:22.908788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:22.926981 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1a836a9-aff5-45f7-bfeb-2e656a549a79 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.653309 Jul 01 10:48:22.929328 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2300/4690] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:48:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:48:22.953891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:22.954520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:22.995357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:23.000273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:23.001461 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:23.007517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:23.354360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:23.370039 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07dcf699-a60e-4d47-9c14-0114749b51be tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1464 microversion: 2.1 time: 0.437012 Jul 01 10:48:23.372181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2301/4691] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:22 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1464 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:23.390807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e093fff8-71eb-4e4b-94fe-b36d94a1efe5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:23.393900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e093fff8-71eb-4e4b-94fe-b36d94a1efe5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:23.817884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e093fff8-71eb-4e4b-94fe-b36d94a1efe5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:23.834485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e093fff8-71eb-4e4b-94fe-b36d94a1efe5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:23.839236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e093fff8-71eb-4e4b-94fe-b36d94a1efe5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:23.845686 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e093fff8-71eb-4e4b-94fe-b36d94a1efe5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1278 microversion: 2.57 time: 0.470140 Jul 01 10:48:23.846618 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2302/4692] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:23 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1278 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:23.861473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63e96437-c4ee-4db0-9764-36fee912b0c0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:23.862494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63e96437-c4ee-4db0-9764-36fee912b0c0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:23.898646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:23.915410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:23.917323 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:23.924308 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3f5b740-d404-4591-830c-d0a4ccfe87a9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 1.054350 Jul 01 10:48:23.925666 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2391/4693] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:22 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:23.938652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e0ef0f6b-e23d-4a80-9777-8463c12aa426 req-018784b6-8bfa-4a44-85fa-53586f8ab126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904d49ed-eae4-4e0e-b31b-1172222ced70", "name": "network-vif-deleted", "tag": "c360d821-bd19-4829-8b88-75b13071c99e"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:23.964352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e0ef0f6b-e23d-4a80-9777-8463c12aa426 req-018784b6-8bfa-4a44-85fa-53586f8ab126 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:23.964837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e0ef0f6b-e23d-4a80-9777-8463c12aa426 req-018784b6-8bfa-4a44-85fa-53586f8ab126 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:23.992729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-63e96437-c4ee-4db0-9764-36fee912b0c0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:24.001823 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63e96437-c4ee-4db0-9764-36fee912b0c0 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1238 microversion: 2.1 time: 0.151521 Jul 01 10:48:24.002912 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2303/4694] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:23 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1238 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:24.004355 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e0ef0f6b-e23d-4a80-9777-8463c12aa426 req-018784b6-8bfa-4a44-85fa-53586f8ab126 service nova] Creating event network-vif-deleted:c360d821-bd19-4829-8b88-75b13071c99e for instance 904d49ed-eae4-4e0e-b31b-1172222ced70 on n-h1-master-1 Jul 01 10:48:24.017637 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e0ef0f6b-e23d-4a80-9777-8463c12aa426 req-018784b6-8bfa-4a44-85fa-53586f8ab126 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088089 Jul 01 10:48:24.017637 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2392/4695] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:24.388696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:24.389724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:24.398147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:24.403838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:24.404920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:24.405549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:24.509094 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:24.523906 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4cd0138e-bc79-4b76-883b-edb4a108526c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 200 len: 1292 microversion: 2.1 time: 0.139701 Jul 01 10:48:24.524631 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2304/4696] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:24 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 1292 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:24.867414 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:24.868442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:24.884246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:24.885435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:24.888883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:24.890483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:24.943770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:24.944372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:24.954946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:24.958149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:24.961513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:24.962304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:25.051636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:25.063742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:25.066141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:25.068229 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a663a87e-6f5d-4f01-be9d-4315854a8be9 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1282 microversion: 2.57 time: 0.206208 Jul 01 10:48:25.081703 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2393/4697] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:24 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1282 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:25.086968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:25.087771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:25.100845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:25.101590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:25.102785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:25.103592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:25.323218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:25.354729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:25.365787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:25.367057 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c16bae4f-d2c8-43ee-8a2a-184d3b6fce90 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.427249 Jul 01 10:48:25.374143 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2305/4698] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:24 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:25.448892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:25.457730 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b8115f3-e861-470e-b39f-03d630c83687 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1234 microversion: 2.1 time: 0.374628 Jul 01 10:48:25.474823 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2394/4699] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:25 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1234 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:25.540563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:25.544636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 904d49ed-eae4-4e0e-b31b-1172222ced70] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:25.553990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:25.563421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:25.573590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:25.573590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:25.633356 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 could not be found. Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 HTTP/1.1 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 could not be found. Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '904d49ed-eae4-4e0e-b31b-1172222ced70'} Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 could not be found. Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 could not be found. Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:25.635244 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 could not be found. Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 404 to user: Instance 904d49ed-eae4-4e0e-b31b-1172222ced70 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:48:25.644447 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef0108dc-b08c-4415-a5c2-3321ab144fb4 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70" status: 404 len: 111 microversion: 2.1 time: 0.099943 Jul 01 10:48:25.647536 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2306/4700] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:25 2022] GET /compute/v2.1/servers/904d49ed-eae4-4e0e-b31b-1172222ced70 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:48:25.659246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:25.660058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:25.668575 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:25.670521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:25.671190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:25.672152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:25.672944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:25.709953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:48:26.087652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:26.088265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:26.098829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.106297 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.111428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.111428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.162196 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b940c4c5-d8a4-44eb-a311-f216438ef66c tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 204 len: 0 microversion: 2.1 time: 0.512977 Jul 01 10:48:26.165826 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2395/4701] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:48:25 2022] DELETE /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:48:26.173412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:26.175866 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:26.210557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.211403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.218878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.220539 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.279093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:26.295216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:26.296843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:26.301299 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73356923-dfa5-437e-a14f-3ccfe2a91162 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1330 microversion: 2.57 time: 0.215444 Jul 01 10:48:26.303290 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2307/4702] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:26 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1330 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:26.386139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:26.387706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:26.412428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.417909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.417909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.417909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.828728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:26.828728 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-102ac060-40ef-4ac6-b209-168d7bd01b12 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.631549 Jul 01 10:48:26.828728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2396/4703] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:26 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:48:26.828728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:26.828728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:26.856492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.856987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.857900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:26.860521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:26.877935 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:27.142316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:27.172478 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-612df4ed-1ed1-468a-b590-3312598a4e24 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1308 microversion: 2.1 time: 0.356991 Jul 01 10:48:27.174005 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2397/4704] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:26 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:27.334264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:27.337333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:27.343472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:27.345049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:27.345529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:27.346327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:27.346768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:27.383466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:27.387643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:27.393560 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8616a05-4f8c-4ff6-a3ae-ce46ab7ed745 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 1.011751 Jul 01 10:48:27.404340 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2308/4705] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:26 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:27.425013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:27.441761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:27.451675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:27.451675 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e03eeb4-3aae-4fec-ace4-791941abb115 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1348 microversion: 2.57 time: 0.127686 Jul 01 10:48:27.452119 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2398/4706] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:27 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1348 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:28.191670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:28.192374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:28.219646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:28.219646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:28.219979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.221236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:28.223925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.225552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:28.227959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.231031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:28.232762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.233421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:28.813053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:28.840991 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98132f1a-bbbe-4ac4-a336-7d4976f8c315 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 1.018263 Jul 01 10:48:28.840991 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2309/4707] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:27 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:28.857059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:28.857789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:28.885055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.885055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:28.885055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.885055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:28.916294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:28.929741 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa30e96f-fff3-4e8e-92e2-9dab569fa3b2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.743486 Jul 01 10:48:28.937200 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2399/4708] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:28 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:28.965664 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:28.967122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:28.982998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.983746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:28.984710 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:28.985188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:29.218994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:29.228591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:29.231351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:29.233033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f91e941-9edd-496b-b293-a54398b898d2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1336 microversion: 2.57 time: 0.294123 Jul 01 10:48:29.235241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2400/4709] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:28 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1336 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:29.339206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:29.350199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:29.357521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:29.359334 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3bf0eca0-0e41-484f-8c11-73e167c28485 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.520382 Jul 01 10:48:29.360360 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2310/4710] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:28 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:29.855627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:29.856792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:29.864892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:29.865664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:29.866837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:29.868366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:29.955497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:29.956805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:29.971592 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:29.972302 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:29.973350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:29.982518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:30.717422 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:30.732003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c98e286f-639c-4c57-98f6-65fcf461755f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.781733 Jul 01 10:48:30.733043 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2311/4711] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:29 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:30.737784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:30.738384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:30.757742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:30.758413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:30.759352 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:30.759935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:30.765823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:30.792302 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e888e4f-f0ea-4745-a9eb-0a5286f0ac11 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 0.941660 Jul 01 10:48:30.826375 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2401/4712] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:29 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:30.839273 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:30.841010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:30.853792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:30.854676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:30.855929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:30.858177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:30.954743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:30.970657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:30.974220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:30.978198 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9699e5fc-6966-43e7-99e5-fe8e48c533c5 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1357 microversion: 2.57 time: 0.244045 Jul 01 10:48:30.997597 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2312/4713] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:30 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:31.009570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:31.015270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:31.023942 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.024512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:31.025470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.026011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:31.198354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:48:31.198354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:48:31.198354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:48:31.198354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:48:31.198354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:48:31.622624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:31.635063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:31.636191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:31.644099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.644964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:31.646045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.647365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:31.668680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:31.673129 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0562e4d6-7113-403a-8f42-438c6aaf8c93 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.841867 Jul 01 10:48:31.675191 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2402/4714] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:30 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:31.753595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:31.755275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:31.769856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.771040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:31.771699 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77459101-2c78-4e84-9e57-dc75b01c7da2 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "POST /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b/action" status: 202 len: 1138 microversion: 2.57 time: 0.772531 Jul 01 10:48:31.772204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.772868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:31.784074 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2313/4715] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Jul 1 10:48:30 2022] POST /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b/action => generated 1138 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 01 10:48:31.789082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:31.789749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:31.797485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.798153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:31.799950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:31.807566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:32.119376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:32.144032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:32.153885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:32.156870 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-08775af7-fa5d-4caa-8bf3-ebdb8a0394b0 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.363926 Jul 01 10:48:32.193491 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2314/4716] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:31 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:32.203403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:32.204752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:32.221054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:32.221989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:32.224399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:32.226141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:32.255737 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:32.295443 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:32.412692 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:33.013890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.041914 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-63bb0f7a-eb34-44d6-890c-92cbf4e138de tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 1.293455 Jul 01 10:48:33.044655 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2403/4717] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:31 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:33.054115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9e53ffbe-fb7f-4b39-bbc5-8bafe3250797 req-ef0837b0-0c58-4c53-995e-d42bc9283b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8dc684-eeda-4cd7-9772-b6ab10e3f722", "tag": "669dda6a-b98a-4d29-8ea0-883621f4415e"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:33.072650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e53ffbe-fb7f-4b39-bbc5-8bafe3250797 req-ef0837b0-0c58-4c53-995e-d42bc9283b2d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:33.076722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e53ffbe-fb7f-4b39-bbc5-8bafe3250797 req-ef0837b0-0c58-4c53-995e-d42bc9283b2d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:33.114262 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9e53ffbe-fb7f-4b39-bbc5-8bafe3250797 req-ef0837b0-0c58-4c53-995e-d42bc9283b2d service nova] Creating event network-changed:669dda6a-b98a-4d29-8ea0-883621f4415e for instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 on n-h2-master-1 Jul 01 10:48:33.120546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9e53ffbe-fb7f-4b39-bbc5-8bafe3250797 req-ef0837b0-0c58-4c53-995e-d42bc9283b2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074191 Jul 01 10:48:33.122248 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2404/4718] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:33.133315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:33.137407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:33.159361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:33.160081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:33.161065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:33.161710 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:33.196660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.211759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74495709-6deb-4319-8694-1125195c6daf tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1520 microversion: 2.1 time: 1.015507 Jul 01 10:48:33.237325 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2315/4719] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:32 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1520 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:33.260178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:33.266345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:33.298569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:33.300670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:33.304831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:33.306957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:33.323234 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:33.618547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.627647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.632042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.637551 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e80ea1e0-0062-4d4e-a929-6fd001cb13df tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.397128 Jul 01 10:48:33.653340 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2316/4720] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:33 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:33.814479 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.835822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.837745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:33.839241 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-651b941a-72c7-49a9-96d1-5543533969d8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.715698 Jul 01 10:48:33.852261 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2405/4721] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:33 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:34.087739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:34.090730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:34.103964 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:34.105763 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:34.108908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.109615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.111055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.111931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.238422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:34.240897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:34.256767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.261791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.263250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.263933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.331373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.332155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.335435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lazy-loading 'fault' on Instance uuid 3e86e169-88e7-4094-9f19-014a424b87d6 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:48:34.378255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:34.411087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66aa6c8c-4fb1-4c9e-b4cf-39309f465187 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.332828 Jul 01 10:48:34.413857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2317/4722] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:34 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:34.441792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979fb250468450aa9ba8a032a4ab90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ca97adc659431ea83b0703369d0c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:34.451159 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6175e162-aa51-4476-b477-867fdf4a4f15 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 200 len: 1311 microversion: 2.1 time: 0.216823 Jul 01 10:48:34.460985 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2406/4723] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:34 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:34.660326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:34.660753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:34.672365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.678107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.683587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.693836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.874494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:34.876715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:34.877227 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:34.890646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.890646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.890646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:34.890646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:34.892630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:34.894618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:34.896111 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-da85b70e-f90a-434c-8ae3-1855eba28b1f tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.239175 Jul 01 10:48:34.897587 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2318/4724] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:34 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:35.145113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-8ce4c124-947a-44d4-a3dc-fc4630272b80 req-2bd9c30e-c307-4ecd-9ef2-c1e7c71228d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e86e169-88e7-4094-9f19-014a424b87d6", "name": "network-vif-deleted", "tag": "bbf841da-6bf8-441a-b482-7bd94085c086"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:35.162665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8ce4c124-947a-44d4-a3dc-fc4630272b80 req-2bd9c30e-c307-4ecd-9ef2-c1e7c71228d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:35.164728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8ce4c124-947a-44d4-a3dc-fc4630272b80 req-2bd9c30e-c307-4ecd-9ef2-c1e7c71228d8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:35.180747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:35.182438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-8ce4c124-947a-44d4-a3dc-fc4630272b80 req-2bd9c30e-c307-4ecd-9ef2-c1e7c71228d8 service nova] Creating event network-vif-deleted:bbf841da-6bf8-441a-b482-7bd94085c086 for instance 3e86e169-88e7-4094-9f19-014a424b87d6 on n-h1-master-1 Jul 01 10:48:35.188883 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-8ce4c124-947a-44d4-a3dc-fc4630272b80 req-2bd9c30e-c307-4ecd-9ef2-c1e7c71228d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048029 Jul 01 10:48:35.190064 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2319/4725] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:48:35.192253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:35.195961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:35.197469 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6c195fd6-3dfe-40e9-9cf9-4d746e9f09e1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.338011 Jul 01 10:48:35.198131 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2407/4726] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:34 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:35.431198 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:35.431984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:35.440730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:35.441586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:35.442369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:35.443207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:35.478148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:35.479351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] [instance: 3e86e169-88e7-4094-9f19-014a424b87d6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:35.489742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:35.494097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:35.495306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:35.496241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:35.531257 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] HTTP exception thrown: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 could not be found. Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Request method failure captured: Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 HTTP/1.1 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivs_Qq20unyeK_-vod60Kn9buLEvgDgxcJxU3klkHHSfKgO-Ai98odYhjA3kTjLr6x8j8WtlkS7RcHRDVUcnXEgP8HQEUuNtGHgVv-iB60ftYdqwmOxFAFHtIujy_mrk_M9Y2SfF69WnKbEAfXoiU60z5AJs4NYnK4orodbN7steuQxo Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86ca97adc659431ea83b0703369d0c50", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86ca97adc659431ea83b0703369d0c50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 86ca97adc659431ea83b0703369d0c50 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-981615755 Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 2979fb250468450aa9ba8a032a4ab90f Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-981615755-project Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 could not be found. Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3e86e169-88e7-4094-9f19-014a424b87d6'} Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 could not be found. Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 could not be found. Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:48:35.535666 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:35.539716 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:48:35.539716 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:48:35.539716 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:48:35.539716 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:48:35.539716 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:48:35.539716 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 could not be found. Jul 01 10:48:35.539716 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:48:35.543276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] Returning 404 to user: Instance 3e86e169-88e7-4094-9f19-014a424b87d6 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:48:35.546370 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a2a961d-8d2c-4bd3-bf31-648e91ba2e28 tempest-ServerRescueNegativeTestJSON-981615755 tempest-ServerRescueNegativeTestJSON-981615755-project] 10.222.0.23 "GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6" status: 404 len: 111 microversion: 2.1 time: 0.078255 Jul 01 10:48:35.549797 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2408/4727] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:35 2022] GET /compute/v2.1/servers/3e86e169-88e7-4094-9f19-014a424b87d6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:48:35.924311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:35.925113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:35.931659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:35.933015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:35.935083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:35.937137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:36.017072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:36.034860 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa6310bc-69ea-4d5c-a224-7eb7697c4cf1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.601026 Jul 01 10:48:36.034860 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2320/4728] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:35 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:36.148084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:36.178223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:36.193100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:36.202892 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f9712a7f-f2b2-4229-ba80-e386c7945c23 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.288385 Jul 01 10:48:36.202892 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2409/4729] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:35 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:36.217006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:36.217910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:36.227520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:36.231674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:36.232746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:36.236516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:36.481722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b26e022e-4f1a-4180-9955-75b8d03cecd0 req-9b930d98-01db-4da2-b01a-1777d08cb864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "name": "network-vif-plugged", "status": "completed", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:36.492758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b26e022e-4f1a-4180-9955-75b8d03cecd0 req-9b930d98-01db-4da2-b01a-1777d08cb864 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:36.493492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b26e022e-4f1a-4180-9955-75b8d03cecd0 req-9b930d98-01db-4da2-b01a-1777d08cb864 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:36.507501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b26e022e-4f1a-4180-9955-75b8d03cecd0 req-9b930d98-01db-4da2-b01a-1777d08cb864 service nova] Creating event network-vif-plugged:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h1-master-1 Jul 01 10:48:36.515241 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b26e022e-4f1a-4180-9955-75b8d03cecd0 req-9b930d98-01db-4da2-b01a-1777d08cb864 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037753 Jul 01 10:48:36.516490 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2410/4730] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:48:37.045826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:37.046759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:37.072237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:37.072919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:37.074025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:37.074618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:37.838828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:37.840291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:37.860093 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-370ca691-a412-4b17-9e15-e40899193f2a tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.819134 Jul 01 10:48:37.862621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:37.864767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:37.875789 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c2a9ced-08dd-498a-851b-abab83d8bfa0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 1.663164 Jul 01 10:48:37.880694 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2411/4731] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:37 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:37.882770 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2321/4732] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:36 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:37.894596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:37.899296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:37.914092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:37.917048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:37.925256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:37.927261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:38.126450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:38.126450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:38.126450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:38.126450 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-72614935-2fa6-460d-aadc-ff32f8de4211 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.204785 Jul 01 10:48:38.126450 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2412/4733] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:37 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:38.896405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:38.897478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:38.898891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:38.901748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:38.918776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:38.919251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:38.920078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:38.920515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:38.938973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:38.939482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:38.940373 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:38.940812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:39.520787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:39.531413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:39.533822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:39.534627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:39.536945 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1bfbd64-6804-4863-96f3-96e93bb1ac96 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.644346 Jul 01 10:48:39.537645 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2413/4734] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:38 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:39.549804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:39.549946 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f85e080-3b9e-42fd-a496-b7d3a7abd5c6 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.666917 Jul 01 10:48:39.550449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:39.564246 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2322/4735] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:38 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:39.586558 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:39.587019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:39.587835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:39.588344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:39.702716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:39.720873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:39.722977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:39.729757 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7c5e74d0-ee9b-4a7b-b191-42933ea1eeaa tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.189831 Jul 01 10:48:39.732506 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2414/4736] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:39 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:40.560819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:40.572307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:40.574794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:40.582598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:40.622503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:40.627537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:40.629814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:40.632169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:40.647380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:40.647840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:40.651847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:40.651847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:40.687375 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:41.360266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:41.382832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4b927bfa-b80a-4bbb-b120-f78b6b7e1a5c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.815580 Jul 01 10:48:41.385890 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2415/4737] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:40 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:41.416025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:41.420302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:41.457835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:41.458300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:41.459112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:41.459559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:41.522275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:41.534794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:41.545201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:41.556152 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03aa9c0a-9e97-402e-9955-20c9e28f5a99 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1810 microversion: 2.20 time: 0.997929 Jul 01 10:48:41.573640 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2323/4738] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:40 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1810 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:41.773091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:41.791172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:41.794577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:41.797026 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b9db2a7-2de0-42b0-9adc-8b0901d6ba43 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.407201 Jul 01 10:48:41.798435 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2416/4739] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:41 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:42.409440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:42.410456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:42.432393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:42.433475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:42.435759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:42.438390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:42.599195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:42.599195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:42.618230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:42.618929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:42.620252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:42.633917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:43.138588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:43.148204 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77101cc7-5df0-40a2-b1bc-e1962da1f2dc tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.748307 Jul 01 10:48:43.148815 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2324/4740] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:42 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:43.157760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:43.158380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:43.175269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:43.179158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:43.179621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:43.180408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:43.180850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:43.187096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:43.201061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:43.231371 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bbd41c39-2476-456c-a33f-d04b57d63ec0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1797 microversion: 2.20 time: 0.653500 Jul 01 10:48:43.236157 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2417/4741] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:42 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1797 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:43.358869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:43.374636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:43.376201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:43.377451 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6fafdfa-7c3c-430f-bf04-ab71445a52a8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.223552 Jul 01 10:48:43.378027 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2325/4742] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:43 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:43.404927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1630713065", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "0417ff04-b95e-42da-8dd3-bd5150fa1982"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:43.405900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-fbdfc5b9-42e0-4e76-a700-633db86b32ab req-b9b49b2e-f36e-4643-8bf1-08cac2c9293d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8dc684-eeda-4cd7-9772-b6ab10e3f722", "name": "network-vif-plugged", "status": "completed", "tag": "669dda6a-b98a-4d29-8ea0-883621f4415e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:43.431964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fbdfc5b9-42e0-4e76-a700-633db86b32ab req-b9b49b2e-f36e-4643-8bf1-08cac2c9293d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:43.432442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fbdfc5b9-42e0-4e76-a700-633db86b32ab req-b9b49b2e-f36e-4643-8bf1-08cac2c9293d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:43.463473 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-fbdfc5b9-42e0-4e76-a700-633db86b32ab req-b9b49b2e-f36e-4643-8bf1-08cac2c9293d service nova] Creating event network-vif-plugged:669dda6a-b98a-4d29-8ea0-883621f4415e for instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 on n-h2-master-1 Jul 01 10:48:43.471431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-fbdfc5b9-42e0-4e76-a700-633db86b32ab req-b9b49b2e-f36e-4643-8bf1-08cac2c9293d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091813 Jul 01 10:48:43.472702 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2326/4743] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:43.504451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] validate_networks() for [('0417ff04-b95e-42da-8dd3-bd5150fa1982', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:48:44.168474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:44.173339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:44.184658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:44.186780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:44.187780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:44.189974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:44.975087 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:45.003253 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c065711-5201-40da-a37f-823c4d60a7bb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 0.826803 Jul 01 10:48:45.003253 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2327/4744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:44 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:45.003253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:45.003253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:45.003253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:45.003710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:45.004220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:45.004845 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:45.467460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:45.494373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:45.499469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:45.508760 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b78f2e3-6f89-43cb-a2ff-bdac9680d092 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.509468 Jul 01 10:48:45.509594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2328/4745] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:44 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:46.007358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:46.007984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:46.023574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:46.034060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:46.034060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:46.034060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:46.953887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:48:46.954529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:48:46.955162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:48:46.955699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:48:46.956664 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:48:46.980919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:46.981676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:46.985779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:46.991345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:47.002030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:47.046146 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-33d0d495-8af0-4f49-8c72-8bf9874c1230 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1363 microversion: 2.1 time: 1.043222 Jul 01 10:48:47.046749 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2329/4746] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:46 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1363 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:48:47.066430 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:47.074667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:48:47.120167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:47.121269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for user be759a44a78544109032556c07b5c868 and project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:48:47.151382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:47.155070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:47.159318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:47.162611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:47.220725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:48:47.233752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:48:47.484297 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1eb27f2d-a6e4-4b33-bc1a-c0f7565b1089 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.243435 Jul 01 10:48:47.486209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2418/4747] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:48:47.499092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5394a3a-500b-4785-ae00-fbc72bc97e28 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:47.502318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5394a3a-500b-4785-ae00-fbc72bc97e28 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:47.536414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:47.553017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:47.559396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:47.564096 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d9195f3-6e21-4ccc-bec7-d658aefc56c6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.513865 Jul 01 10:48:47.568515 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2330/4748] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:47 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:47.748576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5394a3a-500b-4785-ae00-fbc72bc97e28 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:47.758697 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5394a3a-500b-4785-ae00-fbc72bc97e28 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1208 microversion: 2.1 time: 0.266131 Jul 01 10:48:47.764030 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2419/4749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:47 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1208 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:48:48.063903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:48.064521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:48.080879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:48.081361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:48.082206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:48.082821 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:48.590856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:48.591834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:48.604391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:48.614169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:48.615214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:48.616698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:48.618530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:48.622141 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f74df39-d64f-4fe3-b986-aeab7655a2c2 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1550 microversion: 2.1 time: 0.559076 Jul 01 10:48:48.633179 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2331/4750] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:48 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1550 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:48.643417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d5b60b6-2283-4593-b38e-eee2d6c873c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:48.644098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d5b60b6-2283-4593-b38e-eee2d6c873c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:48.662554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5b60b6-2283-4593-b38e-eee2d6c873c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:48.663982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5b60b6-2283-4593-b38e-eee2d6c873c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:48.665988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5b60b6-2283-4593-b38e-eee2d6c873c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:48.669732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d5b60b6-2283-4593-b38e-eee2d6c873c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:48.803754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:48.825659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:48.825659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:48.825659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-770a109b-b1e0-485e-978e-c76a71a3cd46 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.237292 Jul 01 10:48:48.825659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2420/4751] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:48 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:48.837497 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86c477be-1c32-4f86-a82e-b29a35d11851 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:48.838743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86c477be-1c32-4f86-a82e-b29a35d11851 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:48.892377 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d5b60b6-2283-4593-b38e-eee2d6c873c9 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.253847 Jul 01 10:48:48.899997 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2332/4752] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:48:48 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-interface => generated 285 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:48.983860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86c477be-1c32-4f86-a82e-b29a35d11851 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:49.005340 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86c477be-1c32-4f86-a82e-b29a35d11851 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1208 microversion: 2.1 time: 0.181199 Jul 01 10:48:49.008187 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2421/4753] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:48 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:49.847801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:49.849038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:49.914925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:49.921940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:49.923007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:49.923618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:50.025921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:50.026682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:50.066256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:50.066799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:50.068640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:50.069083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:50.296384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:50.345344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:50.346889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:50.348636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7b8406e-b584-42e9-a785-a70c632c77e6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.510187 Jul 01 10:48:50.351090 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2333/4754] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:49 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:50.446030 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:50.455734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11a1aa1d-77f7-4893-a2e0-7ed3964af545 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1212 microversion: 2.1 time: 0.435682 Jul 01 10:48:50.456336 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2422/4755] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:50 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1212 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:51.369999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:51.371440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:51.402190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:51.402190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:51.405657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:51.406153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:51.447414 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:51.473512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:51.474992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:51.493208 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:51.493872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:51.495246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:51.496024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:51.676637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:51.691590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:51.698680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:51.701583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00b15f98-94e5-4345-bb48-c0262b0c95ad tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.335871 Jul 01 10:48:51.702928 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2334/4756] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:51 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:51.711758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7158b07d-ee15-4b8d-ad18-245d775b70da req-ba16d2f6-285a-4d0d-b92e-9dd35dac595a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8dc684-eeda-4cd7-9772-b6ab10e3f722", "tag": "669dda6a-b98a-4d29-8ea0-883621f4415e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:51.734409 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7158b07d-ee15-4b8d-ad18-245d775b70da req-ba16d2f6-285a-4d0d-b92e-9dd35dac595a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:51.735294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7158b07d-ee15-4b8d-ad18-245d775b70da req-ba16d2f6-285a-4d0d-b92e-9dd35dac595a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:51.753533 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7158b07d-ee15-4b8d-ad18-245d775b70da req-ba16d2f6-285a-4d0d-b92e-9dd35dac595a service nova] Creating event network-changed:669dda6a-b98a-4d29-8ea0-883621f4415e for instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 on n-h2-master-1 Jul 01 10:48:51.756920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7158b07d-ee15-4b8d-ad18-245d775b70da req-ba16d2f6-285a-4d0d-b92e-9dd35dac595a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052656 Jul 01 10:48:51.758537 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2335/4757] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:51.848726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:51.865100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c4b8a8b-ff67-4933-8f76-6bc28b8f8391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1260 microversion: 2.1 time: 0.394704 Jul 01 10:48:51.866466 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2423/4758] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:51 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1260 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:52.730689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:52.738827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:52.762097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:52.763105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:52.769680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:52.770370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:52.885464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:52.887614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:52.903220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:52.905292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:52.905531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:52.908316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:53.014992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:53.026710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:53.029228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:53.030883 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-841a02f5-e2df-4dda-a9fc-0e5db3f2050c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.312131 Jul 01 10:48:53.042899 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2336/4759] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:52 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:53.087187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:53.097707 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9d420fa-66c0-4b00-b087-ffcc41fef518 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1266 microversion: 2.1 time: 0.218488 Jul 01 10:48:53.099537 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2424/4760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:52 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:48:53.248744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2084854695", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": "none"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:53.335427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:48:53.335849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:48:53.336324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:48:53.339836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:48:53.340378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:48:53.362638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:53.362638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:53.362638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:53.364085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:53.406743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Getting quotas for project a2a1f8d2ac454ab6a1d0bf8c57767100. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:48:53.421577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Getting quotas for user 9cca5ebb6e4546a790eebe8b58918faf and project a2a1f8d2ac454ab6a1d0bf8c57767100. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:48:53.452865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:48:53.466261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:48:53.674237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae6a6db5-fbbf-43de-a739-34a67c58b09f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.629532 Jul 01 10:48:53.675465 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2337/4761] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:48:53.691831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64a2042c-856f-4596-a0ca-407caa5c29cb tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:53.692653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-64a2042c-856f-4596-a0ca-407caa5c29cb tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:54.049673 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:54.051539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:54.087867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:54.088327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:54.095733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:54.096298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:54.452234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:54.462900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64a2042c-856f-4596-a0ca-407caa5c29cb tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:54.466733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:54.471832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64a2042c-856f-4596-a0ca-407caa5c29cb tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:54.473733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64a2042c-856f-4596-a0ca-407caa5c29cb tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:54.491071 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64a2042c-856f-4596-a0ca-407caa5c29cb tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3" status: 200 len: 1278 microversion: 2.47 time: 0.789748 Jul 01 10:48:54.491192 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:54.496270 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2425/4762] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:53 2022] GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3 => generated 1278 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:54.497534 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b36220d6-1093-4f7f-9757-b2d5d4dceb6c tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.447345 Jul 01 10:48:54.501245 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2338/4763] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:54 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:54.514917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:54.515563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:54.532504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:54.533717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:54.541528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:54.541528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:54.616151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1727096372", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": "none"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:54.716461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:48:54.716461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:48:54.716461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:48:54.716461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:48:54.716461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:48:54.732039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:54.732712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:54.733925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:54.734511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:54.787947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Getting quotas for project a2a1f8d2ac454ab6a1d0bf8c57767100. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:48:54.796306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Getting quotas for user 9cca5ebb6e4546a790eebe8b58918faf and project a2a1f8d2ac454ab6a1d0bf8c57767100. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:48:54.820674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:48:54.828119 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:48:54.982312 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca906e89-8948-4c4b-8334-eb223d436ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.367095 Jul 01 10:48:54.989586 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2339/4764] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 01 10:48:55.007346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7bcba475-d8e7-4552-a113-17afa2a5f041 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:55.019167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7bcba475-d8e7-4552-a113-17afa2a5f041 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:55.083042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:55.099191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ecaab2a8-482b-4431-909c-ec92fe4426cc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1266 microversion: 2.1 time: 0.595836 Jul 01 10:48:55.100283 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2426/4765] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:54 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1266 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:55.213965 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7bcba475-d8e7-4552-a113-17afa2a5f041 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "PUT /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 992 microversion: 2.47 time: 0.221855 Jul 01 10:48:55.230777 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2340/4766] 10.222.0.23 () {62 vars in 1296 bytes} [Fri Jul 1 10:48:54 2022] PUT /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 992 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:48:55.235489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6334fa25-235f-4b6b-b781-c91707de7704 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:55.236961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6334fa25-235f-4b6b-b781-c91707de7704 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:55.441969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6334fa25-235f-4b6b-b781-c91707de7704 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:55.453916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6334fa25-235f-4b6b-b781-c91707de7704 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:55.459513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6334fa25-235f-4b6b-b781-c91707de7704 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:55.467687 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6334fa25-235f-4b6b-b781-c91707de7704 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1278 microversion: 2.47 time: 0.235245 Jul 01 10:48:55.490868 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2427/4767] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:55 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:55.524372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:55.525002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:55.539026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:55.541550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:55.542751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:55.545499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:55.760521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:55.773603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:55.780908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:55.783055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-211f11cd-70ec-4dea-a9a7-5b6d6c2af886 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.263484 Jul 01 10:48:55.799323 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2341/4768] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:55 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:56.119135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:56.120242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:56.177598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:56.178483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:56.184246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:56.187529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:56.486651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2eb9e77f-ee70-497c-81ca-81223021295f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:56.488337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2eb9e77f-ee70-497c-81ca-81223021295f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:56.738828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2eb9e77f-ee70-497c-81ca-81223021295f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:56.761586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2eb9e77f-ee70-497c-81ca-81223021295f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:56.763221 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2eb9e77f-ee70-497c-81ca-81223021295f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:56.792174 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2eb9e77f-ee70-497c-81ca-81223021295f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1278 microversion: 2.47 time: 0.307987 Jul 01 10:48:56.792174 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2342/4769] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:56 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1278 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:56.820248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:56.820941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:56.839829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:56.840296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:56.842812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:56.843495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:57.015861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:57.024231 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:57.032641 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2294c2ad-6962-4777-97a1-d857c5b22413 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.916567 Jul 01 10:48:57.034747 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2428/4770] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:56 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:57.070318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:57.082745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:57.082745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:57.087704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9ab9f0bb-849d-4d4a-9ad8-9e86b9a00830 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.282230 Jul 01 10:48:57.100561 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2343/4771] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:56 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:57.668166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2df9698d-3023-463f-97f7-f6c347e10bec req-f1348076-4066-4cbf-b7c5-c8e3486620c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205d1cc4-59f7-4959-8d0a-72052c741f2c", "tag": "e3ec33cf-2d3a-4c93-98cc-ff599398b4bf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:48:57.696934 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:48:57.701689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2df9698d-3023-463f-97f7-f6c347e10bec req-f1348076-4066-4cbf-b7c5-c8e3486620c0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:57.702525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2df9698d-3023-463f-97f7-f6c347e10bec req-f1348076-4066-4cbf-b7c5-c8e3486620c0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:57.722123 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2df9698d-3023-463f-97f7-f6c347e10bec req-f1348076-4066-4cbf-b7c5-c8e3486620c0 service nova] Creating event network-changed:e3ec33cf-2d3a-4c93-98cc-ff599398b4bf for instance 205d1cc4-59f7-4959-8d0a-72052c741f2c on n-h1-master-1 Jul 01 10:48:57.734726 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2df9698d-3023-463f-97f7-f6c347e10bec req-f1348076-4066-4cbf-b7c5-c8e3486620c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073185 Jul 01 10:48:57.746562 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2429/4772] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:48:57.810968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:57.811793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:57.829377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:57.830333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:57.831433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:57.832094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:57.947364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:57.974463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:57.980368 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:57.981771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a19fbf65-03fc-4371-a18b-a5e70798de92 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1330 microversion: 2.47 time: 0.175071 Jul 01 10:48:58.011585 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2344/4773] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:57 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1330 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:58.058251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:58.063519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:58.078561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:58.079419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:58.081015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:58.083563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:58.108339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:58.109763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:58.117521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:58.118200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:58.119725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:58.121450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:58.280302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:58.299262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:58.300816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:58.302438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51e64f4b-a096-4c9f-9864-d745763abed6 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1366 microversion: 2.57 time: 0.199267 Jul 01 10:48:58.319127 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2345/4774] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:58 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:48:58.384895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:58.394191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f5817dce-7000-44a1-9521-25c18d250cb5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.347027 Jul 01 10:48:58.395404 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2430/4775] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:58 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:48:59.006722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:59.007344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:59.019946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:59.021240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:59.022541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:59.023148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:59.162902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:59.174485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:59.177058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:59.178856 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b1aaaa8a-3ec9-460d-b294-c8ec4bd7d089 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1338 microversion: 2.47 time: 0.176863 Jul 01 10:48:59.193631 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2346/4776] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:59 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1338 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:59.329092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:59.330537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:59.343488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:59.346463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:59.351478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:59.353240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:59.413704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:48:59.414607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:48:59.440955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:59.445421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:59.447375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:48:59.448030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:48:59.527329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:59.536349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:59.537951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:59.539175 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-07ae39dd-84f3-44c0-9b48-e21ec67177c3 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1384 microversion: 2.57 time: 0.214088 Jul 01 10:48:59.563708 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2431/4777] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:48:59 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1384 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:48:59.925543 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:48:59.935878 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d19655c-cc40-41c3-b724-6e4af460d936 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.527618 Jul 01 10:48:59.936792 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2347/4778] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:48:59 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:00.203354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:00.203998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:00.217077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:00.223357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:00.224385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:00.226263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:00.319320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:00.330216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:00.332651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:00.335125 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8312e77f-52e8-472b-9823-0900f37593fa tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1336 microversion: 2.47 time: 0.139157 Jul 01 10:49:00.336182 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2432/4779] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:00 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1336 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:00.571226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:00.571898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:00.595017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:00.595803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:00.598958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:00.599644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:00.810277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:00.826269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:00.830329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:00.832909 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e47c3370-7826-4b27-82f1-f367254b22d4 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1372 microversion: 2.57 time: 0.266536 Jul 01 10:49:00.845226 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2348/4780] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:00 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:00.953039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:00.954500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:00.981419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:00.985056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:00.985993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:00.986552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:01.361218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:01.362222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:01.369520 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:01.379129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:01.388624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:01.388624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:01.388624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:01.572781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:01.590328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:01.594415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:01.598378 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d4c8536-87ea-4767-af9d-bcbb09de5ada tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1336 microversion: 2.47 time: 0.246442 Jul 01 10:49:01.610317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:01.612316 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2349/4781] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:01 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1336 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:01.618617 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95571b80-c529-4a5b-9818-56110adb067e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.669375 Jul 01 10:49:01.628570 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2433/4782] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:00 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:01.857078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:01.858066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:01.866810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:01.867597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:01.868615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:01.869125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:01.952635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:01.964320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:01.966780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:01.974277 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-427b92de-fe0c-4b87-9531-85c38c15b025 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1372 microversion: 2.57 time: 0.121887 Jul 01 10:49:01.975572 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2350/4783] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:01 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:02.624576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:02.624576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:02.636818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:02.638583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:02.670191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:02.680761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:02.681354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:02.684413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:02.687823 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:02.688393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:02.690369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:02.696193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:02.922749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:02.943421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:02.945264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:02.947679 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9f326bb0-bb2f-404f-9570-a56a62bd32bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1357 microversion: 2.47 time: 0.334188 Jul 01 10:49:02.955819 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2434/4784] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:02 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:02.978608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:02.980723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:02.989026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:02.989831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:02.991111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:02.991820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.057816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:03.071632 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99a87967-2f6d-4b76-b081-c8a319d4f93c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.434740 Jul 01 10:49:03.073667 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2351/4785] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:02 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:03.093366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:03.093366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:03.104487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.105083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.105814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.106294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.197217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:49:03.199078 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:49:03.199905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:49:03.200532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:49:03.201226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:49:03.287181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:03.298284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:03.300255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:03.301794 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-873a68f9-7469-447a-92ec-8be9368f4b4a tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1357 microversion: 2.57 time: 0.226721 Jul 01 10:49:03.302448 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2352/4786] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:03 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:03.333581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:03.334084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:03.360706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.361674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.362632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.363225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.395446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:49:03.471089 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:03.482277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.489895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.490880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.491839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.517098 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:03.556643 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:03.566385 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bdfa9727-735c-45b7-9ebf-ab771b449e8f tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "POST /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017/action" status: 202 len: 1079 microversion: 2.47 time: 0.591879 Jul 01 10:49:03.569360 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2435/4787] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:49:02 2022] POST /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017/action => generated 1079 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 01 10:49:03.581688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:03.582312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:03.600172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.600172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.600172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.600172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.784619 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c8cc505-2f67-407c-bfac-885bace98bf8 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "DELETE /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 204 len: 0 microversion: 2.57 time: 0.454789 Jul 01 10:49:03.785821 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2353/4788] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:49:03 2022] DELETE /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:49:03.796526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:03.797266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:03.813715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.814182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.815693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:03.816010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:03.952819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:03.965113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:03.970152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:03.971426 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0a13b60-9613-4e32-bfdd-51f2b32d9610 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.393673 Jul 01 10:49:03.971997 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2436/4789] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:03 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:04.015638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:04.024512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:04.031211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:04.037566 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6bbcb039-89dd-4384-81c4-f436ba7a6241 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1363 microversion: 2.57 time: 0.246607 Jul 01 10:49:04.038171 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2354/4790] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:03 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:04.090203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:04.090836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:04.110184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:04.110650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:04.111430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:04.111877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:04.412068 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:04.421935 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-76ccd219-e804-4bd7-a333-51eab9cd22bc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.336155 Jul 01 10:49:04.423013 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2437/4791] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:04 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:04.995615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:04.996840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:05.011185 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:05.017901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:05.018359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:05.019155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:05.019599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:05.059461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:05.060097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:05.091601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:05.092756 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:05.094013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:05.094775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:05.450315 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=14 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:05.704486 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:05.708161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:05.715541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:05.718520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:05.719184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:05.720046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:05.721271 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81f5bcf4-4799-4eed-af37-58c8f16a85f0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.732730 Jul 01 10:49:05.721538 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c68ac0b2-801f-40fd-a5b7-2a6d71854227 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1363 microversion: 2.57 time: 0.668128 Jul 01 10:49:05.724190 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2355/4792] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:04 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:05.729660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:05.730284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:05.747383 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2438/4793] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:05 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1363 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:05.756600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:05.756936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:05.757792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:05.760006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:06.012342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:06.023049 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc42ae13-0a73-4a61-bd94-fd97945a684b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.297469 Jul 01 10:49:06.032755 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2356/4794] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:05 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:06.746469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:06.747108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:06.748343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:06.748959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:06.757640 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=14 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:06.759618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:06.760257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:06.762124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:06.766515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:06.768190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:06.769706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:06.772192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:06.772793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:06.821002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:06.822414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:06.823731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lazy-loading 'fault' on Instance uuid 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:49:06.967562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:06.980345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:06.981318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:06.984054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0348e01677594557a54d5069aa8a8122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84c1fb654b489589947d75e0181583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:06.987289 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9fc03e7a-eb53-4d08-804e-079ff0f23aba tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 200 len: 1368 microversion: 2.57 time: 0.250249 Jul 01 10:49:06.988806 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2357/4795] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:06 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:06.992908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:07.000420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:07.001716 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-340c0a4b-bfee-4d46-8a93-48194a5a9319 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.265706 Jul 01 10:49:07.002555 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2439/4796] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:06 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:07.043927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:07.045202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:07.052691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:07.053543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:07.054498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:07.054944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:07.207722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:07.216738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b769449c-ba55-42be-ab7d-e730c279e69e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.180746 Jul 01 10:49:07.228712 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2358/4797] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:07 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:08.008410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:08.009110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] [instance: 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:08.018486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:08.018486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:08.019148 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:08.019592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:08.024808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:08.035182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:08.056576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:08.057458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:08.057865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:08.063206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:08.074086 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] HTTP exception thrown: Instance 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b could not be found. Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Request method failure captured: Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b HTTP/1.1 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtD0GI6s4xUaiqxtgDqTY6U1GeIeU4nQlwIwz9mRY53epwnf3b1gqxdrBYtqAnvGkgrMoQoiTceKHTVL5xjNyT1CrykUW0D3J-N3VMu20TuNEpKfG6btySZZvIELC4w8UFy5wbSOrNiWuCochif213FOxUo9P4oupfsTrmfB-BV_fjw Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.57 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 8a84c1fb654b489589947d75e0181583 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerShowV257Test-168688310 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a84c1fb654b489589947d75e0181583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a84c1fb654b489589947d75e0181583"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a84c1fb654b489589947d75e0181583", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a84c1fb654b489589947d75e0181583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerShowV257Test-168688310 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 8a84c1fb654b489589947d75e0181583 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerShowV257Test-168688310 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerShowV257Test-168688310-project Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0348e01677594557a54d5069aa8a8122 Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerShowV257Test-168688310-project Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b could not be found. Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b'} Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b could not be found. Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b could not be found. Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:08.076439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b could not be found. Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] Returning 404 to user: Instance 246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38c1dc9c-57ea-430b-8755-fa51601ad880 tempest-ServerShowV257Test-168688310 tempest-ServerShowV257Test-168688310-project] 10.222.0.23 "GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b" status: 404 len: 111 microversion: 2.57 time: 0.074310 Jul 01 10:49:08.092687 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2440/4798] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:08 2022] GET /compute/v2.1/servers/246fa7c5-8ae2-4543-ae1b-3dc68e7f1e9b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:49:08.154382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:08.163485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:08.165202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:08.166830 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d8760857-a2a5-45fe-bebc-954552dc5b0a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.145756 Jul 01 10:49:08.178209 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2359/4799] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:08 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:08.240365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:08.241065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:08.250190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:08.250664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:08.251871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:08.252644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:08.532275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:08.548045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11ad268c-6dbd-4f55-ae82-10f2f6d79c1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.317135 Jul 01 10:49:08.548630 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2441/4800] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:08 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:08.744275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ac767b5c-32ed-497a-827e-7e6535b6aa4f req-7aebde25-62a9-48c6-8681-fa563a34f0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205d1cc4-59f7-4959-8d0a-72052c741f2c", "name": "network-vif-plugged", "status": "completed", "tag": "e3ec33cf-2d3a-4c93-98cc-ff599398b4bf"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:08.755573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ac767b5c-32ed-497a-827e-7e6535b6aa4f req-7aebde25-62a9-48c6-8681-fa563a34f0b4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:08.757067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ac767b5c-32ed-497a-827e-7e6535b6aa4f req-7aebde25-62a9-48c6-8681-fa563a34f0b4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:08.771391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ac767b5c-32ed-497a-827e-7e6535b6aa4f req-7aebde25-62a9-48c6-8681-fa563a34f0b4 service nova] Creating event network-vif-plugged:e3ec33cf-2d3a-4c93-98cc-ff599398b4bf for instance 205d1cc4-59f7-4959-8d0a-72052c741f2c on n-h1-master-1 Jul 01 10:49:08.784342 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ac767b5c-32ed-497a-827e-7e6535b6aa4f req-7aebde25-62a9-48c6-8681-fa563a34f0b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044055 Jul 01 10:49:08.792610 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2360/4801] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:09.191273 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:09.191273 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:09.199996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:09.200750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:09.201814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:09.202481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:09.333312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:09.342944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:09.344806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:09.346566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b4efa0c-c6da-460b-9766-217c6221c00c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.165413 Jul 01 10:49:09.349305 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2442/4802] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:09 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:09.582408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:09.582845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:09.590906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:09.591576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:09.592505 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:09.593088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:09.800673 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:09.820460 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f1b289d-62a5-4f84-95c2-c589f3fb07e3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1308 microversion: 2.1 time: 0.258200 Jul 01 10:49:09.821073 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2361/4803] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:09 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:10.375980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:10.377337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:10.408454 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:10.416202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:10.417409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:10.421372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:10.561511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:10.575525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:10.582665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:10.584456 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e10f2ba5-86c6-473f-ac81-7282413234e8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.222142 Jul 01 10:49:10.598694 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2443/4804] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:10 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:10.839316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:10.841026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:10.849374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:10.850614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:10.851795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:10.852414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:11.058432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:11.067410 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cac16c1-24ea-4686-a9ea-a98b29a03e0c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1488 microversion: 2.1 time: 0.233179 Jul 01 10:49:11.073885 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2362/4805] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:10 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1488 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:11.084353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a4fd7729-5f65-44c0-b5e5-5047afd3caaf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:11.084898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a4fd7729-5f65-44c0-b5e5-5047afd3caaf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:11.096229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4fd7729-5f65-44c0-b5e5-5047afd3caaf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:11.096690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4fd7729-5f65-44c0-b5e5-5047afd3caaf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:11.097735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4fd7729-5f65-44c0-b5e5-5047afd3caaf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:11.098342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4fd7729-5f65-44c0-b5e5-5047afd3caaf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:11.377357 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a4fd7729-5f65-44c0-b5e5-5047afd3caaf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c/action" status: 202 len: 0 microversion: 2.1 time: 0.296477 Jul 01 10:49:11.381351 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2444/4806] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:49:11 2022] POST /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:49:11.388176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:11.389592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:11.405751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:11.407284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:11.408533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:11.409175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:11.615702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:11.618220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:11.638711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:11.643163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:11.644455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:11.648242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:11.673659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:11.693299 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f952e2a9-bb58-45ea-93aa-a6bf51365209 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1493 microversion: 2.1 time: 0.310196 Jul 01 10:49:11.696674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2363/4807] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:11 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1493 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:11.790145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:11.798455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:11.799947 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:11.801158 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-85693ba4-8e49-4596-984c-6eefa028d222 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.201347 Jul 01 10:49:11.801721 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2445/4808] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:11 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:12.711057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:12.712337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:12.725500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:12.725968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:12.726822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:12.727274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:12.798738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-34507bc6-f9b0-4901-a58d-9a6f57f18df6 tempest-ComputeTenantNetworksTest-1982891023 tempest-ComputeTenantNetworksTest-1982891023-project] Calling method '.version_select at 0x7f6f907b0670>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:13.154712 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-34507bc6-f9b0-4901-a58d-9a6f57f18df6 tempest-ComputeTenantNetworksTest-1982891023 tempest-ComputeTenantNetworksTest-1982891023-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.560501 Jul 01 10:49:13.162945 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2364/4809] 10.222.0.23 () {58 vars in 1157 bytes} [Fri Jul 1 10:49:12 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:13.167396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:13.168098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:13.186704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.187163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.187966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.189399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.201802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:13.234905 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5779f1f8-1654-4572-88da-65c2e7dad103 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 200 len: 1473 microversion: 2.1 time: 0.513761 Jul 01 10:49:13.235767 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2446/4810] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:12 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 1473 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:13.242042 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e89876e2-0693-4b37-9f00-6181fbf32aba tempest-ComputeTenantNetworksTest-1982891023 tempest-ComputeTenantNetworksTest-1982891023-project] Calling method '.version_select at 0x7f6f90bd0820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:13.353268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:13.374060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:13.377134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:13.378876 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-809872c0-2e4b-4642-b4fb-7e3139f8821b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.220376 Jul 01 10:49:13.380566 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2365/4811] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:13 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:13.394419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2dd97301-2e3e-408c-b343-b719b2c9f692 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1750673272"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:13.395784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2dd97301-2e3e-408c-b343-b719b2c9f692 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:13.402061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd97301-2e3e-408c-b343-b719b2c9f692 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.402726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd97301-2e3e-408c-b343-b719b2c9f692 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.403691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd97301-2e3e-408c-b343-b719b2c9f692 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.404306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dd97301-2e3e-408c-b343-b719b2c9f692 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.465478 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e89876e2-0693-4b37-9f00-6181fbf32aba tempest-ComputeTenantNetworksTest-1982891023 tempest-ComputeTenantNetworksTest-1982891023-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/76365c13-9d43-4e5e-a3b4-bc8cdcbdf97d" status: 200 len: 140 microversion: 2.1 time: 0.228419 Jul 01 10:49:13.472002 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2447/4812] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 10:49:13 2022] GET /compute/v2.1/os-tenant-networks/76365c13-9d43-4e5e-a3b4-bc8cdcbdf97d => generated 140 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:13.558067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5997ffc6-a784-435c-a4d2-7753d1004b52 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:13.559213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5997ffc6-a784-435c-a4d2-7753d1004b52 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:13.566006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5997ffc6-a784-435c-a4d2-7753d1004b52 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.566699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5997ffc6-a784-435c-a4d2-7753d1004b52 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.567740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5997ffc6-a784-435c-a4d2-7753d1004b52 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.568384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5997ffc6-a784-435c-a4d2-7753d1004b52 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.627260 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5997ffc6-a784-435c-a4d2-7753d1004b52 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments/efba7ea9-8662-4ec8-b326-45231ff95e76" status: 200 len: 194 microversion: 2.20 time: 0.073436 Jul 01 10:49:13.631073 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2448/4813] 10.222.0.23 () {60 vars in 1453 bytes} [Fri Jul 1 10:49:13 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments/efba7ea9-8662-4ec8-b326-45231ff95e76 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:49:13.719179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:13.719867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:13.729692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.732409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.733766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:13.734720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:13.851084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lazy-loading 'services' on Instance uuid 412c198b-5665-41d2-b3b3-7f4f261bdc4d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:49:14.190787 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-396ebaa8-670f-442c-b374-ca4724253845 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments/efba7ea9-8662-4ec8-b326-45231ff95e76" status: 202 len: 0 microversion: 2.20 time: 0.468047 Jul 01 10:49:14.196809 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2dd97301-2e3e-408c-b343-b719b2c9f692 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c/action" status: 202 len: 0 microversion: 2.1 time: 0.814731 Jul 01 10:49:14.197744 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2366/4814] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:49:13 2022] POST /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:49:14.198863 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2449/4815] 10.222.0.23 () {60 vars in 1456 bytes} [Fri Jul 1 10:49:13 2022] DELETE /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments/efba7ea9-8662-4ec8-b326-45231ff95e76 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:49:14.217384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-376f9efa-bd90-4acb-bcb1-779fdeba93d1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90bd0d30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:14.226161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dfa94a6f-0bdb-4abd-a3c4-2a84786adaa3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:14.232469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dfa94a6f-0bdb-4abd-a3c4-2a84786adaa3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:14.249394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfa94a6f-0bdb-4abd-a3c4-2a84786adaa3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:14.249840 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfa94a6f-0bdb-4abd-a3c4-2a84786adaa3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:14.250611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfa94a6f-0bdb-4abd-a3c4-2a84786adaa3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:14.251035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfa94a6f-0bdb-4abd-a3c4-2a84786adaa3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:14.277851 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-376f9efa-bd90-4acb-bcb1-779fdeba93d1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.064610 Jul 01 10:49:14.284387 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dfa94a6f-0bdb-4abd-a3c4-2a84786adaa3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085531 Jul 01 10:49:14.284522 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2450/4816] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:14 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:14.284898 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2367/4817] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:14 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:49:14.405535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:14.405535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:14.408456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:14.408978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:14.409857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:14.410363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:14.542051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:14.549605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:14.551134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:14.552354 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-05dd276a-4ef7-439c-9b8c-c13dda0da024 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.156369 Jul 01 10:49:14.552883 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2451/4818] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:14 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:15.300888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-97c36cfb-b3de-4392-a3d1-61cfd4acc56e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:15.301854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-97c36cfb-b3de-4392-a3d1-61cfd4acc56e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:15.303688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-30abdb57-38ed-4eef-8e8d-233ae81f1474 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f923c24c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:15.310301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c36cfb-b3de-4392-a3d1-61cfd4acc56e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:15.310746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c36cfb-b3de-4392-a3d1-61cfd4acc56e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:15.312472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c36cfb-b3de-4392-a3d1-61cfd4acc56e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:15.313075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97c36cfb-b3de-4392-a3d1-61cfd4acc56e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:15.390971 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-97c36cfb-b3de-4392-a3d1-61cfd4acc56e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094194 Jul 01 10:49:15.395402 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2368/4819] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:15 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:49:15.433343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-30abdb57-38ed-4eef-8e8d-233ae81f1474 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.136229 Jul 01 10:49:15.437697 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2452/4820] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:15 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:15.572243 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:15.573538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:15.585500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:15.586206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:15.587625 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:15.589085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:15.763838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:15.778148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:15.783554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:15.790424 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-75d26879-914c-4911-88f0-b893ecb1e677 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.217576 Jul 01 10:49:15.790424 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2369/4821] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:15 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:16.421670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c997bfe-2f8e-434f-b6e4-90fb4fd17da3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:16.421670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c997bfe-2f8e-434f-b6e4-90fb4fd17da3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:16.429074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c997bfe-2f8e-434f-b6e4-90fb4fd17da3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:16.429929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c997bfe-2f8e-434f-b6e4-90fb4fd17da3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:16.430986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c997bfe-2f8e-434f-b6e4-90fb4fd17da3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:16.431628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c997bfe-2f8e-434f-b6e4-90fb4fd17da3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:16.454169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ac100424-4126-4c8b-8439-6c8c33f0936e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906ffb80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:16.474129 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c997bfe-2f8e-434f-b6e4-90fb4fd17da3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073060 Jul 01 10:49:16.480776 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2453/4822] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:16 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:49:16.521197 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ac100424-4126-4c8b-8439-6c8c33f0936e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.072342 Jul 01 10:49:16.522223 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2370/4823] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:16 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:16.805948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:16.806835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:16.814024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:16.814700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:16.815812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:16.816422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:16.822531 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:17.382619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:17.414692 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:17.417974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:17.420675 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e239c88-0cf1-4cde-8493-54662cd1556d tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.618931 Jul 01 10:49:17.427509 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2454/4824] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:16 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:17.487245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-208d360f-7562-434f-b8a1-08f0769b14c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:17.490080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-208d360f-7562-434f-b8a1-08f0769b14c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:17.503099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-208d360f-7562-434f-b8a1-08f0769b14c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:17.504025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-208d360f-7562-434f-b8a1-08f0769b14c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:17.505304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-208d360f-7562-434f-b8a1-08f0769b14c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:17.506100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-208d360f-7562-434f-b8a1-08f0769b14c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:17.512110 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:17.535469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ccc4425-747c-46a0-8765-0e80dffcd18a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f913a04c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:17.577497 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-208d360f-7562-434f-b8a1-08f0769b14c9 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087769 Jul 01 10:49:17.583937 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2371/4825] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:17 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:49:17.614148 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ccc4425-747c-46a0-8765-0e80dffcd18a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.082724 Jul 01 10:49:17.617099 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2455/4826] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:17 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:18.450086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:18.450725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:18.482719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:18.483261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:18.486725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:18.488892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:18.594554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7d9cfc25-8ff5-48c2-8ae8-1dcf38476a5c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:18.595560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7d9cfc25-8ff5-48c2-8ae8-1dcf38476a5c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:18.636470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d9cfc25-8ff5-48c2-8ae8-1dcf38476a5c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:18.637493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d9cfc25-8ff5-48c2-8ae8-1dcf38476a5c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:18.638708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d9cfc25-8ff5-48c2-8ae8-1dcf38476a5c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:18.639635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d9cfc25-8ff5-48c2-8ae8-1dcf38476a5c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:18.775279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:18.797915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:18.805186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:18.807628 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7d9cfc25-8ff5-48c2-8ae8-1dcf38476a5c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.214635 Jul 01 10:49:18.811766 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2456/4827] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:18 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:49:18.814399 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc5aca21-d3d1-4d89-afe0-0b73fb996718 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.369607 Jul 01 10:49:18.820340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-382f17c6-7c5f-4050-8da0-1898df9e65e4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f9111dca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:18.822165 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2372/4828] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:18 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:18.920172 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-382f17c6-7c5f-4050-8da0-1898df9e65e4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.106728 Jul 01 10:49:18.921864 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2457/4829] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:18 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:19.824130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8738bf9f-dce9-4ab1-8f86-8bce926ec6dc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:19.825932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8738bf9f-dce9-4ab1-8f86-8bce926ec6dc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:19.835754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:19.836595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:19.841244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8738bf9f-dce9-4ab1-8f86-8bce926ec6dc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:19.841916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8738bf9f-dce9-4ab1-8f86-8bce926ec6dc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:19.842862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8738bf9f-dce9-4ab1-8f86-8bce926ec6dc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:19.845613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8738bf9f-dce9-4ab1-8f86-8bce926ec6dc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:19.855549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:19.856033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:19.856843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:19.857314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:19.917570 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8738bf9f-dce9-4ab1-8f86-8bce926ec6dc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098633 Jul 01 10:49:19.930494 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2373/4830] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:19 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:49:19.936518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7f8c4056-7d0e-4a84-aad0-073a102a1cc5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f9076bb80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:19.950942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:19.962003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:19.964682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:19.966525 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8eedb5cf-66c4-4f81-84c5-52bc78579bb8 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.135802 Jul 01 10:49:19.967572 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2458/4831] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:19 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:19.996135 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7f8c4056-7d0e-4a84-aad0-073a102a1cc5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.064155 Jul 01 10:49:19.997329 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2374/4832] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:19 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:20.673775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c7eab15c-1641-4aac-b899-932619fd27d7 req-3bbe7540-a1cd-4f82-9407-8ab38d28ad17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205d1cc4-59f7-4959-8d0a-72052c741f2c", "name": "network-vif-plugged", "status": "completed", "tag": "e3ec33cf-2d3a-4c93-98cc-ff599398b4bf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:20.683029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c7eab15c-1641-4aac-b899-932619fd27d7 req-3bbe7540-a1cd-4f82-9407-8ab38d28ad17 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:20.683695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c7eab15c-1641-4aac-b899-932619fd27d7 req-3bbe7540-a1cd-4f82-9407-8ab38d28ad17 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:20.724044 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c7eab15c-1641-4aac-b899-932619fd27d7 req-3bbe7540-a1cd-4f82-9407-8ab38d28ad17 service nova] Creating event network-vif-plugged:e3ec33cf-2d3a-4c93-98cc-ff599398b4bf for instance 205d1cc4-59f7-4959-8d0a-72052c741f2c on n-h1-master-1 Jul 01 10:49:20.749635 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c7eab15c-1641-4aac-b899-932619fd27d7 req-3bbe7540-a1cd-4f82-9407-8ab38d28ad17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079864 Jul 01 10:49:20.750498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2459/4833] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:20.944967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1a38bb5f-1cb1-448b-98ba-437d2143d6b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:20.946086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1a38bb5f-1cb1-448b-98ba-437d2143d6b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:20.973942 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a38bb5f-1cb1-448b-98ba-437d2143d6b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:20.976918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a38bb5f-1cb1-448b-98ba-437d2143d6b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:20.977835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a38bb5f-1cb1-448b-98ba-437d2143d6b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:20.978268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a38bb5f-1cb1-448b-98ba-437d2143d6b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:20.985899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:20.988834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:21.000772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:21.001546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:21.002526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:21.003200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:21.063054 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1a38bb5f-1cb1-448b-98ba-437d2143d6b0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124427 Jul 01 10:49:21.064832 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2375/4834] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:20 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:49:21.075400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f99483b-79a2-4246-a939-cc358114faac tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906ce040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:21.156892 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f99483b-79a2-4246-a939-cc358114faac tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.090503 Jul 01 10:49:21.168870 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2376/4835] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:21 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:21.228251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:21.254834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:21.257624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:21.267510 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c8c9f49-ff09-4c8c-ba14-64ab365d1701 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.285353 Jul 01 10:49:21.268114 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2460/4836] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:20 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:22.100565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c519eacf-8ea2-4127-9fee-8de83d4cbd21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:22.109978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c519eacf-8ea2-4127-9fee-8de83d4cbd21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:22.166857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c519eacf-8ea2-4127-9fee-8de83d4cbd21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:22.170094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c519eacf-8ea2-4127-9fee-8de83d4cbd21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:22.172548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-533d011a-fefd-46e1-9f5c-00c2a972524b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f970ecb80>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:22.173073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c519eacf-8ea2-4127-9fee-8de83d4cbd21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:22.173073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c519eacf-8ea2-4127-9fee-8de83d4cbd21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:22.236701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c519eacf-8ea2-4127-9fee-8de83d4cbd21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164010 Jul 01 10:49:22.238254 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2377/4837] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:22 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:49:22.271177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-533d011a-fefd-46e1-9f5c-00c2a972524b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.102746 Jul 01 10:49:22.272073 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2461/4838] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:22 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:22.288145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:22.289095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:22.306347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:22.311880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:22.317898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:22.318088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:22.549219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:22.588837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:22.597915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:22.599159 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c10dd1e1-ec94-46a1-a362-bfc2bcfd60ab tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.316372 Jul 01 10:49:22.609766 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2378/4839] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:22 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:23.275606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a4cad87e-d76d-485e-8646-e07945c294ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:23.281349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a4cad87e-d76d-485e-8646-e07945c294ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:23.291874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4cad87e-d76d-485e-8646-e07945c294ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:23.292578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4cad87e-d76d-485e-8646-e07945c294ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:23.292740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f97e845-be69-4044-8763-c17ffa3c485a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906d8790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:23.294108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4cad87e-d76d-485e-8646-e07945c294ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:23.294747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4cad87e-d76d-485e-8646-e07945c294ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:23.381841 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f97e845-be69-4044-8763-c17ffa3c485a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.100571 Jul 01 10:49:23.382746 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2379/4840] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:23 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:23.383830 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a4cad87e-d76d-485e-8646-e07945c294ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.137081 Jul 01 10:49:23.384632 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2462/4841] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:49:23 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:23.524634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:23.524634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:23.536310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:23.537876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:23.538868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:23.539319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:23.642137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:23.646468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:23.648780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:49:23.669889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:23.675129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:23.679030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:23.679030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:23.816916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:23.835408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:23.836929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:23.846515 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bfc60909-cc88-468d-ad8d-f945cfb727b3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.225725 Jul 01 10:49:23.859848 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2463/4842] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:23 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:24.054287 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-795f0f9d-0cbb-449e-ba26-7f135d1b52ef tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 204 len: 0 microversion: 2.20 time: 0.535524 Jul 01 10:49:24.061580 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2380/4843] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:49:23 2022] DELETE /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:49:24.063818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:24.064444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:24.070992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:24.071671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:24.073215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:24.073816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:24.317022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:24.330576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:24.332547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:24.334265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60eb68d3-9ad0-4c80-9803-7d3a02d5ea57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.274334 Jul 01 10:49:24.335326 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2464/4844] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:24 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:24.396439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-706b9979-2a36-4e08-b654-7ddf3520340b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906ce3a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:24.468233 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-706b9979-2a36-4e08-b654-7ddf3520340b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.075933 Jul 01 10:49:24.475154 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2381/4845] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:24 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:24.574039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3ad30b1-1212-4833-84e4-87d64f4ccb3c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:24.574551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3ad30b1-1212-4833-84e4-87d64f4ccb3c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:24.601458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3ad30b1-1212-4833-84e4-87d64f4ccb3c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:24.602041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3ad30b1-1212-4833-84e4-87d64f4ccb3c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:24.602896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3ad30b1-1212-4833-84e4-87d64f4ccb3c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:24.603413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3ad30b1-1212-4833-84e4-87d64f4ccb3c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:24.694181 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3ad30b1-1212-4833-84e4-87d64f4ccb3c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/ips" status: 200 len: 146 microversion: 2.1 time: 0.135233 Jul 01 10:49:24.698565 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2465/4846] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:49:24 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/ips => generated 146 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:24.868866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:24.871840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:24.884416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:24.890575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:24.890575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:24.890575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:25.225841 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:25.240261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:25.242200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:25.251523 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c4421d2-5633-4ec8-8fd9-a93e4cd9fd3c tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.384588 Jul 01 10:49:25.264266 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2382/4847] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:24 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:25.359170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:25.359170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:25.370887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:25.371982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:25.373376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:25.374521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:25.486482 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d71e748f-f19c-4a2d-8957-ee47165ded10 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90723d30>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:25.561069 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d71e748f-f19c-4a2d-8957-ee47165ded10 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.078146 Jul 01 10:49:25.566913 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2383/4848] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:25 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:26.100766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:26.111834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:26.118699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:26.136557 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4df1a69e-bb9b-4b25-ac0e-53084802e905 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.772895 Jul 01 10:49:26.136557 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2466/4849] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:25 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:26.270965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:26.272171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:26.290233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:26.291284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:26.294756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:26.295816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:26.501405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:26.525888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:26.530205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:26.535420 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4f348def-83b6-450a-98ff-b0a0750fbed1 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.266781 Jul 01 10:49:26.550551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2384/4850] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:26 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:26.579079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c0e2f3f-884f-4746-8283-8a38e512586e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f923c29d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:26.674898 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c0e2f3f-884f-4746-8283-8a38e512586e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.104171 Jul 01 10:49:26.675712 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2467/4851] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:26 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:27.145571 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:27.146206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:27.165194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:27.175992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:27.177464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:27.177924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:27.557646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:27.558543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:27.592481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:27.599850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:27.599850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:27.603386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:27.659820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:27.682707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:27.694277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:27.706133 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c009940-ef3e-495e-a94b-1abb93eb51af tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1725 microversion: 2.20 time: 0.556545 Jul 01 10:49:27.706844 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2385/4852] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:27 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1725 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:27.746072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b67009f4-895f-42d5-a928-450972ccc422 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906dc310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:27.850111 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b67009f4-895f-42d5-a928-450972ccc422 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.123644 Jul 01 10:49:27.851636 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2386/4853] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:27 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:27.872944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:27.898953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:27.908640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:27.911347 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-74557bc9-f250-4680-b370-81662522f4d3 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.358533 Jul 01 10:49:27.914004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2468/4854] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:27 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:28.736038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:28.736989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:28.739217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7c91f1ed-fd3e-416c-93ea-68dd867257fb req-a4fd6933-4579-414b-a440-21c39667400e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412c198b-5665-41d2-b3b3-7f4f261bdc4d", "name": "network-vif-deleted", "tag": "0727876c-19b5-4bcb-ab26-44c896d39b54"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:28.766270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:28.768368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:28.772138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:28.777990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:28.785284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7c91f1ed-fd3e-416c-93ea-68dd867257fb req-a4fd6933-4579-414b-a440-21c39667400e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:28.785284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7c91f1ed-fd3e-416c-93ea-68dd867257fb req-a4fd6933-4579-414b-a440-21c39667400e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:28.820141 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7c91f1ed-fd3e-416c-93ea-68dd867257fb req-a4fd6933-4579-414b-a440-21c39667400e service nova] Creating event network-vif-deleted:0727876c-19b5-4bcb-ab26-44c896d39b54 for instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d on n-h1-master-1 Jul 01 10:49:28.840122 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7c91f1ed-fd3e-416c-93ea-68dd867257fb req-a4fd6933-4579-414b-a440-21c39667400e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115731 Jul 01 10:49:28.843382 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2387/4855] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:28.877869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66efdd4c-9d60-4bce-8f2f-03f8f839422b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f9072c550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:28.962009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:28.994753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:28.998324 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66efdd4c-9d60-4bce-8f2f-03f8f839422b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.137559 Jul 01 10:49:29.005188 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2388/4856] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:28 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:29.007361 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:29.012490 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4dad2350-b762-43b8-a4b7-ff5f62a841b1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 200 len: 1657 microversion: 2.20 time: 0.287546 Jul 01 10:49:29.014653 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2469/4857] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:28 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 1657 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:29.015438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:29.016485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:29.032174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:29.032617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:29.033435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:29.033866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:29.192456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:29.210245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:29.218031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:29.219397 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b686c684-05b0-4e01-bc63-ad8236ed12cf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.214212 Jul 01 10:49:29.219984 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2389/4858] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:28 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:29.561752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e7c82e9-4322-4d9d-97d3-15569b30605d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "657657da-12b0-412a-a3a3-ba67de36992b"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:29.562918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e7c82e9-4322-4d9d-97d3-15569b30605d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:29.577868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7c82e9-4322-4d9d-97d3-15569b30605d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:29.583182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7c82e9-4322-4d9d-97d3-15569b30605d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:29.587134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7c82e9-4322-4d9d-97d3-15569b30605d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:29.595792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7c82e9-4322-4d9d-97d3-15569b30605d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:30.013421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-deaf392c-e7d0-4653-ae7a-84c3598ea1ab tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906ce160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:30.151766 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-deaf392c-e7d0-4653-ae7a-84c3598ea1ab tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.142339 Jul 01 10:49:30.152444 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2390/4859] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:30 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:30.171269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:30.178801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:30.206617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:30.207089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:30.213475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:30.213928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:30.240992 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] HTTP exception thrown: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Request method failure captured: Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d HTTP/1.1 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtBNVSI7E6QNENLDwCq98oPEnnwP9hJgc_nUV_llhNljAE-QW2hVbk9kRdTcV5hIDXYPCsCHV-dsyJZmig1HkLbyURn5FrxAuOvEbKca3uMy7vvP2lkSQIM89j_VwbVyvxaFEQdppuyswB5NI-jcTFyUCtI0hGfawWabVPbKh77ABao Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e18843e9062a4e72a41c2ed4b433341a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 899c57c8434e49d08e5c73a1baf5069b Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '412c198b-5665-41d2-b3b3-7f4f261bdc4d'} Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:30.246675 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:49:30.250955 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:30.263971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Returning 404 to user: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:49:30.263971 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3551185a-a4ef-4e19-bb5f-31fa7e7767b8 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 404 len: 111 microversion: 2.20 time: 0.101294 Jul 01 10:49:30.263971 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2391/4860] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:30 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:49:30.278136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:30.282171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:30.292466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:30.292962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:30.305666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:30.312943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:30.432851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:30.443675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:30.445312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:30.446476 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61cca0fe-e8a4-4adb-8c8c-f7dbe5f6a173 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.180610 Jul 01 10:49:30.448373 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2392/4861] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:30 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:30.484611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-504040c8-2ca9-4d4a-b9e7-5bad2f37ab5f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '.version_select at 0x7f6f91f56670>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:30.643330 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-504040c8-2ca9-4d4a-b9e7-5bad2f37ab5f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333839250" status: 204 len: 0 microversion: 2.20 time: 0.193807 Jul 01 10:49:30.644598 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2393/4862] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Jul 1 10:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333839250 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:49:30.997518 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e7c82e9-4322-4d9d-97d3-15569b30605d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.439426 Jul 01 10:49:31.002613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2470/4863] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:49:29 2022] POST /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments => generated 194 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:31.166252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de08e2d0-892e-4bf5-949f-9ed10863246a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906ffaf0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:31.288117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de08e2d0-892e-4bf5-949f-9ed10863246a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.126838 Jul 01 10:49:31.293774 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2394/4864] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:31 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:31.468790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:31.469580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:31.492090 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=74 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:31.519251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:31.520850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:31.521741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:31.530982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:31.878449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:31.888887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:31.890453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:31.898754 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-185c36c7-6603-4c47-b820-0c7f0ac01860 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.436014 Jul 01 10:49:31.914616 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2471/4865] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:31 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:32.314030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-772ad598-f7c7-4f45-bfc5-49448d5b9b6f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91e46700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:32.412149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-67e57ee8-0832-41c4-8c61-d8d742c98506 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'create', calling method: .version_select at 0x7f6f91dd0820>, body: {"keypair": {"name": "tempest-keypair-657927438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFofPmaHYzaQLNPcd4kZzBA1W91c1u4F4ZwLVjfRV/U+vcvDgu/cyqxFDzjvvuKobAxjSBGJio+q1ea/M7njV92dK7a8VhEednUrroIwYFNIGR5OhjD1cBHoF94RF2PmQ=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:32.473764 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-772ad598-f7c7-4f45-bfc5-49448d5b9b6f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.169991 Jul 01 10:49:32.474726 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2395/4866] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:32 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:32.484567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-67e57ee8-0832-41c4-8c61-d8d742c98506 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for project e18843e9062a4e72a41c2ed4b433341a. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:49:32.500062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-67e57ee8-0832-41c4-8c61-d8d742c98506 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for user 899c57c8434e49d08e5c73a1baf5069b and project e18843e9062a4e72a41c2ed4b433341a. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:49:32.688161 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-67e57ee8-0832-41c4-8c61-d8d742c98506 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.280203 Jul 01 10:49:32.689404 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2472/4867] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:49:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 01 10:49:32.920612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:32.926036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:32.926036 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:32.937286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:32.947388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:32.953480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:32.953946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:33.226029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:33.240676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:33.246014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:33.250913 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca70a288-f24a-4ed8-aa4a-7760e086314b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.334240 Jul 01 10:49:33.259062 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2396/4868] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:32 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:33.490106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80b04dac-81b4-4a39-8fb5-70a8209375aa tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90c2da60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:33.619604 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80b04dac-81b4-4a39-8fb5-70a8209375aa tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.133729 Jul 01 10:49:33.631046 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2473/4869] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:33 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:34.276015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:34.277322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:34.304645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:34.310058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:34.314448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:34.317634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:34.652161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3b967215-0350-44e0-9160-3e1312e6e695 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91dd0af0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:34.753580 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3b967215-0350-44e0-9160-3e1312e6e695 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.113352 Jul 01 10:49:34.754497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2474/4870] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:34 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:34.964141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:34.998910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:35.001594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:35.008430 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc5f8791-b997-4eec-8954-abad44c41cf4 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.738176 Jul 01 10:49:35.013802 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2397/4871] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:34 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:35.768982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f0f4b23-c8b1-4535-bf62-ae8bdc017d65 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91b1e1f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:36.008353 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f0f4b23-c8b1-4535-bf62-ae8bdc017d65 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.241984 Jul 01 10:49:36.024021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2475/4872] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:35 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:36.036988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:36.043414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:36.090452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:36.122470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:36.130559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:36.141973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:36.378103 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:36.738460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:36.793082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:36.801126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:36.808860 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8f0158c-9120-47a1-be10-8046052fe2ea tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1366 microversion: 2.47 time: 0.773390 Jul 01 10:49:36.810036 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2398/4873] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:36 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1366 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:37.095960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1bb5f5a5-aa31-4e06-ad3e-68fe737d233c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91dd01f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:37.102111 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1bb5f5a5-aa31-4e06-ad3e-68fe737d233c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.078745 Jul 01 10:49:37.108830 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2476/4874] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:37 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:37.829508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:37.830305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:37.845965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:37.849999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:37.853685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:37.854179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:38.057873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:38.066960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:38.074271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:38.080427 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8422918e-1edb-4168-921d-b6abc6453db0 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1372 microversion: 2.47 time: 0.255785 Jul 01 10:49:38.108485 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2399/4875] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:37 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:38.119147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-225f7d72-e924-47d7-8dc0-762f268fc21c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f92147160>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:38.189105 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-225f7d72-e924-47d7-8dc0-762f268fc21c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.077100 Jul 01 10:49:38.190417 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2477/4876] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:38 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:39.022998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1748527893", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ddca155-c4d6-4a43-bb26-27af9de9ec83"}], "security_groups": [{"name": "tempest-securitygroup--1572651067"}], "key_name": "tempest-keypair-657927438", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:39.123609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:39.125030 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:39.146600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:39.146600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:39.150730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:39.151473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:39.860914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:39.881579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:39.895563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:39.896949 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23a2a4da-c39f-4640-8bbf-df18d3ed4465 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1372 microversion: 2.47 time: 0.785257 Jul 01 10:49:39.897577 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2478/4877] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:39 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1372 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:39.971006 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f808e33-aa6c-49fa-9875-a80e76b58b1c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91ea4dc0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:40.065061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] validate_networks() for [('0ddca155-c4d6-4a43-bb26-27af9de9ec83', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:49:40.096288 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f808e33-aa6c-49fa-9875-a80e76b58b1c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.140598 Jul 01 10:49:40.099511 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2479/4878] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:39 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:40.935829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:40.936459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:40.966080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:40.966574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:40.967429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:40.967880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:41.347150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:41.356432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:41.370663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:41.372044 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0fd815c5-4b75-4a6a-828c-154195cbbed9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1357 microversion: 2.47 time: 0.441403 Jul 01 10:49:41.381470 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2480/4879] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:40 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1357 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:41.401577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d0ab9466-4dee-4687-ba02-36f850811189 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91213940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:41.507835 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d0ab9466-4dee-4687-ba02-36f850811189 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.125148 Jul 01 10:49:41.516894 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2481/4880] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:41 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:41.536038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:41.536038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:41.553672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Searching by: {'deleted': False, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:49:41.576379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:41.576941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:41.586023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:41.587849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:41.952956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:49:41.953438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:49:41.953906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:49:41.954322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:49:41.954736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:49:41.972737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:41.978632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:41.979727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:41.984918 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:42.097470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for project e18843e9062a4e72a41c2ed4b433341a. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:49:42.135802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Getting quotas for user 899c57c8434e49d08e5c73a1baf5069b and project e18843e9062a4e72a41c2ed4b433341a. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:49:42.152468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:49:42.243294 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:49:42.255142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:49:42.361397 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:42.392597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:42.414985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:42.418859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:42.454606 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dcba9114-91d3-426d-997c-cf981bef1d9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.434913 Jul 01 10:49:42.455719 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2400/4881] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Jul 1 10:49:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 3438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:49:42.465603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:42.468172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:42.475649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-631f1aec-5aa9-44d6-bfea-e2c36ab99607 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:42.479422 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-631f1aec-5aa9-44d6-bfea-e2c36ab99607 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:42.597307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab711af1-9cf0-47bf-9d37-b12e3fd1a476 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 1.079049 Jul 01 10:49:42.598072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2482/4882] 10.222.0.23 () {60 vars in 1186 bytes} [Fri Jul 1 10:49:41 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:42.604191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-540f2a13-c734-41a7-81c8-d5645e31bd77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f9223c1f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:42.718487 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-540f2a13-c734-41a7-81c8-d5645e31bd77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.118371 Jul 01 10:49:42.725958 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2483/4883] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:42 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:42.741821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:42.744870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:42.765668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:42.766127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:42.766926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:42.767368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:42.774881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-631f1aec-5aa9-44d6-bfea-e2c36ab99607 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:42.803586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-631f1aec-5aa9-44d6-bfea-e2c36ab99607 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:42.803586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-631f1aec-5aa9-44d6-bfea-e2c36ab99607 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:42.803586 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-631f1aec-5aa9-44d6-bfea-e2c36ab99607 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1281 microversion: 2.20 time: 0.341320 Jul 01 10:49:42.815289 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2401/4884] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:42 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1281 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:42.833543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:49:43.212237 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-69386c59-e695-4d2f-a622-02bc9f185ae9 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 204 len: 0 microversion: 2.47 time: 0.484829 Jul 01 10:49:43.212864 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2484/4885] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:49:42 2022] DELETE /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:49:43.223235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:43.224807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:43.243201 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:43.245539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:43.247073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:43.248629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:43.504156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:43.523654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:43.533850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:43.536753 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a9e1404-7f3d-4163-87ea-5db33213abaf tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1363 microversion: 2.47 time: 0.319236 Jul 01 10:49:43.541477 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2402/4886] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:43 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:43.735052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7eacf8a1-ea3e-4399-9305-fd574b6280f1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91ad9ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:43.831461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6320c668-13df-4391-9aa8-9ca83d64cbab tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:43.838622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6320c668-13df-4391-9aa8-9ca83d64cbab tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:43.846001 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7eacf8a1-ea3e-4399-9305-fd574b6280f1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.113034 Jul 01 10:49:43.856376 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2485/4887] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:43 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:44.122497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6320c668-13df-4391-9aa8-9ca83d64cbab tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:44.145918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6320c668-13df-4391-9aa8-9ca83d64cbab tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:44.156647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6320c668-13df-4391-9aa8-9ca83d64cbab tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:44.163677 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6320c668-13df-4391-9aa8-9ca83d64cbab tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1281 microversion: 2.20 time: 0.335776 Jul 01 10:49:44.166197 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2403/4888] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:43 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:44.560561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:44.562125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:44.584218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:44.586832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:44.588241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:44.590959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:44.756315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:44.770226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:44.774201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:44.783058 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5ef8a45-3c33-4c13-9eb5-c39a57be8a70 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1363 microversion: 2.47 time: 0.224674 Jul 01 10:49:44.784287 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2486/4889] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:44 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:44.870891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9ff31381-7df6-4f44-84f4-5738d49769a9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f9069b700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:44.984462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9ff31381-7df6-4f44-84f4-5738d49769a9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.124429 Jul 01 10:49:44.994015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2404/4890] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:44 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:45.187407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:45.188402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:45.203290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:45.204967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:45.207640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:45.209395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:45.382003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:45.403943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:45.405657 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:45.407122 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4899a895-c4aa-4606-8fb7-38a081ad2c08 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1333 microversion: 2.20 time: 0.225051 Jul 01 10:49:45.407836 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2487/4891] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:45 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1333 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:45.802765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:45.805284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:45.818543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:45.824719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:45.824719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:45.824719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:46.002478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b07bfa7-717d-480e-95e8-08602ee6b9ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f913a0430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:46.108242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:46.141816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:46.141816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:46.194128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b07bfa7-717d-480e-95e8-08602ee6b9ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.196987 Jul 01 10:49:46.195397 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc420dba-8fae-4b3a-aa57-efe45c173692 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1363 microversion: 2.47 time: 0.387621 Jul 01 10:49:46.203220 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2488/4892] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:45 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:46.216205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2405/4893] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:45 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:46.426059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:46.426702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:46.439853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:46.440486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:46.441306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:46.447446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:46.685613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:46.727032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:46.729165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:46.759126 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ffa07bb8-6a42-4514-a801-456d58763d21 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1351 microversion: 2.20 time: 0.328907 Jul 01 10:49:46.760403 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2489/4894] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:46 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1351 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:47.222038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bc49ea3-fd45-4f31-8a13-11cc7ddfee68 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90688a60>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:47.222652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:47.223283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:47.235351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:47.247950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:47.250105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:47.250747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:47.363037 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bc49ea3-fd45-4f31-8a13-11cc7ddfee68 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.154528 Jul 01 10:49:47.370538 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2406/4895] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:47 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:47.474561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:47.474561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:47.474561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lazy-loading 'fault' on Instance uuid 346ab603-c619-40a4-a48a-5720ad5d4017 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:49:47.518165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:47.528787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:47.531048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:47.534567 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-475b294b-3801-4296-be38-9b8620b8b136 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 200 len: 1368 microversion: 2.47 time: 0.316437 Jul 01 10:49:47.553131 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2490/4896] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:47 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:47.782444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:47.783833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:47.806546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:47.807441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:47.808388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:47.808823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:48.305484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:48.321291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:48.327372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:48.327372 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-621a40a8-d70e-4d32-99cf-a3d963eca344 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1339 microversion: 2.20 time: 0.549939 Jul 01 10:49:48.337401 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2407/4897] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:47 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1339 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:48.388434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a713bac2-4487-47ff-894a-b9b1be857bda tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91c22ee0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:48.498600 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a713bac2-4487-47ff-894a-b9b1be857bda tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.114624 Jul 01 10:49:48.499815 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2491/4898] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:48 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:48.560602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:48.561249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: 346ab603-c619-40a4-a48a-5720ad5d4017] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:48.568775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:48.569256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:48.570034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:48.580958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:48.623412 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] HTTP exception thrown: Instance 346ab603-c619-40a4-a48a-5720ad5d4017 could not be found. Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Request method failure captured: Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 HTTP/1.1 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEUuKa0mbYIztAmqfMYm-SJi0eYVnnK_JFhSZ8FSOxYqcXg1pdrTBpJR2Lqknk2LeaX14vJMglEgBQBDHRG1TN6bsVDOa5CO5jg0IIS6AsyIOkxn9c_C3BD3yEU2oiOeAChn9KQYd8mn09Uh46zBmt1HFUK-L-x3TdbhozxQVCIfr0 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.47 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: a2a1f8d2ac454ab6a1d0bf8c57767100 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerShowV247Test-681706795 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2a1f8d2ac454ab6a1d0bf8c57767100"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a2a1f8d2ac454ab6a1d0bf8c57767100"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a2a1f8d2ac454ab6a1d0bf8c57767100", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2a1f8d2ac454ab6a1d0bf8c57767100"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerShowV247Test-681706795 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: a2a1f8d2ac454ab6a1d0bf8c57767100 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerShowV247Test-681706795 Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerShowV247Test-681706795-project Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9cca5ebb6e4546a790eebe8b58918faf Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerShowV247Test-681706795-project Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 346ab603-c619-40a4-a48a-5720ad5d4017 could not be found. Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '346ab603-c619-40a4-a48a-5720ad5d4017'} Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 346ab603-c619-40a4-a48a-5720ad5d4017 could not be found. Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 346ab603-c619-40a4-a48a-5720ad5d4017 could not be found. Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:48.626559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:48.631384 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:48.631384 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:48.631384 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:48.631384 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:49:48.631384 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:49:48.631384 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 346ab603-c619-40a4-a48a-5720ad5d4017 could not be found. Jul 01 10:49:48.631384 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:48.655897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Returning 404 to user: Instance 346ab603-c619-40a4-a48a-5720ad5d4017 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:49:48.656872 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c597e27-c1f7-4cfb-8d94-a49a3b0733e2 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017" status: 404 len: 111 microversion: 2.47 time: 0.100677 Jul 01 10:49:48.657530 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2408/4899] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:48 2022] GET /compute/v2.1/servers/346ab603-c619-40a4-a48a-5720ad5d4017 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:49:48.666488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:48.666995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:48.674216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:48.674669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:48.675470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:48.693668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:48.813370 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:49:49.335755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-67522639-46a3-4a7e-a840-fa40b84f79f7 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3" status: 204 len: 0 microversion: 2.47 time: 0.673659 Jul 01 10:49:49.336659 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2492/4900] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:49:48 2022] DELETE /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:49:49.345956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:49.346334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:49.364206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:49.365047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:49.373716 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:49.382816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:49.385077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:49.386779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:49.391813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:49.392620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:49.400027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:49.405876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:49.660675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:49.673769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:49.675355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:49.678530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a518a912-6ea3-4752-85d6-655a1aecf858 tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3" status: 200 len: 1363 microversion: 2.47 time: 0.337227 Jul 01 10:49:49.679189 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2409/4901] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:49 2022] GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:49.686454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e776aa85-4c6d-4074-9025-0cad03a8bf4f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f9072cc10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:49.736986 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e776aa85-4c6d-4074-9025-0cad03a8bf4f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1414 microversion: 2.1 time: 0.056143 Jul 01 10:49:49.744512 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2410/4902] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:49 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:50.194928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:50.233993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:50.246422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:50.248884 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-44ab4702-5d2d-413d-a426-75e0bfdd0755 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 0.897878 Jul 01 10:49:50.251857 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2493/4903] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:49 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:50.826115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:50.826115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:50.826115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:50.826115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:50.826115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:50.826115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:50.829476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-561d1cde-5fe0-4479-ae12-07259ec542d7 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91e15550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:50.831878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:50.831878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:50.831878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:50.831878 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e86327bd-dac7-48aa-b9d8-1f88961d03bd tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3" status: 200 len: 1363 microversion: 2.47 time: 0.097514 Jul 01 10:49:50.831878 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2411/4904] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:50 2022] GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3 => generated 1363 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:50.836414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-561d1cde-5fe0-4479-ae12-07259ec542d7 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1423 microversion: 2.1 time: 0.049710 Jul 01 10:49:50.836414 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2494/4905] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:50 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1423 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:49:50.848387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ff597bf-2277-49e3-873b-f5018bf1708c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f9069b670>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:50.949257 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ff597bf-2277-49e3-873b-f5018bf1708c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 200 len: 1423 microversion: 2.1 time: 0.122097 Jul 01 10:49:50.950331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2412/4906] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:49:50 2022] GET /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:50.963412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e143ff55-7140-4eaf-a571-067fc3e218d0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f913a0ca0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:51.280925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:51.282410 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:51.308650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:51.324642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:51.325921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:51.330000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:51.765071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:51.778593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:51.785670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:51.789666 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0eb0857e-b968-47c8-a466-69c184006eff tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 0.519341 Jul 01 10:49:51.802283 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2413/4907] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:51 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:51.826611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:51.827527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:51.846989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:51.846989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:51.846989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:51.846989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:51.930147 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:52.046564 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:52.067316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:52.117517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:52.128642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cca5ebb6e4546a790eebe8b58918faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a1f8d2ac454ab6a1d0bf8c57767100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:52.131289 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-133aa9c4-a8fd-4030-b1a6-199fb81f459a tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3" status: 200 len: 1363 microversion: 2.47 time: 0.311055 Jul 01 10:49:52.135551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2414/4908] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:51 2022] GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3 => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:52.304943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-74b17184-2f1a-4c08-884e-a96902a0306c req-42c69cdf-08ed-4ae9-8610-87e5302b8b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:52.330734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-74b17184-2f1a-4c08-884e-a96902a0306c req-42c69cdf-08ed-4ae9-8610-87e5302b8b73 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:52.333426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-74b17184-2f1a-4c08-884e-a96902a0306c req-42c69cdf-08ed-4ae9-8610-87e5302b8b73 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:52.363522 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-74b17184-2f1a-4c08-884e-a96902a0306c req-42c69cdf-08ed-4ae9-8610-87e5302b8b73 service nova] Creating event network-changed:02113d39-dc23-4aa0-be32-f08c71eda3b2 for instance 5ab1b344-b65d-4f47-9630-08ac6461e289 on n-h2-master-1 Jul 01 10:49:52.389719 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:52.395553 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-74b17184-2f1a-4c08-884e-a96902a0306c req-42c69cdf-08ed-4ae9-8610-87e5302b8b73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094084 Jul 01 10:49:52.398368 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2415/4909] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:49:52.810349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:52.811067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:52.823825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:52.824283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:52.828989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:52.829648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:53.216128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:53.225815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:53.229987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:53.231449 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7f331704-fea3-4b6d-8c15-0c29357f93ea tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 0.425735 Jul 01 10:49:53.232573 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2416/4910] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:52 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:53.237591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:53.238478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] [instance: ea646553-437a-456b-bd6b-a053329c79d3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:53.245314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:53.246055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:53.247084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:53.250308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:53.258710 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e143ff55-7140-4eaf-a571-067fc3e218d0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 204 len: 0 microversion: 2.1 time: 2.296730 Jul 01 10:49:53.258710 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2495/4911] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:50 2022] DELETE /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 0 bytes in 2298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:49:53.267849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:53.267849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:53.279900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:53.279900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:53.279900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:53.279900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:53.297747 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] HTTP exception thrown: Instance ea646553-437a-456b-bd6b-a053329c79d3 could not be found. Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Request method failure captured: Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3 HTTP/1.1 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEUuKa0mbYIztAmqfMYm-SJi0eYVnnK_JFhSZ8FSOxYqcXg1pdrTBpJR2Lqknk2LeaX14vJMglEgBQBDHRG1TN6bsVDOa5CO5jg0IIS6AsyIOkxn9c_C3BD3yEU2oiOeAChn9KQYd8mn09Uh46zBmt1HFUK-L-x3TdbhozxQVCIfr0 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.47 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: a2a1f8d2ac454ab6a1d0bf8c57767100 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerShowV247Test-681706795 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2a1f8d2ac454ab6a1d0bf8c57767100"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a2a1f8d2ac454ab6a1d0bf8c57767100"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a2a1f8d2ac454ab6a1d0bf8c57767100", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2a1f8d2ac454ab6a1d0bf8c57767100"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerShowV247Test-681706795 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: a2a1f8d2ac454ab6a1d0bf8c57767100 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerShowV247Test-681706795 Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerShowV247Test-681706795-project Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9cca5ebb6e4546a790eebe8b58918faf Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerShowV247Test-681706795-project Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: exception: Instance ea646553-437a-456b-bd6b-a053329c79d3 could not be found. Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ea646553-437a-456b-bd6b-a053329c79d3'} Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea646553-437a-456b-bd6b-a053329c79d3 could not be found. Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea646553-437a-456b-bd6b-a053329c79d3 could not be found. Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:49:53.300048 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea646553-437a-456b-bd6b-a053329c79d3 could not be found. Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] Returning 404 to user: Instance ea646553-437a-456b-bd6b-a053329c79d3 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:49:53.304596 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82a6be80-d915-4afd-ae49-7b6f5da4592b tempest-ServerShowV247Test-681706795 tempest-ServerShowV247Test-681706795-project] 10.222.0.23 "GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3" status: 404 len: 111 microversion: 2.47 time: 0.070842 Jul 01 10:49:53.308563 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2417/4912] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:53 2022] GET /compute/v2.1/servers/ea646553-437a-456b-bd6b-a053329c79d3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:49:53.352012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:49:53.841594 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c2eb3f5-e749-417d-ba02-37e08b8622e8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 204 len: 0 microversion: 2.1 time: 0.578231 Jul 01 10:49:53.842760 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2496/4913] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:49:53 2022] DELETE /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:49:54.250288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:54.256497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:54.263551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1209224741", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "0417ff04-b95e-42da-8dd3-bd5150fa1982"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:54.269051 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:49:54.277064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:54.277405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:54.278185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:54.278628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:54.365417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] validate_networks() for [('0417ff04-b95e-42da-8dd3-bd5150fa1982', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:49:55.052999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:55.068439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:55.072037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:55.073771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d6d9fdc-c995-4edd-a4a0-583d34563ead tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 0.827486 Jul 01 10:49:55.074742 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2418/4914] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:54 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:49:55.080714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ac68958-56b9-4a73-beaf-69b0f7393645 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:55.081987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ac68958-56b9-4a73-beaf-69b0f7393645 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:55.091174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ac68958-56b9-4a73-beaf-69b0f7393645 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:55.091750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ac68958-56b9-4a73-beaf-69b0f7393645 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:55.092869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ac68958-56b9-4a73-beaf-69b0f7393645 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:55.093400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ac68958-56b9-4a73-beaf-69b0f7393645 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:55.127231 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ac68958-56b9-4a73-beaf-69b0f7393645 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051010 Jul 01 10:49:55.127792 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2419/4915] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:49:55 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:55.138578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-37a24443-d16b-406e-9fb0-1cbef01a2686 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:55.139694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37a24443-d16b-406e-9fb0-1cbef01a2686 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:55.148387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37a24443-d16b-406e-9fb0-1cbef01a2686 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:55.149868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37a24443-d16b-406e-9fb0-1cbef01a2686 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:55.151181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37a24443-d16b-406e-9fb0-1cbef01a2686 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:55.151808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37a24443-d16b-406e-9fb0-1cbef01a2686 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:55.278276 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-37a24443-d16b-406e-9fb0-1cbef01a2686 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/657657da-12b0-412a-a3a3-ba67de36992b" status: 200 len: 194 microversion: 2.1 time: 0.144272 Jul 01 10:49:55.278907 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2420/4916] 10.222.0.23 () {58 vars in 1412 bytes} [Fri Jul 1 10:49:55 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/657657da-12b0-412a-a3a3-ba67de36992b => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:56.105731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:56.106494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:56.135132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:56.135585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:56.139200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:56.141937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:56.507247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:49:56.508890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:49:56.510395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:49:56.511108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:49:56.511842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:49:56.525593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:56.526399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:56.527448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:56.528112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:56.560424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:49:56.570560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for user be759a44a78544109032556c07b5c868 and project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:49:56.611723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:49:56.621299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:49:56.984262 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-91752462-01b4-4001-afa9-3ce4213d82c3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.723942 Jul 01 10:49:56.988221 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2497/4917] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:49:57.012424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86f06cd6-e290-4b19-ab87-e61529f6b5eb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:57.013121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86f06cd6-e290-4b19-ab87-e61529f6b5eb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:57.240634 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86f06cd6-e290-4b19-ab87-e61529f6b5eb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:57.255303 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86f06cd6-e290-4b19-ab87-e61529f6b5eb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1208 microversion: 2.1 time: 0.259084 Jul 01 10:49:57.269916 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2498/4918] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:56 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1208 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:57.279311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-dc549348-263d-454d-aaa8-99121eabb6d4 req-579c8ad5-9ab7-46ab-a544-1080ca6a937a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205d1cc4-59f7-4959-8d0a-72052c741f2c", "name": "network-vif-unplugged", "status": "completed", "tag": "e3ec33cf-2d3a-4c93-98cc-ff599398b4bf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:57.294887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-dc549348-263d-454d-aaa8-99121eabb6d4 req-579c8ad5-9ab7-46ab-a544-1080ca6a937a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:57.304193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-dc549348-263d-454d-aaa8-99121eabb6d4 req-579c8ad5-9ab7-46ab-a544-1080ca6a937a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:57.304461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:57.316026 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-dc549348-263d-454d-aaa8-99121eabb6d4 req-579c8ad5-9ab7-46ab-a544-1080ca6a937a service nova] Creating event network-vif-unplugged:e3ec33cf-2d3a-4c93-98cc-ff599398b4bf for instance 205d1cc4-59f7-4959-8d0a-72052c741f2c on n-h1-master-1 Jul 01 10:49:57.326550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:57.330190 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-dc549348-263d-454d-aaa8-99121eabb6d4 req-579c8ad5-9ab7-46ab-a544-1080ca6a937a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061114 Jul 01 10:49:57.331198 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2499/4919] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:57.335001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:57.341162 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39f02a37-7d3d-4d8d-8224-c9c17ed8809f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 1.248171 Jul 01 10:49:57.345340 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2421/4920] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:56 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:58.277034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1ec100d5-b0da-4293-8bd4-b74ac802fefe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:58.278276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1ec100d5-b0da-4293-8bd4-b74ac802fefe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:58.367260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:58.369590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:58.469940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:58.470329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:58.471157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:58.471597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:58.653296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1ec100d5-b0da-4293-8bd4-b74ac802fefe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:58.672279 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1ec100d5-b0da-4293-8bd4-b74ac802fefe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1208 microversion: 2.1 time: 0.394616 Jul 01 10:49:58.681675 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2500/4921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:58 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1208 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:49:58.861741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f26c704e-155d-49c8-922a-6e185d8943ac req-d1bf6d9a-8ea0-4104-b675-6f78bb64a6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205d1cc4-59f7-4959-8d0a-72052c741f2c", "name": "network-vif-deleted", "tag": "e3ec33cf-2d3a-4c93-98cc-ff599398b4bf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:58.892695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f26c704e-155d-49c8-922a-6e185d8943ac req-d1bf6d9a-8ea0-4104-b675-6f78bb64a6f6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:58.897781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f26c704e-155d-49c8-922a-6e185d8943ac req-d1bf6d9a-8ea0-4104-b675-6f78bb64a6f6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:58.924897 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f26c704e-155d-49c8-922a-6e185d8943ac req-d1bf6d9a-8ea0-4104-b675-6f78bb64a6f6 service nova] Creating event network-vif-deleted:e3ec33cf-2d3a-4c93-98cc-ff599398b4bf for instance 205d1cc4-59f7-4959-8d0a-72052c741f2c on n-h1-master-1 Jul 01 10:49:58.934698 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f26c704e-155d-49c8-922a-6e185d8943ac req-d1bf6d9a-8ea0-4104-b675-6f78bb64a6f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077411 Jul 01 10:49:58.938738 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2501/4922] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:49:58.948739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:58.961336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:58.964952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:49:58.969941 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-500220a6-94de-4401-a2d5-56995fbe39d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 0.612554 Jul 01 10:49:58.970907 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2422/4923] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:49:58 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:49:59.387921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8b801858-590e-4c4b-a046-8c5e62a2783f req-f3b3b1e1-36ad-4e7d-8609-b32ac27b5f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "name": "network-vif-plugged", "status": "completed", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:59.430996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8b801858-590e-4c4b-a046-8c5e62a2783f req-f3b3b1e1-36ad-4e7d-8609-b32ac27b5f8a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:59.435846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8b801858-590e-4c4b-a046-8c5e62a2783f req-f3b3b1e1-36ad-4e7d-8609-b32ac27b5f8a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:59.459984 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8b801858-590e-4c4b-a046-8c5e62a2783f req-f3b3b1e1-36ad-4e7d-8609-b32ac27b5f8a service nova] Creating event network-vif-plugged:02113d39-dc23-4aa0-be32-f08c71eda3b2 for instance 5ab1b344-b65d-4f47-9630-08ac6461e289 on n-h2-master-1 Jul 01 10:49:59.467701 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8b801858-590e-4c4b-a046-8c5e62a2783f req-f3b3b1e1-36ad-4e7d-8609-b32ac27b5f8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097869 Jul 01 10:49:59.469375 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2502/4924] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:49:59.673199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82ea944f-115d-458e-b052-0f4e0984dd87 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fa7c546-8913-4005-8ed4-63090a285301"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:49:59.675324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82ea944f-115d-458e-b052-0f4e0984dd87 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:59.702779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:49:59.707428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:49:59.714453 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82ea944f-115d-458e-b052-0f4e0984dd87 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:59.717431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82ea944f-115d-458e-b052-0f4e0984dd87 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:59.718779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82ea944f-115d-458e-b052-0f4e0984dd87 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:59.719619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82ea944f-115d-458e-b052-0f4e0984dd87 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:59.721729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:59.722421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:59.726911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:49:59.726911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:49:59.876742 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:00.049553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:00.071078 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:00.074712 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a29a3719-a64d-4ba9-bb2f-9d6c9c4d85a2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1212 microversion: 2.1 time: 0.386410 Jul 01 10:50:00.075794 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2503/4925] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:49:59 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1212 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:00.082000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:00.094644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:00.095248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:00.096094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:00.097103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:00.098548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:00.407631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:00.423175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:00.437202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:00.438456 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 0.361325 Jul 01 10:50:00.439118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2504/4926] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:00 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:50:00.449406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:00.449406 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6c0505f7-77ad-4c8e-bb42-fbada5909217 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001023 Jul 01 10:50:00.449406 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2505/4927] 10.222.0.23 () {56 vars in 885 bytes} [Fri Jul 1 10:50:00 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 01 10:50:01.079082 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82ea944f-115d-458e-b052-0f4e0984dd87 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "POST /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.418268 Jul 01 10:50:01.079701 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2423/4928] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:49:59 2022] POST /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments => generated 194 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:01.092655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:01.093316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:01.111465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:01.113387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:01.122268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:01.122268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:01.329762 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:01.337973 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba127e2e-7c76-4266-96a6-bf54433e6134 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1268 microversion: 2.1 time: 0.249282 Jul 01 10:50:01.345354 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2506/4929] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:01 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:01.457656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:01.458354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:01.466663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:01.474942 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:01.476050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:01.483149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:02.069804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:02.089216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:02.092869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:02.098000 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-60997f79-1f54-4ed5-be3b-d1ae6161b487 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1407 microversion: 2.20 time: 0.642778 Jul 01 10:50:02.101198 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2424/4930] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:01 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1407 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:50:02.355956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:02.356669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:02.359457 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:02.374216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:02.374780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:02.376890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:02.379501 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:02.538943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:02.554824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6c72cb5-9fa8-4d00-9c48-a45bd2734757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1266 microversion: 2.1 time: 0.203705 Jul 01 10:50:02.556029 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2507/4931] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:02 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:03.127743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:03.127743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:03.142899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:03.144527 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:03.147284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:03.147808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:03.573879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:03.574402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:03.594878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:03.599513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:03.599513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:03.599513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:03.706602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:03.719385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:03.721516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:03.724545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c80d316-6a58-4750-bc79-a9d13aaa7372 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1600 microversion: 2.20 time: 0.606546 Jul 01 10:50:03.728556 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2425/4932] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:03 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1600 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:50:03.751747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae4f5fb6-18db-45d3-b432-dd31d3976546 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:03.752667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae4f5fb6-18db-45d3-b432-dd31d3976546 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:03.760604 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:03.762837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae4f5fb6-18db-45d3-b432-dd31d3976546 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:03.777172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae4f5fb6-18db-45d3-b432-dd31d3976546 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:03.779590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae4f5fb6-18db-45d3-b432-dd31d3976546 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:03.780299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae4f5fb6-18db-45d3-b432-dd31d3976546 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:04.223967 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae4f5fb6-18db-45d3-b432-dd31d3976546 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.476158 Jul 01 10:50:04.225275 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2426/4933] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Jul 1 10:50:03 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-interface => generated 285 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:50:04.346382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:04.357607 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7eda94c-bac9-4797-80d0-7a305b6ff05c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.788576 Jul 01 10:50:04.358190 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2508/4934] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:03 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:05.375906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:05.377261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:05.389744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:05.392291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:05.394219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:05.403188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:06.249527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:06.267617 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-890ec95c-6c58-48d8-9931-fe455bb87621 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.896500 Jul 01 10:50:06.268552 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2427/4935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:05 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:06.642568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7f651e36-2bb4-4a71-bb9e-0ecf26dc3b57 req-c1a57961-781c-491d-a610-acaaf57e8aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd57d7c8-7193-40e6-9ffe-232ca63f86cd", "tag": "5d73af2e-d31e-4f5e-b0cd-cc192d38540b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:06.655500 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:06.671586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7f651e36-2bb4-4a71-bb9e-0ecf26dc3b57 req-c1a57961-781c-491d-a610-acaaf57e8aa1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:06.672454 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7f651e36-2bb4-4a71-bb9e-0ecf26dc3b57 req-c1a57961-781c-491d-a610-acaaf57e8aa1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:06.696325 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7f651e36-2bb4-4a71-bb9e-0ecf26dc3b57 req-c1a57961-781c-491d-a610-acaaf57e8aa1 service nova] Creating event network-changed:5d73af2e-d31e-4f5e-b0cd-cc192d38540b for instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd on n-h1-master-1 Jul 01 10:50:06.708088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7f651e36-2bb4-4a71-bb9e-0ecf26dc3b57 req-c1a57961-781c-491d-a610-acaaf57e8aa1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081417 Jul 01 10:50:06.709072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2509/4936] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:06.928038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ae356b2f-9244-4ca0-8790-8329d6133e11 req-5c382f8e-b98a-4fc5-b799-7885b813454f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:06.950638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ae356b2f-9244-4ca0-8790-8329d6133e11 req-5c382f8e-b98a-4fc5-b799-7885b813454f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:06.951102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ae356b2f-9244-4ca0-8790-8329d6133e11 req-5c382f8e-b98a-4fc5-b799-7885b813454f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:06.972713 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ae356b2f-9244-4ca0-8790-8329d6133e11 req-5c382f8e-b98a-4fc5-b799-7885b813454f service nova] Creating event network-changed:02113d39-dc23-4aa0-be32-f08c71eda3b2 for instance 5ab1b344-b65d-4f47-9630-08ac6461e289 on n-h2-master-1 Jul 01 10:50:06.979744 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ae356b2f-9244-4ca0-8790-8329d6133e11 req-5c382f8e-b98a-4fc5-b799-7885b813454f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069165 Jul 01 10:50:06.980883 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2428/4937] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:07.299426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:07.302513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:07.316552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:07.321373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:07.322280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:07.322784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:08.661566 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:08.674680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:08.697254 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-640213b7-6573-4a97-9a5b-a44fe786527e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 1.411487 Jul 01 10:50:08.701442 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2510/4938] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:07 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:09.717774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:09.718993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:09.731242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:09.733023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:09.734008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:09.735648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:09.880810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f967dccd-013b-41d4-a02b-c8b84aea4d85 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f91e57c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:09.990357 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f967dccd-013b-41d4-a02b-c8b84aea4d85 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0430df36-fafc-4223-9971-9e52fdd8d2e0" status: 200 len: 351 microversion: 2.1 time: 0.116377 Jul 01 10:50:09.991284 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2511/4939] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:50:09 2022] GET /compute/v2.1/os-volumes/0430df36-fafc-4223-9971-9e52fdd8d2e0 => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:50:10.304156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:10.319389 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d329aca-0473-42b4-b615-4b4140518d73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.605210 Jul 01 10:50:10.326423 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2429/4940] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:09 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:11.341958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:11.343189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:11.351669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:11.352414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:11.353397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:11.354010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:11.580379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:11.595856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e98d6c5b-5cfa-480f-a418-a70061886917 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.259275 Jul 01 10:50:11.596449 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2512/4941] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:11 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:12.613837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:12.625276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:12.625276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:12.625276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:12.625276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:12.625904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:12.957253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:12.967516 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a76500e3-3310-450d-bf6d-342d0838f0be tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.357944 Jul 01 10:50:12.968714 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2430/4942] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:12 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:13.503147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-960b70fe-340e-4e21-8174-28b0572f6d44 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f91e578b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:13.604724 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-960b70fe-340e-4e21-8174-28b0572f6d44 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ecad8e70-0321-4f74-9daa-e67c94510c0d" status: 200 len: 351 microversion: 2.1 time: 0.105440 Jul 01 10:50:13.606004 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2513/4943] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:50:13 2022] GET /compute/v2.1/os-volumes/ecad8e70-0321-4f74-9daa-e67c94510c0d => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:13.985753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:13.986365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:14.007979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:14.008429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:14.021320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:14.022186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:14.321889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:14.333038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bddb8195-d597-4471-ae7b-76f458daf159 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.351336 Jul 01 10:50:14.334221 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2431/4944] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:13 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:15.351665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:15.352225 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:15.377182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:15.384978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:15.389805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:15.390984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:15.704593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:15.739711 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-538e7e1e-a0e1-4c97-a817-c361e5239e77 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.392027 Jul 01 10:50:15.751643 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2514/4945] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:15 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:16.760246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:16.760853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:16.773178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:16.781575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:16.783600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:16.784380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:16.837713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d21e05bb-b9c2-4050-adcc-e8cc1d52d4e9 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f9709d4c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:16.961101 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d21e05bb-b9c2-4050-adcc-e8cc1d52d4e9 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/45be1089-5e63-41be-8991-6b6882bc0bcf" status: 200 len: 351 microversion: 2.1 time: 0.127813 Jul 01 10:50:16.961807 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2515/4946] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:50:16 2022] GET /compute/v2.1/os-volumes/45be1089-5e63-41be-8991-6b6882bc0bcf => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:50:16.973915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-afe9157b-c941-42d3-a179-2f7a31f45b40 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f92426670>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:17.158512 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-afe9157b-c941-42d3-a179-2f7a31f45b40 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.188654 Jul 01 10:50:17.159090 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2516/4947] 10.222.0.23 () {58 vars in 1133 bytes} [Fri Jul 1 10:50:16 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:17.170585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-30d9e3e2-bb77-4763-ad8a-63ebc3fcd9f9 req-6b961154-8823-43d1-afbb-e0ae5f9b78ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd57d7c8-7193-40e6-9ffe-232ca63f86cd", "name": "network-vif-plugged", "status": "completed", "tag": "5d73af2e-d31e-4f5e-b0cd-cc192d38540b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:17.203023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-30d9e3e2-bb77-4763-ad8a-63ebc3fcd9f9 req-6b961154-8823-43d1-afbb-e0ae5f9b78ff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:17.209234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-30d9e3e2-bb77-4763-ad8a-63ebc3fcd9f9 req-6b961154-8823-43d1-afbb-e0ae5f9b78ff service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:17.228116 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-30d9e3e2-bb77-4763-ad8a-63ebc3fcd9f9 req-6b961154-8823-43d1-afbb-e0ae5f9b78ff service nova] Creating event network-vif-plugged:5d73af2e-d31e-4f5e-b0cd-cc192d38540b for instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd on n-h1-master-1 Jul 01 10:50:17.243758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-30d9e3e2-bb77-4763-ad8a-63ebc3fcd9f9 req-6b961154-8823-43d1-afbb-e0ae5f9b78ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081688 Jul 01 10:50:17.244450 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2517/4948] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:17.253603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e65fe0fa-954e-47b7-8fc5-dc398b6c5d17 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f923c2940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:17.382414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e65fe0fa-954e-47b7-8fc5-dc398b6c5d17 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.136772 Jul 01 10:50:17.383704 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2518/4949] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Jul 1 10:50:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:17.397699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2beeaa6-db03-47e1-984b-3cb2ef274ab9 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f91e70940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:17.590380 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2beeaa6-db03-47e1-984b-3cb2ef274ab9 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.196430 Jul 01 10:50:17.591738 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2519/4950] 10.222.0.23 () {58 vars in 1133 bytes} [Fri Jul 1 10:50:17 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:17.606459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab96a00e-c48f-43ca-b6ef-1910db2f813d tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f91ea4040>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:17.781455 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab96a00e-c48f-43ca-b6ef-1910db2f813d tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.182212 Jul 01 10:50:17.782077 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2520/4951] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Jul 1 10:50:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:50:17.795352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b94f7308-55f2-4bff-9a60-18e38e25677c tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f9219f820>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:17.873854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:17.901601 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d661cca-947a-4d82-aef2-bcd17b55fc3b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 1.144780 Jul 01 10:50:17.904575 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2432/4952] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:16 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:18.011836 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b94f7308-55f2-4bff-9a60-18e38e25677c tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.220415 Jul 01 10:50:18.013249 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2521/4953] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Jul 1 10:50:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:50:18.029041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7add4cf-d1af-474c-a02a-0e00af91d6e1 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f906459d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:18.162833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c7add4cf-d1af-474c-a02a-0e00af91d6e1 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.140298 Jul 01 10:50:18.163746 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2433/4954] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:50:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:18.175841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2eda9862-f210-4636-9d8b-53c78514584e tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f9709dc10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:18.294738 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2eda9862-f210-4636-9d8b-53c78514584e tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.122690 Jul 01 10:50:18.307791 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2522/4955] 10.222.0.23 () {58 vars in 1187 bytes} [Fri Jul 1 10:50:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:18.322551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6b55e350-ff2b-483f-9a6d-5fc9921c4bc5 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] Calling method '.version_select at 0x7f6f906dc1f0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:18.431696 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6b55e350-ff2b-483f-9a6d-5fc9921c4bc5 tempest-VolumesTestJSON-1016847300 tempest-VolumesTestJSON-1016847300-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.116131 Jul 01 10:50:18.432372 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2434/4956] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 10:50:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:18.919626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:18.920630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:18.953899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:18.953899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:18.953899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:18.953899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:19.066532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eda11362-0105-40e5-bd66-2bafc4ea872e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:19.069307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eda11362-0105-40e5-bd66-2bafc4ea872e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:19.075595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eda11362-0105-40e5-bd66-2bafc4ea872e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:19.076127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eda11362-0105-40e5-bd66-2bafc4ea872e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:19.076982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eda11362-0105-40e5-bd66-2bafc4ea872e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:19.080936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eda11362-0105-40e5-bd66-2bafc4ea872e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:19.186558 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eda11362-0105-40e5-bd66-2bafc4ea872e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.114988 Jul 01 10:50:19.188607 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2435/4957] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:50:19 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:19.331979 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:19.339847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8434bcc-cc0b-4047-97c1-b294c3838eec tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:19.341023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c8434bcc-cc0b-4047-97c1-b294c3838eec tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:19.346462 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d6e517a-f738-4bd3-b1b6-f7ee822450f4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1308 microversion: 2.1 time: 0.427524 Jul 01 10:50:19.360599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8434bcc-cc0b-4047-97c1-b294c3838eec tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:19.360839 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2523/4958] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:18 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:19.360981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8434bcc-cc0b-4047-97c1-b294c3838eec tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:19.360981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8434bcc-cc0b-4047-97c1-b294c3838eec tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:19.360981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c8434bcc-cc0b-4047-97c1-b294c3838eec tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:19.489523 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8434bcc-cc0b-4047-97c1-b294c3838eec tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/657657da-12b0-412a-a3a3-ba67de36992b" status: 200 len: 194 microversion: 2.1 time: 0.155331 Jul 01 10:50:19.490137 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2436/4959] 10.222.0.23 () {58 vars in 1412 bytes} [Fri Jul 1 10:50:19 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/657657da-12b0-412a-a3a3-ba67de36992b => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:19.500604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:19.504923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:19.517819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:19.518294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:19.519095 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:19.519544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:19.715716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lazy-loading 'services' on Instance uuid ee8dc684-eeda-4cd7-9772-b6ab10e3f722 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:50:20.051020 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1aa5250d-382c-4d77-b216-f13ea55e1a31 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/657657da-12b0-412a-a3a3-ba67de36992b" status: 202 len: 0 microversion: 2.1 time: 0.554741 Jul 01 10:50:20.053989 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2524/4960] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:50:19 2022] DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/657657da-12b0-412a-a3a3-ba67de36992b => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:50:20.368044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:20.371157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:20.382933 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:20.386357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:20.387796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:20.391627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:20.614329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:20.633117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1bb74492-0a9c-4765-9b68-51799c98ff05 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1487 microversion: 2.1 time: 0.263262 Jul 01 10:50:20.635147 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2437/4961] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:20 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:20.665490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5313655d-9d65-4c6c-af66-693d564f3ff2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:20.675709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5313655d-9d65-4c6c-af66-693d564f3ff2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:20.677204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5313655d-9d65-4c6c-af66-693d564f3ff2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:20.703298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5313655d-9d65-4c6c-af66-693d564f3ff2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Going to try to stop instance {{(pid=119764) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 10:50:20.940479 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5313655d-9d65-4c6c-af66-693d564f3ff2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd/action" status: 202 len: 0 microversion: 2.1 time: 0.282673 Jul 01 10:50:20.941238 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2525/4962] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:50:20 2022] POST /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:50:20.950748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:20.951473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:20.957976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:20.965796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:20.966754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:20.967211 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:21.300575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:21.317720 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5549914e-94f5-4342-aad7-6377e9f0d619 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.362824 Jul 01 10:50:21.317720 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2438/4963] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:20 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:22.354975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:22.356761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:22.382068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:22.382068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:22.386397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:22.387238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:22.724183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:22.731456 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-32ae9429-0cb7-48c9-9d44-d59178bc5e13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.396373 Jul 01 10:50:22.732530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2526/4964] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:22 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:23.754783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:23.756042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:23.780998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:23.793534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:23.794830 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:23.795542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:24.246418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:24.254539 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c78b78ad-9b9b-4369-8ba6-25d318148772 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.506721 Jul 01 10:50:24.255119 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2439/4965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:23 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:25.273236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:25.274589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:25.306739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:25.312002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:25.312967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:25.320959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:25.783189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:25.798087 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f7ca123-b2a5-406d-81c0-c203c3f38a91 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.529703 Jul 01 10:50:25.802503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2527/4966] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:25 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:26.819098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:26.826186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:26.856110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:26.859216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:26.863319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:26.864445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:27.288834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:27.301431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-916eb374-72d0-4ba4-982d-6e573d38afae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.486561 Jul 01 10:50:27.302014 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2440/4967] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:26 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:28.332087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:28.332087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:28.339693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:28.340328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:28.341119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:28.341595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:28.722025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:28.735337 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7aad0a2d-1e6b-4002-b178-03297b86bf73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.419813 Jul 01 10:50:28.740018 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2528/4968] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:28 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:29.280320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa5842bd-c69d-489e-aad9-d2267b96cf74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:29.280837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa5842bd-c69d-489e-aad9-d2267b96cf74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:29.316010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa5842bd-c69d-489e-aad9-d2267b96cf74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:29.316652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa5842bd-c69d-489e-aad9-d2267b96cf74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:29.325952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa5842bd-c69d-489e-aad9-d2267b96cf74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:29.326736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa5842bd-c69d-489e-aad9-d2267b96cf74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:29.437993 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa5842bd-c69d-489e-aad9-d2267b96cf74 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/4fa7c546-8913-4005-8ed4-63090a285301" status: 200 len: 194 microversion: 2.1 time: 0.161741 Jul 01 10:50:29.438938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2441/4969] 10.222.0.23 () {58 vars in 1412 bytes} [Fri Jul 1 10:50:29 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/4fa7c546-8913-4005-8ed4-63090a285301 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:29.449455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:29.449984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:29.467768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:29.468226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:29.476125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:29.476908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:29.759652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:29.760266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:29.777640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lazy-loading 'services' on Instance uuid ee8dc684-eeda-4cd7-9772-b6ab10e3f722 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:50:29.787507 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:29.788064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:29.788811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:29.789852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:29.795246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:29.817735 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:30.128689 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9d76400-a59e-4ae1-94c1-4eb0a0d768d1 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/4fa7c546-8913-4005-8ed4-63090a285301" status: 202 len: 0 microversion: 2.1 time: 0.683999 Jul 01 10:50:30.129954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2529/4970] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:50:29 2022] DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments/4fa7c546-8913-4005-8ed4-63090a285301 => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:50:30.172472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:30.182712 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e41fdf15-f44c-4934-8b45-a97c0c7acd2b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.427312 Jul 01 10:50:30.184778 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2442/4971] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:29 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:31.201650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:31.202980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:31.217693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:31.233091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:31.235335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:31.235786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:31.636637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:31.651033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eaf8e86a-c335-4f2a-a73b-86be89b344dc tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.454285 Jul 01 10:50:31.651711 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2530/4972] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:31 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:32.677503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:32.677503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:32.688385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:32.688836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:32.691955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:32.692399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:33.058305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:33.070358 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-378f189c-007c-48a2-aa4d-7ad3bff3be55 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.403834 Jul 01 10:50:33.070588 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2443/4973] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:32 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:34.098795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:34.099706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:34.108886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:34.109375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:34.110211 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:34.110651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:34.529473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:34.537565 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6c2ad57e-c47b-437f-ba7c-c0b2d14cf9a0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.453137 Jul 01 10:50:34.543125 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2531/4974] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:34 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:35.562815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:35.563450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:35.586233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:35.591393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:35.591393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:35.593240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:36.072544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:36.083227 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1388796-2f90-4999-920c-3274cd311a96 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.527318 Jul 01 10:50:36.084970 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2444/4975] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:35 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:37.102625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:37.103332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:37.115568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:37.116362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:37.118414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:37.118956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:37.495184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:37.503823 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c2969cb4-2556-4cd9-ae97-1ccc28617bb9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.406301 Jul 01 10:50:37.512569 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2532/4976] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:37 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:38.520896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:38.521553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:38.526007 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=34 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:38.539193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:38.539584 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:38.540568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:38.541203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:38.787048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:38.796234 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-772e14b1-e225-49d0-be99-544182875e46 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.279063 Jul 01 10:50:38.799859 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2445/4977] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:38 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:50:39.677485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c21c24fe-914e-4a52-a9e8-c845061c967e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:39.678948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c21c24fe-914e-4a52-a9e8-c845061c967e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:39.682956 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:39.691778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c21c24fe-914e-4a52-a9e8-c845061c967e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:39.692467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c21c24fe-914e-4a52-a9e8-c845061c967e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:39.693369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c21c24fe-914e-4a52-a9e8-c845061c967e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:39.693891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c21c24fe-914e-4a52-a9e8-c845061c967e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:39.743444 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c21c24fe-914e-4a52-a9e8-c845061c967e tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071069 Jul 01 10:50:39.744671 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2533/4978] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:50:39 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:50:39.817625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:39.818913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:39.830350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:39.830798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:39.831568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:39.831997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:39.914309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-61a6f4c3-02ff-4b4e-8d99-8a945fc7ca1f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:39.915555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-61a6f4c3-02ff-4b4e-8d99-8a945fc7ca1f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:39.924382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a6f4c3-02ff-4b4e-8d99-8a945fc7ca1f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:39.924831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a6f4c3-02ff-4b4e-8d99-8a945fc7ca1f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:39.927036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a6f4c3-02ff-4b4e-8d99-8a945fc7ca1f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:39.927619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61a6f4c3-02ff-4b4e-8d99-8a945fc7ca1f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:39.972614 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-61a6f4c3-02ff-4b4e-8d99-8a945fc7ca1f tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062123 Jul 01 10:50:39.973293 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2534/4979] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:50:39 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:50:40.041278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:40.041278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:40.044983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:40.045471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:40.046228 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:40.046664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:40.049829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:40.058935 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-536da65d-d1de-40e2-a42d-7729f6a2bf58 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.245959 Jul 01 10:50:40.060295 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2446/4980] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:39 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:40.087906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:50:40.446974 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4548f13f-0f1f-44b3-ac93-ab280516e3f4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 204 len: 0 microversion: 2.1 time: 0.413296 Jul 01 10:50:40.447580 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2535/4981] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:50:40 2022] DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:50:40.457104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:40.458373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:40.466008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:40.466528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:40.469535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:40.469535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:40.768257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:40.789775 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3b8a330f-daed-4769-a9eb-67c0fe904a3d tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1674 microversion: 2.1 time: 0.337728 Jul 01 10:50:40.790381 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2447/4982] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:40 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1674 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:41.078931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:41.078931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:41.085999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:41.086720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:41.087499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:41.088006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:41.294532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:41.304889 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa1dfb50-0717-4f48-bff6-d8f0e1ee0757 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.230367 Jul 01 10:50:41.306113 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2536/4983] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:41 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:41.807730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:41.808465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:41.816036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:41.816491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:41.817594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:41.818039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:41.976752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:41.985491 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5d6b5ad0-407e-458c-b0dd-2d46caed3906 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1674 microversion: 2.1 time: 0.181817 Jul 01 10:50:41.987457 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2448/4984] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:41 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:42.323397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:42.324020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:42.340690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:42.341353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:42.342221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:42.342666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:42.820718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8277829f-18a9-4939-a1aa-f755cf09a994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:42.827782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8277829f-18a9-4939-a1aa-f755cf09a994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:42.829611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8277829f-18a9-4939-a1aa-f755cf09a994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:42.830241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8277829f-18a9-4939-a1aa-f755cf09a994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:42.831240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8277829f-18a9-4939-a1aa-f755cf09a994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:42.832079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8277829f-18a9-4939-a1aa-f755cf09a994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:42.862391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8277829f-18a9-4939-a1aa-f755cf09a994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/ips" status: 200 len: 153 microversion: 2.20 time: 0.300497 Jul 01 10:50:42.862391 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2449/4985] 10.222.0.23 () {60 vars in 1288 bytes} [Fri Jul 1 10:50:42 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/ips => generated 153 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:50:43.004435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:43.005217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:43.016417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:43.017442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:43.018711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:43.021186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:43.044039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:43.053677 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4cdb5cf4-fc9e-4067-9fed-9e7dddc38f06 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 0.735016 Jul 01 10:50:43.058123 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2537/4986] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:42 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:43.480139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:43.492465 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a0312479-0997-4fe8-8bd7-33e000e57091 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1674 microversion: 2.1 time: 0.491602 Jul 01 10:50:43.503072 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2450/4987] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:42 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1674 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:44.080972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:44.086185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:44.097345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:44.098649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:44.099441 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:44.101440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:44.512887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:44.512887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:44.522313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:44.530216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:44.535382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:44.536035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:46.062550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:46.079703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-83a25ca6-a350-425c-9263-aab177f3bc19 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1607 microversion: 2.1 time: 1.573961 Jul 01 10:50:46.086861 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2451/4988] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:44 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1607 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:46.438705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a1a26e34-0295-424f-bb8e-fc0d57ec6d4c req-28b2ae55-7372-4e26-aaeb-65a4433da9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8dc684-eeda-4cd7-9772-b6ab10e3f722", "name": "network-vif-deleted", "tag": "669dda6a-b98a-4d29-8ea0-883621f4415e"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:46.440689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:46.455195 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a1a26e34-0295-424f-bb8e-fc0d57ec6d4c req-28b2ae55-7372-4e26-aaeb-65a4433da9d9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:46.457579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a1a26e34-0295-424f-bb8e-fc0d57ec6d4c req-28b2ae55-7372-4e26-aaeb-65a4433da9d9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:46.467994 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbd0428f-2574-4b8a-95de-d39f3e99ad2e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1497 microversion: 2.1 time: 2.389263 Jul 01 10:50:46.478635 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2538/4989] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:44 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1497 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:46.502398 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a1a26e34-0295-424f-bb8e-fc0d57ec6d4c req-28b2ae55-7372-4e26-aaeb-65a4433da9d9 service nova] Creating event network-vif-deleted:669dda6a-b98a-4d29-8ea0-883621f4415e for instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 on n-h2-master-1 Jul 01 10:50:46.520146 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a1a26e34-0295-424f-bb8e-fc0d57ec6d4c req-28b2ae55-7372-4e26-aaeb-65a4433da9d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085820 Jul 01 10:50:46.529607 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2452/4990] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:50:47.107680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:47.108316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:47.125802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:47.126172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:47.126962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:47.127604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:47.198714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:47.199511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:47.200185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lazy-loading 'fault' on Instance uuid ee8dc684-eeda-4cd7-9772-b6ab10e3f722 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:50:47.361719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a534c1028048b3af84ce213aad7f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba2af3867524497b17de32361dec716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:47.382916 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-024f1653-d330-456b-af95-4a57e67ec636 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 200 len: 1328 microversion: 2.1 time: 0.268573 Jul 01 10:50:47.392644 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2539/4991] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:47 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 1328 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:47.490564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:47.491826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:47.509121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:47.512467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:47.513771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:47.514424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:47.958469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:47.959105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:47.978037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:47.982271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:47.988184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:47.988184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:48.034637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lazy-loading 'flavor' on Instance uuid 5ab1b344-b65d-4f47-9630-08ac6461e289 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:50:48.433207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:48.460745 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ddb3d177-4e6b-47d9-8ca5-fb4fd1338071 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 200 len: 1474 microversion: 2.1 time: 0.974516 Jul 01 10:50:48.463606 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2453/4992] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:47 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 1474 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:48.486147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:48.489378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:48.534078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:48.534785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:48.535323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:48.538633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:48.572980 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] HTTP exception thrown: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Request method failure captured: Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 HTTP/1.1 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtAKzUu3P4sOV3EuKmbG4sl0KNnlOND9QVMWqOY9-NSUh2orEX-e9xRZTXh4GQ5qPhRnnRSPC2upKT_wpr7LbI8kcGv8WJzBZTMo7uhS5iJl4aoXZ4MC2gKAgPg-XuJxQGaCxUH10q6rdBtA3rMlm6UFlOsTyYtw7avTVpRGK5rhcsc Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: dba2af3867524497b17de32361dec716 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dba2af3867524497b17de32361dec716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dba2af3867524497b17de32361dec716", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: dba2af3867524497b17de32361dec716 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 83a534c1028048b3af84ce213aad7f15 Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: exception: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ee8dc684-eeda-4cd7-9772-b6ab10e3f722'} Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:50:48.579104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:50:48.586254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:50:48.586254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:50:48.586254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:50:48.586254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:50:48.586254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:50:48.586254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:50:48.586254 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:50:48.588791 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Returning 404 to user: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:50:48.591188 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5032e12d-c640-4fda-b601-8ca97ebe7735 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 404 len: 111 microversion: 2.1 time: 0.112669 Jul 01 10:50:48.591974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2454/4993] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:50:48 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:50:48.604674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7740aef-4379-40d6-af5f-862351a4a2c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-639723815"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:48.606199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a7740aef-4379-40d6-af5f-862351a4a2c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:48.623427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7740aef-4379-40d6-af5f-862351a4a2c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:48.628864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7740aef-4379-40d6-af5f-862351a4a2c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:48.630221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7740aef-4379-40d6-af5f-862351a4a2c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:48.630775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7740aef-4379-40d6-af5f-862351a4a2c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:49.479234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4f27df3-e534-4727-b27c-aa8c8f3942bc tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/action" status: 202 len: 0 microversion: 2.20 time: 1.529828 Jul 01 10:50:49.480513 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2540/4994] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:50:47 2022] POST /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/action => generated 0 bytes in 1532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:50:49.487725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-093d7ad8-fc8e-4f88-a2db-a4cb65447f4c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '.version_select at 0x7f6f91bd8550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:49.639630 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-093d7ad8-fc8e-4f88-a2db-a4cb65447f4c tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000098376" status: 202 len: 0 microversion: 2.1 time: 0.157056 Jul 01 10:50:49.640183 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2541/4995] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:50:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000098376 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:50:49.657942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:49.662468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:49.690387 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:49.693066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:49.699733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:49.702363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:49.708092 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7740aef-4379-40d6-af5f-862351a4a2c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd/action" status: 202 len: 0 microversion: 2.1 time: 1.110757 Jul 01 10:50:49.716267 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2455/4996] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:50:48 2022] POST /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd/action => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:50:49.733323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fabf42e2-f3e6-4426-b9e6-bd03071f6704 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f908ac8b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:49.852345 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fabf42e2-f3e6-4426-b9e6-bd03071f6704 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1413 microversion: 2.1 time: 0.132640 Jul 01 10:50:49.853522 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2456/4997] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:50:49 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:50.417766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:50.449215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:50.452175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:50.460031 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43d2fee8-1f73-4334-a877-ed52efc9f181 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.817309 Jul 01 10:50:50.463354 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2542/4998] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:49 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:50:50.867680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ebdd0ce-7c9a-441b-8087-ccf75f98c228 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91cd7ca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:50.962331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ebdd0ce-7c9a-441b-8087-ccf75f98c228 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1413 microversion: 2.1 time: 0.098474 Jul 01 10:50:50.962331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2457/4999] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:50:50 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:50:51.483815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:51.485292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:51.510199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:51.519768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:51.520743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:51.521248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:51.527119 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:51.968879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:51.976762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b66898f7-b4d9-4540-841a-2b97792c9641 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90762e50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:51.981297 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:51.983331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:51.986636 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50c3fc30-6488-4d24-bb9f-5c372894ad7e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.506982 Jul 01 10:50:51.988841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2543/5000] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:51 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:50:52.064226 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b66898f7-b4d9-4540-841a-2b97792c9641 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1413 microversion: 2.1 time: 0.094345 Jul 01 10:50:52.079005 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2458/5001] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:50:51 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:50:53.015230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:53.016515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:53.049603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:53.052185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:53.058878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:53.059771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:53.080047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5757e36-f5a3-433d-a275-df607ba50136 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f908ac1f0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:53.345547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:53.357198 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:53.361105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:53.363393 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c69c5be-cb81-43de-a1b8-0108f732a808 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.353540 Jul 01 10:50:53.374323 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2544/5002] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:53 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:50:54.383132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:54.383779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:54.394314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:54.394765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:54.395549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:54.395988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:54.982833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:54.993876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:55.006680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:55.010180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09248834-66e9-4c45-9cd1-2e9a8a34e4c0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.632098 Jul 01 10:50:55.018818 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2545/5003] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:54 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:50:56.037168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:56.038642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:56.051078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:56.051688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:56.057353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:56.062724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:56.521323 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:56.536006 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:56.541721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:56.551071 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f828122c-0650-429b-9036-761074d3e360 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.517821 Jul 01 10:50:56.563975 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2546/5004] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:56 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:50:56.570581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fd5c2d47-4242-42d3-906c-b958f9345916 req-f6b4dcce-dad8-427f-a260-679f725bedb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd57d7c8-7193-40e6-9ffe-232ca63f86cd", "name": "network-vif-plugged", "status": "completed", "tag": "5d73af2e-d31e-4f5e-b0cd-cc192d38540b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:50:56.600787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fd5c2d47-4242-42d3-906c-b958f9345916 req-f6b4dcce-dad8-427f-a260-679f725bedb6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:56.602037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fd5c2d47-4242-42d3-906c-b958f9345916 req-f6b4dcce-dad8-427f-a260-679f725bedb6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:56.638528 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fd5c2d47-4242-42d3-906c-b958f9345916 req-f6b4dcce-dad8-427f-a260-679f725bedb6 service nova] Creating event network-vif-plugged:5d73af2e-d31e-4f5e-b0cd-cc192d38540b for instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd on n-h1-master-1 Jul 01 10:50:56.653832 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fd5c2d47-4242-42d3-906c-b958f9345916 req-f6b4dcce-dad8-427f-a260-679f725bedb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095816 Jul 01 10:50:56.654844 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2547/5005] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:50:57.573782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:57.574638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:57.597872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:57.601743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:57.603347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:57.608629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:58.337457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:58.347205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:58.367271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:50:58.369217 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-754714b7-e1d0-42c6-aaf7-9afdc411bebd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.801718 Jul 01 10:50:58.370368 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2548/5006] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:57 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:50:58.620383 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=21 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:50:59.212962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b5757e36-f5a3-433d-a275-df607ba50136 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1413 microversion: 2.1 time: 6.138357 Jul 01 10:50:59.213970 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2459/5007] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:50:53 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1413 bytes in 6141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:50:59.389990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:50:59.390792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:50:59.406150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:59.414168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:50:59.419291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:50:59.419291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:00.222605 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:00.228103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2435b378-de43-4fe2-ae4a-fc31c980bf84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90c46160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:00.319855 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2435b378-de43-4fe2-ae4a-fc31c980bf84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1413 microversion: 2.1 time: 0.097084 Jul 01 10:51:00.320793 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2460/5008] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:00 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:51:00.394525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:00.406442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:00.413031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:00.417113 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ef7d437-ed12-466b-9792-67ae049279f7 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 1.031512 Jul 01 10:51:00.422358 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2549/5009] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:50:59 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:01.336001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3791cce9-8f32-4d66-a328-9583754b43c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91ad2700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:01.439967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:01.440579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:01.443858 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3791cce9-8f32-4d66-a328-9583754b43c9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1413 microversion: 2.1 time: 0.114293 Jul 01 10:51:01.451893 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2461/5010] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:01 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:01.454813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:01.469024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:01.472511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:01.472996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:02.032002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:02.052920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:02.063798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:02.066659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-90be37ac-bb5c-4da9-807c-4dfaf16193f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1746 microversion: 2.20 time: 0.630553 Jul 01 10:51:02.067695 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2550/5011] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:01 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1746 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:02.461618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71d6ec7b-6801-4d11-8ba7-96c7e124fbb3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90655550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:02.567527 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71d6ec7b-6801-4d11-8ba7-96c7e124fbb3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1413 microversion: 2.1 time: 0.114167 Jul 01 10:51:02.569777 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2462/5012] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:02 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:03.088328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:03.090028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:03.122307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:03.130772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:03.137494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:03.138274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:03.481635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:03.494734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:03.496989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:03.498484 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3c028962-abd3-41d4-a77e-9b9daf7a1090 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.414834 Jul 01 10:51:03.511368 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2551/5013] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:03 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:03.586937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-27b4497d-9ed9-4be6-89fc-339f9eb383e0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f907628b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:04.518296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:04.518868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:04.542486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:04.545349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:04.546278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:04.555965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:06.150717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:06.178928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:06.178928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:06.192965 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5273f5d6-3009-4e9c-a0f3-34db48e41520 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 1.663899 Jul 01 10:51:06.197410 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2552/5014] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:04 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:07.215481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:07.219879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:07.242898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:07.243523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:07.244144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:07.244578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:08.331955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:08.358218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:08.360621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:08.366978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-22e4c7ee-66ba-4550-892a-e33a42d266df tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 1.155375 Jul 01 10:51:08.367960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2553/5015] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:07 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:09.291081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7c98099e-a878-4856-a000-1040c2bbeee7 req-1e81161b-8e36-4dbe-9076-ebc8834b50bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "name": "network-vif-plugged", "status": "completed", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:09.307324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c98099e-a878-4856-a000-1040c2bbeee7 req-1e81161b-8e36-4dbe-9076-ebc8834b50bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:09.311086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c98099e-a878-4856-a000-1040c2bbeee7 req-1e81161b-8e36-4dbe-9076-ebc8834b50bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:09.341745 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7c98099e-a878-4856-a000-1040c2bbeee7 req-1e81161b-8e36-4dbe-9076-ebc8834b50bf service nova] Creating event network-vif-plugged:02113d39-dc23-4aa0-be32-f08c71eda3b2 for instance 5ab1b344-b65d-4f47-9630-08ac6461e289 on n-h2-master-1 Jul 01 10:51:09.359353 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7c98099e-a878-4856-a000-1040c2bbeee7 req-1e81161b-8e36-4dbe-9076-ebc8834b50bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072536 Jul 01 10:51:09.360526 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2554/5016] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:51:09.387724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:09.389496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:09.405758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:09.407179 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:09.409779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:09.410404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:09.982011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:09.990862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:09.995411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:09.997388 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c9c29eee-b12b-4bed-9c58-f96592ffec67 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.613830 Jul 01 10:51:10.001744 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2555/5017] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:09 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:11.019656 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:11.020693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:11.032115 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:11.033805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:11.044629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:11.048495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:11.049093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:11.602012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:11.616562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:11.618877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:11.620555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08879300-07e8-4fcb-a69d-e097044d1bb5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.604886 Jul 01 10:51:11.626101 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2556/5018] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:11 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:12.638787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:12.639344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:12.652541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:12.653015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:12.659204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:12.659669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:13.172202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:13.191633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:13.200240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:13.201642 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8afa42c9-856a-428b-8480-d24986acea47 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.567111 Jul 01 10:51:13.202233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2557/5019] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:12 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:13.230369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:13.230952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:13.242518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:13.251328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:13.252833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:13.253485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:13.300637 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] HTTP exception thrown: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Request method failure captured: Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 HTTP/1.1 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtAKzUu3P4sOV3EuKmbG4sl0KNnlOND9QVMWqOY9-NSUh2orEX-e9xRZTXh4GQ5qPhRnnRSPC2upKT_wpr7LbI8kcGv8WJzBZTMo7uhS5iJl4aoXZ4MC2gKAgPg-XuJxQGaCxUH10q6rdBtA3rMlm6UFlOsTyYtw7avTVpRGK5rhcsc Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dba2af3867524497b17de32361dec716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dba2af3867524497b17de32361dec716", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 83a534c1028048b3af84ce213aad7f15 Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: exception: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'ee8dc684-eeda-4cd7-9772-b6ab10e3f722'} Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:51:13.307189 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.312228 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Returning 404 to user: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:13.313947 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-669c67c6-db42-46e0-ac6b-b1ebd6748dbe tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 404 len: 111 microversion: 2.1 time: 0.109485 Jul 01 10:51:13.319235 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2558/5020] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:51:13 2022] DELETE /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:51:13.330756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:13.331441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: ee8dc684-eeda-4cd7-9772-b6ab10e3f722] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:13.346229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:13.348956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:13.353480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:13.353815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:13.381587 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] HTTP exception thrown: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Request method failure captured: Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 HTTP/1.1 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtAKzUu3P4sOV3EuKmbG4sl0KNnlOND9QVMWqOY9-NSUh2orEX-e9xRZTXh4GQ5qPhRnnRSPC2upKT_wpr7LbI8kcGv8WJzBZTMo7uhS5iJl4aoXZ4MC2gKAgPg-XuJxQGaCxUH10q6rdBtA3rMlm6UFlOsTyYtw7avTVpRGK5rhcsc Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dba2af3867524497b17de32361dec716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dba2af3867524497b17de32361dec716", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 83a534c1028048b3af84ce213aad7f15 Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: exception: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'ee8dc684-eeda-4cd7-9772-b6ab10e3f722'} Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:13.383158 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Returning 404 to user: Instance ee8dc684-eeda-4cd7-9772-b6ab10e3f722 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:13.387826 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e446672-0a58-4401-bb41-117ee0c9e9a4 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722" status: 404 len: 111 microversion: 2.1 time: 0.064313 Jul 01 10:51:13.397498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2559/5021] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:13 2022] GET /compute/v2.1/servers/ee8dc684-eeda-4cd7-9772-b6ab10e3f722 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:51:14.220840 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:14.224119 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:14.244690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:14.248344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:14.251305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:14.253674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:14.660876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:14.673488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:14.681011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:14.700060 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31294c85-9570-406b-8660-06eee94cc88e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.467960 Jul 01 10:51:14.700060 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2560/5022] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:14 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:15.716677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:15.720601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:15.758220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:15.758682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:15.759505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:15.759923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:16.118592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:16.130554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:16.135401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:16.142652 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f1e83bb-b6f7-4bc7-9bdd-36c3b3dc3303 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.429410 Jul 01 10:51:16.142652 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2561/5023] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:15 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:17.158572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:17.159709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:17.180097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:17.184695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:17.194318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:17.195444 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:17.263556 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:18.041924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:18.074081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:18.098845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:18.102646 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e48ac71b-94f1-4228-b27c-95a38e569b41 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.946462 Jul 01 10:51:18.109303 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2562/5024] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:17 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:19.129256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:19.130063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:19.140988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:19.141794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:19.142998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:19.143774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:19.442908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:19.455075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:19.456893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:19.458342 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ad0aa06-6c14-40e5-a3b3-55002bbd2609 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.334733 Jul 01 10:51:19.459739 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2563/5025] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:19 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:20.482138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:20.482830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:20.495318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:20.495796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:20.511257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:20.512682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:21.200919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:21.213564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:21.220685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:21.221776 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cf4bea7d-8ddc-472a-8b7d-36ac9e0b8067 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.743796 Jul 01 10:51:21.222359 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2564/5026] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:20 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:21.368518 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-27b4497d-9ed9-4be6-89fc-339f9eb383e0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1422 microversion: 2.1 time: 17.787914 Jul 01 10:51:21.372006 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2463/5027] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:03 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1422 bytes in 17794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:21.382274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f87562a9-3f38-422b-9ea3-1b3ec9cb1e3a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f97027c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:21.520409 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f87562a9-3f38-422b-9ea3-1b3ec9cb1e3a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 200 len: 1422 microversion: 2.1 time: 0.139162 Jul 01 10:51:21.526461 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2565/5028] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:21 2022] GET /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 1422 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:21.538436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f46f6da5-16bf-4a04-8b10-e5e29f472bb8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906ff790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:21.579885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:21.580542 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:21.598281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:21.598766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:21.599568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:21.602982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:21.661114 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] HTTP exception thrown: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Request method failure captured: Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 HTTP/1.1 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtAKzUu3P4sOV3EuKmbG4sl0KNnlOND9QVMWqOY9-NSUh2orEX-e9xRZTXh4GQ5qPhRnnRSPC2upKT_wpr7LbI8kcGv8WJzBZTMo7uhS5iJl4aoXZ4MC2gKAgPg-XuJxQGaCxUH10q6rdBtA3rMlm6UFlOsTyYtw7avTVpRGK5rhcsc Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dba2af3867524497b17de32361dec716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dba2af3867524497b17de32361dec716", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 83a534c1028048b3af84ce213aad7f15 Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '11758f07-3b9c-487c-8d96-ac3a93fbfbf8'} Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:51:21.663294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Returning 404 to user: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:21.669577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5cad419-7b9b-400a-bf73-c67e5c367da3 tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 404 len: 111 microversion: 2.1 time: 0.088770 Jul 01 10:51:21.680795 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2566/5029] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:51:21 2022] DELETE /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:51:21.685950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:21.690640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] [instance: 11758f07-3b9c-487c-8d96-ac3a93fbfbf8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:21.729901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:21.733162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:21.734309 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:21.734938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:21.776644 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] HTTP exception thrown: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Request method failure captured: Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 HTTP/1.1 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtAKzUu3P4sOV3EuKmbG4sl0KNnlOND9QVMWqOY9-NSUh2orEX-e9xRZTXh4GQ5qPhRnnRSPC2upKT_wpr7LbI8kcGv8WJzBZTMo7uhS5iJl4aoXZ4MC2gKAgPg-XuJxQGaCxUH10q6rdBtA3rMlm6UFlOsTyYtw7avTVpRGK5rhcsc Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dba2af3867524497b17de32361dec716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dba2af3867524497b17de32361dec716", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dba2af3867524497b17de32361dec716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: dba2af3867524497b17de32361dec716 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2122814783 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 83a534c1028048b3af84ce213aad7f15 Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachVolumeTestJSON-2122814783-project Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '11758f07-3b9c-487c-8d96-ac3a93fbfbf8'} Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:21.784150 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.789814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:21.789814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:21.789814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:21.789814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:51:21.789814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:51:21.789814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. Jul 01 10:51:21.789814 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:21.798489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] Returning 404 to user: Instance 11758f07-3b9c-487c-8d96-ac3a93fbfbf8 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:21.811515 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06f980ff-6e1d-463f-acbe-5fc0da2cbfdb tempest-AttachVolumeTestJSON-2122814783 tempest-AttachVolumeTestJSON-2122814783-project] 10.222.0.23 "GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8" status: 404 len: 111 microversion: 2.1 time: 0.125213 Jul 01 10:51:21.811515 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2567/5030] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:21 2022] GET /compute/v2.1/servers/11758f07-3b9c-487c-8d96-ac3a93fbfbf8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:51:22.241206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:22.242146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:22.257612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:22.258197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:22.258932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:22.265863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:22.734337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:22.749017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:22.760341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:22.767929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9340d59-87af-4da0-bf8b-7f638ed759ba tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.531977 Jul 01 10:51:22.772623 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2568/5031] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:22 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:23.792673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:23.794270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:23.803243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:23.817346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:23.820238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:23.825326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:24.249869 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f46f6da5-16bf-4a04-8b10-e5e29f472bb8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 204 len: 0 microversion: 2.1 time: 2.715462 Jul 01 10:51:24.252354 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2464/5032] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:21 2022] DELETE /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 0 bytes in 2717 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:51:24.262614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:24.263853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:24.284389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:24.284845 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:24.285761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:24.286430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:24.355060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:51:24.821431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ddfca44-ab0e-4166-b983-11af990876a8 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 204 len: 0 microversion: 2.1 time: 0.563816 Jul 01 10:51:24.822883 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2465/5033] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:51:24 2022] DELETE /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:51:25.073691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-343939038", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "0417ff04-b95e-42da-8dd3-bd5150fa1982"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:25.147382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:25.164359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:25.173467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:25.176431 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3570e5b7-ea99-47c7-99ac-751196de8f8b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 1.387708 Jul 01 10:51:25.183123 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2569/5034] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:23 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:25.255714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] validate_networks() for [('0417ff04-b95e-42da-8dd3-bd5150fa1982', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:51:25.450566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e3b937a3-9895-4f96-80b4-a636a4f5a019 req-98e1c5c8-11c8-484e-8f42-a9b36ef01d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd57d7c8-7193-40e6-9ffe-232ca63f86cd", "name": "network-vif-unplugged", "status": "completed", "tag": "5d73af2e-d31e-4f5e-b0cd-cc192d38540b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:25.466393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e3b937a3-9895-4f96-80b4-a636a4f5a019 req-98e1c5c8-11c8-484e-8f42-a9b36ef01d2e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:25.468754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e3b937a3-9895-4f96-80b4-a636a4f5a019 req-98e1c5c8-11c8-484e-8f42-a9b36ef01d2e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:25.501067 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e3b937a3-9895-4f96-80b4-a636a4f5a019 req-98e1c5c8-11c8-484e-8f42-a9b36ef01d2e service nova] Creating event network-vif-unplugged:5d73af2e-d31e-4f5e-b0cd-cc192d38540b for instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd on n-h1-master-1 Jul 01 10:51:25.514358 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e3b937a3-9895-4f96-80b4-a636a4f5a019 req-98e1c5c8-11c8-484e-8f42-a9b36ef01d2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071942 Jul 01 10:51:25.517626 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2570/5035] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:51:26.202547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:26.203407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:26.237837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:26.243085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:26.244125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:26.251218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:27.813457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:27.835509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:27.839266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:27.843437 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9905880d-b8fa-4430-987b-ea7cc7c76e76 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 1.645730 Jul 01 10:51:27.844748 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2571/5036] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:26 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:27.966291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:27.988398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:51:27.995500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for user be759a44a78544109032556c07b5c868 and project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:51:28.011209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:51:28.014053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:51:28.637072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d533029-4be3-4d95-a7d4-a46e14bee31a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.565345 Jul 01 10:51:28.651827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a56332e-251e-4656-99e5-ab32c03babbd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:28.653555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a56332e-251e-4656-99e5-ab32c03babbd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:28.662919 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2466/5037] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:51:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:51:28.866650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:28.868055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:28.878574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:28.883144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:28.883719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1a56332e-251e-4656-99e5-ab32c03babbd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:28.884204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:28.884204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:28.893584 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a56332e-251e-4656-99e5-ab32c03babbd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1207 microversion: 2.1 time: 0.243990 Jul 01 10:51:28.894156 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2572/5038] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:28 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1207 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:29.483747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:29.502577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:29.508952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:29.515956 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3a06068-46c7-443e-91dd-489fa66bd497 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.655130 Jul 01 10:51:29.529476 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2467/5039] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:28 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:29.638800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-18fbf9ca-2f41-4c3d-8a54-b3237bbaecd4 req-84df8e14-ecfa-47bf-be88-295f75018241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd57d7c8-7193-40e6-9ffe-232ca63f86cd", "name": "network-vif-deleted", "tag": "5d73af2e-d31e-4f5e-b0cd-cc192d38540b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:29.659330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-18fbf9ca-2f41-4c3d-8a54-b3237bbaecd4 req-84df8e14-ecfa-47bf-be88-295f75018241 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:29.659785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-18fbf9ca-2f41-4c3d-8a54-b3237bbaecd4 req-84df8e14-ecfa-47bf-be88-295f75018241 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:29.698484 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-18fbf9ca-2f41-4c3d-8a54-b3237bbaecd4 req-84df8e14-ecfa-47bf-be88-295f75018241 service nova] Creating event network-vif-deleted:5d73af2e-d31e-4f5e-b0cd-cc192d38540b for instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd on n-h1-master-1 Jul 01 10:51:29.712841 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-18fbf9ca-2f41-4c3d-8a54-b3237bbaecd4 req-84df8e14-ecfa-47bf-be88-295f75018241 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.650986 Jul 01 10:51:29.714867 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2573/5040] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:51:29.912524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aaefe7f4-8f03-444e-99a6-93d48ba5a1c7 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:29.913244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aaefe7f4-8f03-444e-99a6-93d48ba5a1c7 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:30.063015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aaefe7f4-8f03-444e-99a6-93d48ba5a1c7 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:30.071856 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aaefe7f4-8f03-444e-99a6-93d48ba5a1c7 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1207 microversion: 2.1 time: 0.163651 Jul 01 10:51:30.094234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2468/5041] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:29 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1207 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:30.539142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:30.539142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:30.557925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:30.558462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:30.559589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:30.560035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:30.898187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:30.906995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:30.908649 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:30.914844 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a7ad1a3c-724f-4fdb-97c0-eb736807e8fe tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.381084 Jul 01 10:51:30.915464 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2574/5042] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:30 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:31.091966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:31.092590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:31.103977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:31.104643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:31.105890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:31.106599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:31.244983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:31.264962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d7f2d1d-5dfd-4c81-9320-2a625bf795b3 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1211 microversion: 2.1 time: 0.175499 Jul 01 10:51:31.264962 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2469/5043] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:31 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1211 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:31.938028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:31.939719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:31.955971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:31.956624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:31.957962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:31.958780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:32.225499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:32.242874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:32.251011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:32.258612 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4b16eec-f58b-4746-a4ca-d8df9e3386d5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1741 microversion: 2.20 time: 0.321066 Jul 01 10:51:32.285428 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2575/5044] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:31 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1741 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:32.296633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:32.297372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:32.316424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:32.317063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:32.323512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:32.324675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:32.431138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:32.448199 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fe4cba76-1a0b-4f33-953d-6f2a7d7b0190 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1259 microversion: 2.1 time: 0.162741 Jul 01 10:51:32.466588 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2470/5045] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:32 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:33.280179 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:33.281315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:33.295147 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:33.297085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:33.301785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:33.306902 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:33.473199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:33.474881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:33.490483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:33.493139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:33.500969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:33.500969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:33.801097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:33.845411 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39813706-f43e-45e0-91d3-fb56600d2acf tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1277 microversion: 2.1 time: 0.364470 Jul 01 10:51:33.855944 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2471/5046] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:33 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1277 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:51:33.875720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:33.888248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:33.889953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:33.898762 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c2a0e9e-7c54-4d3b-8028-a488cfcd795b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1723 microversion: 2.20 time: 0.616180 Jul 01 10:51:33.910530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2576/5047] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:33 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1723 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:34.865971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:34.866664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:34.882277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:34.882735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:34.885587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:34.886220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:34.918217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:34.919472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:34.931808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:34.937666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:34.938802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:34.939430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:35.063471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:35.092649 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7127447e-71bc-4dd1-8bd1-f168bae37d84 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1265 microversion: 2.1 time: 0.232286 Jul 01 10:51:35.096539 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2472/5048] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:34 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:35.273970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:35.285308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:35.288954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:35.290341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8629d1c8-f9c0-486c-b6e8-5b7f8df9ff02 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1723 microversion: 2.20 time: 0.375960 Jul 01 10:51:35.293555 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2577/5049] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:34 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:36.116029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:36.117353 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:36.149432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:36.149864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:36.158804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:36.160261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:36.310407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:36.311013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:36.332373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:36.332836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:36.339134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:36.355704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:37.349268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:37.359838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:37.367909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:37.372197 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8744df7e-3729-4b66-96c7-0fb774193e39 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1726 microversion: 2.20 time: 1.065948 Jul 01 10:51:37.373117 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2578/5050] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:36 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1726 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:37.383282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1c9a1cdc-0842-438d-8e3a-2d0e392b177f req-61139fd3-d7d9-4084-a145-e4313dad5c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "name": "network-vif-unplugged", "status": "completed", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:37.404243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1c9a1cdc-0842-438d-8e3a-2d0e392b177f req-61139fd3-d7d9-4084-a145-e4313dad5c1b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:37.405473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1c9a1cdc-0842-438d-8e3a-2d0e392b177f req-61139fd3-d7d9-4084-a145-e4313dad5c1b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:37.431329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.server_external_events [req-1c9a1cdc-0842-438d-8e3a-2d0e392b177f req-61139fd3-d7d9-4084-a145-e4313dad5c1b service nova] Unable to find a host for instance 5ab1b344-b65d-4f47-9630-08ac6461e289. Dropping event network-vif-unplugged {{(pid=119764) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 10:51:37.432662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:37.435549 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1c9a1cdc-0842-438d-8e3a-2d0e392b177f req-61139fd3-d7d9-4084-a145-e4313dad5c1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061476 Jul 01 10:51:37.438150 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2579/5051] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 10:51:37.449000 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5493e1c3-08e5-4195-bd11-bd1ff8f72b17 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 1.339733 Jul 01 10:51:37.449989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4da7a03f-38d3-43fd-ab8b-281833ee223e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01035edb-ef64-42c1-9f2b-dcf28fa8f8a3"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:37.450179 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2473/5052] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:36 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:37.452373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4da7a03f-38d3-43fd-ab8b-281833ee223e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:37.469427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4da7a03f-38d3-43fd-ab8b-281833ee223e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:37.471120 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4da7a03f-38d3-43fd-ab8b-281833ee223e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:37.476799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4da7a03f-38d3-43fd-ab8b-281833ee223e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:37.476799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4da7a03f-38d3-43fd-ab8b-281833ee223e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:38.468728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:38.483385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:38.491045 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:38.499426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:38.501931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:38.506023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:38.508282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:38.891730 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:38.988949 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4da7a03f-38d3-43fd-ab8b-281833ee223e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.548247 Jul 01 10:51:38.991081 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2580/5053] 10.222.0.23 () {62 vars in 1363 bytes} [Fri Jul 1 10:51:37 2022] POST /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-volume_attachments => generated 188 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:51:39.015208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-91bf9f1a-4ca0-4e0f-bdec-9dc831acb241 req-e3a29c50-973d-4d90-944f-5a2441f9a3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d10188c-4a0b-466b-8623-8f0aa597929a", "tag": "0529a866-192b-4c17-af82-677ab8648764"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:39.050966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-91bf9f1a-4ca0-4e0f-bdec-9dc831acb241 req-e3a29c50-973d-4d90-944f-5a2441f9a3e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:39.052848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-91bf9f1a-4ca0-4e0f-bdec-9dc831acb241 req-e3a29c50-973d-4d90-944f-5a2441f9a3e3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:39.076278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-91bf9f1a-4ca0-4e0f-bdec-9dc831acb241 req-e3a29c50-973d-4d90-944f-5a2441f9a3e3 service nova] Creating event network-changed:0529a866-192b-4c17-af82-677ab8648764 for instance 6d10188c-4a0b-466b-8623-8f0aa597929a on n-h2-master-1 Jul 01 10:51:39.090678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-91bf9f1a-4ca0-4e0f-bdec-9dc831acb241 req-e3a29c50-973d-4d90-944f-5a2441f9a3e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097910 Jul 01 10:51:39.096366 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2581/5054] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:51:39.212507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:39.224684 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d053336-34ba-477d-9e6c-0aa2a202e395 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 0.762463 Jul 01 10:51:39.239041 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2474/5055] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:38 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:39.326518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23eb3a00-77ff-4820-b197-8c4f8a90956e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:39.327883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23eb3a00-77ff-4820-b197-8c4f8a90956e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:39.366349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23eb3a00-77ff-4820-b197-8c4f8a90956e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:39.370617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23eb3a00-77ff-4820-b197-8c4f8a90956e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:39.386139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23eb3a00-77ff-4820-b197-8c4f8a90956e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:39.386139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23eb3a00-77ff-4820-b197-8c4f8a90956e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:39.442153 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:40.069906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78261fa8-ad9e-46a3-af77-15804c8e3dd6 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Action: 'create', calling method: .version_select at 0x7f6f90ee04c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2079429426", "metadata": {"Type": "work"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78261fa8-ad9e-46a3-af77-15804c8e3dd6 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Request method failure captured: Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 122 Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtG7-fNsgz9AsmpX0iHG7Dn2qwW8VoDBTg7vWfBtfnaI0sP06T_vGZreUbu6iWgrzn3Au9k37o0yDQXCxhm1w6RgtnhUwJJ24gj-Utz0ljty41OUArrZROVOuw_7IZU5mYsfsledOb28ZLDWao1MUz3zHiuyGZnWGWGzy1Jjd1nbJ4E Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e14c1e25ff1f42b1ac113d796f7ccc2d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9dadd494fb6647b1960ed4ddb2cdb27b Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2079429426", "metadata": {"Type": "work"}}} Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2079429426', 'metadata': {'Type': 'work'}}}} Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '#$%' Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:51:40.093276 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 10:51:40.100950 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.133805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78261fa8-ad9e-46a3-af77-15804c8e3dd6 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:40.143052 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78261fa8-ad9e-46a3-af77-15804c8e3dd6 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.307849 Jul 01 10:51:40.143052 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2475/5056] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Jul 1 10:51:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:51:40.159063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9974a7e8-fecc-4315-ba8d-3b96437a35d5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Action: 'create', calling method: .version_select at 0x7f6f90c244c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2079237265", "metadata": {"Type": "work"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9974a7e8-fecc-4315-ba8d-3b96437a35d5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Request method failure captured: Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 120 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtG7-fNsgz9AsmpX0iHG7Dn2qwW8VoDBTg7vWfBtfnaI0sP06T_vGZreUbu6iWgrzn3Au9k37o0yDQXCxhm1w6RgtnhUwJJ24gj-Utz0ljty41OUArrZROVOuw_7IZU5mYsfsledOb28ZLDWao1MUz3zHiuyGZnWGWGzy1Jjd1nbJ4E Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e14c1e25ff1f42b1ac113d796f7ccc2d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9dadd494fb6647b1960ed4ddb2cdb27b Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2079237265", "metadata": {"Type": "work"}}} Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2079237265', 'metadata': {'Type': 'work'}}}} Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '0' Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:51:40.164245 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 10:51:40.170112 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.172639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9974a7e8-fecc-4315-ba8d-3b96437a35d5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:40.173778 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9974a7e8-fecc-4315-ba8d-3b96437a35d5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023955 Jul 01 10:51:40.174815 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2476/5057] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Jul 1 10:51:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:51:40.198199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f77b1fbb-b81f-4cff-bc1f-04de5b78303f tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Action: 'create', calling method: .version_select at 0x7f6f9064f430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1294253091", "metadata": {"Type": "work"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f77b1fbb-b81f-4cff-bc1f-04de5b78303f tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Request method failure captured: Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 119 Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtG7-fNsgz9AsmpX0iHG7Dn2qwW8VoDBTg7vWfBtfnaI0sP06T_vGZreUbu6iWgrzn3Au9k37o0yDQXCxhm1w6RgtnhUwJJ24gj-Utz0ljty41OUArrZROVOuw_7IZU5mYsfsledOb28ZLDWao1MUz3zHiuyGZnWGWGzy1Jjd1nbJ4E Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e14c1e25ff1f42b1ac113d796f7ccc2d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9dadd494fb6647b1960ed4ddb2cdb27b Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1294253091", "metadata": {"Type": "work"}}} Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1294253091', 'metadata': {'Type': 'work'}}}} Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi '' Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 10:51:40.212253 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f77b1fbb-b81f-4cff-bc1f-04de5b78303f tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:40.221808 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f77b1fbb-b81f-4cff-bc1f-04de5b78303f tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028268 Jul 01 10:51:40.223247 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2477/5058] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Jul 1 10:51:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:51:40.230386 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:40.247046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2aaec8a-3d67-4b91-8361-aa8521b4e481 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Calling method '.version_select at 0x7f6f90c2f4c0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:40.349863 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e2aaec8a-3d67-4b91-8361-aa8521b4e481 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] HTTP exception thrown: Volume tempest-invalid-985464480 could not be found. Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2aaec8a-3d67-4b91-8361-aa8521b4e481 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Request method failure captured: Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-985464480 HTTP/1.1 Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtG7-fNsgz9AsmpX0iHG7Dn2qwW8VoDBTg7vWfBtfnaI0sP06T_vGZreUbu6iWgrzn3Au9k37o0yDQXCxhm1w6RgtnhUwJJ24gj-Utz0ljty41OUArrZROVOuw_7IZU5mYsfsledOb28ZLDWao1MUz3zHiuyGZnWGWGzy1Jjd1nbJ4E Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e14c1e25ff1f42b1ac113d796f7ccc2d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9dadd494fb6647b1960ed4ddb2cdb27b Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: exception: Volume tempest-invalid-985464480 could not be found. Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'tempest-invalid-985464480'} Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-985464480 could not be found. (HTTP 404) (Request-ID: req-d226fe92-bf67-400f-90b1-e6bd0a9b3c42) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:51:40.352218 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-985464480 could not be found. Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-985464480 could not be found. Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-985464480 could not be found. Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2aaec8a-3d67-4b91-8361-aa8521b4e481 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Returning 404 to user: Volume tempest-invalid-985464480 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2aaec8a-3d67-4b91-8361-aa8521b4e481 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-985464480" status: 404 len: 98 microversion: 2.1 time: 0.124433 Jul 01 10:51:40.363719 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2478/5059] 10.222.0.23 () {58 vars in 1214 bytes} [Fri Jul 1 10:51:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-985464480 => generated 98 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:51:40.369529 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:40.374086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:40.380117 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23eb3a00-77ff-4820-b197-8c4f8a90956e tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-volume_attachments/01035edb-ef64-42c1-9f2b-dcf28fa8f8a3" status: 202 len: 0 microversion: 2.20 time: 1.064683 Jul 01 10:51:40.387094 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2582/5060] 10.222.0.23 () {60 vars in 1456 bytes} [Fri Jul 1 10:51:39 2022] DELETE /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-volume_attachments/01035edb-ef64-42c1-9f2b-dcf28fa8f8a3 => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:51:40.403348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:40.403810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:40.404040 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6b1c9c1-97f8-4ea1-8ff4-c15f780852cc tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013018 Jul 01 10:51:40.404764 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2583/5061] 10.222.0.23 () {58 vars in 1139 bytes} [Fri Jul 1 10:51:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 10:51:40.408870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:40.409358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:40.436062 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-94aed7f9-0cb9-45f0-b3f4-d7c7395265fe tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021322 Jul 01 10:51:40.436844 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2584/5062] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:51:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 10:51:40.467872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58fefb9b-c2c7-4cbd-af14-1e1f2ab987a7 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Calling method '.version_select at 0x7f6f9220e3a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:40.592006 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-58fefb9b-c2c7-4cbd-af14-1e1f2ab987a7 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] HTTP exception thrown: Volume 6b4adaca-eba1-457b-90e9-b733f48fe07a could not be found. Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58fefb9b-c2c7-4cbd-af14-1e1f2ab987a7 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Request method failure captured: Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/os-volumes/6b4adaca-eba1-457b-90e9-b733f48fe07a HTTP/1.1 Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtG7-fNsgz9AsmpX0iHG7Dn2qwW8VoDBTg7vWfBtfnaI0sP06T_vGZreUbu6iWgrzn3Au9k37o0yDQXCxhm1w6RgtnhUwJJ24gj-Utz0ljty41OUArrZROVOuw_7IZU5mYsfsledOb28ZLDWao1MUz3zHiuyGZnWGWGzy1Jjd1nbJ4E Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e14c1e25ff1f42b1ac113d796f7ccc2d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 9dadd494fb6647b1960ed4ddb2cdb27b Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: exception: Volume 6b4adaca-eba1-457b-90e9-b733f48fe07a could not be found. Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6b4adaca-eba1-457b-90e9-b733f48fe07a'} Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b4adaca-eba1-457b-90e9-b733f48fe07a could not be found. (HTTP 404) (Request-ID: req-276abea0-2eda-4a3c-bea1-89fd08e65dcb) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:51:40.595508 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b4adaca-eba1-457b-90e9-b733f48fe07a could not be found. Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b4adaca-eba1-457b-90e9-b733f48fe07a could not be found. Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b4adaca-eba1-457b-90e9-b733f48fe07a could not be found. Jul 01 10:51:40.600505 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.607041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58fefb9b-c2c7-4cbd-af14-1e1f2ab987a7 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Returning 404 to user: Volume 6b4adaca-eba1-457b-90e9-b733f48fe07a could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:40.608870 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58fefb9b-c2c7-4cbd-af14-1e1f2ab987a7 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/6b4adaca-eba1-457b-90e9-b733f48fe07a" status: 404 len: 109 microversion: 2.1 time: 0.165648 Jul 01 10:51:40.612509 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2585/5063] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:51:40 2022] DELETE /compute/v2.1/os-volumes/6b4adaca-eba1-457b-90e9-b733f48fe07a => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:51:40.632117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a45c0eeb-3be2-4a94-9774-b6d9ec1da419 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:40.633520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a45c0eeb-3be2-4a94-9774-b6d9ec1da419 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:40.655951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45c0eeb-3be2-4a94-9774-b6d9ec1da419 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:40.657927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45c0eeb-3be2-4a94-9774-b6d9ec1da419 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:40.667000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45c0eeb-3be2-4a94-9774-b6d9ec1da419 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:40.667000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a45c0eeb-3be2-4a94-9774-b6d9ec1da419 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:40.875839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:40.887890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f7e7e866-4b33-4182-9215-c9d6ee6dcda2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 0.532376 Jul 01 10:51:40.896017 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2479/5064] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:40 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:40.896672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e7618479-4a40-4ddd-a0d2-433eaf07e4f5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Calling method '.version_select at 0x7f6f90c24550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:40.948797 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e7618479-4a40-4ddd-a0d2-433eaf07e4f5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] HTTP exception thrown: Volume e4b82430-34aa-4a3c-bed9-e48f9682fd20 could not be found. Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e7618479-4a40-4ddd-a0d2-433eaf07e4f5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Request method failure captured: Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/os-volumes/e4b82430-34aa-4a3c-bed9-e48f9682fd20 HTTP/1.1 Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtG7-fNsgz9AsmpX0iHG7Dn2qwW8VoDBTg7vWfBtfnaI0sP06T_vGZreUbu6iWgrzn3Au9k37o0yDQXCxhm1w6RgtnhUwJJ24gj-Utz0ljty41OUArrZROVOuw_7IZU5mYsfsledOb28ZLDWao1MUz3zHiuyGZnWGWGzy1Jjd1nbJ4E Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e14c1e25ff1f42b1ac113d796f7ccc2d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e14c1e25ff1f42b1ac113d796f7ccc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e14c1e25ff1f42b1ac113d796f7ccc2d Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesNegativeTest-128710032 Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 9dadd494fb6647b1960ed4ddb2cdb27b Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesNegativeTest-128710032-project Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: exception: Volume e4b82430-34aa-4a3c-bed9-e48f9682fd20 could not be found. Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e4b82430-34aa-4a3c-bed9-e48f9682fd20'} Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4b82430-34aa-4a3c-bed9-e48f9682fd20 could not be found. (HTTP 404) (Request-ID: req-99a5d6e8-9b71-4ea6-be61-b552217071a3) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 10:51:40.950872 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4b82430-34aa-4a3c-bed9-e48f9682fd20 could not be found. Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4b82430-34aa-4a3c-bed9-e48f9682fd20 could not be found. Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4b82430-34aa-4a3c-bed9-e48f9682fd20 could not be found. Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e7618479-4a40-4ddd-a0d2-433eaf07e4f5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] Returning 404 to user: Volume e4b82430-34aa-4a3c-bed9-e48f9682fd20 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:51:40.957581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e7618479-4a40-4ddd-a0d2-433eaf07e4f5 tempest-VolumesNegativeTest-128710032 tempest-VolumesNegativeTest-128710032-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e4b82430-34aa-4a3c-bed9-e48f9682fd20" status: 404 len: 109 microversion: 2.1 time: 0.062459 Jul 01 10:51:40.963237 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2480/5065] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 10:51:40 2022] GET /compute/v2.1/os-volumes/e4b82430-34aa-4a3c-bed9-e48f9682fd20 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:51:40.992171 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a45c0eeb-3be2-4a94-9774-b6d9ec1da419 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "POST /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/action" status: 202 len: 0 microversion: 2.20 time: 0.378041 Jul 01 10:51:40.999096 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2586/5066] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Jul 1 10:51:40 2022] POST /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:51:41.007175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:41.008139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:41.022580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:41.024333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:41.026462 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:41.029823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:41.255090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:41.278082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:41.290111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:41.291382 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc5b8683-c6fe-4ee9-95dd-08d3a428955b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1674 microversion: 2.20 time: 0.289019 Jul 01 10:51:41.291987 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2481/5067] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:41 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1674 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:41.907384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:41.907946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:41.922447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:41.922970 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:41.925037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:41.925871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:42.315840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:42.316460 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:42.337332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:42.337332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:42.338633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:42.343010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:42.607570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:42.617485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb0f53c3-1afe-4791-8038-623b5ba5a953 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 0.716017 Jul 01 10:51:42.633273 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2587/5068] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:41 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:43.243840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:43.258069 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:43.259663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:43.273379 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5e6d82af-de5e-4058-b835-de37f5287acf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1674 microversion: 2.20 time: 0.949884 Jul 01 10:51:43.274922 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2482/5069] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:42 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1674 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:43.636349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:43.636944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:43.657328 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=60 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:43.662440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:43.667487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:43.667487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:43.667487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:44.225849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:44.241511 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99416525-a858-41e4-a392-8a0a54c015d6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 0.606401 Jul 01 10:51:44.242642 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2588/5070] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:43 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:44.293043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:44.293699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:44.304476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:44.304931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:44.310981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:44.311686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:44.836436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:44.850055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:44.851850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:44.861127 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-11a21b4e-c96e-4529-8403-2d73177d9003 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.564399 Jul 01 10:51:44.861127 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2483/5071] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:44 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:45.261720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:45.262493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:45.301101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:45.302790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:45.306514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:45.307424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:45.880415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:45.881367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:45.900481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:45.900939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:45.901762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:45.902825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:45.905847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:45.914014 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77d7add3-1ec3-488a-950e-d7e02d554f13 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 0.658788 Jul 01 10:51:45.918953 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2589/5072] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:45 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:46.936773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:46.936773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:46.962119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:46.962563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:46.963346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:46.963786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:47.928781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:47.944973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:47.963697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:47.975670 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2cf30489-5c69-40b5-8b88-728a9e54c6dd tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 2.091319 Jul 01 10:51:47.979973 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2484/5073] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:45 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:47.988183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c79bac4b-21a8-4862-90f1-110c4c81e624 req-1d5304ad-e574-45f2-8c2b-da075fb880e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d10188c-4a0b-466b-8623-8f0aa597929a", "name": "network-vif-plugged", "status": "completed", "tag": "0529a866-192b-4c17-af82-677ab8648764"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:48.026673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c79bac4b-21a8-4862-90f1-110c4c81e624 req-1d5304ad-e574-45f2-8c2b-da075fb880e0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:48.036712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c79bac4b-21a8-4862-90f1-110c4c81e624 req-1d5304ad-e574-45f2-8c2b-da075fb880e0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:48.074831 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c79bac4b-21a8-4862-90f1-110c4c81e624 req-1d5304ad-e574-45f2-8c2b-da075fb880e0 service nova] Creating event network-vif-plugged:0529a866-192b-4c17-af82-677ab8648764 for instance 6d10188c-4a0b-466b-8623-8f0aa597929a on n-h2-master-1 Jul 01 10:51:48.090988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c79bac4b-21a8-4862-90f1-110c4c81e624 req-1d5304ad-e574-45f2-8c2b-da075fb880e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113014 Jul 01 10:51:48.091913 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2485/5074] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:51:48.115597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:48.124811 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b2d855bd-a359-47a3-a2c1-3532380950ec tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 1.194465 Jul 01 10:51:48.134930 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2590/5075] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:46 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:48.965562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-89db9c6a-cf3b-478e-bf96-bbaebc2b60b8 req-a8f9b8c3-5ac0-4725-9f5a-ee8fd05e70e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:48.985963 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:48.997344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:48.997955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:49.022883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:49.023341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:49.024132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:49.024612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:49.030364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-89db9c6a-cf3b-478e-bf96-bbaebc2b60b8 req-a8f9b8c3-5ac0-4725-9f5a-ee8fd05e70e0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:49.030511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-89db9c6a-cf3b-478e-bf96-bbaebc2b60b8 req-a8f9b8c3-5ac0-4725-9f5a-ee8fd05e70e0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:49.085078 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-89db9c6a-cf3b-478e-bf96-bbaebc2b60b8 req-a8f9b8c3-5ac0-4725-9f5a-ee8fd05e70e0 service nova] Creating event network-changed:02113d39-dc23-4aa0-be32-f08c71eda3b2 for instance 5ab1b344-b65d-4f47-9630-08ac6461e289 on n-h1-master-1 Jul 01 10:51:49.115361 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-89db9c6a-cf3b-478e-bf96-bbaebc2b60b8 req-a8f9b8c3-5ac0-4725-9f5a-ee8fd05e70e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163728 Jul 01 10:51:49.136450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2486/5076] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:51:49.151154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:49.157273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:49.197700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:49.198182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:49.203340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:49.203802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:50.699262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:50.718011 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:50.726020 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f588a60-909b-4130-bca9-a0ff0c8def0f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1307 microversion: 2.1 time: 1.579037 Jul 01 10:51:50.726637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2487/5077] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:49 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1307 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:50.763175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:50.776053 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:50.780192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:50.786532 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-291c585f-f88b-47b5-b963-661d25b34f3a tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 1.792566 Jul 01 10:51:50.791614 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2591/5078] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:48 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:51.745298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:51.746444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:51.759926 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:51.765206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:51.766588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:51.767440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:51.809892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:51.810509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:51.820485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:51.820943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:51.829022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:51.830782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:52.833852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:52.841556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c90a9643-0430-4267-97bd-316e6ff5ee9f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1486 microversion: 2.1 time: 1.102077 Jul 01 10:51:52.849920 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2488/5079] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:51 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1486 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:52.869171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:52.870099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:52.880952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:52.892188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:52.898256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:52.899229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:52.987028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lazy-loading 'flavor' on Instance uuid 6d10188c-4a0b-466b-8623-8f0aa597929a {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:51:53.015091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:53.026588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:53.037996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:53.041217 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f2f03e1-f494-42f3-8bd4-0e9780ca03b3 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 1.235809 Jul 01 10:51:53.041778 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2592/5080] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:51 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:51:53.482367 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-877aabce-3641-4a53-80e8-14e7162bc204 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a/action" status: 202 len: 0 microversion: 2.1 time: 0.616979 Jul 01 10:51:53.484183 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2489/5081] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:51:52 2022] POST /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:51:53.493208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:53.496182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:53.506221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:53.507121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:53.508035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:53.508624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:54.063533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:54.064817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:54.096216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:54.106015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:54.107151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:54.107757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:55.008150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:55.020795 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56ac9183-a742-4925-9231-affe59ce8927 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1494 microversion: 2.1 time: 1.531957 Jul 01 10:51:55.031811 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2593/5082] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:53 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1494 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:55.188469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:55.208222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:55.225121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:55.244346 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71cd08dd-5ea2-4019-80ce-5b23887ce08d tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 1.172498 Jul 01 10:51:55.247563 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2490/5083] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:54 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:56.038195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:56.038828 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:56.056047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:56.056504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:56.064244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:56.065059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:56.263204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:56.263976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:56.273028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:56.280680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:56.282141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:56.285331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:56.578381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:56.586991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f9661723-280d-456e-9b10-e65f55d7e416 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 200 len: 1477 microversion: 2.1 time: 0.552718 Jul 01 10:51:56.595091 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2594/5084] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:51:56 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 1477 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:56.609506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1e07f32-d12a-4772-bf4a-44139ed0d552 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-965910522"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:51:56.611094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a1e07f32-d12a-4772-bf4a-44139ed0d552 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:56.623382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1e07f32-d12a-4772-bf4a-44139ed0d552 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:56.625046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1e07f32-d12a-4772-bf4a-44139ed0d552 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:56.627623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1e07f32-d12a-4772-bf4a-44139ed0d552 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:56.628305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1e07f32-d12a-4772-bf4a-44139ed0d552 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:56.834589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:56.843298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:56.848754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:56.860322 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a461b7b1-7a10-435f-b9ae-da636e379f62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.600819 Jul 01 10:51:56.866094 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2491/5085] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:56 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:57.381133 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1e07f32-d12a-4772-bf4a-44139ed0d552 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a/action" status: 202 len: 0 microversion: 2.1 time: 0.774784 Jul 01 10:51:57.397403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e189bf80-2387-4629-9c46-aa60a83a7329 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90893940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:57.405330 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2595/5086] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:51:56 2022] POST /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 01 10:51:57.484195 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e189bf80-2387-4629-9c46-aa60a83a7329 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.095372 Jul 01 10:51:57.495678 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2492/5087] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:57 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:57.888752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:57.889885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:57.904172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:57.907917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:57.910708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:57.913839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:58.230753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:58.244104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:58.246904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:58.248948 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-153423a7-cdbb-4185-a3c0-10fe085e9b62 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.365873 Jul 01 10:51:58.250067 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2596/5088] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:57 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:51:58.499939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ab4c10a2-39b9-4762-a50f-04d29e8a1cc2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f927e8dc0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:58.595968 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ab4c10a2-39b9-4762-a50f-04d29e8a1cc2 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.101846 Jul 01 10:51:58.602299 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2493/5089] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:58 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:51:59.270654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:59.271404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:51:59.321176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:59.321954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:59.327737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:51:59.338490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:51:59.404519 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:51:59.610049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1b2577ee-f741-4b84-8032-fe06257f1bac tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90eea040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:51:59.702489 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1b2577ee-f741-4b84-8032-fe06257f1bac tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.096870 Jul 01 10:51:59.709504 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2494/5090] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:51:59 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:51:59.737721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:59.749626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:59.752212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:51:59.753866 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e002f91-3666-4a4b-bafd-e0d1c7ef642b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.488992 Jul 01 10:51:59.756503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2597/5091] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:51:59 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:00.718561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6ada47f-cef7-4add-8f68-cdacf67a80b6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90e8b040>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:00.776164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:00.776939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:00.807392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:00.807859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:00.825028 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:00.826534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:00.859059 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a6ada47f-cef7-4add-8f68-cdacf67a80b6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.146202 Jul 01 10:52:00.864301 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2495/5092] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:00 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:01.220818 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:01.234570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:01.236623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:01.238119 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6be49a65-ca2f-4c1d-8c60-68aeedd61e9f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.468688 Jul 01 10:52:01.239947 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2598/5093] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:00 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:01.878365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-361597de-e5d3-472a-a3e3-60547737c05f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90893940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:02.266662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:02.267294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:02.304663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:02.305121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:02.306030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:02.306412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:03.405344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:03.420301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:03.434738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:03.434738 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e6c7f3e8-a0df-4857-a011-7ca9f6470486 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 1.166158 Jul 01 10:52:03.436468 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2599/5094] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:02 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:03.443141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-efa770a7-d284-48b7-8282-5bd45b61fd96 req-8727f228-8f4d-4bef-95dd-a9c72a9f67ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d10188c-4a0b-466b-8623-8f0aa597929a", "name": "network-vif-plugged", "status": "completed", "tag": "0529a866-192b-4c17-af82-677ab8648764"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:03.456014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-efa770a7-d284-48b7-8282-5bd45b61fd96 req-8727f228-8f4d-4bef-95dd-a9c72a9f67ce service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:03.456933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-efa770a7-d284-48b7-8282-5bd45b61fd96 req-8727f228-8f4d-4bef-95dd-a9c72a9f67ce service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:03.471141 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-efa770a7-d284-48b7-8282-5bd45b61fd96 req-8727f228-8f4d-4bef-95dd-a9c72a9f67ce service nova] Creating event network-vif-plugged:0529a866-192b-4c17-af82-677ab8648764 for instance 6d10188c-4a0b-466b-8623-8f0aa597929a on n-h2-master-1 Jul 01 10:52:03.481575 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-efa770a7-d284-48b7-8282-5bd45b61fd96 req-8727f228-8f4d-4bef-95dd-a9c72a9f67ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039683 Jul 01 10:52:03.481575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2600/5095] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:04.456886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:04.456886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:04.471679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:04.480197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:04.481256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:04.481839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:04.727200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:04.736549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:04.739165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:04.740732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8a048ce4-ba3c-4316-ad9d-2e749cb22214 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.303137 Jul 01 10:52:04.741923 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2601/5096] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:04 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:05.760581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:05.761286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:05.777224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:05.782616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:05.794892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:05.794892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:06.179841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:06.189976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:06.192429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:06.194021 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b583a9a3-4951-4f50-baf0-8508c735c2a5 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.437347 Jul 01 10:52:06.205218 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2602/5097] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:05 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:06.274052 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=11 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:06.842192 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:07.212961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:07.226077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:07.234845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:07.236703 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:07.243064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:07.243776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:07.624250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:07.641359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:07.654071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:07.656647 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96ec4e0f-fa51-4582-b5c9-ca47e72f1426 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.448766 Jul 01 10:52:07.664345 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2603/5098] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:07 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:08.683369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:08.684066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:08.702175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:08.704044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:08.706482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:08.706989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:08.982230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:08.992631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:09.006982 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:09.006982 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f8a1893c-1609-46ef-96b4-f66bad560c53 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.317012 Jul 01 10:52:09.008528 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2604/5099] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:08 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:10.015366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:10.016245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:10.032118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:10.035053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:10.039340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:10.040189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:10.330637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:10.341338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:10.343971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:10.345797 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-062a7dd0-50cc-4a28-9696-05a727795105 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.334972 Jul 01 10:52:10.347235 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2605/5100] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:10 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:11.346563 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-361597de-e5d3-472a-a3e3-60547737c05f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 9.477491 Jul 01 10:52:11.349390 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2496/5101] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:01 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 9479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:11.365428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:11.366151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:11.374782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:11.375348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:11.376293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:11.376897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:11.524641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:11.532597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:11.534118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:11.535267 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-763c57be-549b-467c-b4ab-c36f665ee6eb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.175034 Jul 01 10:52:11.536339 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2606/5102] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:11 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:12.368326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2e63563-1007-4cc9-bb77-0ed89644a88a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90c2fca0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:12.484943 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2e63563-1007-4cc9-bb77-0ed89644a88a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.127720 Jul 01 10:52:12.485564 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2497/5103] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:12 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:12.553469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:12.556176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:12.569569 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:12.570096 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:12.570814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:12.571259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:12.910073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:12.920815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:12.924850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:12.924850 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-389ea91e-258c-4c7f-9bb2-5324dd89d735 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.374367 Jul 01 10:52:12.924850 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2607/5104] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:12 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:13.500844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e107ca33-cadd-4d61-b57f-7fc555c6783c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90c59d30>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:13.621022 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e107ca33-cadd-4d61-b57f-7fc555c6783c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.125899 Jul 01 10:52:13.627105 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2498/5105] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:13 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:13.943299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:13.944767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:13.972853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:13.975071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:13.981319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:13.983200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:14.329224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:14.343669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:14.349766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:14.349766 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77e5f872-5f2d-47ab-ab35-67b9c73969c1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.408871 Jul 01 10:52:14.353647 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2608/5106] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:13 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:14.636103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eabef732-4085-45a4-8500-12ff87c38f15 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f908a8280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:14.726104 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eabef732-4085-45a4-8500-12ff87c38f15 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.094329 Jul 01 10:52:14.732250 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2499/5107] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:14 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:15.371074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:15.378215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:15.383904 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=42 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:15.388411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:15.390172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:15.391361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:15.397498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:15.648538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:15.660637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:15.663229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:15.664872 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dea165e2-c107-42ca-90ea-3689f80df6c2 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.298435 Jul 01 10:52:15.665849 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2609/5108] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:15 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:15.741361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41a61c4a-ab32-46d6-9fb3-b6cd092cedd5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f906ff790>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:15.842090 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-41a61c4a-ab32-46d6-9fb3-b6cd092cedd5 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.106743 Jul 01 10:52:15.843496 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2500/5109] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:15 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:15.897389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2144685012", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:16.052539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:52:16.683766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:16.686397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:16.689256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:52:16.690561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:52:16.691347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:52:16.692083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:52:16.693029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:52:16.702081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:16.702081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:16.702081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:16.702471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:16.706725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:16.707488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:16.708543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:16.708987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:16.742531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Getting quotas for project 41987492c7014214bf08467521411527. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:52:16.761385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Getting quotas for user 68b863f3695645d2a8aac2a4bf1cfee8 and project 41987492c7014214bf08467521411527. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:52:16.838732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:52:16.869366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:52:17.129010 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cdebeeb9-431b-45f4-bf6e-335435dfe77b tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234884 Jul 01 10:52:17.137226 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2610/5110] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:52:17.153860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06bfdcb9-1e8e-4357-a13d-a18a8df43675 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f97040790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:17.183159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:17.198895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:17.205876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:17.207125 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b12d400-76f4-4a7e-bc0f-ac3e8ba69c9b tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.527530 Jul 01 10:52:17.223357 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2501/5111] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:16 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:17.240856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5333514d-913b-4ed7-9460-8b11b258f3ce tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:17.241488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5333514d-913b-4ed7-9460-8b11b258f3ce tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:17.308380 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06bfdcb9-1e8e-4357-a13d-a18a8df43675 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.169388 Jul 01 10:52:17.315662 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2611/5112] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:17 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:17.376951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5333514d-913b-4ed7-9460-8b11b258f3ce tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:17.384078 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5333514d-913b-4ed7-9460-8b11b258f3ce tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1215 microversion: 2.1 time: 0.160576 Jul 01 10:52:17.398295 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2502/5113] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:17 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:18.220197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c1db62c2-e8cb-462b-8659-686529a56954 req-5ddb00c0-98e6-483f-a7f3-fda8301c8a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "name": "network-vif-plugged", "status": "completed", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:18.226151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:18.226880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:18.244407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c1db62c2-e8cb-462b-8659-686529a56954 req-5ddb00c0-98e6-483f-a7f3-fda8301c8a14 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:18.248345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c1db62c2-e8cb-462b-8659-686529a56954 req-5ddb00c0-98e6-483f-a7f3-fda8301c8a14 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:18.251146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:18.252972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:18.253988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:18.256310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:18.278329 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c1db62c2-e8cb-462b-8659-686529a56954 req-5ddb00c0-98e6-483f-a7f3-fda8301c8a14 service nova] Creating event network-vif-plugged:02113d39-dc23-4aa0-be32-f08c71eda3b2 for instance 5ab1b344-b65d-4f47-9630-08ac6461e289 on n-h1-master-1 Jul 01 10:52:18.288690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c1db62c2-e8cb-462b-8659-686529a56954 req-5ddb00c0-98e6-483f-a7f3-fda8301c8a14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.537556 Jul 01 10:52:18.298114 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2612/5114] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:18.328770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3739a43-ea5f-468a-b8e3-3df7c8fff40d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f96fd9940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:18.385643 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3739a43-ea5f-468a-b8e3-3df7c8fff40d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1439 microversion: 2.1 time: 0.065674 Jul 01 10:52:18.386967 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2613/5115] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:18 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:18.420132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93320a14-b494-42fa-89a0-722428c4718c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:18.423046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93320a14-b494-42fa-89a0-722428c4718c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:18.561622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-93320a14-b494-42fa-89a0-722428c4718c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:18.569343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93320a14-b494-42fa-89a0-722428c4718c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1215 microversion: 2.1 time: 0.169153 Jul 01 10:52:18.572597 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2614/5116] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:18 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:18.604608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:18.625497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:18.637556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:18.637556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4044ec14-926e-435c-a31e-5bc3feaca5f6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.407348 Jul 01 10:52:18.637556 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2503/5117] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:18 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:19.399805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9debf0b-5e98-48e5-8340-2db1402912cb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f96f4fee0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:19.492249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9debf0b-5e98-48e5-8340-2db1402912cb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1448 microversion: 2.1 time: 0.096174 Jul 01 10:52:19.503614 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2615/5118] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:19 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1448 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:19.509545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ebe04e8-7b60-41db-ba20-80b104297e63 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91d970d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:19.588598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:19.591841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:19.610018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:19.610386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:19.611167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:19.613036 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ebe04e8-7b60-41db-ba20-80b104297e63 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 200 len: 1448 microversion: 2.1 time: 0.100294 Jul 01 10:52:19.617104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2504/5119] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:19 2022] GET /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 1448 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:19.617779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:19.637347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c84f7076-ec5c-466f-a11e-d2e278aeb33f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90c24280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:19.945476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:19.953501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2bbf96fc-14de-4a06-af56-850ce6b5aeb5 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1219 microversion: 2.1 time: 0.368797 Jul 01 10:52:19.960648 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2616/5120] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:19 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1219 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:19.969180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:19.969800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:19.986736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:19.987197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:19.987994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:19.988439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:20.255508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:20.265673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:20.266977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:20.268867 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4036e8f9-4863-49c9-bdb7-8816864cdb8c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.307123 Jul 01 10:52:20.269639 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2617/5121] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:19 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:20.982987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:20.984844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:20.998688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:20.999918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:21.006714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:21.007223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:21.150529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:21.166758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4d99a91e-2b66-4127-8187-4583fe3e0b6f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1275 microversion: 2.1 time: 0.196556 Jul 01 10:52:21.170338 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2618/5122] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:20 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1275 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:21.291953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:21.292975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:21.309022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:21.312229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:21.313353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:21.313836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:21.599814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:21.605125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:21.606933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:21.608774 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-54266ab2-7a7b-4dc0-9dff-848d540ee3d6 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.324139 Jul 01 10:52:21.619483 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2619/5123] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:21 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:22.139433 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c84f7076-ec5c-466f-a11e-d2e278aeb33f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 204 len: 0 microversion: 2.1 time: 2.516469 Jul 01 10:52:22.142894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2505/5124] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:19 2022] DELETE /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 0 bytes in 2518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:52:22.149716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:22.150965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:22.174243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:22.175781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:22.178052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:22.185657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:22.189133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:22.190029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:22.198901 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:22.202472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:22.202635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:22.203420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:22.205746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:22.275045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:52:22.636981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:22.657398 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-da178022-7b02-42d1-84ec-b9ecb72ab432 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1273 microversion: 2.1 time: 0.473881 Jul 01 10:52:22.669524 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2506/5125] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:22 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1273 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:22.677016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:22.677909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:22.684896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:22.685644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:22.687603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:22.688251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:22.826724 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d6796fb5-99e1-425c-9630-b628db9d0ffb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 204 len: 0 microversion: 2.1 time: 0.681893 Jul 01 10:52:22.829932 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2620/5126] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:52:22 2022] DELETE /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:52:23.000039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:23.016917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:23.018485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:23.019743 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a63d8769-c0e4-40fe-aaaa-355002671e57 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1732 microversion: 2.20 time: 0.348874 Jul 01 10:52:23.020327 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2507/5127] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:22 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1732 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:23.295701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a0cf3dad-f3cc-4fc6-8686-cec266625d26 req-81fede98-b236-4589-977c-2004aeb0266a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d10188c-4a0b-466b-8623-8f0aa597929a", "name": "network-vif-unplugged", "status": "completed", "tag": "0529a866-192b-4c17-af82-677ab8648764"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:23.318596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a0cf3dad-f3cc-4fc6-8686-cec266625d26 req-81fede98-b236-4589-977c-2004aeb0266a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:23.319066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a0cf3dad-f3cc-4fc6-8686-cec266625d26 req-81fede98-b236-4589-977c-2004aeb0266a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:23.350010 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a0cf3dad-f3cc-4fc6-8686-cec266625d26 req-81fede98-b236-4589-977c-2004aeb0266a service nova] Creating event network-vif-unplugged:0529a866-192b-4c17-af82-677ab8648764 for instance 6d10188c-4a0b-466b-8623-8f0aa597929a on n-h2-master-1 Jul 01 10:52:23.364823 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a0cf3dad-f3cc-4fc6-8686-cec266625d26 req-81fede98-b236-4589-977c-2004aeb0266a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076884 Jul 01 10:52:23.366143 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2621/5128] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:23.506076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-434529690", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "0417ff04-b95e-42da-8dd3-bd5150fa1982"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:23.622021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] validate_networks() for [('0417ff04-b95e-42da-8dd3-bd5150fa1982', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:52:23.689591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:23.693472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:23.702617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:23.702906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:23.703782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:23.704319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:24.487238 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:24.497812 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-583cad66-a5d9-4486-b314-19eeb92f26d9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.820629 Jul 01 10:52:24.511234 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2622/5129] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:23 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:24.520569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:24.522667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:24.541609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:24.542385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:24.543219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:24.543673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:25.037569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:52:25.043970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:52:25.044651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:52:25.045366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:52:25.046515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:52:25.073029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:25.073512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:25.077866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:25.086869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:25.087669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:25.105775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:25.110261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:25.111506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6dd6ec83-6e35-49f0-b3f0-939de70c36a1 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1719 microversion: 2.20 time: 0.598330 Jul 01 10:52:25.112487 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2623/5130] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:24 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1719 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:25.143659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:52:25.162713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Getting quotas for user be759a44a78544109032556c07b5c868 and project 2c2edf723e9a4f2f877bf43812b279da. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:52:25.193261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:52:25.196473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:52:25.399820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fe87fb77-1d54-4ce8-9656-ad7c4f82716d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901202 Jul 01 10:52:25.404567 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2508/5131] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:52:25.421799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-818cfdf0-9f1a-4455-9f2d-8904b6520582 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:25.422472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-818cfdf0-9f1a-4455-9f2d-8904b6520582 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:25.516491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:25.517398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:25.530930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:25.531388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:25.532243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:25.532670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:25.578730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-818cfdf0-9f1a-4455-9f2d-8904b6520582 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:25.588764 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-818cfdf0-9f1a-4455-9f2d-8904b6520582 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1207 microversion: 2.1 time: 0.178600 Jul 01 10:52:25.603086 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2624/5132] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:25 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1207 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:26.042391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b1fcc3d5-f935-416a-b999-6d7637950091 req-445b26d0-8a42-4ce2-9a1f-86f68528e1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9a2bbf-ec32-4533-8f8a-7ba6819b4495", "tag": "17f59781-7816-4948-8ba6-ff6f60357a45"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:26.067325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b1fcc3d5-f935-416a-b999-6d7637950091 req-445b26d0-8a42-4ce2-9a1f-86f68528e1bd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:26.069381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b1fcc3d5-f935-416a-b999-6d7637950091 req-445b26d0-8a42-4ce2-9a1f-86f68528e1bd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:26.123684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:26.131178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b1fcc3d5-f935-416a-b999-6d7637950091 req-445b26d0-8a42-4ce2-9a1f-86f68528e1bd service nova] Creating event network-changed:17f59781-7816-4948-8ba6-ff6f60357a45 for instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 on n-h1-master-1 Jul 01 10:52:26.153196 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b1fcc3d5-f935-416a-b999-6d7637950091 req-445b26d0-8a42-4ce2-9a1f-86f68528e1bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114358 Jul 01 10:52:26.156249 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2625/5133] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:52:26.166159 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cc1a46c-1a35-4090-ba7d-ad63896686a3 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.632314 Jul 01 10:52:26.208124 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2509/5134] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:25 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:26.615038 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25ee0fb9-f952-4168-8b1c-98c69c5378ae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:26.617059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-25ee0fb9-f952-4168-8b1c-98c69c5378ae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:26.723853 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:26.836579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-25ee0fb9-f952-4168-8b1c-98c69c5378ae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:26.858215 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25ee0fb9-f952-4168-8b1c-98c69c5378ae tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1207 microversion: 2.1 time: 0.252154 Jul 01 10:52:26.868864 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2626/5135] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:26 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1207 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:27.009688 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 10:52:27.010119 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 10:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Jul 01 10:52:27.212125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:27.212987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:27.221520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:27.222363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:27.224162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:27.224949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:27.416410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:27.417044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5308e0ff-af4b-48e3-81ae-9ce35402ac54 req-275d9ddd-7aa9-49d4-8afe-6297d1fc04a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d10188c-4a0b-466b-8623-8f0aa597929a", "name": "network-vif-deleted", "tag": "0529a866-192b-4c17-af82-677ab8648764"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:27.427282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5308e0ff-af4b-48e3-81ae-9ce35402ac54 req-275d9ddd-7aa9-49d4-8afe-6297d1fc04a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:27.427727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5308e0ff-af4b-48e3-81ae-9ce35402ac54 req-275d9ddd-7aa9-49d4-8afe-6297d1fc04a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:27.430142 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-847d31d4-1032-4210-bcc1-3aa7d24511d4 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.222095 Jul 01 10:52:27.430831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2627/5136] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:27 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:27.440221 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5308e0ff-af4b-48e3-81ae-9ce35402ac54 req-275d9ddd-7aa9-49d4-8afe-6297d1fc04a4 service nova] Creating event network-vif-deleted:0529a866-192b-4c17-af82-677ab8648764 for instance 6d10188c-4a0b-466b-8623-8f0aa597929a on n-h2-master-1 Jul 01 10:52:27.445514 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5308e0ff-af4b-48e3-81ae-9ce35402ac54 req-275d9ddd-7aa9-49d4-8afe-6297d1fc04a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.585930 Jul 01 10:52:27.446121 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2510/5137] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:27.877560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:27.878117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:27.889842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:27.890297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:27.899372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:27.899880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:28.077565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:28.089700 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-74aad4a3-341a-492f-b3f0-6c111a941269 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1203 microversion: 2.1 time: 0.216332 Jul 01 10:52:28.098760 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2628/5138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:27 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:28.457553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:28.461041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:28.484436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:28.484860 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:28.485796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:28.486354 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:28.824833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:28.833967 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-690d1816-d24a-49da-a4bb-a22434adc8a9 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.389778 Jul 01 10:52:28.839807 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2511/5139] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:28 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:29.111229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:29.111862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:29.131757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:29.131757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:29.131757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:29.131757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:29.306196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:29.315548 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b18146fa-b4f6-48c0-bd4a-1d64e314f26e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1277 microversion: 2.1 time: 0.212276 Jul 01 10:52:29.326512 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2629/5140] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:29 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:29.856261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:29.856883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:29.868434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:29.873526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:29.881116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:29.881116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:30.322982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:30.333636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:30.334258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:30.342129 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b7c6d836-e80c-4e3e-a4fc-689e0c8fd6c1 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.489686 Jul 01 10:52:30.342753 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2512/5141] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:29 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:30.360795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:30.361282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:30.362110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:30.362521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:30.655934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:30.667662 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1909cb48-de02-4d9d-a271-784d51027a5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.338628 Jul 01 10:52:30.670072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2630/5142] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:30 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:31.359248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:31.360709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:31.369806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:31.370738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:31.371723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:31.372493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:31.692015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:31.693635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:31.702596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:31.704262 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:31.704971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:31.706559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:31.707221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:31.715218 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d344298d-a0ca-435a-9e06-a453bc5a0f4f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.359679 Jul 01 10:52:31.716485 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2513/5143] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:31 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:31.974745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:31.984033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08897710-195c-433c-86ad-7ff4e7cd3b66 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.296317 Jul 01 10:52:31.994089 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2631/5144] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:31 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:32.163961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b47f08fd-25c1-4641-ac80-e03a2f4f0975 req-6e1f1149-9a50-4ccd-91b3-bd77003860e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e354861c-8bdb-495c-a36f-dd66dd04e0f6", "tag": "fce5f10a-b292-4e03-932e-45c581115208"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:32.177465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b47f08fd-25c1-4641-ac80-e03a2f4f0975 req-6e1f1149-9a50-4ccd-91b3-bd77003860e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:32.182947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b47f08fd-25c1-4641-ac80-e03a2f4f0975 req-6e1f1149-9a50-4ccd-91b3-bd77003860e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:32.206429 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b47f08fd-25c1-4641-ac80-e03a2f4f0975 req-6e1f1149-9a50-4ccd-91b3-bd77003860e4 service nova] Creating event network-changed:fce5f10a-b292-4e03-932e-45c581115208 for instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 on n-h2-master-1 Jul 01 10:52:32.221200 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b47f08fd-25c1-4641-ac80-e03a2f4f0975 req-6e1f1149-9a50-4ccd-91b3-bd77003860e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061325 Jul 01 10:52:32.221825 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2514/5145] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:52:32.741172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:32.741810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:32.782482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:32.782940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:32.786385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:32.787256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:33.005383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:33.006973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:33.044033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:33.046410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:33.050475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:33.054036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:33.145445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:33.154901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8cbc8a60-5b39-4672-8e9f-b04a5164334f tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.425230 Jul 01 10:52:33.161063 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2632/5146] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:32 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:33.414719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:33.423542 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-10ebcb18-3d91-40ea-9d79-facdb27b3387 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.425129 Jul 01 10:52:33.424924 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2515/5147] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:32 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:33.852045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f7e5e656-0b81-4ab9-8620-b615301557e1 req-6344d181-aad6-4419-a1cb-a80f480dff60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9a2bbf-ec32-4533-8f8a-7ba6819b4495", "name": "network-vif-plugged", "status": "completed", "tag": "17f59781-7816-4948-8ba6-ff6f60357a45"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:33.889770 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f7e5e656-0b81-4ab9-8620-b615301557e1 req-6344d181-aad6-4419-a1cb-a80f480dff60 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:33.894567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f7e5e656-0b81-4ab9-8620-b615301557e1 req-6344d181-aad6-4419-a1cb-a80f480dff60 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:33.928101 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f7e5e656-0b81-4ab9-8620-b615301557e1 req-6344d181-aad6-4419-a1cb-a80f480dff60 service nova] Creating event network-vif-plugged:17f59781-7816-4948-8ba6-ff6f60357a45 for instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 on n-h1-master-1 Jul 01 10:52:33.939325 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f7e5e656-0b81-4ab9-8620-b615301557e1 req-6344d181-aad6-4419-a1cb-a80f480dff60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093794 Jul 01 10:52:33.945356 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2633/5148] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:34.176225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:34.177038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:34.195628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:34.196147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:34.196889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:34.211503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:34.444234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:34.445422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:34.459110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:34.460245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:34.461958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:34.462821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:34.686799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:34.735401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5a0ff911-62a8-4a35-bd73-1be998732b1c tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1315 microversion: 2.1 time: 0.561769 Jul 01 10:52:34.737260 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2516/5149] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:34 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:34.915196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:34.925526 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d471b2e-378b-416c-9722-316646265061 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.487603 Jul 01 10:52:34.928247 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2634/5150] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:34 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:35.765539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:35.765539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:35.770876 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:35.771572 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:35.788239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:35.794842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:35.794842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:35.794842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:35.946458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:35.948550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:35.982857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:35.985069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:35.987338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:35.989367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:36.081921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:36.095684 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-547c8826-c727-4c86-ba02-6c448cb56856 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1465 microversion: 2.1 time: 0.342102 Jul 01 10:52:36.096283 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2517/5151] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:35 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1465 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:36.151680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:36.151994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:36.158865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:36.159314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:36.160684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:36.161122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:36.213463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:52:36.257658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:36.266577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8e79490-fe1a-4163-acf0-4417a38909dd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.326535 Jul 01 10:52:36.273018 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2635/5152] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:35 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:36.547230 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cc11059-e202-41ea-93d7-d33b822d7678 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 204 len: 0 microversion: 2.1 time: 0.399454 Jul 01 10:52:36.548686 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2518/5153] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:52:36 2022] DELETE /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:52:36.557682 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:36.558506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:36.565812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:36.567457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:36.568443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:36.569047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:36.841402 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:36.916396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:36.932523 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-21b0bfee-451c-453b-906c-61e05bda4d77 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1471 microversion: 2.1 time: 0.379491 Jul 01 10:52:36.933868 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2636/5154] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:36 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:37.285743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:37.286454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:37.299780 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:37.302094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:37.302536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:37.308891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:37.310053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:37.516703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:37.532239 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ce7a09e-290f-4115-95c4-9c65c40ccf1d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.244534 Jul 01 10:52:37.532933 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2519/5155] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:37 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:37.950585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:37.951747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:37.966208 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:37.966752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:37.973657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:37.977190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:38.385820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:38.400058 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7522fff7-5c94-4a6f-a128-8692f645cb00 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1471 microversion: 2.1 time: 0.453510 Jul 01 10:52:38.404425 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2637/5156] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:37 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:38.551853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:38.552492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:38.570718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:38.570718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:38.570718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:38.571323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:38.575262 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:39.006284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:39.021668 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9042b228-1eb8-4414-b140-fda5172f653b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.471863 Jul 01 10:52:39.026721 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2520/5157] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:38 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:39.260477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-391aaed0-58e8-4d8a-b55a-21de230fd290 req-97e1543f-a92a-4d7c-b5e8-541c3927c173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9a2bbf-ec32-4533-8f8a-7ba6819b4495", "name": "network-vif-deleted", "tag": "17f59781-7816-4948-8ba6-ff6f60357a45"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:39.282026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-391aaed0-58e8-4d8a-b55a-21de230fd290 req-97e1543f-a92a-4d7c-b5e8-541c3927c173 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:39.288627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-391aaed0-58e8-4d8a-b55a-21de230fd290 req-97e1543f-a92a-4d7c-b5e8-541c3927c173 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:39.326112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-391aaed0-58e8-4d8a-b55a-21de230fd290 req-97e1543f-a92a-4d7c-b5e8-541c3927c173 service nova] Creating event network-vif-deleted:17f59781-7816-4948-8ba6-ff6f60357a45 for instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 on n-h1-master-1 Jul 01 10:52:39.354447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-391aaed0-58e8-4d8a-b55a-21de230fd290 req-97e1543f-a92a-4d7c-b5e8-541c3927c173 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099182 Jul 01 10:52:39.355064 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2638/5158] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:39.423570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:39.426780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:39.438639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:39.439418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:39.444667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:39.444667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:39.575146 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:39.585723 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39b0aad0-a3c4-4784-b8b6-b615b2c086b7 tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1429 microversion: 2.1 time: 0.167316 Jul 01 10:52:39.601251 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2521/5159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:39 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:40.038803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:40.040761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8631641f-399d-4bae-883b-453fd14c949b req-81b6b354-0be8-47fa-adc9-7d31bf1fad86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e354861c-8bdb-495c-a36f-dd66dd04e0f6", "name": "network-vif-plugged", "status": "completed", "tag": "fce5f10a-b292-4e03-932e-45c581115208"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:40.041801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:40.067362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:40.067362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:40.067362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:40.069700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:40.071176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8631641f-399d-4bae-883b-453fd14c949b req-81b6b354-0be8-47fa-adc9-7d31bf1fad86 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:40.079646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8631641f-399d-4bae-883b-453fd14c949b req-81b6b354-0be8-47fa-adc9-7d31bf1fad86 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:40.121277 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8631641f-399d-4bae-883b-453fd14c949b req-81b6b354-0be8-47fa-adc9-7d31bf1fad86 service nova] Creating event network-vif-plugged:fce5f10a-b292-4e03-932e-45c581115208 for instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 on n-h2-master-1 Jul 01 10:52:40.136259 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8631641f-399d-4bae-883b-453fd14c949b req-81b6b354-0be8-47fa-adc9-7d31bf1fad86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106722 Jul 01 10:52:40.137937 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2639/5160] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:52:40.346373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:40.356024 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-edc705ce-46a0-4358-a117-593e6136d2c4 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.320748 Jul 01 10:52:40.357602 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2522/5161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:40 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:40.604854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:40.605640 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:40.619268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:40.619778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:40.622085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:40.629838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:40.653571 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:40.697957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:40.699942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:40.700562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lazy-loading 'fault' on Instance uuid 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:52:40.876934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b863f3695645d2a8aac2a4bf1cfee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41987492c7014214bf08467521411527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:40.887048 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6347b3e-56f9-4b42-af65-ad13dbcfbdbf tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 200 len: 1305 microversion: 2.1 time: 0.287111 Jul 01 10:52:40.887873 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2640/5162] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:40 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:41.373458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:41.375079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:41.394313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:41.397052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:41.399088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:41.401045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:41.809991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:41.818267 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9400f68-7dec-42ec-83d5-61b5898bdbee tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1307 microversion: 2.1 time: 0.448699 Jul 01 10:52:41.832409 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2523/5163] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:41 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1307 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:41.911235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:41.912596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] [instance: 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:41.922192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:41.922778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:41.924024 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:41.924549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:41.975187 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] HTTP exception thrown: Instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 could not be found. Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Request method failure captured: Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 HTTP/1.1 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtHbnq3ubc4B2HWTCNtTDYOG3goCiUiXurOeLJndwpm-achDJfM-9qt-_F0DcCREzmp8ZeiTdWiRGRKjVuPr1dA4kM86Xv4QlnLwUv4tvxnQpQ3uTc_lBETHNL6ry8U2SdP2g8yYIbq71yYqDsRRJYPHIP5275jmZoR467NX2KwtIMo Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 41987492c7014214bf08467521411527 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesNegativeTest-1130349145 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41987492c7014214bf08467521411527"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/41987492c7014214bf08467521411527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_41987492c7014214bf08467521411527", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41987492c7014214bf08467521411527"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesNegativeTest-1130349145 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 41987492c7014214bf08467521411527 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesNegativeTest-1130349145 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesNegativeTest-1130349145-project Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 68b863f3695645d2a8aac2a4bf1cfee8 Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesNegativeTest-1130349145-project Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 could not be found. Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6d9a2bbf-ec32-4533-8f8a-7ba6819b4495'} Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 could not be found. Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 could not be found. Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:41.976988 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 could not be found. Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] Returning 404 to user: Instance 6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:41.983713 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb46dcb0-f65c-45eb-b494-361d56c4016a tempest-VolumesNegativeTest-1130349145 tempest-VolumesNegativeTest-1130349145-project] 10.222.0.23 "GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495" status: 404 len: 111 microversion: 2.1 time: 0.075729 Jul 01 10:52:41.988707 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2641/5164] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:41 2022] GET /compute/v2.1/servers/6d9a2bbf-ec32-4533-8f8a-7ba6819b4495 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:52:42.838150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:42.838756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:42.849345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:42.853456 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:42.853456 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:42.853456 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:43.506430 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:43.524216 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d9d8f0f2-531a-4b1d-ad0c-3e9cdab82b73 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1486 microversion: 2.1 time: 0.690112 Jul 01 10:52:43.534871 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2524/5165] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:42 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1486 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:43.557091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e76c6e4d-e895-448f-911d-7bc01691f73c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-383988223"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:43.560515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e76c6e4d-e895-448f-911d-7bc01691f73c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:43.595487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e76c6e4d-e895-448f-911d-7bc01691f73c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:43.596104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e76c6e4d-e895-448f-911d-7bc01691f73c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:43.598447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e76c6e4d-e895-448f-911d-7bc01691f73c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:43.599421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e76c6e4d-e895-448f-911d-7bc01691f73c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:44.615283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e76c6e4d-e895-448f-911d-7bc01691f73c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "POST /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6/action" status: 202 len: 0 microversion: 2.1 time: 1.072501 Jul 01 10:52:44.617282 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2642/5166] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:52:43 2022] POST /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6/action => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 10:52:44.629272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-194df95c-b020-4500-8a16-bb63288847cb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f90c46940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:44.716700 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-194df95c-b020-4500-8a16-bb63288847cb tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1" status: 200 len: 1413 microversion: 2.1 time: 0.092884 Jul 01 10:52:44.719234 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2525/5167] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:44 2022] GET /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:44.738479 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea0a5cae-2954-4849-bcc1-c61a3c458579 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91ad5c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:44.844723 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea0a5cae-2954-4849-bcc1-c61a3c458579 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1" status: 200 len: 1413 microversion: 2.1 time: 0.111066 Jul 01 10:52:44.856901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c55b94e6-3531-4639-ab49-8abee0cb6391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91e46f70>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:44.862997 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2643/5168] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:44 2022] GET /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:45.230706 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c55b94e6-3531-4639-ab49-8abee0cb6391 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1" status: 204 len: 0 microversion: 2.1 time: 0.373859 Jul 01 10:52:45.230706 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2526/5169] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:44 2022] DELETE /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:52:45.238819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-023c9208-bfe7-4856-9344-8dd7f8a48b5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f923d1c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:45.273289 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-023c9208-bfe7-4856-9344-8dd7f8a48b5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Image not found. Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-023c9208-bfe7-4856-9344-8dd7f8a48b5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1 HTTP/1.1 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd67f21b7-a683-41ce-9e89-a712752aa8a1'} Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d67f21b7-a683-41ce-9e89-a712752aa8a1 Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 01 10:52:45.277414 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d67f21b7-a683-41ce-9e89-a712752aa8a1 could not be found. Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:52:45.280299 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:45.285047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-023c9208-bfe7-4856-9344-8dd7f8a48b5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:45.286776 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-023c9208-bfe7-4856-9344-8dd7f8a48b5c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1" status: 404 len: 62 microversion: 2.1 time: 0.054030 Jul 01 10:52:45.304496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:45.306159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:45.308909 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2644/5170] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Jul 1 10:52:45 2022] GET /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:52:45.318981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:45.320204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:45.327281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:45.328771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:45.585367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:45.594753 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed29693a-947a-4bc0-add1-6ba9f780c16f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1498 microversion: 2.1 time: 0.302695 Jul 01 10:52:45.595838 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2527/5171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:45 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1498 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:46.616621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:46.619192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:46.627327 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:46.630630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:46.631390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:46.632449 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:46.633070 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:46.926117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:46.936583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ee33245a-f693-4aed-8b13-68848f72299a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1504 microversion: 2.1 time: 0.327008 Jul 01 10:52:46.948431 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2645/5172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:46 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:47.959988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:47.976799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:48.014972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:48.015458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:48.023352 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:48.023818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:48.355175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:48.364771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb819fb5-0e1e-4a9e-b51a-7172d2b8cdbe tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1499 microversion: 2.1 time: 0.410195 Jul 01 10:52:48.368617 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2528/5173] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:47 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1499 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:49.403560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:49.405004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:49.438539 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:49.440298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:49.446461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:49.447507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:49.629545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4d31455a-baf0-4f13-a5a4-5f9cebd42fda req-dbe67f7e-054c-49df-bf4a-55738b3183c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e354861c-8bdb-495c-a36f-dd66dd04e0f6", "name": "network-vif-plugged", "status": "completed", "tag": "fce5f10a-b292-4e03-932e-45c581115208"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:49.674432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4d31455a-baf0-4f13-a5a4-5f9cebd42fda req-dbe67f7e-054c-49df-bf4a-55738b3183c1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:49.678237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4d31455a-baf0-4f13-a5a4-5f9cebd42fda req-dbe67f7e-054c-49df-bf4a-55738b3183c1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:49.729268 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4d31455a-baf0-4f13-a5a4-5f9cebd42fda req-dbe67f7e-054c-49df-bf4a-55738b3183c1 service nova] Creating event network-vif-plugged:fce5f10a-b292-4e03-932e-45c581115208 for instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 on n-h2-master-1 Jul 01 10:52:49.736606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:49.743025 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4d31455a-baf0-4f13-a5a4-5f9cebd42fda req-dbe67f7e-054c-49df-bf4a-55738b3183c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122077 Jul 01 10:52:49.746758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8eb7ce08-19b4-46b3-a79e-42cf6807204c tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1486 microversion: 2.1 time: 0.360891 Jul 01 10:52:49.750643 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2529/5174] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:52:49.760431 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2646/5175] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:49 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1486 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:49.776333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:49.781176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:49.808377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:49.809136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:49.814989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:49.816299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:49.938907 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:52:50.437081 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-150f5f1e-b9d6-4706-a71a-136eabc976fd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 204 len: 0 microversion: 2.1 time: 0.674920 Jul 01 10:52:50.442807 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2530/5176] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:52:49 2022] DELETE /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:52:50.456686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e0d6aa1-1062-4cdd-b506-3ad56c2e6b1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f97040280>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:50.488780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-4e0d6aa1-1062-4cdd-b506-3ad56c2e6b1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Image not found. Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e0d6aa1-1062-4cdd-b506-3ad56c2e6b1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1 HTTP/1.1 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd67f21b7-a683-41ce-9e89-a712752aa8a1'} Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d67f21b7-a683-41ce-9e89-a712752aa8a1 to delete Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d67f21b7-a683-41ce-9e89-a712752aa8a1 could not be found. Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:50.495871 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:52:50.499092 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:50.521990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e0d6aa1-1062-4cdd-b506-3ad56c2e6b1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:50.523277 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e0d6aa1-1062-4cdd-b506-3ad56c2e6b1b tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1" status: 404 len: 62 microversion: 2.1 time: 0.074154 Jul 01 10:52:50.529049 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2647/5177] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:50 2022] DELETE /compute/v2.1/images/d67f21b7-a683-41ce-9e89-a712752aa8a1 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 10:52:50.535149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:50.535751 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:50.550961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:50.551418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:50.552215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:50.552661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:50.612387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:52:50.810478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6e0e181-f675-4e9f-be8e-db244b03e887 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:50.812998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6e0e181-f675-4e9f-be8e-db244b03e887 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:50.838767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6e0e181-f675-4e9f-be8e-db244b03e887 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:50.839212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6e0e181-f675-4e9f-be8e-db244b03e887 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:50.844163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6e0e181-f675-4e9f-be8e-db244b03e887 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:50.845760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6e0e181-f675-4e9f-be8e-db244b03e887 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:50.849897 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.api [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Instance is already in deleting state, ignoring this request Jul 01 10:52:50.850959 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f5327ff-2d95-4471-bab6-32972361bddd tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 204 len: 0 microversion: 2.1 time: 0.320267 Jul 01 10:52:50.851905 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2531/5178] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:52:50 2022] DELETE /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:52:50.884245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:50.891424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:50.914756 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:50.915412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:50.917064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:50.917816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:50.919857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6e0e181-f675-4e9f-be8e-db244b03e887 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.114793 Jul 01 10:52:50.921834 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2648/5179] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Jul 1 10:52:50 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:51.030075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:51.030814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:51.052943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:51.056077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:51.057090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:51.058421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:51.147809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:52:51.228815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:51.238482 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-53b11622-50c1-4663-a2ad-ec2ca162776e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1492 microversion: 2.1 time: 0.378101 Jul 01 10:52:51.242680 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2532/5180] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:50 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1492 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:51.683829 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-112a9a6f-da9f-44d2-87c2-a8704d8bb7cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 204 len: 0 microversion: 2.20 time: 0.657551 Jul 01 10:52:51.687635 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2649/5181] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:52:51 2022] DELETE /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:52:51.697758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:51.698798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:51.720481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:51.727622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:51.727622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:51.731078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:52.014014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:52.026423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:52.031449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:52.032882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67a40a4e-432d-4e03-b30a-b945a5e22c36 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.340187 Jul 01 10:52:52.036335 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2533/5182] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:51 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:52:52.260241 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:52.261100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:52.282734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:52.283351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:52.284164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:52.285175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:52.498493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:52.510916 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06429336-13fd-488e-927d-4d43f6e15df9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1492 microversion: 2.1 time: 0.255479 Jul 01 10:52:52.527759 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2650/5183] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:52 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1492 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:52:52.905403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c368e712-417c-4caa-b119-e64d08a188b8 req-b790f45d-1d4b-47b2-ad77-5584cd4d3f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e354861c-8bdb-495c-a36f-dd66dd04e0f6", "name": "network-vif-deleted", "tag": "fce5f10a-b292-4e03-932e-45c581115208"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:52.933165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c368e712-417c-4caa-b119-e64d08a188b8 req-b790f45d-1d4b-47b2-ad77-5584cd4d3f51 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:52.936137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c368e712-417c-4caa-b119-e64d08a188b8 req-b790f45d-1d4b-47b2-ad77-5584cd4d3f51 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:52.964564 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c368e712-417c-4caa-b119-e64d08a188b8 req-b790f45d-1d4b-47b2-ad77-5584cd4d3f51 service nova] Creating event network-vif-deleted:fce5f10a-b292-4e03-932e-45c581115208 for instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 on n-h2-master-1 Jul 01 10:52:52.975975 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c368e712-417c-4caa-b119-e64d08a188b8 req-b790f45d-1d4b-47b2-ad77-5584cd4d3f51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074244 Jul 01 10:52:52.977211 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2534/5184] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:53.056165 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:53.056785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:53.064214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:53.064670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:53.066630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:53.067296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:53.520413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:53.535262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:53.536129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:53.537234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:53.537646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:53.539122 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e761bbe0-3240-428c-bd20-d041ec3ebcce tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1725 microversion: 2.20 time: 0.489304 Jul 01 10:52:53.549777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:53.550421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:53.551992 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2651/5185] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:53 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1725 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:53.558830 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:53.560105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:53.618313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:53.618882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:53.619412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lazy-loading 'fault' on Instance uuid e354861c-8bdb-495c-a36f-dd66dd04e0f6 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:52:53.693084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be759a44a78544109032556c07b5c868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2edf723e9a4f2f877bf43812b279da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:53.701452 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa81810c-1461-4f7f-9202-061799eab93e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 200 len: 1297 microversion: 2.1 time: 0.170099 Jul 01 10:52:53.702042 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2535/5186] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:53 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 1297 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:52:54.558331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:54.558838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:54.569117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.577881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.578862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.579305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.695612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:54.709528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:54.717540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:54.718784 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-807193da-10cd-4c0f-a9f2-77c34c743514 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1657 microversion: 2.20 time: 0.164695 Jul 01 10:52:54.718908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:54.719397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: e354861c-8bdb-495c-a36f-dd66dd04e0f6] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:54.727986 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2652/5187] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:54 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1657 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:54.759639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.764274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.765182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.774127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.796720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0c843f8a-946f-4d4c-8888-fdeec716c909 req-7b885b0e-22d4-45d7-a1eb-79f723532695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab1b344-b65d-4f47-9630-08ac6461e289", "name": "network-vif-deleted", "tag": "02113d39-dc23-4aa0-be32-f08c71eda3b2"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:52:54.809805 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 could not be found. Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 HTTP/1.1 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: exception: Instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 could not be found. Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'e354861c-8bdb-495c-a36f-dd66dd04e0f6'} Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 could not be found. Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 could not be found. Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.813453 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 could not be found. Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Instance e354861c-8bdb-495c-a36f-dd66dd04e0f6 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:54.820621 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68fd72bb-78d2-4fa6-826a-6b23719bace0 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6" status: 404 len: 111 microversion: 2.1 time: 0.103081 Jul 01 10:52:54.821265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0c843f8a-946f-4d4c-8888-fdeec716c909 req-7b885b0e-22d4-45d7-a1eb-79f723532695 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.821265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0c843f8a-946f-4d4c-8888-fdeec716c909 req-7b885b0e-22d4-45d7-a1eb-79f723532695 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.823432 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2536/5188] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:54 2022] GET /compute/v2.1/servers/e354861c-8bdb-495c-a36f-dd66dd04e0f6 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:52:54.830334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98172abf-b4a7-4f38-affe-cbedd60fb2e9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91f38280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:54.849347 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0c843f8a-946f-4d4c-8888-fdeec716c909 req-7b885b0e-22d4-45d7-a1eb-79f723532695 service nova] Creating event network-vif-deleted:02113d39-dc23-4aa0-be32-f08c71eda3b2 for instance 5ab1b344-b65d-4f47-9630-08ac6461e289 on n-h1-master-1 Jul 01 10:52:54.863758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0c843f8a-946f-4d4c-8888-fdeec716c909 req-7b885b0e-22d4-45d7-a1eb-79f723532695 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073106 Jul 01 10:52:54.867438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-98172abf-b4a7-4f38-affe-cbedd60fb2e9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Image not found. Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98172abf-b4a7-4f38-affe-cbedd60fb2e9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 HTTP/1.1 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '06efe1af-caa7-451f-ba6b-776148a16079'} Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 06efe1af-caa7-451f-ba6b-776148a16079 to delete Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06efe1af-caa7-451f-ba6b-776148a16079 could not be found. Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.871159 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.879314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98172abf-b4a7-4f38-affe-cbedd60fb2e9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:54.880725 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2653/5189] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:52:54.880794 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98172abf-b4a7-4f38-affe-cbedd60fb2e9 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079" status: 404 len: 62 microversion: 2.1 time: 0.046060 Jul 01 10:52:54.880794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2537/5190] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:54 2022] DELETE /compute/v2.1/images/06efe1af-caa7-451f-ba6b-776148a16079 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:52:54.885362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:54.885958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:54.892596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.893050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.893905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.895321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a HTTP/1.1 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '6d10188c-4a0b-466b-8623-8f0aa597929a'} Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:54.918922 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a37e35d1-5eba-4596-b240-14d7628dc0b1 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 404 len: 111 microversion: 2.1 time: 0.043352 Jul 01 10:52:54.922142 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2654/5191] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:52:54 2022] DELETE /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:52:54.935728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:54.940263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 6d10188c-4a0b-466b-8623-8f0aa597929a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:54.959384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.960033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.960856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:54.961335 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:54.980559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a HTTP/1.1 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '6d10188c-4a0b-466b-8623-8f0aa597929a'} Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.982407 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Instance 6d10188c-4a0b-466b-8623-8f0aa597929a could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:54.987896 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cc181b43-a6c3-4db5-95e3-d2dda48c559e tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a" status: 404 len: 111 microversion: 2.1 time: 0.060347 Jul 01 10:52:54.988823 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2538/5192] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:54 2022] GET /compute/v2.1/servers/6d10188c-4a0b-466b-8623-8f0aa597929a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:52:54.997238 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a1496dc-9726-4188-b716-6c038911a669 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f910170d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:55.026929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-1a1496dc-9726-4188-b716-6c038911a669 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Image not found. Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a1496dc-9726-4188-b716-6c038911a669 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 HTTP/1.1 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: exception: Image not found. Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '5eab7b08-b2db-4974-8a63-6f6d531fae14'} Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5eab7b08-b2db-4974-8a63-6f6d531fae14 to delete Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5eab7b08-b2db-4974-8a63-6f6d531fae14 could not be found. Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.029032 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:52:55.032713 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.034657 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a1496dc-9726-4188-b716-6c038911a669 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Image not found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:55.035666 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a1496dc-9726-4188-b716-6c038911a669 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14" status: 404 len: 62 microversion: 2.1 time: 0.042379 Jul 01 10:52:55.036656 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2655/5193] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:54 2022] DELETE /compute/v2.1/images/5eab7b08-b2db-4974-8a63-6f6d531fae14 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:52:55.052145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:55.053102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:55.073872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.074438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.076764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.076764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.086207 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd HTTP/1.1 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: exception: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'fd57d7c8-7193-40e6-9ffe-232ca63f86cd'} Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:55.108645 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a238350c-fefd-4ab7-a661-1f29ec8a2a80 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 404 len: 111 microversion: 2.1 time: 0.066065 Jul 01 10:52:55.112602 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2539/5194] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:52:55 2022] DELETE /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:52:55.115755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:55.116407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: fd57d7c8-7193-40e6-9ffe-232ca63f86cd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:55.131914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.132422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.133266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.134076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.158307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd HTTP/1.1 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: exception: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'fd57d7c8-7193-40e6-9ffe-232ca63f86cd'} Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.160941 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Instance fd57d7c8-7193-40e6-9ffe-232ca63f86cd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-036c3a23-898c-45d6-8a0c-83635a882c5d tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd" status: 404 len: 111 microversion: 2.1 time: 0.051019 Jul 01 10:52:55.164033 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2656/5195] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:55 2022] GET /compute/v2.1/servers/fd57d7c8-7193-40e6-9ffe-232ca63f86cd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:52:55.173211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71fd05cd-a4cd-4bcb-8755-38503cc0664a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '.version_select at 0x7f6f91e04310>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:55.209274 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-71fd05cd-a4cd-4bcb-8755-38503cc0664a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Image not found. Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71fd05cd-a4cd-4bcb-8755-38503cc0664a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a HTTP/1.1 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: exception: Image not found. Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '6dec1742-93a7-4723-bc13-83728d85090a'} Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6dec1742-93a7-4723-bc13-83728d85090a to delete Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6dec1742-93a7-4723-bc13-83728d85090a could not be found. Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.211229 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71fd05cd-a4cd-4bcb-8755-38503cc0664a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Image not found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71fd05cd-a4cd-4bcb-8755-38503cc0664a tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a" status: 404 len: 62 microversion: 2.1 time: 0.046076 Jul 01 10:52:55.220636 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2540/5196] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:55 2022] DELETE /compute/v2.1/images/6dec1742-93a7-4723-bc13-83728d85090a => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 10:52:55.227953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:55.228594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:55.240400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.241290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.244050 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.244610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.279471 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c HTTP/1.1 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '205d1cc4-59f7-4959-8d0a-72052c741f2c'} Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:55.282538 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:55.294383 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9532481-3025-4502-bd71-d458b8c97c8f tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 404 len: 111 microversion: 2.1 time: 0.062502 Jul 01 10:52:55.299213 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2657/5197] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:52:55 2022] DELETE /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:52:55.302748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:55.303607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] [instance: 205d1cc4-59f7-4959-8d0a-72052c741f2c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:55.312198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.312799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.313752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.314378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.330290 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] HTTP exception thrown: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Request method failure captured: Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c HTTP/1.1 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtEKyTW4DQUG8vYRDGv0g1vghKx08U6vdXE9_2ro7THdzrE9rq7xdTBRd1MWw2wycCfBvqvz-7jLPfh0N5WdjOgOjaDZN7l9VlKggX8rGbIo5DY7UJnwJipfweWPNG5P--_wHTlhJJ-axloWjyHfUkTX0h8f5BFy_U693cEmHeAld7A Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c2edf723e9a4f2f877bf43812b279da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c2edf723e9a4f2f877bf43812b279da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 2c2edf723e9a4f2f877bf43812b279da Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ImagesTestJSON-1244658857 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: be759a44a78544109032556c07b5c868 Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ImagesTestJSON-1244658857-project Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '205d1cc4-59f7-4959-8d0a-72052c741f2c'} Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.332122 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:55.335910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:55.335910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:55.335910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:55.335910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:55.335910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. Jul 01 10:52:55.335910 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:55.335910 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] Returning 404 to user: Instance 205d1cc4-59f7-4959-8d0a-72052c741f2c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:55.336340 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c5b83e7-d45a-435c-94d4-bb24277fc0f6 tempest-ImagesTestJSON-1244658857 tempest-ImagesTestJSON-1244658857-project] 10.222.0.23 "GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c" status: 404 len: 111 microversion: 2.1 time: 0.045274 Jul 01 10:52:55.337291 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2541/5198] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:52:55 2022] GET /compute/v2.1/servers/205d1cc4-59f7-4959-8d0a-72052c741f2c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:52:55.751430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:55.754157 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:55.772910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.774244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.776715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.776715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.856014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:55.856845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:55.857521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lazy-loading 'fault' on Instance uuid 5ab1b344-b65d-4f47-9630-08ac6461e289 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:52:55.938236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:55.948998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:55.952191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899c57c8434e49d08e5c73a1baf5069b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18843e9062a4e72a41c2ed4b433341a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:52:55.953434 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0ff3b9b-684b-4d5a-ba02-dd566dcbc55c tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 200 len: 1371 microversion: 2.20 time: 0.210594 Jul 01 10:52:55.964580 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2658/5199] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:55 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:52:56.973511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:56.974281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:52:56.982852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:56.983405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:56.984862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:52:56.985471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:52:57.002678 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] HTTP exception thrown: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Request method failure captured: Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 HTTP/1.1 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtBNVSI7E6QNENLDwCq98oPEnnwP9hJgc_nUV_llhNljAE-QW2hVbk9kRdTcV5hIDXYPCsCHV-dsyJZmig1HkLbyURn5FrxAuOvEbKca3uMy7vvP2lkSQIM89j_VwbVyvxaFEQdppuyswB5NI-jcTFyUCtI0hGfawWabVPbKh77ABao Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e18843e9062a4e72a41c2ed4b433341a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 899c57c8434e49d08e5c73a1baf5069b Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '5ab1b344-b65d-4f47-9630-08ac6461e289'} Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:57.004344 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Returning 404 to user: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b5a4e6e1-cdb6-4b89-b059-499b7c8cecaf tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 404 len: 111 microversion: 2.20 time: 0.037963 Jul 01 10:52:57.009066 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2542/5200] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:52:56 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:52:57.015882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0dcb894-b186-4dbc-b45a-96008d61ab66 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '.version_select at 0x7f6f96f4f8b0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:52:57.107332 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0dcb894-b186-4dbc-b45a-96008d61ab66 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657927438" status: 204 len: 0 microversion: 2.20 time: 0.095314 Jul 01 10:52:57.108145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2659/5201] 10.222.0.23 () {60 vars in 1258 bytes} [Fri Jul 1 10:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657927438 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 10:53:01.904560 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:01.905200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:01.916512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:01.917231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:01.918244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:01.921737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:01.939728 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] HTTP exception thrown: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Request method failure captured: Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 HTTP/1.1 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtBNVSI7E6QNENLDwCq98oPEnnwP9hJgc_nUV_llhNljAE-QW2hVbk9kRdTcV5hIDXYPCsCHV-dsyJZmig1HkLbyURn5FrxAuOvEbKca3uMy7vvP2lkSQIM89j_VwbVyvxaFEQdppuyswB5NI-jcTFyUCtI0hGfawWabVPbKh77ABao Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e18843e9062a4e72a41c2ed4b433341a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 899c57c8434e49d08e5c73a1baf5069b Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '5ab1b344-b65d-4f47-9630-08ac6461e289'} Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:53:01.942063 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Returning 404 to user: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:01.946172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0613408b-6ebc-4819-bec9-4630ecb274cb tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 404 len: 111 microversion: 2.20 time: 0.044423 Jul 01 10:53:01.947587 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2543/5202] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:53:01 2022] DELETE /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:53:01.952650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:01.953889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 5ab1b344-b65d-4f47-9630-08ac6461e289] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:01.972997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:01.973711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:01.974497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:01.974971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:01.993430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] HTTP exception thrown: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Request method failure captured: Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 HTTP/1.1 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtBNVSI7E6QNENLDwCq98oPEnnwP9hJgc_nUV_llhNljAE-QW2hVbk9kRdTcV5hIDXYPCsCHV-dsyJZmig1HkLbyURn5FrxAuOvEbKca3uMy7vvP2lkSQIM89j_VwbVyvxaFEQdppuyswB5NI-jcTFyUCtI0hGfawWabVPbKh77ABao Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e18843e9062a4e72a41c2ed4b433341a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 899c57c8434e49d08e5c73a1baf5069b Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '5ab1b344-b65d-4f47-9630-08ac6461e289'} Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:01.995153 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Returning 404 to user: Instance 5ab1b344-b65d-4f47-9630-08ac6461e289 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33aff600-9112-4252-87b7-5a6bb61f27d0 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289" status: 404 len: 111 microversion: 2.20 time: 0.048064 Jul 01 10:53:02.003793 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2660/5203] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:53:01 2022] GET /compute/v2.1/servers/5ab1b344-b65d-4f47-9630-08ac6461e289 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 10:53:04.600321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19c21640-f27d-4d77-83f3-27983ef2600f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: .version_select at 0x7f6f91f38ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-662972386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfTmZmj219KEe1olEO3HaTuSIRlsKi0BSJlq4byUN4zN5tIFhcDckgt/PTyguIxfMjn55TUve7dcPN5U22MP9j4j0AjvJYfYW0aJdZEDaJxTJxhuVzyPWvPE/tbVJ301w=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:04.637657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-19c21640-f27d-4d77-83f3-27983ef2600f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:04.657109 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-19c21640-f27d-4d77-83f3-27983ef2600f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:04.794207 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-19c21640-f27d-4d77-83f3-27983ef2600f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.616725 Jul 01 10:53:04.796041 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2544/5204] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:06.314670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2836d12-2e83-4b39-a1d3-7f24864b8c9b tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Action: 'create', calling method: .version_select at 0x7f6f96fa05e0>, body: {"keypair": {"name": "tempest-keypair-1973228809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE18sj35Rt6S7c9NmiQX0KpaPIXlAqf+L2z0dm5EeH26kTrfWGIJxXx/kCBXqqgQmhCPlga1fB5tj9UiQK7OqUN5lV3j09wGUL0uqu/DBepFxqytG4k/3oelFiOGke77Sg=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:06.332752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-f2836d12-2e83-4b39-a1d3-7f24864b8c9b tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:06.339093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-f2836d12-2e83-4b39-a1d3-7f24864b8c9b tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for user 9dcfbde580af49d68eb2a1ffc5bc6ff2 and project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:06.438373 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2836d12-2e83-4b39-a1d3-7f24864b8c9b tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.417641 Jul 01 10:53:06.442258 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2661/5205] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:06.450924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63def8ba-a72d-4b99-8937-410897258a12 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f91aa8c10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:06.476864 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63def8ba-a72d-4b99-8937-410897258a12 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1973228809" status: 200 len: 498 microversion: 2.1 time: 0.030234 Jul 01 10:53:06.477509 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2545/5206] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:53:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1973228809 => generated 498 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:06.493481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b75705b-405f-437b-89a9-5591d4945204 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f91ace3a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:06.639390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b75705b-405f-437b-89a9-5591d4945204 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973228809" status: 202 len: 0 microversion: 2.1 time: 0.149863 Jul 01 10:53:06.647031 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2662/5207] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973228809 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:06.652091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87556ea5-91d3-40af-ad5d-065d5df2ff56 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Action: 'create', calling method: .version_select at 0x7f6f970dd160>, body: {"keypair": {"name": "tempest-keypair-790656988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7QLTTIeJH0QIC/5gJZQYRE3Id46OpU1+vOytg7ILsX9/jdE8e9oRx7C1ynI0mvWhA5HEyi4l19Sc8UTJmOgOmQY2ZbsJagxUnntPfuNwYoyj6DTNmYWnojB72Q1Co4Xg=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:06.653942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:06.654457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:06.667042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:06.669292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:06.669292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:06.669292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:06.669534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-87556ea5-91d3-40af-ad5d-065d5df2ff56 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:06.675231 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-87556ea5-91d3-40af-ad5d-065d5df2ff56 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for user 9dcfbde580af49d68eb2a1ffc5bc6ff2 and project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:06.713672 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] HTTP exception thrown: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Request method failure captured: Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d HTTP/1.1 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtBNVSI7E6QNENLDwCq98oPEnnwP9hJgc_nUV_llhNljAE-QW2hVbk9kRdTcV5hIDXYPCsCHV-dsyJZmig1HkLbyURn5FrxAuOvEbKca3uMy7vvP2lkSQIM89j_VwbVyvxaFEQdppuyswB5NI-jcTFyUCtI0hGfawWabVPbKh77ABao Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e18843e9062a4e72a41c2ed4b433341a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 899c57c8434e49d08e5c73a1baf5069b Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '412c198b-5665-41d2-b3b3-7f4f261bdc4d'} Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:53:06.715325 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Returning 404 to user: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:06.719132 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c03ea208-9e0b-4216-886f-41cb0583e994 tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 404 len: 111 microversion: 2.20 time: 0.070474 Jul 01 10:53:06.722273 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2546/5208] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 10:53:06 2022] DELETE /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:53:06.728521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:06.729366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] [instance: 412c198b-5665-41d2-b3b3-7f4f261bdc4d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:06.742977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:06.743594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:06.745710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:06.747408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:06.788070 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] HTTP exception thrown: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Request method failure captured: Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d HTTP/1.1 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtBNVSI7E6QNENLDwCq98oPEnnwP9hJgc_nUV_llhNljAE-QW2hVbk9kRdTcV5hIDXYPCsCHV-dsyJZmig1HkLbyURn5FrxAuOvEbKca3uMy7vvP2lkSQIM89j_VwbVyvxaFEQdppuyswB5NI-jcTFyUCtI0hGfawWabVPbKh77ABao Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e18843e9062a4e72a41c2ed4b433341a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e18843e9062a4e72a41c2ed4b433341a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: e18843e9062a4e72a41c2ed4b433341a Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653358618 Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 899c57c8434e49d08e5c73a1baf5069b Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653358618-project Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '412c198b-5665-41d2-b3b3-7f4f261bdc4d'} Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.789679 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. Jul 01 10:53:06.793610 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:06.798095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] Returning 404 to user: Instance 412c198b-5665-41d2-b3b3-7f4f261bdc4d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:06.799108 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c618eb6e-d782-4f27-b7cc-fe678ced316f tempest-AttachVolumeShelveTestJSON-653358618 tempest-AttachVolumeShelveTestJSON-653358618-project] 10.222.0.23 "GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d" status: 404 len: 111 microversion: 2.20 time: 0.075082 Jul 01 10:53:06.810594 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2547/5209] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:53:06 2022] GET /compute/v2.1/servers/412c198b-5665-41d2-b3b3-7f4f261bdc4d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:53:06.833991 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87556ea5-91d3-40af-ad5d-065d5df2ff56 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185605 Jul 01 10:53:06.834615 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2663/5210] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:53:06.845033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42f90ec8-a22d-4b89-8e48-663ca1388e42 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f91aa8940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:06.980066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42f90ec8-a22d-4b89-8e48-663ca1388e42 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-790656988" status: 202 len: 0 microversion: 2.1 time: 0.139729 Jul 01 10:53:06.984613 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2548/5211] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-790656988 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:06.995354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bcc23a71-63f2-430a-851b-ab7c173037f4 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Action: 'create', calling method: .version_select at 0x7f6f9249d9d0>, body: {"keypair": {"name": "tempest-keypair-1323932361", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:07.046664 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bcc23a71-63f2-430a-851b-ab7c173037f4 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:07.063293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bcc23a71-63f2-430a-851b-ab7c173037f4 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for user 9dcfbde580af49d68eb2a1ffc5bc6ff2 and project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:07.164992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bcc23a71-63f2-430a-851b-ab7c173037f4 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.178541 Jul 01 10:53:07.165700 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2664/5212] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:06 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:07.183650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8ef8d21e-b771-481a-bf71-2a198ec74157 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f91f38e50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:07.324664 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8ef8d21e-b771-481a-bf71-2a198ec74157 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323932361" status: 202 len: 0 microversion: 2.1 time: 0.130548 Jul 01 10:53:07.324664 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2549/5213] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323932361 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:07.329587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab30d992-57c5-4b6a-8bac-616fb2d316a8 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Action: 'create', calling method: .version_select at 0x7f6f90db5f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-434359887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq0N4o6/SB9lbgarS/PcMGAqPLbm6d1M60xYkF/OkKP2Nh4znp62uwl0QYD3eLTd2EhKfTLhu3/3XfLkIHl1QwUnt1JcWIWAEguaHyuGt26bdlH+UppBTM6trqI1o3TwQ=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:07.387523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ab30d992-57c5-4b6a-8bac-616fb2d316a8 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:07.397607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ab30d992-57c5-4b6a-8bac-616fb2d316a8 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for user 9dcfbde580af49d68eb2a1ffc5bc6ff2 and project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:07.586146 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab30d992-57c5-4b6a-8bac-616fb2d316a8 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.260411 Jul 01 10:53:07.589845 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2665/5214] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:07 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:07.605180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b127c8a-7a1d-4198-a2da-a53ee8b5bf11 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Action: 'create', calling method: .version_select at 0x7f6f91df3af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1210868787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmlEhsLvQ1ro7ZGLJMsyt67V5oRHPk1ChAEefTeNgVnMj6RSTnUs/5Xd72r0c7Ve8YNZVb8m9UDXlQx37w4EgZ/6zLTTv6qFZD4kSI9ICGZUPTDb1UKtkTgbnHRPKoTNg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:07.640554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-7b127c8a-7a1d-4198-a2da-a53ee8b5bf11 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:07.655883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-7b127c8a-7a1d-4198-a2da-a53ee8b5bf11 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for user 9dcfbde580af49d68eb2a1ffc5bc6ff2 and project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:07.803828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b127c8a-7a1d-4198-a2da-a53ee8b5bf11 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.205145 Jul 01 10:53:07.805366 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2550/5215] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:53:07.826666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-94485215-06b9-43e0-be7e-1f20683c5e17 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Action: 'create', calling method: .version_select at 0x7f6f90db5160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1750009170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgrNgbf0vNmSngoQSMAIRziL7JeHRV9vrOB49dFakyQMBrx2sbcEPAh6p87PlnwBUS6icXCfag0ZF3fVTZHyVwPhcKreleg/fJTwE1+cNt2nwvz5HOCF+p9bb0ZruBDgA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:07.890518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-94485215-06b9-43e0-be7e-1f20683c5e17 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:07.926623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-94485215-06b9-43e0-be7e-1f20683c5e17 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Getting quotas for user 9dcfbde580af49d68eb2a1ffc5bc6ff2 and project afc5e874817742fbb1f8ac28f3c62da7. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:07.961869 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:08.084998 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-94485215-06b9-43e0-be7e-1f20683c5e17 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.263444 Jul 01 10:53:08.087705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2666/5216] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:08.105604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b4c3bbe-1316-46f1-b9c2-0ebefa944d31 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f906ffe50>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:08.108559 n-d-master-1 devstack@n-api.service[119765]: WARNING oslo_db.sqlalchemy.utils [None req-7b4c3bbe-1316-46f1-b9c2-0ebefa944d31 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 01 10:53:08.123616 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b4c3bbe-1316-46f1-b9c2-0ebefa944d31 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.020343 Jul 01 10:53:08.124238 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2551/5217] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:53:08 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:08.135340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-26dbbb00-c2bb-424f-8e6a-d7afa6e16036 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f97125430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:08.302568 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-26dbbb00-c2bb-424f-8e6a-d7afa6e16036 tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1750009170" status: 202 len: 0 microversion: 2.1 time: 0.171719 Jul 01 10:53:08.303780 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2667/5218] 10.222.0.23 () {58 vars in 1277 bytes} [Fri Jul 1 10:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1750009170 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:08.312668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e5b608e-3c01-4d2f-af58-026cd1e48a8f tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f90c01ee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:08.485779 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e5b608e-3c01-4d2f-af58-026cd1e48a8f tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1210868787" status: 202 len: 0 microversion: 2.1 time: 0.177763 Jul 01 10:53:08.488336 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2552/5219] 10.222.0.23 () {58 vars in 1277 bytes} [Fri Jul 1 10:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1210868787 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:08.500008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3bed59ef-21c8-4c1d-80ee-760e1e162eef tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] Calling method '.version_select at 0x7f6f90d93940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:08.644630 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3bed59ef-21c8-4c1d-80ee-760e1e162eef tempest-KeyPairsV2TestJSON-1237085286 tempest-KeyPairsV2TestJSON-1237085286-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-434359887" status: 202 len: 0 microversion: 2.1 time: 0.152312 Jul 01 10:53:08.645738 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2668/5220] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-434359887 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:26.484824 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=11 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:26.487075 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:26.487756 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:27.110495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2b9d5db-1821-4e4e-8ab6-ce9849b6e92c tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f91d8c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1046696222", "description": "tempest-description-592710043"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:27.382364 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:27.383377 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=20 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:27.391709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1646986584", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "548d7c32-7aba-4fd8-b58b-76ac0fcfe0be"}], "key_name": "tempest-TestNetworkAdvancedServerOps-662972386", "security_groups": [{"name": "tempest-secgroup-smoke-2020994407"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:28.062855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] validate_networks() for [('548d7c32-7aba-4fd8-b58b-76ac0fcfe0be', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:53:29.427547 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2b9d5db-1821-4e4e-8ab6-ce9849b6e92c tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.949605 Jul 01 10:53:29.429017 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2553/5221] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:53:26 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:29.441125 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-670aaabd-be2f-4235-9aa4-38ea7164b9f6 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f91aa89d0>, body: {"security_group_rule": {"parent_group_id": "8181b42e-7784-440f-8099-88d8bd572adf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:31.305198 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:53:31.307196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:53:31.307196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:53:31.307196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:53:31.308746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:53:31.371899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:31.371899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:31.371899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:31.374535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:31.457540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:31.471877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:31.512504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:53:31.515359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:53:31.780365 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d78f27a4-7042-410d-b2aa-33cb0d5b2637 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.399900 Jul 01 10:53:31.794764 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2669/5222] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:53:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 4415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:53:31.819299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-82eedfdb-8982-4c9e-a1ab-0ab36c2b7ab6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:31.825889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-82eedfdb-8982-4c9e-a1ab-0ab36c2b7ab6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:32.168734 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-670aaabd-be2f-4235-9aa4-38ea7164b9f6 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.732087 Jul 01 10:53:32.169349 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2554/5223] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:53:32.182913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-26e2e246-9ed2-4e16-af3e-7fb4bcfde546 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f91f8c040>, body: {"security_group_rule": {"parent_group_id": "8181b42e-7784-440f-8099-88d8bd572adf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:32.275305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-82eedfdb-8982-4c9e-a1ab-0ab36c2b7ab6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:32.296559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-82eedfdb-8982-4c9e-a1ab-0ab36c2b7ab6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1266 microversion: 2.1 time: 0.494180 Jul 01 10:53:32.297199 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2670/5224] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:31 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:53:32.358885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-26e2e246-9ed2-4e16-af3e-7fb4bcfde546 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: This rule already exists in group 8181b42e-7784-440f-8099-88d8bd572adf Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-26e2e246-9ed2-4e16-af3e-7fb4bcfde546 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 138 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: {"security_group_rule": {"parent_group_id": "8181b42e-7784-440f-8099-88d8bd572adf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: exception: This rule already exists in group 8181b42e-7784-440f-8099-88d8bd572adf Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8181b42e-7784-440f-8099-88d8bd572adf', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 8181b42e-7784-440f-8099-88d8bd572adf Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 8181b42e-7784-440f-8099-88d8bd572adf Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:32.360657 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:32.366164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:32.366164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:32.366164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 8181b42e-7784-440f-8099-88d8bd572adf Jul 01 10:53:32.366164 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:32.366164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-26e2e246-9ed2-4e16-af3e-7fb4bcfde546 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 400 to user: This rule already exists in group 8181b42e-7784-440f-8099-88d8bd572adf {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:32.367705 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-26e2e246-9ed2-4e16-af3e-7fb4bcfde546 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.190063 Jul 01 10:53:32.380390 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2555/5225] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:32 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:53:32.385722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c1b7f57-75b3-450f-8631-16206ab2d1d3 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Calling method '.version_select at 0x7f6f90d934c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:32.959448 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c1b7f57-75b3-450f-8631-16206ab2d1d3 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/68125bba-b9a4-45c2-beb7-aba8b289b1a8" status: 202 len: 0 microversion: 2.1 time: 0.577793 Jul 01 10:53:32.960575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2671/5226] 10.222.0.23 () {58 vars in 1286 bytes} [Fri Jul 1 10:53:32 2022] DELETE /compute/v2.1/os-security-group-rules/68125bba-b9a4-45c2-beb7-aba8b289b1a8 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:32.978651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8ac99c1-df79-4eb6-b6f1-f90d5277637f tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f91b19e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1089027249", "description": "tempest-description-762739524"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:33.316406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a29ec3a-35af-44f8-b303-ccc87bc48b2f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:33.317133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a29ec3a-35af-44f8-b303-ccc87bc48b2f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:33.596108 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7a29ec3a-35af-44f8-b303-ccc87bc48b2f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:33.613733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a29ec3a-35af-44f8-b303-ccc87bc48b2f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1266 microversion: 2.1 time: 0.300215 Jul 01 10:53:33.617372 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2672/5227] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:33 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:33.846014 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8ac99c1-df79-4eb6-b6f1-f90d5277637f tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.879931 Jul 01 10:53:33.846626 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2556/5228] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:53:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:33.860067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2beb657-462c-4172-a117-0b1d74f3ecea tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f91a5b700>, body: {"security_group_rule": {"parent_group_id": "d54a3c51-2862-4226-ac09-5bda0b4a3e29", "ip_protocol": "tcp", "from_port": 344577609, "to_port": 22}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:33.993956 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f2beb657-462c-4172-a117-0b1d74f3ecea tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: Invalid port range 344577609:22. Former value cannot be greater than the later Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2beb657-462c-4172-a117-0b1d74f3ecea tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 145 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: {"security_group_rule": {"parent_group_id": "d54a3c51-2862-4226-ac09-5bda0b4a3e29", "ip_protocol": "tcp", "from_port": 344577609, "to_port": 22}} Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid port range 344577609:22. Former value cannot be greater than the later Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd54a3c51-2862-4226-ac09-5bda0b4a3e29', 'ip_protocol': 'tcp', 'from_port': 344577609, 'to_port': 22}}} Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 344577609:22. Former value cannot be greater than the later Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 344577609:22. Former value cannot be greater than the later Jul 01 10:53:33.995521 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 344577609:22. Former value cannot be greater than the later Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2beb657-462c-4172-a117-0b1d74f3ecea tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 400 to user: Invalid port range 344577609:22. Former value cannot be greater than the later {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2beb657-462c-4172-a117-0b1d74f3ecea tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.141845 Jul 01 10:53:33.998793 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2673/5229] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:33 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:53:34.008020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5856ee0f-d79e-441b-8537-801200b65a99 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f906dcee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1590032046", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:34.010096 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-5856ee0f-d79e-441b-8537-801200b65a99 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: Security group id should be uuid Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5856ee0f-d79e-441b-8537-801200b65a99 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 131 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1590032046", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: exception: Security group id should be uuid Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1590032046', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:34.011600 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:34.015304 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 01 10:53:34.015304 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:34.015304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5856ee0f-d79e-441b-8537-801200b65a99 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 400 to user: Security group id should be uuid {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:34.015304 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5856ee0f-d79e-441b-8537-801200b65a99 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009964 Jul 01 10:53:34.032020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45f0d91b-064c-436b-8aca-a08200eb3763 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f92419790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1926545972", "description": "tempest-description-221627180"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:34.039326 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2557/5230] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:34 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:53:34.632174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:34.632887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:34.659731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:34.664429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:34.665736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:34.668934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:34.955261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:34.984160 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c203f338-6f69-4a9c-89dd-e9ba07f96bdc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1318 microversion: 2.1 time: 0.355929 Jul 01 10:53:34.988104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2558/5231] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:34 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:35.368283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45f0d91b-064c-436b-8aca-a08200eb3763 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.348264 Jul 01 10:53:35.368841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2674/5232] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:53:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:53:35.379635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02ca0652-a9c2-4cd1-bc96-d8f3f4502fb3 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f906dcee0>, body: {"security_group_rule": {"parent_group_id": "08378907-5c12-4cad-9040-d830c86174f4", "ip_protocol": "tempest-999-1582431380", "from_port": 22, "to_port": 22}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:35.427715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1744969004", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:35.557518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] validate_networks() for None {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:53:35.666519 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-02ca0652-a9c2-4cd1-bc96-d8f3f4502fb3 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: Invalid IP protocol tempest-999-1582431380. Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02ca0652-a9c2-4cd1-bc96-d8f3f4502fb3 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 157 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: {"security_group_rule": {"parent_group_id": "08378907-5c12-4cad-9040-d830c86174f4", "ip_protocol": "tempest-999-1582431380", "from_port": 22, "to_port": 22}} Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid IP protocol tempest-999-1582431380. Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'security_group_rule': {'parent_group_id': '08378907-5c12-4cad-9040-d830c86174f4', 'ip_protocol': 'tempest-999-1582431380', 'from_port': 22, 'to_port': 22}}} Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1582431380. Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1582431380. Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:35.668103 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1582431380. Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02ca0652-a9c2-4cd1-bc96-d8f3f4502fb3 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 400 to user: Invalid IP protocol tempest-999-1582431380. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02ca0652-a9c2-4cd1-bc96-d8f3f4502fb3 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.293978 Jul 01 10:53:35.683779 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2559/5233] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:35 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 01 10:53:35.690550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e9a5e7e8-b646-4fe8-844a-9b15a501d5b4 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f96ee0280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1198047447", "description": "tempest-description-1174564364"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:36.254914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:53:36.255346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:53:36.255827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:53:36.256249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:53:36.257002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:53:36.267831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:36.268518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:36.269527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:36.270257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:36.315882 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Getting quotas for project 4faaa9eb535d496689088ac519a0f991. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:36.326923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Getting quotas for user b47d76debbbb48c4bef6518bfe465214 and project 4faaa9eb535d496689088ac519a0f991. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:36.340399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:53:36.348081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:53:36.556504 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-464b8344-c696-46ea-9d5a-68773f55ac26 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.128605 Jul 01 10:53:36.558683 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2675/5234] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:53:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:53:36.581622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:36.584624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:36.604319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:36.609419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:36.612800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:36.613321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:36.617061 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e9a5e7e8-b646-4fe8-844a-9b15a501d5b4 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.930862 Jul 01 10:53:36.617797 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2560/5235] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:53:35 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:36.623668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5babeaa8-b6ca-4521-a782-107c09c27919 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:36.624492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5babeaa8-b6ca-4521-a782-107c09c27919 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:36.919648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5babeaa8-b6ca-4521-a782-107c09c27919 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:36.930319 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5babeaa8-b6ca-4521-a782-107c09c27919 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1214 microversion: 2.1 time: 0.310509 Jul 01 10:53:36.934869 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2561/5236] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:36 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:36.959818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b247a792-e63d-4231-b849-648c00d4957f tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f91d8c280>, body: {"security_group_rule": {"parent_group_id": "5791c15c-526d-4545-b283-72fc24c8068b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:36.996693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:37.010592 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-94f89caf-6595-4415-8b83-eca9311ac3a7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1324 microversion: 2.1 time: 0.440664 Jul 01 10:53:37.011835 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2676/5237] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:36 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:37.087100 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b247a792-e63d-4231-b849-648c00d4957f tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b247a792-e63d-4231-b849-648c00d4957f tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 138 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: {"security_group_rule": {"parent_group_id": "5791c15c-526d-4545-b283-72fc24c8068b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5791c15c-526d-4545-b283-72fc24c8068b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 01 10:53:37.089799 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b247a792-e63d-4231-b849-648c00d4957f tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b247a792-e63d-4231-b849-648c00d4957f tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.156086 Jul 01 10:53:37.092930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2562/5238] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:36 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:53:37.110769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a9dd57f-5753-4214-83b5-25e976429c2c tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f90d931f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-27116925", "description": "tempest-description-1652790282"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:37.954252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef2b005f-ea5a-449b-811e-7ef17662b38f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:37.958598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef2b005f-ea5a-449b-811e-7ef17662b38f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:37.959125 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a9dd57f-5753-4214-83b5-25e976429c2c tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.856261 Jul 01 10:53:37.960256 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2677/5239] 10.222.0.23 () {60 vars in 1179 bytes} [Fri Jul 1 10:53:37 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:37.974430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3080d1c0-ef40-410c-a2d9-6113db5397ef tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f91a5b700>, body: {"security_group_rule": {"parent_group_id": "45621328-d2fe-41b6-b3f5-db8f0df4d714", "ip_protocol": "tcp", "from_port": 22, "to_port": 1872627220}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:38.156821 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3080d1c0-ef40-410c-a2d9-6113db5397ef tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: Invalid port range 22:1872627220. Valid TCP ports should be between 1-65535 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3080d1c0-ef40-410c-a2d9-6113db5397ef tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 146 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: {"security_group_rule": {"parent_group_id": "45621328-d2fe-41b6-b3f5-db8f0df4d714", "ip_protocol": "tcp", "from_port": 22, "to_port": 1872627220}} Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid port range 22:1872627220. Valid TCP ports should be between 1-65535 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'security_group_rule': {'parent_group_id': '45621328-d2fe-41b6-b3f5-db8f0df4d714', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1872627220}}} Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1872627220. Valid TCP ports should be between 1-65535 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1872627220. Valid TCP ports should be between 1-65535 Jul 01 10:53:38.159329 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1872627220. Valid TCP ports should be between 1-65535 Jul 01 10:53:38.162663 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.165078 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3080d1c0-ef40-410c-a2d9-6113db5397ef tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 400 to user: Invalid port range 22:1872627220. Valid TCP ports should be between 1-65535 {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:38.166067 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3080d1c0-ef40-410c-a2d9-6113db5397ef tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.196280 Jul 01 10:53:38.175093 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2678/5240] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:37 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:53:38.181227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:38.185935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:38.207005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:38.207005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:38.207005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:38.207005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:38.693114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef2b005f-ea5a-449b-811e-7ef17662b38f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:38.709866 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef2b005f-ea5a-449b-811e-7ef17662b38f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1214 microversion: 2.1 time: 0.762574 Jul 01 10:53:38.719967 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2563/5241] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:37 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1214 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:53:38.728658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52ed62d0-ff4b-4ea0-98fc-2d5882184284 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Action: 'create', calling method: .version_select at 0x7f6f909b68b0>, body: {"security_group_rule": {"parent_group_id": "70670701-ea1b-4adf-ae77-3813c3ab2d4f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:38.918688 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-52ed62d0-ff4b-4ea0-98fc-2d5882184284 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:53:38.919299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-52ed62d0-ff4b-4ea0-98fc-2d5882184284 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Neutron security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f not found {{(pid=119765) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-52ed62d0-ff4b-4ea0-98fc-2d5882184284 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-f36d6c70-42b9-4376-924b-e43ad76645c6'] Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52ed62d0-ff4b-4ea0-98fc-2d5882184284 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 138 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: {"security_group_rule": {"parent_group_id": "70670701-ea1b-4adf-ae77-3813c3ab2d4f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: exception: Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-f36d6c70-42b9-4376-924b-e43ad76645c6'] Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'security_group_rule': {'parent_group_id': '70670701-ea1b-4adf-ae77-3813c3ab2d4f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:38.929201 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f36d6c70-42b9-4376-924b-e43ad76645c6'] Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f36d6c70-42b9-4376-924b-e43ad76645c6'] Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f36d6c70-42b9-4376-924b-e43ad76645c6'] Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f36d6c70-42b9-4376-924b-e43ad76645c6'] Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52ed62d0-ff4b-4ea0-98fc-2d5882184284 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 404 to user: Security group 70670701-ea1b-4adf-ae77-3813c3ab2d4f does not exist Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-f36d6c70-42b9-4376-924b-e43ad76645c6'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52ed62d0-ff4b-4ea0-98fc-2d5882184284 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.207746 Jul 01 10:53:38.932285 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2564/5242] 10.222.0.23 () {60 vars in 1194 bytes} [Fri Jul 1 10:53:38 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:53:38.936187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74f00621-dc4b-4e68-badd-c609315d4559 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Calling method '.version_select at 0x7f6f906dcee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:39.075416 n-d-master-1 devstack@n-api.service[119765]: DEBUG neutronclient.v2_0.client [None req-74f00621-dc4b-4e68-badd-c609315d4559 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist", "detail": ""}} {{(pid=119765) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 01 10:53:39.080695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.security_group_api [None req-74f00621-dc4b-4e68-badd-c609315d4559 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Neutron security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba not found {{(pid=119765) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 01 10:53:39.080695 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-74f00621-dc4b-4e68-badd-c609315d4559 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] HTTP exception thrown: Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist Jul 01 10:53:39.080695 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-8e377ff8-05b3-4c25-ab74-21d7dafc0b5b'] Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74f00621-dc4b-4e68-badd-c609315d4559 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Request method failure captured: Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/os-security-group-rules/29f9f9ae-97ae-45da-8195-c485c0ef90ba HTTP/1.1 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtImC3G6bWdntvOpOfuqSz2OjmFQF66JHlLgPRILJ9MsmsDm-bmPUHFOcDVWez3Vm3E34d0vjI8ExLFHyXBQQ75UEBz9lYGo7G6Adsz-3cuuL2YAZ5tew8Z609vSjaz9VA9dF9Lftp-aRXqaEUYIpuDRX17Krj0HyJgli2GYK917Qh4 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_947fd7c6491141559ad9de17c253afa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/947fd7c6491141559ad9de17c253afa1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 947fd7c6491141559ad9de17c253afa1 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 8a531ae705c241b0ad5ff18a5497b86f Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: method: Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: exception: Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-8e377ff8-05b3-4c25-ab74-21d7dafc0b5b'] Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '29f9f9ae-97ae-45da-8195-c485c0ef90ba'} Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 01 10:53:39.081092 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e377ff8-05b3-4c25-ab74-21d7dafc0b5b'] Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e377ff8-05b3-4c25-ab74-21d7dafc0b5b'] Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e377ff8-05b3-4c25-ab74-21d7dafc0b5b'] Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e377ff8-05b3-4c25-ab74-21d7dafc0b5b'] Jul 01 10:53:39.084881 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:53:39.089391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74f00621-dc4b-4e68-badd-c609315d4559 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Returning 404 to user: Security group rule 29f9f9ae-97ae-45da-8195-c485c0ef90ba does not exist Jul 01 10:53:39.089391 n-d-master-1 devstack@n-api.service[119765]: Neutron server returns request_ids: ['req-8e377ff8-05b3-4c25-ab74-21d7dafc0b5b'] {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:53:39.090288 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74f00621-dc4b-4e68-badd-c609315d4559 tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/29f9f9ae-97ae-45da-8195-c485c0ef90ba" status: 404 len: 199 microversion: 2.1 time: 0.159402 Jul 01 10:53:39.091712 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2565/5243] 10.222.0.23 () {58 vars in 1286 bytes} [Fri Jul 1 10:53:38 2022] DELETE /compute/v2.1/os-security-group-rules/29f9f9ae-97ae-45da-8195-c485c0ef90ba => generated 199 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:53:39.101489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8c0b470-e72f-421f-8fa9-88b42829353d tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Calling method '.version_select at 0x7f6f90ebb0d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:39.341349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:39.353954 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e043452a-124c-4996-b2b4-298f80c9c5f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1392 microversion: 2.1 time: 1.181001 Jul 01 10:53:39.355016 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2679/5244] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:38 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1392 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:39.393804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-65d6c91f-6fa3-4201-821f-c849a18b8a58 req-5d48d6a5-cbcd-4164-a1bb-e761d5ceeb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:39.408892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-65d6c91f-6fa3-4201-821f-c849a18b8a58 req-5d48d6a5-cbcd-4164-a1bb-e761d5ceeb93 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:39.409383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-65d6c91f-6fa3-4201-821f-c849a18b8a58 req-5d48d6a5-cbcd-4164-a1bb-e761d5ceeb93 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:39.436819 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-65d6c91f-6fa3-4201-821f-c849a18b8a58 req-5d48d6a5-cbcd-4164-a1bb-e761d5ceeb93 service nova] Creating event network-changed:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h2-master-1 Jul 01 10:53:39.452196 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-65d6c91f-6fa3-4201-821f-c849a18b8a58 req-5d48d6a5-cbcd-4164-a1bb-e761d5ceeb93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061039 Jul 01 10:53:39.454542 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2680/5245] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:53:39.732544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:39.733332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:39.748170 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:39.748867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:39.754269 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:39.755043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:40.021672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:40.037006 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a137ef9b-e0f0-43e4-9402-946441987e79 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1274 microversion: 2.1 time: 0.301258 Jul 01 10:53:40.037006 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2681/5246] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:39 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:40.255549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8c0b470-e72f-421f-8fa9-88b42829353d tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/45621328-d2fe-41b6-b3f5-db8f0df4d714" status: 202 len: 0 microversion: 2.1 time: 1.158988 Jul 01 10:53:40.257086 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2566/5247] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:53:39 2022] DELETE /compute/v2.1/os-security-groups/45621328-d2fe-41b6-b3f5-db8f0df4d714 => generated 0 bytes in 1162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:53:40.264666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7bcdfa7-90da-4650-9fb4-2836d5a318fc tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Calling method '.version_select at 0x7f6f90db5e50>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:40.371711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:40.372225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:40.390424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:40.390885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:40.391700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:40.392706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:40.871373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:40.892819 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cab5fc66-ddc2-47b2-9638-085c2a353a8e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1392 microversion: 2.1 time: 0.524333 Jul 01 10:53:40.901535 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2567/5248] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:40 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1392 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:41.050744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dbfc90d0-7612-4be4-9e33-35504570b20b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: .version_select at 0x7f6f921e5550>, body: {"keypair": {"name": "tempest-keypair-468705177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6ulMSVGchkCvdECgxOkvvsyTMKaQEyAO4otmbuI0uATFTW/ma2zKqgMeVcio5Dt+Dv846+LFg6lmIxPye4LfPxCGNKnerw+o8zCUFIKrFwcDmxecudOIcthmkEBUFCqQ=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:41.076043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dbfc90d0-7612-4be4-9e33-35504570b20b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:41.083421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-dbfc90d0-7612-4be4-9e33-35504570b20b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:41.192277 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dbfc90d0-7612-4be4-9e33-35504570b20b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.289187 Jul 01 10:53:41.193110 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2568/5249] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:53:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:41.204964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:41.205650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:41.216164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:41.216910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:41.219501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:41.220703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:41.302336 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7bcdfa7-90da-4650-9fb4-2836d5a318fc tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5791c15c-526d-4545-b283-72fc24c8068b" status: 202 len: 0 microversion: 2.1 time: 1.041323 Jul 01 10:53:41.307052 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2682/5250] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:53:40 2022] DELETE /compute/v2.1/os-security-groups/5791c15c-526d-4545-b283-72fc24c8068b => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:41.313573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e33bd02c-b0d0-4e68-9c85-6e8119a700fe tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Calling method '.version_select at 0x7f6f90d93a60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:41.348801 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:41.368345 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a9a0f58-cfa7-4f8d-a7c7-d2c7c5940eb9 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1272 microversion: 2.1 time: 0.167361 Jul 01 10:53:41.371636 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2569/5251] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:41 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:41.911503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:41.912369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:41.947679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:41.949859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:41.952207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:41.953514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:42.003390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e33bd02c-b0d0-4e68-9c85-6e8119a700fe tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/08378907-5c12-4cad-9040-d830c86174f4" status: 202 len: 0 microversion: 2.1 time: 0.694193 Jul 01 10:53:42.014708 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2683/5252] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:53:41 2022] DELETE /compute/v2.1/os-security-groups/08378907-5c12-4cad-9040-d830c86174f4 => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:42.015481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a3dc8ba-5c95-4c81-8519-d8f2053a277b tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Calling method '.version_select at 0x7f6f96fd9dc0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:42.478232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:42.492680 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-add78541-5dd4-48eb-b8dd-0c098d8a5fc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1392 microversion: 2.1 time: 0.584075 Jul 01 10:53:42.494678 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2570/5253] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:41 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1392 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:53:42.506545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:42.508328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:42.521494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:42.522417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:42.541997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:42.545458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:42.747600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:42.776121 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0442b33-1ada-474d-a3f7-0aeaeb6a4a62 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1272 microversion: 2.1 time: 0.279409 Jul 01 10:53:42.785709 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2571/5254] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:42 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:43.154366 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a3dc8ba-5c95-4c81-8519-d8f2053a277b tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d54a3c51-2862-4226-ac09-5bda0b4a3e29" status: 202 len: 0 microversion: 2.1 time: 1.144000 Jul 01 10:53:43.154954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2684/5255] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:53:42 2022] DELETE /compute/v2.1/os-security-groups/d54a3c51-2862-4226-ac09-5bda0b4a3e29 => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:43.163769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7888ed2a-c41d-4354-96ca-77e869ae4caa tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] Calling method '.version_select at 0x7f6f90a1b9d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:43.513270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:43.514365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:43.541653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:43.543564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:43.546867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:43.549615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:43.782930 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7888ed2a-c41d-4354-96ca-77e869ae4caa tempest-SecurityGroupRulesNegativeTestJSON-1786495560 tempest-SecurityGroupRulesNegativeTestJSON-1786495560-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/8181b42e-7784-440f-8099-88d8bd572adf" status: 202 len: 0 microversion: 2.1 time: 0.623330 Jul 01 10:53:43.787450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2572/5256] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 10:53:43 2022] DELETE /compute/v2.1/os-security-groups/8181b42e-7784-440f-8099-88d8bd572adf => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:53:43.803277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:43.804333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:43.820030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:43.821558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:43.824803 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:43.825533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:43.942364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:43.956932 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b03b993f-8c9d-4b1f-8cd2-eabbe6543820 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1392 microversion: 2.1 time: 0.448161 Jul 01 10:53:43.967209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2685/5257] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:43 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1392 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:53:44.247707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:44.258861 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b9f29f10-b848-4b14-b791-185ad0af29b6 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1314 microversion: 2.1 time: 0.459836 Jul 01 10:53:44.262096 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2573/5258] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:43 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:53:44.977845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:44.978665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:44.992059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:45.000180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:45.004117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:45.004928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:45.278320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:45.279127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:45.303720 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:45.306685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:45.308850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:45.311831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:46.292163 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:46.334033 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=16 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:46.716037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:46.731697 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-372407e6-d766-4d23-bac3-2d3469258696 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1392 microversion: 2.1 time: 1.760436 Jul 01 10:53:46.746957 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2686/5259] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:44 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1392 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:47.219469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:47.236632 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d600674-cdb9-4aa6-a397-2fb151d0b4a8 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1314 microversion: 2.1 time: 1.963112 Jul 01 10:53:47.243294 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2574/5260] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:45 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1314 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:47.748677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d6c1e24d-2afc-486d-b018-46457acb9093 req-ad7c2417-b0ea-4743-ac86-e3d59d9fe29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304c62a1-8cb3-46b7-873b-9f317a7362bd", "tag": "2d1d51cd-06f5-4a2c-9bf1-889e32794a5a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:47.754996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:47.756664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:47.773580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d6c1e24d-2afc-486d-b018-46457acb9093 req-ad7c2417-b0ea-4743-ac86-e3d59d9fe29d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:47.775447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d6c1e24d-2afc-486d-b018-46457acb9093 req-ad7c2417-b0ea-4743-ac86-e3d59d9fe29d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:47.776899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:47.778295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:47.779994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:47.783262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:47.834786 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d6c1e24d-2afc-486d-b018-46457acb9093 req-ad7c2417-b0ea-4743-ac86-e3d59d9fe29d service nova] Creating event network-changed:2d1d51cd-06f5-4a2c-9bf1-889e32794a5a for instance 304c62a1-8cb3-46b7-873b-9f317a7362bd on n-h1-master-1 Jul 01 10:53:47.850459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d6c1e24d-2afc-486d-b018-46457acb9093 req-ad7c2417-b0ea-4743-ac86-e3d59d9fe29d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109525 Jul 01 10:53:47.853510 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2687/5261] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:53:47.965779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-17ae0faa-6bf2-49ae-a420-f90067188498 req-2294cb39-5c40-4c6b-b690-baa73efe2919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "name": "network-vif-plugged", "status": "completed", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:47.976289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-17ae0faa-6bf2-49ae-a420-f90067188498 req-2294cb39-5c40-4c6b-b690-baa73efe2919 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:47.977101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-17ae0faa-6bf2-49ae-a420-f90067188498 req-2294cb39-5c40-4c6b-b690-baa73efe2919 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:47.991715 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-17ae0faa-6bf2-49ae-a420-f90067188498 req-2294cb39-5c40-4c6b-b690-baa73efe2919 service nova] Creating event network-vif-plugged:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h2-master-1 Jul 01 10:53:47.998667 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-17ae0faa-6bf2-49ae-a420-f90067188498 req-2294cb39-5c40-4c6b-b690-baa73efe2919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037045 Jul 01 10:53:47.999927 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2688/5262] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:53:48.259272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:48.260447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:48.272503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:48.273354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:48.274635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:48.275642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:48.622499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:48.637720 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a85bfb5-db47-49e1-ac66-169a48eef55c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1392 microversion: 2.1 time: 0.890107 Jul 01 10:53:48.639308 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2575/5263] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:47 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1392 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:48.917391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:48.930885 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac764c1f-64ec-4de4-9aa5-dda9efbe9379 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1314 microversion: 2.1 time: 0.676327 Jul 01 10:53:48.937626 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2689/5264] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:48 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:49.658483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:49.663829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:49.683872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:49.697137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:49.698815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:49.699154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:49.952030 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:49.953910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:49.987633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:49.988119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:49.988967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:49.996587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:50.906159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:50.933383 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-753350e3-3bcf-430d-99f0-216972a0fa10 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1392 microversion: 2.1 time: 1.268179 Jul 01 10:53:50.962191 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2576/5265] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:49 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1392 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:50.971781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2088480191", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54ddbd62-ac58-4a67-a02d-423b9dfccc04"}], "security_groups": [{"name": "tempest-securitygroup--1696152294"}], "key_name": "tempest-keypair-468705177", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:50.988240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:51.005608 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac50058b-8f33-4764-a007-942c1a1c8b2a tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1314 microversion: 2.1 time: 1.050992 Jul 01 10:53:51.006295 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2690/5266] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:49 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:53:51.092877 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:51.334510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] validate_networks() for [('54ddbd62-ac58-4a67-a02d-423b9dfccc04', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:53:51.978338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:51.978957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:51.992546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:51.992546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:51.992546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:51.992546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:52.978044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:53.004261 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e3c3f05d-f97a-452c-9c96-3bdd890196c6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1565 microversion: 2.1 time: 1.031920 Jul 01 10:53:53.021189 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2691/5267] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:51 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1565 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:53.021985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:53.034591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:53.056140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:53.063010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:53.072529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:53.073238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:53.470028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:53.476323 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0de76397-0089-40f8-855f-22cf45a3bb4f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1314 microversion: 2.1 time: 0.458081 Jul 01 10:53:53.477265 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2692/5268] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:53 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:53.482905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:53.483616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:53.492399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:53.493301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:53.494259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:53.494912 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:53.525436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:53:53.525902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:53:53.526312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:53:53.526981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:53:53.527718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:53:53.550799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:53.557249 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:53.559225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:53.560764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:53.593862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:53:53.603319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:53:53.621573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:53:53.634647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:53:53.852408 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-723d5359-6c58-4c4f-8f41-c6757d60dc21 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.885856 Jul 01 10:53:53.854505 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2577/5269] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:53:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:53:53.867906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3579c17e-f337-4d2e-b92e-812d2ada31cd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:53.872075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3579c17e-f337-4d2e-b92e-812d2ada31cd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:54.098455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3579c17e-f337-4d2e-b92e-812d2ada31cd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:54.116647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:54.119273 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3579c17e-f337-4d2e-b92e-812d2ada31cd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1241 microversion: 2.1 time: 0.258069 Jul 01 10:53:54.120683 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2578/5270] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:53 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1241 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:54.129288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5bffa7df-853b-43f5-84d4-6c75792ce9c1 req-df492c04-815b-4f4b-845c-2c1c01f0c82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304c62a1-8cb3-46b7-873b-9f317a7362bd", "name": "network-vif-plugged", "status": "completed", "tag": "2d1d51cd-06f5-4a2c-9bf1-889e32794a5a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:54.139670 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9cc4ecff-1784-4e6a-b9fd-822292b5ce42 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1565 microversion: 2.1 time: 0.660764 Jul 01 10:53:54.147092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5bffa7df-853b-43f5-84d4-6c75792ce9c1 req-df492c04-815b-4f4b-845c-2c1c01f0c82f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:54.147092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5bffa7df-853b-43f5-84d4-6c75792ce9c1 req-df492c04-815b-4f4b-845c-2c1c01f0c82f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:54.148030 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2693/5271] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:53 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1565 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:54.171698 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5bffa7df-853b-43f5-84d4-6c75792ce9c1 req-df492c04-815b-4f4b-845c-2c1c01f0c82f service nova] Creating event network-vif-plugged:2d1d51cd-06f5-4a2c-9bf1-889e32794a5a for instance 304c62a1-8cb3-46b7-873b-9f317a7362bd on n-h1-master-1 Jul 01 10:53:54.220631 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5bffa7df-853b-43f5-84d4-6c75792ce9c1 req-df492c04-815b-4f4b-845c-2c1c01f0c82f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097294 Jul 01 10:53:54.227121 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2579/5272] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:53:54.494706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:54.495787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:54.503201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:54.503738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:54.504594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:54.505189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:54.858770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:54.867736 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a7342ac-b544-44e1-af29-8eb79d6c2652 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1314 microversion: 2.1 time: 0.377057 Jul 01 10:53:54.874949 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2694/5273] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:54 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:55.138210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31b62eef-a71f-405d-9509-cadf5a9188f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:55.146154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31b62eef-a71f-405d-9509-cadf5a9188f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:55.278012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31b62eef-a71f-405d-9509-cadf5a9188f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:55.293432 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31b62eef-a71f-405d-9509-cadf5a9188f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1241 microversion: 2.1 time: 0.156262 Jul 01 10:53:55.299257 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2580/5274] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:55 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:55.894017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:55.894913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:55.910991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:55.919745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:55.920986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:55.921485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:56.315342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:56.317889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:56.339951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:56.345201 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:56.346514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:56.347706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:56.551966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:56.562615 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d8ab69d-5a44-45c8-a447-c13715ac213f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1237 microversion: 2.1 time: 0.257735 Jul 01 10:53:56.572356 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2581/5275] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:56 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1237 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:56.671564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:56.688214 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e43cec6a-3595-475c-8d3d-8ebf6301459f tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1314 microversion: 2.1 time: 0.800012 Jul 01 10:53:56.706086 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2695/5276] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:55 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:57.582149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:57.592965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:57.606017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:57.606881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:57.608694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:57.611131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:57.647463 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=65 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:53:57.722677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:57.723310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:57.736551 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:57.742748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:57.744165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:57.747669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:57.991111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:58.001624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17177f2b-4ce9-4acc-b52e-062ac6fd14ee tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1311 microversion: 2.1 time: 0.425081 Jul 01 10:53:58.014881 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2582/5277] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:57 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:58.624435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:58.635837 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8a19b1c-ee7e-46e3-aea3-f53ecd3070c2 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1463 microversion: 2.1 time: 0.928493 Jul 01 10:53:58.638202 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2696/5278] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:57 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1463 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:53:58.661012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba6c3cf3-d931-4d17-ad54-530eac4f7d58 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63c864fc-435c-44de-a9e9-3d12c13f29f3", "device": "/dev/sdb"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:53:58.663550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba6c3cf3-d931-4d17-ad54-530eac4f7d58 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:58.672306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba6c3cf3-d931-4d17-ad54-530eac4f7d58 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:58.674075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba6c3cf3-d931-4d17-ad54-530eac4f7d58 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:58.685877 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba6c3cf3-d931-4d17-ad54-530eac4f7d58 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:58.686340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba6c3cf3-d931-4d17-ad54-530eac4f7d58 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:59.033620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:53:59.034395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:53:59.061452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:59.061982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:59.069080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:53:59.069660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:53:59.508216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:53:59.516234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5fb7016b-5f2b-426c-9508-211944555a16 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1367 microversion: 2.1 time: 0.488185 Jul 01 10:53:59.518789 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2697/5279] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:53:59 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:53:59.846421 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba6c3cf3-d931-4d17-ad54-530eac4f7d58 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "POST /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193818 Jul 01 10:53:59.869964 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2583/5280] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:53:58 2022] POST /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:00.289993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:00.290788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:00.307214 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=77,nova_api:DELETE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:00.308569 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:00.313860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:00.322662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:00.323875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-1853a026-1d22-41e8-b658-44ee79e10bb4 req-1a408386-2543-4e21-912c-7955598fdaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:00.328648 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:00.328892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:00.364115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1853a026-1d22-41e8-b658-44ee79e10bb4 req-1a408386-2543-4e21-912c-7955598fdaf0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:00.366065 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-1853a026-1d22-41e8-b658-44ee79e10bb4 req-1a408386-2543-4e21-912c-7955598fdaf0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:00.416328 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-1853a026-1d22-41e8-b658-44ee79e10bb4 req-1a408386-2543-4e21-912c-7955598fdaf0 service nova] Creating event network-changed:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h2-master-1 Jul 01 10:54:00.436732 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-1853a026-1d22-41e8-b658-44ee79e10bb4 req-1a408386-2543-4e21-912c-7955598fdaf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112809 Jul 01 10:54:00.441172 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2584/5281] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:54:00.536331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:00.537300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:00.550719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:00.554571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:00.554571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:00.554571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:00.904729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:00.909762 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=99 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:00.919104 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d1d18a8-2568-41d6-8fef-8513a099bb48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1565 microversion: 2.1 time: 0.639408 Jul 01 10:54:00.921350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2698/5282] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:00 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1565 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:01.458886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:01.474604 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dd3abcd6-1e32-4805-bfca-214d070df09a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1367 microversion: 2.1 time: 0.944229 Jul 01 10:54:01.476242 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2585/5283] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:00 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1367 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:02.508245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:02.509578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:02.535025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:02.544728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:02.548668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:02.552587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:02.746692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5c933262-5a0a-4859-8b73-96c574404c12 req-16d3d508-1a18-445e-aca1-a156dc900019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff1e9b5-e3df-4e72-bb71-4af64102f8ea", "tag": "017f7409-43f9-4dd0-8f59-a3a5ecf532cf"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:02.888522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5c933262-5a0a-4859-8b73-96c574404c12 req-16d3d508-1a18-445e-aca1-a156dc900019 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:02.888522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5c933262-5a0a-4859-8b73-96c574404c12 req-16d3d508-1a18-445e-aca1-a156dc900019 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:02.922768 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5c933262-5a0a-4859-8b73-96c574404c12 req-16d3d508-1a18-445e-aca1-a156dc900019 service nova] Creating event network-changed:017f7409-43f9-4dd0-8f59-a3a5ecf532cf for instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea on n-h2-master-1 Jul 01 10:54:02.950156 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5c933262-5a0a-4859-8b73-96c574404c12 req-16d3d508-1a18-445e-aca1-a156dc900019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212696 Jul 01 10:54:02.956368 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2586/5284] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:03.283476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:03.294622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64b134ad-abf5-4597-8d6d-48921088b4bd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1367 microversion: 2.1 time: 0.800397 Jul 01 10:54:03.295468 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2699/5285] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:02 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1367 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:04.309353 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:04.317715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:04.318828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:04.332328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:04.333350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:04.334754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:04.335929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:04.595679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:04.608869 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b652b578-cf3c-412d-aa47-80e4c94677cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1367 microversion: 2.1 time: 0.300686 Jul 01 10:54:04.610135 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2587/5286] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:04 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:05.628057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:05.629377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:05.647700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:05.648186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:05.650549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:05.651796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:06.441722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:06.450387 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-615ae290-e0d9-4014-b100-3199afe9677a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1367 microversion: 2.1 time: 0.828206 Jul 01 10:54:06.455340 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2700/5287] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:05 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1367 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:07.520196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:07.520896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:07.537645 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:07.551327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:07.554428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:07.558480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:07.559110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:07.907811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:07.923629 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0fa42d7f-9fa4-435b-bec5-25665400a551 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1367 microversion: 2.1 time: 0.447179 Jul 01 10:54:07.952330 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2588/5288] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:07 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:08.010612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-89157489-96aa-427f-8d8b-a8365750ec63 req-72ce4a25-8073-46c9-ab48-d5103bf99675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff1e9b5-e3df-4e72-bb71-4af64102f8ea", "name": "network-vif-plugged", "status": "completed", "tag": "017f7409-43f9-4dd0-8f59-a3a5ecf532cf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:08.067195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-89157489-96aa-427f-8d8b-a8365750ec63 req-72ce4a25-8073-46c9-ab48-d5103bf99675 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:08.070198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-89157489-96aa-427f-8d8b-a8365750ec63 req-72ce4a25-8073-46c9-ab48-d5103bf99675 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:08.118127 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-89157489-96aa-427f-8d8b-a8365750ec63 req-72ce4a25-8073-46c9-ab48-d5103bf99675 service nova] Creating event network-vif-plugged:017f7409-43f9-4dd0-8f59-a3a5ecf532cf for instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea on n-h2-master-1 Jul 01 10:54:08.155091 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-89157489-96aa-427f-8d8b-a8365750ec63 req-72ce4a25-8073-46c9-ab48-d5103bf99675 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138876 Jul 01 10:54:08.168620 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2701/5289] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:08.977525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:08.977525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:08.980959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:08.983278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:08.986648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:08.986648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:09.852956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:09.869234 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e91ca346-5946-4158-8bc6-db13e637751f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1367 microversion: 2.1 time: 0.903846 Jul 01 10:54:09.899299 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2589/5290] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:08 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1367 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:10.909776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:10.910585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:10.927124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:10.929892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:10.930815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:10.934521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:11.599359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:11.610889 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6bf5f22-9385-4f0f-955b-2893d7324f64 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1558 microversion: 2.1 time: 0.706755 Jul 01 10:54:11.613994 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2702/5291] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:10 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1558 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:11.661093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c67f42e-b8e9-4c86-ada7-2dfe3b61b704 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:11.661653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c67f42e-b8e9-4c86-ada7-2dfe3b61b704 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:11.673181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c67f42e-b8e9-4c86-ada7-2dfe3b61b704 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:11.678782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c67f42e-b8e9-4c86-ada7-2dfe3b61b704 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:11.681254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c67f42e-b8e9-4c86-ada7-2dfe3b61b704 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:11.681875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c67f42e-b8e9-4c86-ada7-2dfe3b61b704 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:11.866544 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c67f42e-b8e9-4c86-ada7-2dfe3b61b704 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232460 Jul 01 10:54:11.867510 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2590/5292] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:54:11 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:13.569529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-20088425-ea9b-4927-9f33-cb3237bba2c1 req-85cd7f2e-6d55-4a0f-97e8-67613c91556b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff1e9b5-e3df-4e72-bb71-4af64102f8ea", "tag": "017f7409-43f9-4dd0-8f59-a3a5ecf532cf"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:13.584027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-20088425-ea9b-4927-9f33-cb3237bba2c1 req-85cd7f2e-6d55-4a0f-97e8-67613c91556b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:13.585413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-20088425-ea9b-4927-9f33-cb3237bba2c1 req-85cd7f2e-6d55-4a0f-97e8-67613c91556b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:13.604581 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-20088425-ea9b-4927-9f33-cb3237bba2c1 req-85cd7f2e-6d55-4a0f-97e8-67613c91556b service nova] Creating event network-changed:017f7409-43f9-4dd0-8f59-a3a5ecf532cf for instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea on n-h2-master-1 Jul 01 10:54:13.612368 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-20088425-ea9b-4927-9f33-cb3237bba2c1 req-85cd7f2e-6d55-4a0f-97e8-67613c91556b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049455 Jul 01 10:54:13.613738 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2703/5293] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:16.394501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18feaf67-437a-44de-927a-d203b5df3579 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:16.395488 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-18feaf67-437a-44de-927a-d203b5df3579 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:16.411666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18feaf67-437a-44de-927a-d203b5df3579 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:16.412067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18feaf67-437a-44de-927a-d203b5df3579 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:16.416071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18feaf67-437a-44de-927a-d203b5df3579 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:16.425884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18feaf67-437a-44de-927a-d203b5df3579 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:16.510572 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-18feaf67-437a-44de-927a-d203b5df3579 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action" status: 200 len: 24572 microversion: 2.1 time: 0.123380 Jul 01 10:54:16.512352 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2591/5294] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:54:16 2022] POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action => generated 24572 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:54:16.956698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-26a959c7-24e4-49c4-997e-2e691d6e1f02 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Action: 'create', calling method: .version_select at 0x7f6f9709e0d0>, body: {"keypair": {"name": "tempest-keypair-1678250508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6QN54q7Di26V88XTr3MapQ6Z7z8I124Vbsj2fWsPLUBIAo3OZWrzhAszf2FpA0fXniBuxNacSnrJTjAnxMjjIWklPoA0il9eNoE3P/19+i6qTMQT39o4AWTPaj01WGjw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:16.995862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-26a959c7-24e4-49c4-997e-2e691d6e1f02 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Getting quotas for project 26e611c743aa41f59a371d9a5bfc102f. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:54:17.010843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-26a959c7-24e4-49c4-997e-2e691d6e1f02 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Getting quotas for user afb60d0b6ba441df9d8affa1c8c44f68 and project 26e611c743aa41f59a371d9a5bfc102f. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:54:17.176599 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-26a959c7-24e4-49c4-997e-2e691d6e1f02 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.384760 Jul 01 10:54:17.177297 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2704/5295] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:54:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:21.619310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-125752524", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1a768bd7-f115-4bd6-95f5-2266e420158d"}], "security_groups": [{"name": "tempest-securitygroup--1210396859"}], "key_name": "tempest-keypair-1678250508", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:21.759345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] validate_networks() for [('1a768bd7-f115-4bd6-95f5-2266e420158d', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:54:22.339802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Getting quotas for project 26e611c743aa41f59a371d9a5bfc102f. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:54:22.346045 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Getting quotas for user afb60d0b6ba441df9d8affa1c8c44f68 and project 26e611c743aa41f59a371d9a5bfc102f. Resources: dict_keys(['metadata_items']) {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:54:22.363124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:54:22.363532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:54:22.364035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:54:22.364443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:54:22.364873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:54:22.373697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:22.374146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:22.375494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:22.375925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:22.395449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Getting quotas for project 26e611c743aa41f59a371d9a5bfc102f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:54:22.400782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Getting quotas for user afb60d0b6ba441df9d8affa1c8c44f68 and project 26e611c743aa41f59a371d9a5bfc102f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:54:22.415200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:54:22.417712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:54:22.569950 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03679e9b-b0c2-4a85-9d82-cf746c579fc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.957545 Jul 01 10:54:22.582880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e342fd43-d83d-4019-8680-ff8d02a34749 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:22.584317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e342fd43-d83d-4019-8680-ff8d02a34749 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:22.589869 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2592/5296] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:54:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:54:22.703699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e342fd43-d83d-4019-8680-ff8d02a34749 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:22.712288 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e342fd43-d83d-4019-8680-ff8d02a34749 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1277 microversion: 2.1 time: 0.134879 Jul 01 10:54:22.723296 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2705/5297] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:22 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:23.735424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4cb6d31c-33d6-4394-8d1a-3759b1f02afd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:23.736988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4cb6d31c-33d6-4394-8d1a-3759b1f02afd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:23.872589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4cb6d31c-33d6-4394-8d1a-3759b1f02afd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:23.888066 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4cb6d31c-33d6-4394-8d1a-3759b1f02afd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1277 microversion: 2.1 time: 0.162398 Jul 01 10:54:23.894899 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2593/5298] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:23 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:24.911407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:24.911407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:24.913986 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=23 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:24.946281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:24.946730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:24.950385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:24.952901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:25.024714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:25.033286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbe0c67c-f6f7-484c-adf0-a12269b1b0c0 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1273 microversion: 2.1 time: 0.130072 Jul 01 10:54:25.034515 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2706/5299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:24 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:26.059124 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:26.061722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:26.083892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:26.086081 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:26.087067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:26.087663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:26.206649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:26.215237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07e8d93a-73cb-4e77-9993-1b82964e354f tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1329 microversion: 2.1 time: 0.161086 Jul 01 10:54:26.216140 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2594/5300] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:26 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1329 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:27.232218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:27.232833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:27.248885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:27.249364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:27.250720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:27.251162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:27.432174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:27.445833 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c55ced5b-e066-4010-924c-32672b6e855e tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1335 microversion: 2.1 time: 0.213103 Jul 01 10:54:27.447024 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2707/5301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:27 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:27.465163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ce5f606-3211-4d06-928c-63a820ad3b5c tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:27.465780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6ce5f606-3211-4d06-928c-63a820ad3b5c tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:27.474904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ce5f606-3211-4d06-928c-63a820ad3b5c tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:27.475355 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ce5f606-3211-4d06-928c-63a820ad3b5c tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:27.476150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ce5f606-3211-4d06-928c-63a820ad3b5c tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:27.489494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ce5f606-3211-4d06-928c-63a820ad3b5c tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:28.306722 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ce5f606-3211-4d06-928c-63a820ad3b5c tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1833 microversion: 2.1 time: 0.845320 Jul 01 10:54:28.318382 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2595/5302] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:27 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1833 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:28.329299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:28.330564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:28.342301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:28.345298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:28.346330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:28.353812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:28.474816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:28.475630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:28.526820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:28.527310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:28.532607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:28.536483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:28.663813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:28.675821 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e234f811-ff70-4627-b457-008ccf07d689 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1682 microversion: 2.1 time: 0.350798 Jul 01 10:54:28.685251 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2708/5303] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:28 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1682 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:28.904374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0afb22c9-0633-4d8b-a10e-4356dce463f4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:28.905435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0afb22c9-0633-4d8b-a10e-4356dce463f4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:28.914843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0afb22c9-0633-4d8b-a10e-4356dce463f4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:28.915663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0afb22c9-0633-4d8b-a10e-4356dce463f4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:28.916719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0afb22c9-0633-4d8b-a10e-4356dce463f4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:28.923031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0afb22c9-0633-4d8b-a10e-4356dce463f4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:28.966257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:28.969463 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:28.981044 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1a592cf-da47-4c68-b544-8d7d5ce5c6ca tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.519674 Jul 01 10:54:28.988076 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0afb22c9-0633-4d8b-a10e-4356dce463f4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action" status: 200 len: 32642 microversion: 2.1 time: 0.087682 Jul 01 10:54:28.989005 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2709/5304] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:54:28 2022] POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action => generated 32642 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:54:28.996774 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2596/5305] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:28 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:29.145085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:29.146091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:29.161463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:29.163764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:29.168310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:29.168310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:29.685651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5419133ef0ff47fcad434d1f542a0bf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8363f5d47214ffa95a8f03f74444980', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:29.686978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] flavor_id is None. Assuming migration. {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 01 10:54:29.688420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 10:54:30.020445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:30.025091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:30.059355 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:30.063584 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:30.067121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:30.068040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:30.805347 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e4541561-107c-4597-9acb-1ff8e841db28 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action" status: 202 len: 0 microversion: 2.1 time: 1.664534 Jul 01 10:54:30.813495 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2710/5306] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:54:29 2022] POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action => generated 0 bytes in 1674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:54:30.838302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:30.845445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:30.873063 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:30.874153 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:30.879202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:30.882812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:30.984886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:30.998287 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-847302a8-8eb1-49fc-9acd-b79f690747b9 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.988950 Jul 01 10:54:31.010856 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2597/5307] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:30 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:31.272973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:31.284173 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8adb9496-233c-421e-b326-4f59fa6ea555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1691 microversion: 2.1 time: 0.459153 Jul 01 10:54:31.285864 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2711/5308] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:30 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1691 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:32.025139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:32.026458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:32.058563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:32.066810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:32.072266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:32.078519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:32.304798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:32.307365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:32.370670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:32.384062 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:32.397925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:32.399045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:32.399496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:32.708435 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:33.218213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:33.232903 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87b683cb-a0a4-49bd-8cdd-b2098dc37c66 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1691 microversion: 2.1 time: 0.932974 Jul 01 10:54:33.244102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2712/5309] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:32 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1691 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:33.250669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-abe314d1-bfba-4665-a235-d3a3768c4805 req-d7b2072c-9421-4c41-984a-924fb5255fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022c866f-0716-4b09-819c-fda8fd061325", "tag": "c7f86678-d63a-4852-99fa-cb392dedae88"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:33.266960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-abe314d1-bfba-4665-a235-d3a3768c4805 req-d7b2072c-9421-4c41-984a-924fb5255fe1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:33.268045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-abe314d1-bfba-4665-a235-d3a3768c4805 req-d7b2072c-9421-4c41-984a-924fb5255fe1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:33.271594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:33.280673 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42e8bac0-1232-47b6-a80a-6fb4fa15a5a3 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 1.259066 Jul 01 10:54:33.281425 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2598/5310] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:32 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:33.293481 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-abe314d1-bfba-4665-a235-d3a3768c4805 req-d7b2072c-9421-4c41-984a-924fb5255fe1 service nova] Creating event network-changed:c7f86678-d63a-4852-99fa-cb392dedae88 for instance 022c866f-0716-4b09-819c-fda8fd061325 on n-h1-master-1 Jul 01 10:54:33.299810 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-abe314d1-bfba-4665-a235-d3a3768c4805 req-d7b2072c-9421-4c41-984a-924fb5255fe1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054098 Jul 01 10:54:33.300841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2713/5311] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:34.250893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:34.251516 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:34.255626 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:34.262090 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:34.266041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:34.269298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:34.269298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:34.269298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:34.306637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:34.306637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:34.332397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:34.332857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:34.333673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:34.334110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:34.728702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:34.743449 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3600f126-ec84-4745-9f75-c28c5a3d7a31 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1691 microversion: 2.1 time: 0.496654 Jul 01 10:54:34.754382 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2599/5312] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:34 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1691 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:34.780369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:34.810048 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af76103f-71d1-4d3f-8148-44f72f56cb14 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.515467 Jul 01 10:54:34.813564 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2714/5313] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:34 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:35.762912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:35.763568 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:35.787959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:35.787959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:35.789729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:35.790312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:35.848650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:35.849938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:35.868991 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:35.872983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:35.872983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:35.872983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:35.872983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:36.628102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:36.647151 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7139712a-68c8-4b06-a0af-0641daabde74 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1691 microversion: 2.1 time: 0.888946 Jul 01 10:54:36.648158 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2600/5314] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:35 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1691 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:36.859835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:36.898586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d4bda9c-7353-43c1-87ee-c976d9594772 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 1.053957 Jul 01 10:54:36.919618 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2715/5315] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:35 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:37.665319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:37.666707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:37.681383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:37.690210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:37.692175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:37.694216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:37.915599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:37.916218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:37.932141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:37.932829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:37.933883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:37.935404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:38.551116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:38.565712 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9cf90f0-b333-431a-9de6-4dea67c74787 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1691 microversion: 2.1 time: 0.904227 Jul 01 10:54:38.567183 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2601/5316] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:37 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1691 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:38.633600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:38.660002 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8cb097d-a09a-4c92-a86d-a0acabf2d90b tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.741542 Jul 01 10:54:38.660596 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2716/5317] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:37 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:39.584820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:39.585668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:39.593344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:39.593912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:39.594844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:39.595419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:39.677180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:39.678368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:39.692822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:39.697078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:39.698121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:39.698726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:39.879365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:39.892293 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1a94cff8-0908-4932-b06d-d03639a5bfa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.311923 Jul 01 10:54:39.905113 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2602/5318] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:39 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:40.133585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:40.144783 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-247fb553-c338-4f30-876f-4a66ae7dc188 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.472210 Jul 01 10:54:40.148636 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2717/5319] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:39 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:40.913046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:40.914304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:40.935519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:40.938223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:40.944139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:40.945047 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:41.165899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:41.167112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:41.190648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:41.191409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:41.192406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:41.193270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:41.483642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:41.493197 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6c7f57d-0c2d-4867-8d3c-26a1f7bed757 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.586044 Jul 01 10:54:41.494123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2603/5320] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:40 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:41.759950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:41.777135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-958de276-a409-4f05-aa93-610e96d4ed7d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.617061 Jul 01 10:54:41.785039 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2718/5321] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:41 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:42.511319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:42.511940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:42.520506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:42.530578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:42.534345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:42.534961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:42.795361 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:42.796061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:42.816233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:42.816706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:42.817540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:42.820627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:43.138601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:43.150759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2dccc95b-b05d-4eb2-9301-c3343a36bd63 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.643363 Jul 01 10:54:43.153350 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2604/5322] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:42 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:43.194904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:43.208505 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79d9ea22-d1a9-4e88-9432-2929e03769ce tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.417784 Jul 01 10:54:43.212151 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2719/5323] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:42 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:43.306062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5a54d9b6-c590-4898-9368-168f0f7c3eb7 req-f152552d-36f2-411b-a7db-9aca5d772d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022c866f-0716-4b09-819c-fda8fd061325", "name": "network-vif-plugged", "status": "completed", "tag": "c7f86678-d63a-4852-99fa-cb392dedae88"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:43.317919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5a54d9b6-c590-4898-9368-168f0f7c3eb7 req-f152552d-36f2-411b-a7db-9aca5d772d7d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:43.318369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5a54d9b6-c590-4898-9368-168f0f7c3eb7 req-f152552d-36f2-411b-a7db-9aca5d772d7d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:43.338096 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5a54d9b6-c590-4898-9368-168f0f7c3eb7 req-f152552d-36f2-411b-a7db-9aca5d772d7d service nova] Creating event network-vif-plugged:c7f86678-d63a-4852-99fa-cb392dedae88 for instance 022c866f-0716-4b09-819c-fda8fd061325 on n-h1-master-1 Jul 01 10:54:43.360254 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5a54d9b6-c590-4898-9368-168f0f7c3eb7 req-f152552d-36f2-411b-a7db-9aca5d772d7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056732 Jul 01 10:54:43.360254 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2605/5324] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:54:44.171641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:44.172849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:44.181105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:44.182275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:44.183260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:44.183848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:44.226481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:44.227442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:44.241750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:44.244184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:44.248166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:44.248754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:44.610615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:44.621784 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1437728c-783c-45a7-95a9-86e9e88d8999 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.454937 Jul 01 10:54:44.627061 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2720/5325] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:44 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:44.656863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:44.668005 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed59de02-5d5c-4744-89a0-1a81c0f11e0a tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1403 microversion: 2.1 time: 0.446183 Jul 01 10:54:44.669743 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2606/5326] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:44 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1403 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:45.639184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:45.640976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:45.657119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:45.660742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:45.661820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:45.664552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:45.687876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:45.688495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:45.701082 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:45.701605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:45.706650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:45.707392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:46.040054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:46.044766 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:46.058044 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0aea9465-b0c1-43ff-acd6-d0a27b56f171 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.420351 Jul 01 10:54:46.072743 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2721/5327] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:45 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:46.237029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:46.246915 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0fc3d0c1-6150-41c3-b821-f74cfccb6b19 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1590 microversion: 2.1 time: 0.564004 Jul 01 10:54:46.263235 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2607/5328] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:45 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1590 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:46.347520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-143bd354-f6fc-4bc0-99f7-952915dab4db tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:46.349317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-143bd354-f6fc-4bc0-99f7-952915dab4db tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:46.356332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143bd354-f6fc-4bc0-99f7-952915dab4db tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:46.357072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143bd354-f6fc-4bc0-99f7-952915dab4db tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:46.359394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143bd354-f6fc-4bc0-99f7-952915dab4db tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:46.360032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-143bd354-f6fc-4bc0-99f7-952915dab4db tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:46.475404 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-143bd354-f6fc-4bc0-99f7-952915dab4db tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131798 Jul 01 10:54:46.476011 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2722/5329] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:54:46 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:54:47.079641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:47.080418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:47.106158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:47.109667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:47.110717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:47.111274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:47.438369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:47.455203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c053db58-e7e2-4f32-84c2-004b498c6c5e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.378952 Jul 01 10:54:47.473416 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2608/5330] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:47 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:48.291103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-753f1236-fd9e-4cc6-a9b4-c19a47c2e289 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:48.291681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-753f1236-fd9e-4cc6-a9b4-c19a47c2e289 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:48.324236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-753f1236-fd9e-4cc6-a9b4-c19a47c2e289 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:48.324815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-753f1236-fd9e-4cc6-a9b4-c19a47c2e289 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:48.325701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-753f1236-fd9e-4cc6-a9b4-c19a47c2e289 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:48.326147 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-753f1236-fd9e-4cc6-a9b4-c19a47c2e289 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:48.408460 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-753f1236-fd9e-4cc6-a9b4-c19a47c2e289 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/ips" status: 200 len: 150 microversion: 2.1 time: 0.123470 Jul 01 10:54:48.409052 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2723/5331] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:54:48 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/ips => generated 150 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:48.475176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:48.476090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:48.485219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:48.485913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:48.486835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:48.487700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:48.728244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:48.739283 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e2a0fcd-c97a-490c-8d98-ab09687715e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.267971 Jul 01 10:54:48.743214 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2609/5332] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:48 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:49.741322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:49.743001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:49.758659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:49.759794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:49.769322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:49.773822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:49.779054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:49.779717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:49.783601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:49.785888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:49.787904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:49.788716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:50.070919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:50.086183 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9197a8ff-3150-4e64-95fc-9c6f7e95e46e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.329509 Jul 01 10:54:50.089526 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2610/5333] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:49 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:54:50.099744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-aa012eb9-6531-4ce5-9aa9-5d0578de6340 req-1bcc823f-08d8-43a1-994f-a6f1f57299aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022c866f-0716-4b09-819c-fda8fd061325", "tag": "c7f86678-d63a-4852-99fa-cb392dedae88"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:50.110209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-aa012eb9-6531-4ce5-9aa9-5d0578de6340 req-1bcc823f-08d8-43a1-994f-a6f1f57299aa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:50.110662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-aa012eb9-6531-4ce5-9aa9-5d0578de6340 req-1bcc823f-08d8-43a1-994f-a6f1f57299aa service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:50.145277 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-aa012eb9-6531-4ce5-9aa9-5d0578de6340 req-1bcc823f-08d8-43a1-994f-a6f1f57299aa service nova] Creating event network-changed:c7f86678-d63a-4852-99fa-cb392dedae88 for instance 022c866f-0716-4b09-819c-fda8fd061325 on n-h1-master-1 Jul 01 10:54:50.156157 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-aa012eb9-6531-4ce5-9aa9-5d0578de6340 req-1bcc823f-08d8-43a1-994f-a6f1f57299aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067321 Jul 01 10:54:50.158067 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2611/5334] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:54:50.171312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:50.208343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ee3747e8-3a16-4bde-870b-d35124042f65 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1590 microversion: 2.1 time: 0.472347 Jul 01 10:54:50.212893 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2724/5335] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:49 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1590 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:51.105983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:51.106816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:51.122684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:51.124308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:51.127832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:51.129406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:51.675608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4271655-98c7-40b7-8d19-801e4e6813bf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:54:51.678231 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4271655-98c7-40b7-8d19-801e4e6813bf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:51.689622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4271655-98c7-40b7-8d19-801e4e6813bf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:51.690285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4271655-98c7-40b7-8d19-801e4e6813bf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:51.697250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4271655-98c7-40b7-8d19-801e4e6813bf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:51.697250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4271655-98c7-40b7-8d19-801e4e6813bf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:51.888704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:51.897883 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-65c147ee-723d-4608-9f52-b7ca61ed3e51 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.796716 Jul 01 10:54:51.901476 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2612/5336] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:51 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:52.666791 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4271655-98c7-40b7-8d19-801e4e6813bf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998821 Jul 01 10:54:52.668044 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2725/5337] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:54:51 2022] POST /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 194 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:54:52.916131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:52.916911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:52.928722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:52.929211 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:52.930114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:52.930434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:53.285196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:53.296792 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e258015f-44d9-46bd-8296-ad72332af128 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.384985 Jul 01 10:54:53.299447 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2613/5338] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:52 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:54.318829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:54.320360 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:54.349562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:54.350742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:54.351956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:54.354633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:55.517780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:55.527039 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2531b836-eef0-46be-9682-5fc68792e326 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 1.214015 Jul 01 10:54:55.538773 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2726/5339] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:54 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:56.546203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:56.546973 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:56.558722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:56.565315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:56.566455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:56.567009 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:56.967151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:56.970113 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:54:56.986768 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c5606d2-ffcf-44c4-8606-5c9071036fb3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.444590 Jul 01 10:54:56.989979 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2614/5340] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:56 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:58.005199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:58.005822 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:58.022425 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:58.022957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:58.023977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:58.029625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:58.381747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:54:58.392806 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bfab7b32-e676-4620-a9f6-5cb73ad27939 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.391495 Jul 01 10:54:58.409418 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2727/5341] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:58 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:54:59.412779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:54:59.413648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:54:59.450879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:59.454400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:59.456037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:54:59.472341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:54:59.989462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:00.003927 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e67b65d-60bc-4c08-be92-662eaad246ad tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.592672 Jul 01 10:55:00.006927 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2615/5342] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:54:59 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:01.027580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:01.028981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:01.063763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:01.068507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:01.068507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:01.068507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:01.532701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:01.561362 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c441a299-6101-4295-b99e-53490fa616a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1696 microversion: 2.1 time: 0.539000 Jul 01 10:55:01.566732 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2728/5343] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:01 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1696 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:02.584911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:02.586412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:02.602436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:02.603196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:02.605228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:02.605994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:03.187550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:03.196876 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5ab08af0-9443-4720-a054-f9229fb565d8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1695 microversion: 2.1 time: 0.616581 Jul 01 10:55:03.213264 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2616/5344] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:02 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1695 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:03.780747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6cb12936-f8dc-4d0b-b375-b744d19387f0 req-1f85f2d1-177e-4b50-bd32-5dcc67a838d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "name": "network-vif-unplugged", "status": "completed", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:03.800700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6cb12936-f8dc-4d0b-b375-b744d19387f0 req-1f85f2d1-177e-4b50-bd32-5dcc67a838d5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:03.801909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6cb12936-f8dc-4d0b-b375-b744d19387f0 req-1f85f2d1-177e-4b50-bd32-5dcc67a838d5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:03.816151 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6cb12936-f8dc-4d0b-b375-b744d19387f0 req-1f85f2d1-177e-4b50-bd32-5dcc67a838d5 service nova] Creating event network-vif-unplugged:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h1-master-1 Jul 01 10:55:03.822184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-6cb12936-f8dc-4d0b-b375-b744d19387f0 req-1f85f2d1-177e-4b50-bd32-5dcc67a838d5 service nova] Instance be3d24af-cc22-490c-a483-41d0ce16dd7d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:55:03.838542 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6cb12936-f8dc-4d0b-b375-b744d19387f0 req-1f85f2d1-177e-4b50-bd32-5dcc67a838d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059619 Jul 01 10:55:03.839819 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2729/5345] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:55:04.227640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:04.227640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:04.234799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:04.235253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:04.236221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:04.236662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:04.466005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:04.484563 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e1ab0256-d655-4fd4-b5aa-2a55fcd5ae4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1695 microversion: 2.1 time: 0.257580 Jul 01 10:55:04.490088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2617/5346] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:04 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1695 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:05.497859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:05.499636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:05.518226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:05.518696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:05.520883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:05.522665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:05.966300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:05.986343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4996c59c-60d6-4527-a2d9-fe9e25d73477 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1695 microversion: 2.1 time: 0.491832 Jul 01 10:55:05.988607 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2730/5347] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:05 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1695 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:06.239563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e7ecf782-492c-4544-81c5-2c2e5a5e3529 req-dee95fdc-533d-4a44-8a23-e03f4869d1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:06.259141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e7ecf782-492c-4544-81c5-2c2e5a5e3529 req-dee95fdc-533d-4a44-8a23-e03f4869d1c9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:06.270560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e7ecf782-492c-4544-81c5-2c2e5a5e3529 req-dee95fdc-533d-4a44-8a23-e03f4869d1c9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:06.287987 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e7ecf782-492c-4544-81c5-2c2e5a5e3529 req-dee95fdc-533d-4a44-8a23-e03f4869d1c9 service nova] Creating event network-changed:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h1-master-1 Jul 01 10:55:06.295290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-e7ecf782-492c-4544-81c5-2c2e5a5e3529 req-dee95fdc-533d-4a44-8a23-e03f4869d1c9 service nova] Instance be3d24af-cc22-490c-a483-41d0ce16dd7d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:55:06.309528 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e7ecf782-492c-4544-81c5-2c2e5a5e3529 req-dee95fdc-533d-4a44-8a23-e03f4869d1c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076467 Jul 01 10:55:06.316031 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2618/5348] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:07.005843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:07.007063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:07.018698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:07.019160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:07.019955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:07.020391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:07.506661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:07.530751 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ab96488-dc78-4570-bd92-4134ec5ca2f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1695 microversion: 2.1 time: 0.528797 Jul 01 10:55:07.532699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2731/5349] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:07 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1695 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:08.553340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:08.554055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:08.558119 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=40 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:08.564640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:08.565436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:08.566359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:08.566996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:08.843384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:08.850901 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c68be13c-f058-4406-80c6-e86690fc1050 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1693 microversion: 2.1 time: 0.300439 Jul 01 10:55:08.851593 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2619/5350] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:08 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1693 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:09.871604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:09.872321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:09.881712 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:09.884162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:09.890819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:09.892191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:09.892930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:10.137947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-23eaf6d5-61da-40ed-b6bd-c581c2678d6c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: .version_select at 0x7f6f91426790>, body: {"keypair": {"name": "tempest-keypair-552612570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLc7kQKwYFZrOqNS/K/Gqkgkmh4ZhX/1wTieA7wXLZxlXw8LESp+/93t90/i6y1dTK7vCsoCgkcV+/vXzuIp0o7X95Gq0rk7soRLrnKA4vDCU87G9AOQK9h4jLDM6Lr0w=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:10.188341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-23eaf6d5-61da-40ed-b6bd-c581c2678d6c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:55:10.199242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-23eaf6d5-61da-40ed-b6bd-c581c2678d6c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:55:10.400472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:10.405379 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-23eaf6d5-61da-40ed-b6bd-c581c2678d6c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264548 Jul 01 10:55:10.405379 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2620/5351] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:55:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:55:10.405669 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7589c16f-afb6-498e-8757-0014424971f5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1693 microversion: 2.1 time: 0.537889 Jul 01 10:55:10.413748 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2732/5352] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:09 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1693 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:11.425504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:11.425504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:11.434448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:11.435435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:11.437257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:11.441408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:11.966915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:11.983530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1bff1a9-35c0-4cd6-87d1-42dab275408a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1690 microversion: 2.1 time: 0.566165 Jul 01 10:55:11.996000 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2621/5353] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:11 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1690 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:12.001002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fd9fc268-89be-4a5c-9279-21b26f018d27 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:12.002797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fd9fc268-89be-4a5c-9279-21b26f018d27 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:12.018043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd9fc268-89be-4a5c-9279-21b26f018d27 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:12.018851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd9fc268-89be-4a5c-9279-21b26f018d27 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:12.019907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd9fc268-89be-4a5c-9279-21b26f018d27 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:12.020504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd9fc268-89be-4a5c-9279-21b26f018d27 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:12.315815 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fd9fc268-89be-4a5c-9279-21b26f018d27 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action" status: 204 len: 0 microversion: 2.1 time: 0.319218 Jul 01 10:55:12.317057 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2733/5354] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:55:11 2022] POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:55:12.325242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:12.326011 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:12.335394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:12.335851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:12.337353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:12.337353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:13.403820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-593662629", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "2b99c055-8b0a-458a-bcc3-96205c48afae"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:13.515955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] validate_networks() for [('2b99c055-8b0a-458a-bcc3-96205c48afae', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:55:13.875919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:13.889034 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-001ea552-7c50-4a61-8c6d-a94d3f2fe451 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1690 microversion: 2.1 time: 1.567809 Jul 01 10:55:13.892389 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2622/5355] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:12 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1690 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:14.340687 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e9d0146c-f989-472a-84b6-ed64abb1963b req-cd20797e-a69a-4aff-be0d-1468a2b53ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "name": "network-vif-plugged", "status": "completed", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:14.358820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e9d0146c-f989-472a-84b6-ed64abb1963b req-cd20797e-a69a-4aff-be0d-1468a2b53ea0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:14.359472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e9d0146c-f989-472a-84b6-ed64abb1963b req-cd20797e-a69a-4aff-be0d-1468a2b53ea0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:14.380743 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e9d0146c-f989-472a-84b6-ed64abb1963b req-cd20797e-a69a-4aff-be0d-1468a2b53ea0 service nova] Creating event network-vif-plugged:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h1-master-1 Jul 01 10:55:14.399072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-e9d0146c-f989-472a-84b6-ed64abb1963b req-cd20797e-a69a-4aff-be0d-1468a2b53ea0 service nova] Instance be3d24af-cc22-490c-a483-41d0ce16dd7d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:55:14.420508 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e9d0146c-f989-472a-84b6-ed64abb1963b req-cd20797e-a69a-4aff-be0d-1468a2b53ea0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084197 Jul 01 10:55:14.425305 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2623/5356] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:55:14.578284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:55:14.578713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:55:14.579206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:55:14.579619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:55:14.580036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:55:14.596845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:14.597338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:14.598230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:14.598671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:14.619478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Getting quotas for project 066493bcd8184524908e1e7260d5ad0c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:55:14.626952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Getting quotas for user 479994bc8e4444efa549981c0906bd50 and project 066493bcd8184524908e1e7260d5ad0c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:55:14.642545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:55:14.646213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:55:14.886267 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01289493-affd-43b8-8f78-db95e6647288 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.939743 Jul 01 10:55:14.891825 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2734/5357] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:55:14.898769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb0b19e9-14c2-4f21-9ef1-d54ddbb4e7f6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:14.899653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb0b19e9-14c2-4f21-9ef1-d54ddbb4e7f6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:14.909848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:14.910757 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:14.927886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:14.928800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:14.929795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:14.930689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:15.183884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bb0b19e9-14c2-4f21-9ef1-d54ddbb4e7f6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:15.191901 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb0b19e9-14c2-4f21-9ef1-d54ddbb4e7f6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1214 microversion: 2.1 time: 0.297760 Jul 01 10:55:15.206699 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2624/5358] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:14 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:15.263636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-695043915", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54ddbd62-ac58-4a67-a02d-423b9dfccc04"}], "security_groups": [{"name": "tempest-securitygroup--670279172"}], "key_name": "tempest-keypair-552612570", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:15.286438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:15.295005 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25f7c829-b05b-42d3-a4aa-f8d768877d0c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1690 microversion: 2.1 time: 0.390936 Jul 01 10:55:15.305559 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2735/5359] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:14 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1690 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:15.430261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] validate_networks() for [('54ddbd62-ac58-4a67-a02d-423b9dfccc04', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:55:16.042609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:55:16.043199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:55:16.049404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:55:16.049404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:55:16.049404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:55:16.060466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:16.061473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:16.062271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:16.062704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:16.125809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:55:16.145538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:55:16.176609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:55:16.178943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:55:16.209936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-672b1b17-e110-4f9d-820e-3f04033fdc66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:16.210679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-672b1b17-e110-4f9d-820e-3f04033fdc66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:16.276959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-672b1b17-e110-4f9d-820e-3f04033fdc66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:16.284955 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-672b1b17-e110-4f9d-820e-3f04033fdc66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1214 microversion: 2.1 time: 0.080216 Jul 01 10:55:16.285467 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2736/5360] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:16 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:16.316948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:16.317597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:16.347199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:16.347645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:16.348833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:16.351264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:16.428171 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a5b3d49-88ae-4256-82b5-4b792ea50807 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.168998 Jul 01 10:55:16.429539 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2625/5361] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:55:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:55:16.439049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1877f1af-3554-468a-9e7b-21c245c40b2a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:16.440149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1877f1af-3554-468a-9e7b-21c245c40b2a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:16.544178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1877f1af-3554-468a-9e7b-21c245c40b2a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:16.552094 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1877f1af-3554-468a-9e7b-21c245c40b2a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1240 microversion: 2.1 time: 0.117120 Jul 01 10:55:16.562212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2626/5362] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:16 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:16.710887 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:16.741745 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db3e2d9b-c024-42c5-a3d4-cabbf7044e98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1682 microversion: 2.1 time: 0.424719 Jul 01 10:55:16.743134 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2737/5363] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:16 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:17.318995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:17.319614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:17.343651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:17.349999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:17.349999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:17.349999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:17.420150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:17.431172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdfd9d62-ece6-4d31-ac5c-3875017a1688 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1210 microversion: 2.1 time: 0.115983 Jul 01 10:55:17.432119 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2627/5364] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:17 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:17.569658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d5252d7-fd8e-458b-ad7d-d9a02fd8eba7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:17.570196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d5252d7-fd8e-458b-ad7d-d9a02fd8eba7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:17.651202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d5252d7-fd8e-458b-ad7d-d9a02fd8eba7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:17.660299 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d5252d7-fd8e-458b-ad7d-d9a02fd8eba7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1240 microversion: 2.1 time: 0.093482 Jul 01 10:55:17.660299 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2738/5365] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:17 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:18.449787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:18.452336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:18.462901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:18.465749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:18.468736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:18.469485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:18.581817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:18.590465 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-29f7099d-7ff8-4015-a7a7-63ee09cf11be tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1274 microversion: 2.1 time: 0.145617 Jul 01 10:55:18.593096 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2628/5366] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:18 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1274 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:18.677773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:18.679085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:18.698951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:18.702155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:18.703431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:18.704315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:18.863350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:18.868134 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:18.882549 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bb87375b-0280-4255-9d34-cdd8b7937abe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1292 microversion: 2.1 time: 0.209780 Jul 01 10:55:18.892070 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2739/5367] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:18 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1292 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:19.610190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:19.611531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:19.619187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:19.619975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:19.621347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:19.622086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:19.715364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:19.727301 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6da66fd-ce9b-470b-8348-58c2328cc118 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1272 microversion: 2.1 time: 0.122906 Jul 01 10:55:19.738264 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2629/5368] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:19 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:19.905035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:19.907174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:19.929326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:19.931633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:19.932741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:19.934601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:20.098196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:20.107857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f69b6c00-81b1-4421-9746-bdef1acca2c7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1298 microversion: 2.1 time: 0.206744 Jul 01 10:55:20.112104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2740/5369] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:19 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:20.745450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:20.746167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:20.753566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:20.754012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:20.758141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:20.758141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:21.079871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:21.092751 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39043cab-9955-4f64-b927-e2d43963f90d tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.350432 Jul 01 10:55:21.094289 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2630/5370] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:20 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:21.130301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:21.131527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:21.141474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:21.142155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:21.143081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:21.143997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:21.263376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:21.272587 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5bbbd0c-eaa2-414d-b88d-bde31b4fbdf9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1298 microversion: 2.1 time: 0.147459 Jul 01 10:55:21.284553 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2741/5371] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:21 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:22.109982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:22.110608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:22.118998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:22.119740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:22.121090 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:22.122694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:22.261906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-11268da5-a945-4e10-95f7-2a60c199ea6c req-7f2a4970-8f63-4ccb-97c4-91861981c1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fcaeddd-6964-4391-897f-bf2d28d6f462", "tag": "176ac330-cfe5-4663-96ac-3f77f16b229c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:22.284263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-11268da5-a945-4e10-95f7-2a60c199ea6c req-7f2a4970-8f63-4ccb-97c4-91861981c1ae service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:22.285647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-11268da5-a945-4e10-95f7-2a60c199ea6c req-7f2a4970-8f63-4ccb-97c4-91861981c1ae service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:22.304459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-11268da5-a945-4e10-95f7-2a60c199ea6c req-7f2a4970-8f63-4ccb-97c4-91861981c1ae service nova] Creating event network-changed:176ac330-cfe5-4663-96ac-3f77f16b229c for instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 on n-h1-master-1 Jul 01 10:55:22.320401 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-11268da5-a945-4e10-95f7-2a60c199ea6c req-7f2a4970-8f63-4ccb-97c4-91861981c1ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063117 Jul 01 10:55:22.321758 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2742/5372] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:22.334376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:22.335171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:22.342463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:22.343175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:22.345136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:22.345805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:22.825820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:22.845903 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47c39845-9bbf-405a-b1ac-625aa169fe62 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.740540 Jul 01 10:55:22.847462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:22.848570 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2631/5373] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:22 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:22.858410 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4ee57cf3-af28-40ff-ba6d-ccb0c6945da3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.534607 Jul 01 10:55:22.859064 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2743/5374] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:22 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:22.867682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:22.877389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:22.879054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Searching by: {'deleted': False, 'project_id': '26e611c743aa41f59a371d9a5bfc102f'} {{(pid=119765) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:55:22.924197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:22.926963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:22.931589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:22.933467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.000808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.multi_cell_list [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119765) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:55:23.074455 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d361b32-b468-4fa2-8929-b4405020c47d tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.223926 Jul 01 10:55:23.078370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2632/5375] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 10:55:22 2022] GET /compute/v2.1/servers => generated 339 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:23.092070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:23.096824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:23.102963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Searching by: {'deleted': False, 'project_id': '26e611c743aa41f59a371d9a5bfc102f'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 10:55:23.137593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.142239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.143175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.146577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.269937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 10:55:23.314782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:23.322495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.323155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.441681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7c9f604a-ca13-4a9e-9315-d560ca051e3f req-a6661bde-8119-4afc-95ab-e7b3232521fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de93a5a5-d4c6-4279-8f6a-aab9eae133e7", "tag": "2105d25f-f1e5-44fe-8872-6c003679e8be"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:23.467579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7c9f604a-ca13-4a9e-9315-d560ca051e3f req-a6661bde-8119-4afc-95ab-e7b3232521fc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.468034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7c9f604a-ca13-4a9e-9315-d560ca051e3f req-a6661bde-8119-4afc-95ab-e7b3232521fc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.508286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7c9f604a-ca13-4a9e-9315-d560ca051e3f req-a6661bde-8119-4afc-95ab-e7b3232521fc service nova] Creating event network-changed:2105d25f-f1e5-44fe-8872-6c003679e8be for instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 on n-h1-master-1 Jul 01 10:55:23.523744 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7c9f604a-ca13-4a9e-9315-d560ca051e3f req-a6661bde-8119-4afc-95ab-e7b3232521fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093638 Jul 01 10:55:23.524990 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2633/5376] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 01 10:55:23.583016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa454eae-2804-4c5e-88a4-963f78a7dabd tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.495717 Jul 01 10:55:23.583611 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2744/5377] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 10:55:23 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:23.603106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8dd91c8-9bfe-4210-a792-3bfc17eff1fc tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:23.612709 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8dd91c8-9bfe-4210-a792-3bfc17eff1fc tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013865 Jul 01 10:55:23.613547 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2634/5378] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Jul 1 10:55:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:23.867775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:23.869353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:23.878064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.879613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.880633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.881249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.888197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:23.889412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:23.899666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.909232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:23.932816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:23.933692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:24.151237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:24.165731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:24.170766 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-52928c54-1585-40fb-8146-f72f1697bda7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.307452 Jul 01 10:55:24.171469 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2745/5379] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:23 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:24.179654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:24.180379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:24.188627 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f6e0f029-b4ce-4cdd-8b43-4e086c6f6c60 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.304320 Jul 01 10:55:24.190357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:24.190794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:24.191748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:24.192185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:24.193718 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2635/5380] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:23 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:24.223230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:55:24.669410 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a44fc6f-ea59-4acf-9c12-7d72bf981436 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "DELETE /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 204 len: 0 microversion: 2.1 time: 0.496326 Jul 01 10:55:24.673546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2746/5381] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:55:24 2022] DELETE /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:55:24.685224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:24.685893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:24.704961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:24.705382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:24.706251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:24.706699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:24.890689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:24.903030 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7094097a-b0d2-4b67-9846-f86e502a2d79 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1715 microversion: 2.1 time: 0.226361 Jul 01 10:55:24.903784 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2636/5382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:24 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1715 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:25.205980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:25.206534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:25.207293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:25.207462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:25.215787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:25.216448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:25.218195 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:25.219105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:25.243495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:25.245532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:25.249574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:25.250427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:25.254458 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:25.660465 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:25.670586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:25.672105 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6059328a-26b7-4ad1-8892-bd71c02a7db3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.479352 Jul 01 10:55:25.683221 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1a3ba533-8a6e-4375-bc77-c70e6ba8e6bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.477058 Jul 01 10:55:25.683221 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2637/5383] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:25 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:25.684450 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2747/5384] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:25 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:25.924964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:25.926231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:25.946975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:25.949690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:25.951033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:25.955073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:26.552457 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=14 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:26.691830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:26.704151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:26.713618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:26.714119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:26.715861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:26.717427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:26.853037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:26.867172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ebc27e45-765f-44b7-a897-d78f7ca47bc1 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1715 microversion: 2.1 time: 0.949451 Jul 01 10:55:26.867692 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2638/5385] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:25 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1715 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:26.898113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:26.901030 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:26.916096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:26.916576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:26.920961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:26.928992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:26.931887 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e2809aa9-1327-4416-9af3-9d8251d6cb03 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.244716 Jul 01 10:55:26.932664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:26.943209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2748/5386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:26 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:27.460149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:27.473851 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d16d956-7467-4973-abdd-18c9cab6a6a0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.593460 Jul 01 10:55:27.474454 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2639/5387] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:26 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:27.885278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:27.886601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:27.900982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:27.901990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:27.904773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:27.905605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:27.959025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:27.959744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:27.980575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:27.981889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:27.983349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:27.984014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:28.067080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:28.075124 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9b9d67e-bbce-40cd-afae-406b4ead97b4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1647 microversion: 2.1 time: 0.193829 Jul 01 10:55:28.076938 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2749/5388] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:27 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1647 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:28.341249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:28.352799 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-edf54685-7dc3-43d4-9022-3008955d1aba tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.398569 Jul 01 10:55:28.358838 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2640/5389] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:27 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:28.473757 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e8b09b59-763a-48b1-833a-f726ee2a408b req-aadc8d1f-2939-40d4-b6f2-2143ef4777fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022c866f-0716-4b09-819c-fda8fd061325", "name": "network-vif-deleted", "tag": "c7f86678-d63a-4852-99fa-cb392dedae88"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:28.486601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e8b09b59-763a-48b1-833a-f726ee2a408b req-aadc8d1f-2939-40d4-b6f2-2143ef4777fc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:28.488947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e8b09b59-763a-48b1-833a-f726ee2a408b req-aadc8d1f-2939-40d4-b6f2-2143ef4777fc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:28.495130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:28.495900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:28.511481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:28.511959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:28.515652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:28.516638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:28.522364 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e8b09b59-763a-48b1-833a-f726ee2a408b req-aadc8d1f-2939-40d4-b6f2-2143ef4777fc service nova] Creating event network-vif-deleted:c7f86678-d63a-4852-99fa-cb392dedae88 for instance 022c866f-0716-4b09-819c-fda8fd061325 on n-h1-master-1 Jul 01 10:55:28.537719 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e8b09b59-763a-48b1-833a-f726ee2a408b req-aadc8d1f-2939-40d4-b6f2-2143ef4777fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068344 Jul 01 10:55:28.538766 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2750/5390] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:28.797940 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:28.806956 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7c58ace3-c3bb-4913-a120-b5a6b3339dcf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.318940 Jul 01 10:55:28.809587 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2641/5391] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:28 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:28.939036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-36dc9ef2-f508-4244-84fb-1e13fe72e404 req-1567d423-1e0a-4daa-a88c-eb9af7bbb76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcaeddd-6964-4391-897f-bf2d28d6f462", "name": "network-vif-plugged", "status": "completed", "tag": "176ac330-cfe5-4663-96ac-3f77f16b229c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:28.956682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-36dc9ef2-f508-4244-84fb-1e13fe72e404 req-1567d423-1e0a-4daa-a88c-eb9af7bbb76e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:28.961777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-36dc9ef2-f508-4244-84fb-1e13fe72e404 req-1567d423-1e0a-4daa-a88c-eb9af7bbb76e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:28.992299 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-36dc9ef2-f508-4244-84fb-1e13fe72e404 req-1567d423-1e0a-4daa-a88c-eb9af7bbb76e service nova] Creating event network-vif-plugged:176ac330-cfe5-4663-96ac-3f77f16b229c for instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 on n-h1-master-1 Jul 01 10:55:29.000338 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-36dc9ef2-f508-4244-84fb-1e13fe72e404 req-1567d423-1e0a-4daa-a88c-eb9af7bbb76e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066611 Jul 01 10:55:29.001656 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2751/5392] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:29.093697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:29.094334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:29.115471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:29.115929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:29.130591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:29.130591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:29.213972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:29.213972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:29.213972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lazy-loading 'fault' on Instance uuid 022c866f-0716-4b09-819c-fda8fd061325 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:55:29.261576 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb60d0b6ba441df9d8affa1c8c44f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e611c743aa41f59a371d9a5bfc102f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:29.274075 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec9a0600-c197-4caf-a9c0-bcec41eafbc4 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 200 len: 1367 microversion: 2.1 time: 0.184423 Jul 01 10:55:29.314314 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2642/5393] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:29 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:29.375905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:29.377481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:29.392516 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:29.393580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:29.394484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:29.395108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:29.567657 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:29.576585 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-42f74460-1ea9-4214-be2c-75dc1e2523d0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.207420 Jul 01 10:55:29.581197 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2752/5394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:29 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:29.827626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:29.828615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:29.858001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:29.858587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:29.859480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:29.862723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:30.082588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:30.089513 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-694e96bf-a6ef-4984-b6de-d8450d8c9652 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.266425 Jul 01 10:55:30.090172 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2643/5395] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:29 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:30.290907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:30.292171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] [instance: 022c866f-0716-4b09-819c-fda8fd061325] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:30.306199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:30.309581 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:30.316751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:30.316751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:30.351069 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] HTTP exception thrown: Instance 022c866f-0716-4b09-819c-fda8fd061325 could not be found. Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Request method failure captured: Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 HTTP/1.1 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtJYYGuBEWdQ-YG5QglezdfYGNKru3YV4eWyHQCfy6Qe5KBKU7rC-0AuEPmrKaHnSWIK8sEqVOgI_pO7grCC7RrTJmIK_BMV2ajUpM-Py-iNwW8_SMbJLXSH4KPcyz-ITtZhHgkFah6c8aZ-RXylUtSf0avhF78V8ZAq2iZ1TanW4Ks Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 26e611c743aa41f59a371d9a5bfc102f Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersTestManualDisk-1327749375 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/26e611c743aa41f59a371d9a5bfc102f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/26e611c743aa41f59a371d9a5bfc102f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_26e611c743aa41f59a371d9a5bfc102f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/26e611c743aa41f59a371d9a5bfc102f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersTestManualDisk-1327749375 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 26e611c743aa41f59a371d9a5bfc102f Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersTestManualDisk-1327749375 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersTestManualDisk-1327749375-project Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: afb60d0b6ba441df9d8affa1c8c44f68 Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersTestManualDisk-1327749375-project Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 022c866f-0716-4b09-819c-fda8fd061325 could not be found. Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '022c866f-0716-4b09-819c-fda8fd061325'} Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022c866f-0716-4b09-819c-fda8fd061325 could not be found. Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022c866f-0716-4b09-819c-fda8fd061325 could not be found. Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:55:30.356609 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:55:30.361201 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:30.361201 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:55:30.361201 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:55:30.361201 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:55:30.361201 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:55:30.361201 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022c866f-0716-4b09-819c-fda8fd061325 could not be found. Jul 01 10:55:30.361201 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:55:30.362222 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Returning 404 to user: Instance 022c866f-0716-4b09-819c-fda8fd061325 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:55:30.363193 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-946b107e-0f5d-4dc9-9721-d17371783846 tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325" status: 404 len: 111 microversion: 2.1 time: 0.076230 Jul 01 10:55:30.364800 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2753/5396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:30 2022] GET /compute/v2.1/servers/022c866f-0716-4b09-819c-fda8fd061325 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:55:30.372348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5b1eef96-b4ee-4a2a-9b8b-87a43b7a3b1c tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] Calling method '.version_select at 0x7f6f91b099d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:30.464340 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5b1eef96-b4ee-4a2a-9b8b-87a43b7a3b1c tempest-ServersTestManualDisk-1327749375 tempest-ServersTestManualDisk-1327749375-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678250508" status: 202 len: 0 microversion: 2.1 time: 0.096031 Jul 01 10:55:30.464942 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2644/5397] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:55:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678250508 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:55:30.595458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:30.596089 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:30.606311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:30.608929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:30.613112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:30.613827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:30.870480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:30.882167 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-572fa19a-71ae-4682-b6e6-70682a96b3e0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1314 microversion: 2.1 time: 0.292037 Jul 01 10:55:30.884976 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2754/5398] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:30 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:31.110860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:31.110860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:31.118946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:31.119653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:31.120600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:31.121214 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:31.683750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:31.694283 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-773a446a-76e3-420c-86ba-3e26065741af tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.591325 Jul 01 10:55:31.704514 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2645/5399] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:31 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:31.900216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:31.900847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:31.909911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:31.914126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:31.914126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:31.914126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:32.229969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:32.244512 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b432102-f688-48e2-9af4-2a41b8c7fe66 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1501 microversion: 2.1 time: 0.348982 Jul 01 10:55:32.248180 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2755/5400] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:31 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1501 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:32.261459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:32.262363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:32.268846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:32.269627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:32.270630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:32.271279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:32.558464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:32.569588 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6d9df67-5943-455a-8950-796c9cada0b2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1501 microversion: 2.1 time: 0.311834 Jul 01 10:55:32.583761 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2646/5401] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:32 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1501 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:32.590097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:32.590643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:32.603871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:32.604328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:32.605780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:32.606286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:32.690634 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lazy-loading 'flavor' on Instance uuid 0fcaeddd-6964-4391-897f-bf2d28d6f462 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:55:32.701184 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:32.711264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:32.712474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:32.729300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:32.731281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:32.732878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:32.736193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:32.949191 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:33.119113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:33.129621 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-404a0249-6209-40e1-8159-01669aa38f75 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 0.422044 Jul 01 10:55:33.144341 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2647/5402] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:32 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:33.163302 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:33.176552 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9140849-3e7a-41a6-8c77-d83a1138b149 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action" status: 202 len: 0 microversion: 2.1 time: 0.590190 Jul 01 10:55:33.181330 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2756/5403] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:55:32 2022] POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:55:33.189095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:33.190732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:33.225609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:33.228389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:33.229540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:33.230259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7a089a06-2d5f-459e-840a-9808993b4399 req-f451b6b4-1b31-4c9e-a494-a2421cfe138a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de93a5a5-d4c6-4279-8f6a-aab9eae133e7", "name": "network-vif-plugged", "status": "completed", "tag": "2105d25f-f1e5-44fe-8872-6c003679e8be"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:33.230908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:33.255406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7a089a06-2d5f-459e-840a-9808993b4399 req-f451b6b4-1b31-4c9e-a494-a2421cfe138a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:33.255761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7a089a06-2d5f-459e-840a-9808993b4399 req-f451b6b4-1b31-4c9e-a494-a2421cfe138a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:33.291658 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7a089a06-2d5f-459e-840a-9808993b4399 req-f451b6b4-1b31-4c9e-a494-a2421cfe138a service nova] Creating event network-vif-plugged:2105d25f-f1e5-44fe-8872-6c003679e8be for instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 on n-h1-master-1 Jul 01 10:55:33.302376 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7a089a06-2d5f-459e-840a-9808993b4399 req-f451b6b4-1b31-4c9e-a494-a2421cfe138a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089625 Jul 01 10:55:33.302931 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2757/5404] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:55:33.529724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:33.529724 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c73f785-6909-4aae-bd1b-853c3944da9c tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1509 microversion: 2.1 time: 0.321024 Jul 01 10:55:33.529724 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2648/5405] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:33 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:34.156078 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:34.163173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:34.163897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:34.177968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:34.178417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:34.179199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:34.179637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:34.526029 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:34.526661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:34.559844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:34.564075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:34.565075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:34.565656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:35.478932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:35.503139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ecacb90d-a28d-4b7d-ae0c-7596f6dbc9c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1365 microversion: 2.1 time: 1.347838 Jul 01 10:55:35.511303 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2758/5406] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:34 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1365 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:35.556861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:35.579209 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec9f4bd4-de25-43b8-93a1-d6275d5e48b6 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1492 microversion: 2.1 time: 1.058477 Jul 01 10:55:35.579822 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2649/5407] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:34 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1492 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:35.595959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-80530786-7a21-40d2-b446-e72f3a7e2fa5 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:35.601307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-80530786-7a21-40d2-b446-e72f3a7e2fa5 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:35.603399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80530786-7a21-40d2-b446-e72f3a7e2fa5 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:35.604133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80530786-7a21-40d2-b446-e72f3a7e2fa5 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:35.605094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80530786-7a21-40d2-b446-e72f3a7e2fa5 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:35.605757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-80530786-7a21-40d2-b446-e72f3a7e2fa5 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:35.872453 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-80530786-7a21-40d2-b446-e72f3a7e2fa5 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action" status: 202 len: 0 microversion: 2.1 time: 0.280346 Jul 01 10:55:35.881810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:35.882881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:35.886163 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2759/5408] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:55:35 2022] POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:55:35.891326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:35.891764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:35.892537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:35.893026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:36.226034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:36.244779 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e24d448-1cb2-41b0-a509-362056d377b0 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1498 microversion: 2.1 time: 0.366940 Jul 01 10:55:36.245933 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2650/5409] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:35 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1498 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:36.529169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:36.530212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:36.546334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:36.548165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:36.551697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:36.552520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:36.776588 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:36.781281 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9bf95e7e-63ce-410e-b48c-feb7bbf2a992 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1555 microversion: 2.1 time: 0.256702 Jul 01 10:55:36.782425 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2760/5410] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:36 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:36.798615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78af6431-dad1-421f-ae04-e48f0346a99f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:36.800407 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78af6431-dad1-421f-ae04-e48f0346a99f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:36.807952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78af6431-dad1-421f-ae04-e48f0346a99f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:36.808692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78af6431-dad1-421f-ae04-e48f0346a99f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:36.809693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78af6431-dad1-421f-ae04-e48f0346a99f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:36.811215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78af6431-dad1-421f-ae04-e48f0346a99f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:36.949374 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78af6431-dad1-421f-ae04-e48f0346a99f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155121 Jul 01 10:55:36.950143 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2651/5411] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:55:36 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:37.033124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea38e856-8850-40f2-bb4b-cfee62a25dd5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:37.085618 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea38e856-8850-40f2-bb4b-cfee62a25dd5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:37.113433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea38e856-8850-40f2-bb4b-cfee62a25dd5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:37.116054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea38e856-8850-40f2-bb4b-cfee62a25dd5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:37.116054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea38e856-8850-40f2-bb4b-cfee62a25dd5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:37.116054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea38e856-8850-40f2-bb4b-cfee62a25dd5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:37.236982 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea38e856-8850-40f2-bb4b-cfee62a25dd5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action" status: 200 len: 24574 microversion: 2.1 time: 0.216662 Jul 01 10:55:37.245593 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2761/5412] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:55:37 2022] POST /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d/action => generated 24574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:55:37.262930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:37.263580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:37.265578 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:37.279301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:37.288441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:37.293990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:37.293990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:37.689885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:37.704886 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ce8ef6ef-034f-4cc0-a60e-99c759cb79d7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1498 microversion: 2.1 time: 0.445820 Jul 01 10:55:37.706438 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2652/5413] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:37 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1498 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:38.723751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:38.724616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:38.741245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:38.742090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:38.743250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:38.743942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:38.928849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c76a2d72-4f26-4975-8cbb-7bbbe2afeb7f req-7b7eca28-c8f7-4101-9e62-64b11dff2e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de93a5a5-d4c6-4279-8f6a-aab9eae133e7", "tag": "2105d25f-f1e5-44fe-8872-6c003679e8be"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:38.948242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c76a2d72-4f26-4975-8cbb-7bbbe2afeb7f req-7b7eca28-c8f7-4101-9e62-64b11dff2e40 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:38.952596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c76a2d72-4f26-4975-8cbb-7bbbe2afeb7f req-7b7eca28-c8f7-4101-9e62-64b11dff2e40 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:38.987689 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c76a2d72-4f26-4975-8cbb-7bbbe2afeb7f req-7b7eca28-c8f7-4101-9e62-64b11dff2e40 service nova] Creating event network-changed:2105d25f-f1e5-44fe-8872-6c003679e8be for instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 on n-h1-master-1 Jul 01 10:55:38.995067 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c76a2d72-4f26-4975-8cbb-7bbbe2afeb7f req-7b7eca28-c8f7-4101-9e62-64b11dff2e40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071344 Jul 01 10:55:38.996589 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2653/5414] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:55:39.074191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:39.083410 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a63ae5b3-130b-416d-9429-3544a45fadfe tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1498 microversion: 2.1 time: 0.365033 Jul 01 10:55:39.093412 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2762/5415] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:38 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1498 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:40.111498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:40.112533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:40.141473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:40.143691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:40.146956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:40.147850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:40.511199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:40.525437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-870ea2c7-33a3-4c2b-99aa-12d2c083cb17 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1501 microversion: 2.1 time: 0.419501 Jul 01 10:55:40.526367 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2654/5416] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:40 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1501 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:40.549749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:40.550937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:40.560245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:40.565798 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:40.569993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:40.569993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:40.634667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lazy-loading 'flavor' on Instance uuid 0fcaeddd-6964-4391-897f-bf2d28d6f462 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:55:41.038118 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0db21a54-7970-4a46-acc6-b725797e2e7f tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action" status: 202 len: 0 microversion: 2.1 time: 0.493307 Jul 01 10:55:41.042225 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2763/5417] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:55:40 2022] POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:55:41.047582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:41.048416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:41.062062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:41.062883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:41.063863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:41.064476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:41.103045 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:41.412810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:41.421769 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c3420af3-bcbc-479c-ab24-e5c170a3a740 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1509 microversion: 2.1 time: 0.378473 Jul 01 10:55:41.425525 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2655/5418] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:41 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:42.440307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:42.441021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:42.457066 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:42.459162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:42.459679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:42.462195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:42.462642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:42.757169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:42.765463 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd9663ab-c2c5-452b-8883-5caf784b08f7 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1492 microversion: 2.1 time: 0.329175 Jul 01 10:55:42.766053 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2764/5419] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:42 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1492 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:42.792819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b37a619c-e3f8-4391-9e3f-d68410b356d2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:42.792819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b37a619c-e3f8-4391-9e3f-d68410b356d2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:42.800817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37a619c-e3f8-4391-9e3f-d68410b356d2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:42.806060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37a619c-e3f8-4391-9e3f-d68410b356d2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:42.806898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37a619c-e3f8-4391-9e3f-d68410b356d2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:42.808998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b37a619c-e3f8-4391-9e3f-d68410b356d2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:43.154543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b37a619c-e3f8-4391-9e3f-d68410b356d2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action" status: 202 len: 0 microversion: 2.1 time: 0.373234 Jul 01 10:55:43.159040 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2656/5420] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:55:42 2022] POST /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:55:43.166139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:43.167897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:43.176899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:43.177636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:43.178412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:43.179018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:43.480871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c420bbb-3b9d-41c3-bcaf-8c4b50bdb748 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:43.482717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c420bbb-3b9d-41c3-bcaf-8c4b50bdb748 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:43.534606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c420bbb-3b9d-41c3-bcaf-8c4b50bdb748 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:43.537736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c420bbb-3b9d-41c3-bcaf-8c4b50bdb748 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:43.541570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c420bbb-3b9d-41c3-bcaf-8c4b50bdb748 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:43.542061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c420bbb-3b9d-41c3-bcaf-8c4b50bdb748 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:43.661169 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:43.674395 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-baeb4ddd-3d35-41d3-b5aa-9c98ef5c11ac tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1498 microversion: 2.1 time: 0.512468 Jul 01 10:55:43.679367 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2765/5421] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:43 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1498 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:43.885519 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c420bbb-3b9d-41c3-bcaf-8c4b50bdb748 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1833 microversion: 2.1 time: 0.417191 Jul 01 10:55:43.888495 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2657/5422] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:43 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1833 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:44.698767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:44.699661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:44.710754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:44.711461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:44.712677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:44.712952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:45.391010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:45.401541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbf3fee6-0fc1-45c4-9bee-0191aa5f8969 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1498 microversion: 2.1 time: 0.708489 Jul 01 10:55:45.402140 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2766/5423] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:44 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1498 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:46.419126 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:46.420674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:46.456028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:46.464567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:46.465588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:46.466692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:47.250741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:47.251871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:47.287618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:47.288084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:47.288904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:47.289386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:47.420957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:47.424890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:55:47.443430 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35c504da-bbe2-49f1-9fc3-d9cda86b4a67 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1501 microversion: 2.1 time: 1.028463 Jul 01 10:55:47.444026 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2658/5424] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:46 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1501 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:47.470773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-23850042-340c-4b2b-b8ed-2e0ff4fa11b7 req-95463af8-d005-462c-967f-9e487ca411bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:47.499858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-23850042-340c-4b2b-b8ed-2e0ff4fa11b7 req-95463af8-d005-462c-967f-9e487ca411bb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:47.500257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-23850042-340c-4b2b-b8ed-2e0ff4fa11b7 req-95463af8-d005-462c-967f-9e487ca411bb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:47.553033 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-23850042-340c-4b2b-b8ed-2e0ff4fa11b7 req-95463af8-d005-462c-967f-9e487ca411bb service nova] Creating event network-changed:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h1-master-1 Jul 01 10:55:47.570372 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-23850042-340c-4b2b-b8ed-2e0ff4fa11b7 req-95463af8-d005-462c-967f-9e487ca411bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125073 Jul 01 10:55:47.570999 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2659/5425] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:47.588309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:47.589021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:47.636695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:47.636695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:47.636695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:47.636695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:47.729314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:55:48.135405 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0fff76a1-5ea3-4050-bab1-f0547767e049 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 204 len: 0 microversion: 2.1 time: 0.887821 Jul 01 10:55:48.137483 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2767/5426] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:55:47 2022] DELETE /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 0 bytes in 892 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:55:48.159408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:48.160551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:48.179150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:48.179150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:48.191499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:48.195888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:48.229632 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:55:48.245267 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6499034d-edaf-42fd-a522-ca224f723a1b tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 204 len: 0 microversion: 2.1 time: 0.672757 Jul 01 10:55:48.246501 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2660/5427] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:55:47 2022] DELETE /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:55:48.254850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:48.263691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:48.274316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:48.274974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:48.277900 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:48.279958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:48.534518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:48.549601 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-97a0b12a-6bb1-4b5c-bfc5-ea0eabed2f6a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1688 microversion: 2.1 time: 0.402568 Jul 01 10:55:48.551111 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2768/5428] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:48 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1688 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:48.982090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:48.990222 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3df0c242-7212-4359-9874-0e97aa2cb5c2 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1507 microversion: 2.1 time: 0.739523 Jul 01 10:55:48.993180 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2661/5429] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:48 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1507 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:49.568314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:49.568928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:49.586567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:49.587300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:49.588391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:49.588988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:50.010451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:50.011163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:50.026713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:50.027183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:50.027956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:50.028654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:50.190319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:50.198740 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d2132b71-8594-4be4-b2f3-1c45aa8561f6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1688 microversion: 2.1 time: 0.634556 Jul 01 10:55:50.204108 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2769/5430] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:49 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1688 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:50.366623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:50.381000 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-50df9881-e703-410d-b5f7-261ec3f26258 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1507 microversion: 2.1 time: 0.374125 Jul 01 10:55:50.382287 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2662/5431] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:50 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:51.217880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:51.218484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:51.240213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:51.249856 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:51.250883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:51.252080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:51.413679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:51.418378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:51.432851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:51.433333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:51.434125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:51.434727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:53.030220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:53.068522 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8a4bbcc-7e26-402b-9b91-fe3a986fb9f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1688 microversion: 2.1 time: 1.844424 Jul 01 10:55:53.069506 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2770/5432] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:51 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1688 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:53.090149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-eec70944-08fb-491a-9884-f32eba2e9c67 req-55593503-2001-4704-90fe-34574d1d82e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcaeddd-6964-4391-897f-bf2d28d6f462", "name": "network-vif-unplugged", "status": "completed", "tag": "176ac330-cfe5-4663-96ac-3f77f16b229c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:53.134259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-eec70944-08fb-491a-9884-f32eba2e9c67 req-55593503-2001-4704-90fe-34574d1d82e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:53.145333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-eec70944-08fb-491a-9884-f32eba2e9c67 req-55593503-2001-4704-90fe-34574d1d82e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:53.179727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-eec70944-08fb-491a-9884-f32eba2e9c67 req-55593503-2001-4704-90fe-34574d1d82e9 service nova] Creating event network-vif-unplugged:176ac330-cfe5-4663-96ac-3f77f16b229c for instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 on n-h1-master-1 Jul 01 10:55:53.194192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-eec70944-08fb-491a-9884-f32eba2e9c67 req-55593503-2001-4704-90fe-34574d1d82e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115164 Jul 01 10:55:53.211583 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2771/5433] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:53.215456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:53.235765 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5a081f5f-e019-46e4-8bfc-e438f13a9206 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1507 microversion: 2.1 time: 1.827650 Jul 01 10:55:53.238920 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2663/5434] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:51 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1507 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:55:54.087811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:54.088518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:54.115456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:54.116047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:54.118234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:54.119157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:54.253913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:54.254712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:54.262468 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:54.277878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:54.284187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:54.284658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:54.953997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:54.968786 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd2ab72c-cf72-4235-a969-6fedd4e0a7a3 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1465 microversion: 2.1 time: 0.718687 Jul 01 10:55:54.969444 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2664/5435] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:54 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1465 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:55.156656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b331cda7-b547-4633-bf6b-ecf7bdecfd5c req-382d9ad0-8978-4143-9812-559bce6458be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcaeddd-6964-4391-897f-bf2d28d6f462", "name": "network-vif-deleted", "tag": "176ac330-cfe5-4663-96ac-3f77f16b229c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:55.173841 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b331cda7-b547-4633-bf6b-ecf7bdecfd5c req-382d9ad0-8978-4143-9812-559bce6458be service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:55.174315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b331cda7-b547-4633-bf6b-ecf7bdecfd5c req-382d9ad0-8978-4143-9812-559bce6458be service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:55.210575 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b331cda7-b547-4633-bf6b-ecf7bdecfd5c req-382d9ad0-8978-4143-9812-559bce6458be service nova] Creating event network-vif-deleted:176ac330-cfe5-4663-96ac-3f77f16b229c for instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 on n-h1-master-1 Jul 01 10:55:55.223844 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b331cda7-b547-4633-bf6b-ecf7bdecfd5c req-382d9ad0-8978-4143-9812-559bce6458be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072531 Jul 01 10:55:55.224504 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2665/5436] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:55:55.276078 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:55.303876 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c086679-6e26-4d43-a919-51af9c5ebedd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1571 microversion: 2.1 time: 1.220513 Jul 01 10:55:55.307193 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2772/5437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:54 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1571 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:55.621793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f9d493ec-5fb8-4f34-8838-a5b82386eb13 req-40c1ca9a-f978-4173-ad6d-00c59f92586a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "name": "network-vif-unplugged", "status": "completed", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:55.645771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f9d493ec-5fb8-4f34-8838-a5b82386eb13 req-40c1ca9a-f978-4173-ad6d-00c59f92586a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:55.646669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f9d493ec-5fb8-4f34-8838-a5b82386eb13 req-40c1ca9a-f978-4173-ad6d-00c59f92586a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:55.669383 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f9d493ec-5fb8-4f34-8838-a5b82386eb13 req-40c1ca9a-f978-4173-ad6d-00c59f92586a service nova] Creating event network-vif-unplugged:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h1-master-1 Jul 01 10:55:55.691904 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f9d493ec-5fb8-4f34-8838-a5b82386eb13 req-40c1ca9a-f978-4173-ad6d-00c59f92586a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075113 Jul 01 10:55:55.694649 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2666/5438] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:55.989398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:55.990056 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:56.023081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:56.023661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:56.076126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:56.076126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:56.108497 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:56.109421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:56.110093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lazy-loading 'fault' on Instance uuid 0fcaeddd-6964-4391-897f-bf2d28d6f462 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:55:56.324469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:56.326372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:56.337523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:56.344151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:56.345238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:56.345868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:56.483807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479994bc8e4444efa549981c0906bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066493bcd8184524908e1e7260d5ad0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:56.496053 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e70a3572-6336-46ca-9da8-40f16eb73d58 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 200 len: 1304 microversion: 2.1 time: 0.513010 Jul 01 10:55:56.515329 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2773/5439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:55 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 1304 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:56.600214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:56.647216 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6bebd99a-0cf0-48d6-86f5-c4d9687d072b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1503 microversion: 2.1 time: 0.316543 Jul 01 10:55:56.647856 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2667/5440] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:56 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:57.259308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-da6973e9-5f05-4aca-bedc-6b728151692c req-e51b1769-374a-4a68-8ee7-998195f6b680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3d24af-cc22-490c-a483-41d0ce16dd7d", "name": "network-vif-deleted", "tag": "0813657d-da39-4146-b43e-7251f6b2b3af"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:55:57.283822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-da6973e9-5f05-4aca-bedc-6b728151692c req-e51b1769-374a-4a68-8ee7-998195f6b680 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:57.291244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-da6973e9-5f05-4aca-bedc-6b728151692c req-e51b1769-374a-4a68-8ee7-998195f6b680 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:57.325833 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-da6973e9-5f05-4aca-bedc-6b728151692c req-e51b1769-374a-4a68-8ee7-998195f6b680 service nova] Creating event network-vif-deleted:0813657d-da39-4146-b43e-7251f6b2b3af for instance be3d24af-cc22-490c-a483-41d0ce16dd7d on n-h1-master-1 Jul 01 10:55:57.332320 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-da6973e9-5f05-4aca-bedc-6b728151692c req-e51b1769-374a-4a68-8ee7-998195f6b680 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081755 Jul 01 10:55:57.333872 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2774/5441] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:55:57.513752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:57.514380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] [instance: 0fcaeddd-6964-4391-897f-bf2d28d6f462] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:57.537553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:57.537553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:57.541974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:57.542432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:57.589020 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] HTTP exception thrown: Instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 could not be found. Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Request method failure captured: Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 HTTP/1.1 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtKMi58FmMxOJTulHN3RfyaP-7ff31amDveTWdelZ2jkYE4KJgF0kBmF5QJm-AlVDdyhKCnCMjkrfVF_B0Gf2Z9t1s2NHCA6Wad5sPYGEoW4X-WuIrQ_Wh7jgzkV7azS8P1tqEdo3ckgBIfZB8l3BufoV20kVGz1NAOPVSfdE1BHs30 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 066493bcd8184524908e1e7260d5ad0c Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestServerAdvancedOps-1873675627 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/066493bcd8184524908e1e7260d5ad0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/066493bcd8184524908e1e7260d5ad0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_066493bcd8184524908e1e7260d5ad0c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/066493bcd8184524908e1e7260d5ad0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestServerAdvancedOps-1873675627 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 066493bcd8184524908e1e7260d5ad0c Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestServerAdvancedOps-1873675627 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestServerAdvancedOps-1873675627-project Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 479994bc8e4444efa549981c0906bd50 Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestServerAdvancedOps-1873675627-project Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 could not be found. Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0fcaeddd-6964-4391-897f-bf2d28d6f462'} Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 could not be found. Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 could not be found. Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:55:57.591165 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:57.596762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:57.596762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:55:57.596762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:55:57.596762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:55:57.596762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:55:57.596762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 could not be found. Jul 01 10:55:57.596762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:57.601506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] Returning 404 to user: Instance 0fcaeddd-6964-4391-897f-bf2d28d6f462 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:55:57.602848 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1c62e1b1-23d7-4e9b-a240-c62793934192 tempest-TestServerAdvancedOps-1873675627 tempest-TestServerAdvancedOps-1873675627-project] 10.222.0.23 "GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462" status: 404 len: 111 microversion: 2.1 time: 0.093469 Jul 01 10:55:57.603595 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2668/5442] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:57 2022] GET /compute/v2.1/servers/0fcaeddd-6964-4391-897f-bf2d28d6f462 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:55:57.666853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:57.667473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:57.679495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:57.679948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:57.685460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:57.685918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:57.765466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:57.766163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:57.766925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lazy-loading 'fault' on Instance uuid be3d24af-cc22-490c-a483-41d0ce16dd7d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:55:58.132797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:55:58.150337 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2662a90a-c5b4-493d-b3cb-e31f3002c3f7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 200 len: 1356 microversion: 2.1 time: 0.488029 Jul 01 10:55:58.162644 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2775/5443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:57 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 1356 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:55:59.171131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:55:59.172536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: be3d24af-cc22-490c-a483-41d0ce16dd7d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:55:59.201702 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:59.202762 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:59.204848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:55:59.205338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:55:59.276990 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] HTTP exception thrown: Instance be3d24af-cc22-490c-a483-41d0ce16dd7d could not be found. Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Request method failure captured: Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d HTTP/1.1 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtIMAE4-bQXaEWnIiv5xqMUHPv0jdduWWZpIoL5be7dlGtfQRFL8NNsCC8ke9IXOipeg42ChW0EIK3ytKLDH2l7c8k0hc5J5oKDbzBtFHorJrWbPnlCUbp9XAxMzLNPQCml9MqGh9WTkCve-gvYt6xltduu4CnNUodriQSOL1yJGoCQ Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3844c974f9d84827a9d501d426da8817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3844c974f9d84827a9d501d426da8817", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 0e83529d6b134262849efc588712bd0f Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: exception: Instance be3d24af-cc22-490c-a483-41d0ce16dd7d could not be found. Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'be3d24af-cc22-490c-a483-41d0ce16dd7d'} Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be3d24af-cc22-490c-a483-41d0ce16dd7d could not be found. Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be3d24af-cc22-490c-a483-41d0ce16dd7d could not be found. Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:59.305182 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be3d24af-cc22-490c-a483-41d0ce16dd7d could not be found. Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Returning 404 to user: Instance be3d24af-cc22-490c-a483-41d0ce16dd7d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:55:59.310334 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc8aa236-4d04-45cf-8e81-0e4e9e504617 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d" status: 404 len: 111 microversion: 2.1 time: 0.141775 Jul 01 10:55:59.355499 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2669/5444] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:55:59 2022] GET /compute/v2.1/servers/be3d24af-cc22-490c-a483-41d0ce16dd7d => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:56:09.164658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:09.179346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:09.182608 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:09.187394 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=41 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:09.195764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:09.196217 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:09.201532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:09.202266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:09.347366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lazy-loading 'services' on Instance uuid 304c62a1-8cb3-46b7-873b-9f317a7362bd {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:56:09.547326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0dac22c0-7838-41da-a31b-0c1bb2570471 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '.version_select at 0x7f6f96f41940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:09.560656 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:09.561830 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:09.616962 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29046d9b-ce7a-48c0-9351-03c46d0cf826 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "DELETE /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd/os-volume_attachments/63c864fc-435c-44de-a9e9-3d12c13f29f3" status: 202 len: 0 microversion: 2.1 time: 0.458293 Jul 01 10:56:09.617587 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2776/5445] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:56:09 2022] DELETE /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd/os-volume_attachments/63c864fc-435c-44de-a9e9-3d12c13f29f3 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:56:09.681667 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0dac22c0-7838-41da-a31b-0c1bb2570471 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662972386" status: 202 len: 0 microversion: 2.1 time: 0.144388 Jul 01 10:56:09.688116 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2670/5446] 10.222.0.23 () {58 vars in 1280 bytes} [Fri Jul 1 10:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662972386 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:56:09.735527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b382c86c-f5b6-45ab-87c2-c05eacc7f557 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: .version_select at 0x7f6f91160af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1069309161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPj3Datlvszis1kF94d9r8600znlG1pBPysAluFwsjKDbKuJQe9bUDMGKZ2Ii7qgq4uGCM2e7qZmYyVZeNyHo5WZrYdCgOzZnr9F7UPOSe6ZaucFR4VH+n7+e8AXS3TpA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:09.770972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b382c86c-f5b6-45ab-87c2-c05eacc7f557 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:56:09.787507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b382c86c-f5b6-45ab-87c2-c05eacc7f557 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:56:09.984603 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b382c86c-f5b6-45ab-87c2-c05eacc7f557 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.261733 Jul 01 10:56:09.985592 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2777/5447] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:56:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:13.913564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-33d5a738-f727-4490-98d9-88c6b8cb66e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:13.913934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-33d5a738-f727-4490-98d9-88c6b8cb66e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:13.921799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d5a738-f727-4490-98d9-88c6b8cb66e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:13.922303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d5a738-f727-4490-98d9-88c6b8cb66e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:13.923141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d5a738-f727-4490-98d9-88c6b8cb66e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:13.923757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-33d5a738-f727-4490-98d9-88c6b8cb66e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:13.973357 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-33d5a738-f727-4490-98d9-88c6b8cb66e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.064976 Jul 01 10:56:13.974984 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2671/5448] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:56:13 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:13.988277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:13.989719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:14.011623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:14.013659 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:14.015794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:14.016251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:14.735476 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Invalid volume: volume 8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5 is already attached to instances: aff1e9b5-e3df-4e72-bb71-4af64102f8ea Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7/os-volume_attachments HTTP/1.1 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 74 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: {"volumeAttachment": {"volumeId": "8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5"}} Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid volume: volume 8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5 is already attached to instances: aff1e9b5-e3df-4e72-bb71-4af64102f8ea Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': 'de93a5a5-d4c6-4279-8f6a-aab9eae133e7', 'body': {'volumeAttachment': {'volumeId': '8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5'}}} Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5 is already attached to instances: aff1e9b5-e3df-4e72-bb71-4af64102f8ea Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:56:14.737636 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5 is already attached to instances: aff1e9b5-e3df-4e72-bb71-4af64102f8ea Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5 is already attached to instances: aff1e9b5-e3df-4e72-bb71-4af64102f8ea Jul 01 10:56:14.742077 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:14.754067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 400 to user: Invalid volume: volume 8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5 is already attached to instances: aff1e9b5-e3df-4e72-bb71-4af64102f8ea {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:56:14.755307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8df5e87f-04c4-48d4-9da1-c42969783741 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.774468 Jul 01 10:56:14.756571 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2778/5449] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:56:13 2022] POST /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7/os-volume_attachments => generated 174 bytes in 776 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:56:14.764477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:14.770884 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:14.782276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:14.783698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:14.795052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:14.795704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:14.854651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:56:15.391369 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8226b52e-fbac-4bab-8ec4-25415081bd95 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 204 len: 0 microversion: 2.1 time: 0.629428 Jul 01 10:56:15.396035 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2672/5450] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:56:14 2022] DELETE /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:56:15.404449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:15.405071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:15.428265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:15.438136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:15.440198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:15.443131 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:16.047373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:16.061536 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e3f6026-69e1-404a-a341-faa0f658675b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1680 microversion: 2.1 time: 0.661428 Jul 01 10:56:16.063899 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2779/5451] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:15 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1680 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:17.085019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:17.085793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:17.096044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:17.096503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:17.097334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:17.097772 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:17.940013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:17.958917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86f596c1-d22d-41ff-bc54-ed94578b67ce tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1680 microversion: 2.1 time: 0.879400 Jul 01 10:56:17.961896 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2673/5452] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:17 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1680 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:18.979836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:18.980514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:19.003844 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:19.004363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:19.005224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:19.005665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:19.330779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:19.339907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60a99abb-4c5b-472c-ae8b-e0124f1dd4c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1613 microversion: 2.1 time: 0.363811 Jul 01 10:56:19.340482 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2780/5453] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:18 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1613 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:19.826567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-fd68ac44-7435-4967-9fc0-eb30e3ce2922 req-27c71c66-13c4-4bdd-be35-9897ed04aa5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de93a5a5-d4c6-4279-8f6a-aab9eae133e7", "name": "network-vif-deleted", "tag": "2105d25f-f1e5-44fe-8872-6c003679e8be"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:19.861390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fd68ac44-7435-4967-9fc0-eb30e3ce2922 req-27c71c66-13c4-4bdd-be35-9897ed04aa5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:19.861390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fd68ac44-7435-4967-9fc0-eb30e3ce2922 req-27c71c66-13c4-4bdd-be35-9897ed04aa5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:19.916068 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-fd68ac44-7435-4967-9fc0-eb30e3ce2922 req-27c71c66-13c4-4bdd-be35-9897ed04aa5f service nova] Creating event network-vif-deleted:2105d25f-f1e5-44fe-8872-6c003679e8be for instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 on n-h1-master-1 Jul 01 10:56:19.928914 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-fd68ac44-7435-4967-9fc0-eb30e3ce2922 req-27c71c66-13c4-4bdd-be35-9897ed04aa5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106820 Jul 01 10:56:19.933225 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2674/5454] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:20.357660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:20.358634 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:20.363928 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:20.375630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:20.378057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:20.378938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:20.382302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:20.458785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:20.460459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:20.461772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lazy-loading 'fault' on Instance uuid de93a5a5-d4c6-4279-8f6a-aab9eae133e7 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:56:20.477879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:20.483148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:20.489105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:20.489585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:20.493412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:20.493973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:20.541583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:20.548165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:56:20.559119 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53bed7d9-b2b5-4f90-abf4-679973307549 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 200 len: 1330 microversion: 2.1 time: 0.199066 Jul 01 10:56:20.563534 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2781/5455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:20 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 1330 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:21.022768 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eac6d796-7735-4fe5-b89c-8cd6929c1a7d tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "DELETE /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 204 len: 0 microversion: 2.1 time: 0.549834 Jul 01 10:56:21.024287 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2675/5456] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:56:20 2022] DELETE /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 10:56:21.035606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:21.036488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:21.058234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:21.060521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:21.061553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:21.066373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:21.345874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:21.362733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-98f81e5e-5cd1-49a9-83a2-d8a968cd3990 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1469 microversion: 2.1 time: 0.325937 Jul 01 10:56:21.362733 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2782/5457] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:21 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:21.580779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:21.581817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:21.590175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:21.591028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:21.592444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:21.593035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:21.632446 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 HTTP/1.1 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: exception: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'de93a5a5-d4c6-4279-8f6a-aab9eae133e7'} Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:21.647685 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:21.651399 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:21.651399 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:21.651399 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:21.651399 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:56:21.651399 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:56:21.651399 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 10:56:21.651399 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:21.652366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:56:21.653674 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-189a3bb3-2126-4b39-9fcc-56539537e31d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 404 len: 111 microversion: 2.1 time: 0.078017 Jul 01 10:56:21.682132 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2676/5458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:21 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:56:21.695071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac46b753-95fa-4e8b-a1ee-ee16e052c93b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '.version_select at 0x7f6f90b8caf0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:21.795528 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac46b753-95fa-4e8b-a1ee-ee16e052c93b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552612570" status: 202 len: 0 microversion: 2.1 time: 0.107885 Jul 01 10:56:21.796591 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2783/5459] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:56:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552612570 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:56:22.381129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:22.382400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:22.411438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:22.411935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:22.421121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:22.422626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:23.549379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:23.561610 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-149a2573-f5ad-4b31-a914-9cc0687f49cd tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1469 microversion: 2.1 time: 1.185103 Jul 01 10:56:23.562227 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2677/5460] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:22 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1469 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:24.002746 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:24.003800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:24.014969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:24.015635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:24.016574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:24.017462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:24.218561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lazy-loading 'services' on Instance uuid aff1e9b5-e3df-4e72-bb71-4af64102f8ea {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:56:24.578771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:24.579556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:24.592795 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-90e17ffa-c692-4021-9a41-ea6c0bf81a6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments/8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5" status: 202 len: 0 microversion: 2.1 time: 0.594198 Jul 01 10:56:24.597531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:24.598627 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2784/5461] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:56:23 2022] DELETE /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments/8e20bbd1-cb50-4cde-b7a3-8d77c1d9eee5 => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:56:24.601280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:24.607874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:24.608621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:24.618925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c22b0ee6-32d1-4960-9472-904b87950ecb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:24.625544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c22b0ee6-32d1-4960-9472-904b87950ecb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:24.638746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c22b0ee6-32d1-4960-9472-904b87950ecb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:24.639222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c22b0ee6-32d1-4960-9472-904b87950ecb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:24.642204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c22b0ee6-32d1-4960-9472-904b87950ecb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:24.642695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c22b0ee6-32d1-4960-9472-904b87950ecb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:24.724531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c22b0ee6-32d1-4960-9472-904b87950ecb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113558 Jul 01 10:56:24.725454 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2785/5462] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:24 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:24.796005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:24.821235 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-390a652a-dd55-4cbb-b124-4477e54bc469 tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1427 microversion: 2.1 time: 0.246833 Jul 01 10:56:24.827804 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2678/5463] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:24 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1427 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:56:24.849008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b56e79be-8983-4e1b-8feb-2ad338b23b9a req-7200c81c-1b29-40e5-9ecd-1f8653544808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304c62a1-8cb3-46b7-873b-9f317a7362bd", "name": "network-vif-deleted", "tag": "2d1d51cd-06f5-4a2c-9bf1-889e32794a5a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:24.873460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b56e79be-8983-4e1b-8feb-2ad338b23b9a req-7200c81c-1b29-40e5-9ecd-1f8653544808 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:24.875750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b56e79be-8983-4e1b-8feb-2ad338b23b9a req-7200c81c-1b29-40e5-9ecd-1f8653544808 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:24.927568 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b56e79be-8983-4e1b-8feb-2ad338b23b9a req-7200c81c-1b29-40e5-9ecd-1f8653544808 service nova] Creating event network-vif-deleted:2d1d51cd-06f5-4a2c-9bf1-889e32794a5a for instance 304c62a1-8cb3-46b7-873b-9f317a7362bd on n-h1-master-1 Jul 01 10:56:24.946920 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b56e79be-8983-4e1b-8feb-2ad338b23b9a req-7200c81c-1b29-40e5-9ecd-1f8653544808 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100569 Jul 01 10:56:24.950443 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2786/5464] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:25.737545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-79d0252a-6d05-43a1-bbd1-de7d8c1b3f61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:25.738497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-79d0252a-6d05-43a1-bbd1-de7d8c1b3f61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:25.749903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d0252a-6d05-43a1-bbd1-de7d8c1b3f61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:25.754095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d0252a-6d05-43a1-bbd1-de7d8c1b3f61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:25.754943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d0252a-6d05-43a1-bbd1-de7d8c1b3f61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:25.755386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-79d0252a-6d05-43a1-bbd1-de7d8c1b3f61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:25.818036 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-79d0252a-6d05-43a1-bbd1-de7d8c1b3f61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084415 Jul 01 10:56:25.818634 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2679/5465] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:25 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:25.846476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:25.847187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:25.864754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:25.869803 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:25.874347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:25.882028 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:25.975996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:25.978205 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:25.986704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lazy-loading 'fault' on Instance uuid 304c62a1-8cb3-46b7-873b-9f317a7362bd {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:56:26.111492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d76debbbb48c4bef6518bfe465214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4faaa9eb535d496689088ac519a0f991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:26.119986 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad5274e3-b302-43d1-b500-29f57bb694ad tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 200 len: 1304 microversion: 2.1 time: 0.277725 Jul 01 10:56:26.123271 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2787/5466] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:25 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 1304 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:26.842719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e5e1d7b9-78e5-4458-bef5-0df2aad5c1d5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:26.842719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e5e1d7b9-78e5-4458-bef5-0df2aad5c1d5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:26.876254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e1d7b9-78e5-4458-bef5-0df2aad5c1d5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:26.876713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e1d7b9-78e5-4458-bef5-0df2aad5c1d5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:26.883882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e1d7b9-78e5-4458-bef5-0df2aad5c1d5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:26.884778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e5e1d7b9-78e5-4458-bef5-0df2aad5c1d5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:26.979491 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e5e1d7b9-78e5-4458-bef5-0df2aad5c1d5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145975 Jul 01 10:56:26.983580 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2680/5467] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:26 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] [instance: 304c62a1-8cb3-46b7-873b-9f317a7362bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] HTTP exception thrown: Instance 304c62a1-8cb3-46b7-873b-9f317a7362bd could not be found. Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Request method failure captured: Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd HTTP/1.1 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtIpAV0vpXxbIvIG-FsBpzgn6KcQLB9JdHijpKUuSzarX7aB16Ggm_fuMgmo-8nWBLCAT1-mqmoM19Uak696DwS18K13xwpWcTofpTUwoIVaeD8lxF8KNIgkR_aAo8QxIV1YiOvuKrRSR-J-ODaoyaFqeT2Zt7eQ0WAEXWy8mN05LEM Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 4faaa9eb535d496689088ac519a0f991 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesBackupsTest-1207659699 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4faaa9eb535d496689088ac519a0f991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4faaa9eb535d496689088ac519a0f991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4faaa9eb535d496689088ac519a0f991", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4faaa9eb535d496689088ac519a0f991"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesBackupsTest-1207659699 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 4faaa9eb535d496689088ac519a0f991 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesBackupsTest-1207659699 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesBackupsTest-1207659699-project Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: b47d76debbbb48c4bef6518bfe465214 Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesBackupsTest-1207659699-project Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 304c62a1-8cb3-46b7-873b-9f317a7362bd could not be found. Jul 01 10:56:27.253112 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '304c62a1-8cb3-46b7-873b-9f317a7362bd'} Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304c62a1-8cb3-46b7-873b-9f317a7362bd could not be found. Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304c62a1-8cb3-46b7-873b-9f317a7362bd could not be found. Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304c62a1-8cb3-46b7-873b-9f317a7362bd could not be found. Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] Returning 404 to user: Instance 304c62a1-8cb3-46b7-873b-9f317a7362bd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-48e6d78c-c967-440b-8c00-b656fc0d9b4e tempest-VolumesBackupsTest-1207659699 tempest-VolumesBackupsTest-1207659699-project] 10.222.0.23 "GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd" status: 404 len: 111 microversion: 2.1 time: 0.037704 Jul 01 10:56:27.257702 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2788/5468] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:27 2022] GET /compute/v2.1/servers/304c62a1-8cb3-46b7-873b-9f317a7362bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:56:27.993738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-357fc932-9cf6-462a-adc5-a61a4ab0e441 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:27.995993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-357fc932-9cf6-462a-adc5-a61a4ab0e441 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:28.013274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-357fc932-9cf6-462a-adc5-a61a4ab0e441 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:28.019405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-357fc932-9cf6-462a-adc5-a61a4ab0e441 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:28.019405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-357fc932-9cf6-462a-adc5-a61a4ab0e441 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:28.019405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-357fc932-9cf6-462a-adc5-a61a4ab0e441 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:28.108863 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-357fc932-9cf6-462a-adc5-a61a4ab0e441 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119191 Jul 01 10:56:28.123180 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2681/5469] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:27 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:29.134013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8338d309-727d-46a4-9597-c82032aae716 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:29.135538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8338d309-727d-46a4-9597-c82032aae716 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:29.157464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8338d309-727d-46a4-9597-c82032aae716 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:29.157464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8338d309-727d-46a4-9597-c82032aae716 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:29.157464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8338d309-727d-46a4-9597-c82032aae716 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:29.157464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8338d309-727d-46a4-9597-c82032aae716 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:29.254332 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8338d309-727d-46a4-9597-c82032aae716 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124483 Jul 01 10:56:29.260555 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2789/5470] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:29 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:30.266427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-417cbf84-6110-468d-97ad-2da49e78517b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:30.267490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-417cbf84-6110-468d-97ad-2da49e78517b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:30.282864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417cbf84-6110-468d-97ad-2da49e78517b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:30.283375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417cbf84-6110-468d-97ad-2da49e78517b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:30.286059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417cbf84-6110-468d-97ad-2da49e78517b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:30.294290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-417cbf84-6110-468d-97ad-2da49e78517b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:30.452908 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-417cbf84-6110-468d-97ad-2da49e78517b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184341 Jul 01 10:56:30.454468 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2682/5471] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:30 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:30.488740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-864806338", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "9a886ab7-335b-4953-b3f0-8f772defc885"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1069309161", "security_groups": [{"name": "tempest-secgroup-smoke-2124205323"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:30.784230 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] validate_networks() for [('9a886ab7-335b-4953-b3f0-8f772defc885', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:56:31.474928 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d27e22fc-5527-4408-86bf-a3550acb2001 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:31.478685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d27e22fc-5527-4408-86bf-a3550acb2001 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:31.521036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27e22fc-5527-4408-86bf-a3550acb2001 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:31.528903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27e22fc-5527-4408-86bf-a3550acb2001 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:31.537070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27e22fc-5527-4408-86bf-a3550acb2001 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:31.541574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27e22fc-5527-4408-86bf-a3550acb2001 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:31.705186 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d27e22fc-5527-4408-86bf-a3550acb2001 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238998 Jul 01 10:56:31.709190 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2683/5472] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:31 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:32.141299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:56:32.141740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:56:32.142242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:56:32.142652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:56:32.143072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:56:32.182684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:32.194567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:32.205008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:32.205510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:32.331832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:56:32.350485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:56:32.410250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:56:32.425139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:56:32.687880 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0232368b-7120-4c78-a905-1fbf281cb57b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.195473 Jul 01 10:56:32.695376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b8847e7d-1344-4445-8b8b-88adba67c422 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:32.696858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b8847e7d-1344-4445-8b8b-88adba67c422 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:32.704186 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2790/5473] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:56:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 10:56:32.724332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-14d18fbb-8788-4962-ad86-320fef8c18c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:32.725395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-14d18fbb-8788-4962-ad86-320fef8c18c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:32.748873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14d18fbb-8788-4962-ad86-320fef8c18c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:32.769663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14d18fbb-8788-4962-ad86-320fef8c18c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:32.776802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14d18fbb-8788-4962-ad86-320fef8c18c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:32.783343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14d18fbb-8788-4962-ad86-320fef8c18c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:32.872181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b8847e7d-1344-4445-8b8b-88adba67c422 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:32.881210 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b8847e7d-1344-4445-8b8b-88adba67c422 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1266 microversion: 2.1 time: 0.190436 Jul 01 10:56:32.885351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2684/5474] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:32 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:32.967488 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-14d18fbb-8788-4962-ad86-320fef8c18c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235195 Jul 01 10:56:32.967488 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2791/5475] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:32 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:33.901830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fe576858-15b9-45f9-83b9-9bc0b91b0256 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:33.903078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fe576858-15b9-45f9-83b9-9bc0b91b0256 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:33.980050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-325d7ef7-9ac2-4a2d-afd3-a6743e8b6eae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:33.981601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-325d7ef7-9ac2-4a2d-afd3-a6743e8b6eae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:33.998547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-325d7ef7-9ac2-4a2d-afd3-a6743e8b6eae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:33.999445 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-325d7ef7-9ac2-4a2d-afd3-a6743e8b6eae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:34.000397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-325d7ef7-9ac2-4a2d-afd3-a6743e8b6eae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:34.001007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-325d7ef7-9ac2-4a2d-afd3-a6743e8b6eae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:34.056094 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fe576858-15b9-45f9-83b9-9bc0b91b0256 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:34.070199 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fe576858-15b9-45f9-83b9-9bc0b91b0256 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1266 microversion: 2.1 time: 0.172159 Jul 01 10:56:34.076498 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2685/5476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:33 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:34.097894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-325d7ef7-9ac2-4a2d-afd3-a6743e8b6eae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117072 Jul 01 10:56:34.097894 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2792/5477] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:33 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:35.094334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:35.095655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:35.111501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9ce2dead-b835-47f9-bdb5-d92f3379e85b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:35.113236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9ce2dead-b835-47f9-bdb5-d92f3379e85b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:35.137961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:35.138474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ce2dead-b835-47f9-bdb5-d92f3379e85b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:35.139003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ce2dead-b835-47f9-bdb5-d92f3379e85b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:35.142439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:35.144614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:35.145084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:35.145724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ce2dead-b835-47f9-bdb5-d92f3379e85b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:35.147130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9ce2dead-b835-47f9-bdb5-d92f3379e85b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:35.335527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9ce2dead-b835-47f9-bdb5-d92f3379e85b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227333 Jul 01 10:56:35.339263 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2793/5478] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:35 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:35.462780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:35.487928 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7619a0df-dd17-4051-8021-897611df8ecb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1262 microversion: 2.1 time: 0.399092 Jul 01 10:56:35.525189 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2686/5479] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:35 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1262 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:36.361130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da2d9c97-57a6-488f-bee4-cb6c98c72bde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:36.371997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da2d9c97-57a6-488f-bee4-cb6c98c72bde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:36.407314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da2d9c97-57a6-488f-bee4-cb6c98c72bde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:36.408175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da2d9c97-57a6-488f-bee4-cb6c98c72bde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:36.409292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da2d9c97-57a6-488f-bee4-cb6c98c72bde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:36.411339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da2d9c97-57a6-488f-bee4-cb6c98c72bde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:36.517634 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:36.532479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:36.533900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:36.550070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:36.551554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:36.553976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:36.555705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:36.557706 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da2d9c97-57a6-488f-bee4-cb6c98c72bde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208592 Jul 01 10:56:36.564166 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2794/5480] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:36 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:36.837558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:36.844793 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:36.859736 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dfac0f68-6c92-42c7-a747-393c84424d16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1326 microversion: 2.1 time: 0.330854 Jul 01 10:56:36.861224 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2687/5481] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:36 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1326 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:56:37.572945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a806b82-1648-437c-9039-facc93bf9c26 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:37.574129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a806b82-1648-437c-9039-facc93bf9c26 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:37.598117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a806b82-1648-437c-9039-facc93bf9c26 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:37.603008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a806b82-1648-437c-9039-facc93bf9c26 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:37.604201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a806b82-1648-437c-9039-facc93bf9c26 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:37.607690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a806b82-1648-437c-9039-facc93bf9c26 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:37.690271 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a806b82-1648-437c-9039-facc93bf9c26 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123860 Jul 01 10:56:37.691205 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2795/5482] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:37 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:56:37.881478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:37.882386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:37.906438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:37.906820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:37.912222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:37.929837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:38.126189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:38.151278 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-540f1153-56e2-477e-9125-136d7375c8d7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1324 microversion: 2.1 time: 0.274506 Jul 01 10:56:38.157257 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2688/5483] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:37 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:38.702434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99756ed8-67ae-4ddc-8188-ae7a4a58dde2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:38.703367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99756ed8-67ae-4ddc-8188-ae7a4a58dde2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:38.713405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99756ed8-67ae-4ddc-8188-ae7a4a58dde2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:38.713855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99756ed8-67ae-4ddc-8188-ae7a4a58dde2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:38.719695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99756ed8-67ae-4ddc-8188-ae7a4a58dde2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:38.720160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99756ed8-67ae-4ddc-8188-ae7a4a58dde2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:38.829709 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99756ed8-67ae-4ddc-8188-ae7a4a58dde2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124544 Jul 01 10:56:38.831718 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2796/5484] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:56:38 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:56:38.951561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:38.952648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:38.965092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:38.965851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:38.974198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:38.974198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:39.011692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:56:39.173701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:39.179672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:39.212197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:39.213568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:39.215882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:39.216331 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:39.397258 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a21b8838-9a9d-4577-8651-a32ec123f6d7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 204 len: 0 microversion: 2.1 time: 0.449678 Jul 01 10:56:39.398490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2689/5485] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:56:38 2022] DELETE /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:56:39.414688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:39.419040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:39.436136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:39.439196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:39.440774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:39.444095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:40.586582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:40.608490 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bfb9fa92-b880-4ed1-a44c-fda3f953a553 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1392 microversion: 2.1 time: 1.443036 Jul 01 10:56:40.617459 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2797/5486] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:39 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1392 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:56:40.630527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:40.642820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d909ddf-d16b-48da-8322-3b29782f0376 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1682 microversion: 2.1 time: 1.235668 Jul 01 10:56:40.643685 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2690/5487] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:39 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1682 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:41.601494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c228aa26-66de-4f6f-be44-7da7bbf22ed0 req-461ae1e0-61d5-444f-8c0a-d704d38b77dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:41.621346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c228aa26-66de-4f6f-be44-7da7bbf22ed0 req-461ae1e0-61d5-444f-8c0a-d704d38b77dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:41.622342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c228aa26-66de-4f6f-be44-7da7bbf22ed0 req-461ae1e0-61d5-444f-8c0a-d704d38b77dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:41.641047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:41.644734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:41.665341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c228aa26-66de-4f6f-be44-7da7bbf22ed0 req-461ae1e0-61d5-444f-8c0a-d704d38b77dc service nova] Creating event network-changed:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:56:41.682755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c228aa26-66de-4f6f-be44-7da7bbf22ed0 req-461ae1e0-61d5-444f-8c0a-d704d38b77dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.524703 Jul 01 10:56:41.684216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:41.688712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:41.689674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:41.694189 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2798/5488] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:41.695341 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:41.715318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:41.716878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:41.735223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:41.737691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:41.739333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:41.741038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:42.273138 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:42.398825 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:43.065058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:43.075252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0a684e2-74c7-4357-b9ce-edc4c727d604 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1392 microversion: 2.1 time: 1.442039 Jul 01 10:56:43.080177 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2691/5489] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:41 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1392 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:43.399655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:43.413559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-14deb720-b793-4e18-86d3-770c9cb2c75d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1682 microversion: 2.1 time: 1.711947 Jul 01 10:56:43.414741 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2799/5490] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:41 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1682 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:44.097111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:44.097895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:44.100914 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:44.112880 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:44.113382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:44.114184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:44.114632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:44.434468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:44.436052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:44.453047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:44.465456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:44.467737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:44.469333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:44.534617 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:44.554041 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c6e833f-0876-41d3-bb85-d0167c4c9054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1392 microversion: 2.1 time: 0.455998 Jul 01 10:56:44.562313 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2692/5491] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:44 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:44.843004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:44.861367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a4ba9b7-4301-4fa2-871c-fa74fa78c1ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1682 microversion: 2.1 time: 0.431271 Jul 01 10:56:44.865174 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2800/5492] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:44 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:45.458303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4dd158ea-d58e-4198-891f-17133db55a7f req-938eb845-ca4b-44a1-806b-61d2635cdca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff1e9b5-e3df-4e72-bb71-4af64102f8ea", "name": "network-vif-deleted", "tag": "017f7409-43f9-4dd0-8f59-a3a5ecf532cf"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:45.464267 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:45.497691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4dd158ea-d58e-4198-891f-17133db55a7f req-938eb845-ca4b-44a1-806b-61d2635cdca1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:45.498136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4dd158ea-d58e-4198-891f-17133db55a7f req-938eb845-ca4b-44a1-806b-61d2635cdca1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:45.534612 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4dd158ea-d58e-4198-891f-17133db55a7f req-938eb845-ca4b-44a1-806b-61d2635cdca1 service nova] Creating event network-vif-deleted:017f7409-43f9-4dd0-8f59-a3a5ecf532cf for instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea on n-h2-master-1 Jul 01 10:56:45.561977 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4dd158ea-d58e-4198-891f-17133db55a7f req-938eb845-ca4b-44a1-806b-61d2635cdca1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102543 Jul 01 10:56:45.562978 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2693/5493] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:45.575306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:45.576093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:45.588755 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:56:45.595854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:45.605572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:45.607473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:45.613212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:45.889274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:45.902752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:45.931245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:45.931245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:45.934733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:45.935893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:46.086761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:46.087215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:46.087676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lazy-loading 'fault' on Instance uuid aff1e9b5-e3df-4e72-bb71-4af64102f8ea {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:56:46.385892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:46.400442 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02f8fe17-1ca3-4a05-b72a-ff723abdce71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 200 len: 1331 microversion: 2.1 time: 0.517184 Jul 01 10:56:46.401714 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2694/5494] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:45 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 1331 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:46.552777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:46.565082 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e43f93a4-6358-47ae-85c9-b3a3dee0203b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1392 microversion: 2.1 time: 0.994328 Jul 01 10:56:46.571498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2801/5495] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:45 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1392 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:47.419915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:47.421925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:47.440366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:47.442438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:47.445685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:47.445685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:47.492496 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea HTTP/1.1 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: exception: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'aff1e9b5-e3df-4e72-bb71-4af64102f8ea'} Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:56:47.498174 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:56:47.504880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:56:47.506595 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63f5abc7-57a5-49f7-a0ee-cdf2b54dad89 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 404 len: 111 microversion: 2.1 time: 0.092504 Jul 01 10:56:47.509362 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2695/5496] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:47 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:56:47.519415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c0bc5a5-5516-409a-8101-ccd2b3fc3bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '.version_select at 0x7f6f90b3b160>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:47.586120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:47.587167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:47.610741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:47.614340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:47.614340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:47.614340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:47.626410 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c0bc5a5-5516-409a-8101-ccd2b3fc3bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468705177" status: 202 len: 0 microversion: 2.1 time: 0.109688 Jul 01 10:56:47.626410 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2802/5497] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:56:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468705177 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:56:48.119040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:48.137477 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-80475ad9-8436-4fa9-9456-900bbae80da8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1392 microversion: 2.1 time: 0.553186 Jul 01 10:56:48.137798 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2696/5498] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:47 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1392 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:49.159831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:49.160450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:49.174825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:49.184851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:49.184851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:49.184851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:49.403943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-66089976-6ed0-4a84-9716-b95d94259c83 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: .version_select at 0x7f6f90645a60>, body: {"keypair": {"name": "tempest-keypair-1619567855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiadNe0fTmsSJOtOQoCChelv3VaoyPtsIH5YLT/p4gypBZ/OH/U+r4hpfZMQDbsCetYugU8uVcJxRbjRgw0lTOHM64Jckqxo2i3aiYPSpVKQXGrliCIWxvTFLIOvb5d4g=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:49.446873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-66089976-6ed0-4a84-9716-b95d94259c83 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:56:49.446993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:49.449435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-66089976-6ed0-4a84-9716-b95d94259c83 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:56:49.453915 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3083174-bdaf-4144-9222-23bf6aba63b6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1392 microversion: 2.1 time: 0.298901 Jul 01 10:56:49.465906 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2803/5499] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:49 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:49.538702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-66089976-6ed0-4a84-9716-b95d94259c83 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138698 Jul 01 10:56:49.540193 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2697/5500] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:56:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:56:49.594535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-29ee8e94-9e39-49b8-93bf-85daa1231b5a req-7548dcee-c4ea-4906-9d28-5c4757bfaed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "name": "network-vif-plugged", "status": "completed", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:49.605573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-29ee8e94-9e39-49b8-93bf-85daa1231b5a req-7548dcee-c4ea-4906-9d28-5c4757bfaed6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:49.606134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-29ee8e94-9e39-49b8-93bf-85daa1231b5a req-7548dcee-c4ea-4906-9d28-5c4757bfaed6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:49.630283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-29ee8e94-9e39-49b8-93bf-85daa1231b5a req-7548dcee-c4ea-4906-9d28-5c4757bfaed6 service nova] Creating event network-vif-plugged:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:56:49.637559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-29ee8e94-9e39-49b8-93bf-85daa1231b5a req-7548dcee-c4ea-4906-9d28-5c4757bfaed6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049758 Jul 01 10:56:49.641060 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2804/5501] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:56:50.472828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:50.473558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:50.486917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:50.487491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:50.488757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:50.489337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:50.734966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:50.762203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b397eb4-db15-4460-a6b3-9f17e96306fd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1392 microversion: 2.1 time: 0.292683 Jul 01 10:56:50.763204 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2698/5502] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:50 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:56:51.782589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:51.784958 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:51.794916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:51.805811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:51.807294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:51.810026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:52.078801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:52.100574 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-75a6a633-116f-49de-9200-02b3cb9fbcb2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1564 microversion: 2.1 time: 0.324619 Jul 01 10:56:52.102971 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2805/5503] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:51 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1564 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:52.130577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:52.131435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:52.143029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:52.145532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:52.146607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:52.152030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:52.891802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:52.901745 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4fc2e1a6-f60d-4514-95d5-0a9cc687ffb8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1564 microversion: 2.1 time: 0.779686 Jul 01 10:56:52.913632 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2699/5504] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:52 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1564 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:53.383120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-618710055", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54ddbd62-ac58-4a67-a02d-423b9dfccc04"}], "security_groups": [{"name": "tempest-securitygroup--1814122934"}], "key_name": "tempest-keypair-1619567855", "user_data": "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:53.646011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] validate_networks() for [('54ddbd62-ac58-4a67-a02d-423b9dfccc04', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:56:54.357536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:56:54.357954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:56:54.358672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:56:54.359110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:56:54.359546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:56:54.378629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:54.379378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:54.380394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:54.381006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:54.425022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:56:54.432766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:56:54.457941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:56:54.460262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:56:54.620464 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-55512689-7fd6-4186-a849-3df6c326bf7b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.242324 Jul 01 10:56:54.633100 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2806/5505] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:56:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:56:54.651503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5777e2cf-e0bb-4798-a77f-5b8185ea7564 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:54.652698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5777e2cf-e0bb-4798-a77f-5b8185ea7564 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:54.857429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5777e2cf-e0bb-4798-a77f-5b8185ea7564 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:54.866383 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5777e2cf-e0bb-4798-a77f-5b8185ea7564 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1241 microversion: 2.1 time: 0.220430 Jul 01 10:56:54.879150 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2700/5506] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:54 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:55.886160 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd1a86dd-5240-4b3f-a0c5-7fb6dcb33ebe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:55.886791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dd1a86dd-5240-4b3f-a0c5-7fb6dcb33ebe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:56.007239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd1a86dd-5240-4b3f-a0c5-7fb6dcb33ebe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:56.023281 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd1a86dd-5240-4b3f-a0c5-7fb6dcb33ebe tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1241 microversion: 2.1 time: 0.140440 Jul 01 10:56:56.027028 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2807/5507] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:55 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:56.859149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:56.862015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:56.886722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:56.887212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3da4bee9-6a44-4709-b980-22657d2d3384 req-75419a8b-3ad2-4f1b-a898-62ed95a82d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:56:56.889779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:56.891078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:56.891929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:56.908564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3da4bee9-6a44-4709-b980-22657d2d3384 req-75419a8b-3ad2-4f1b-a898-62ed95a82d5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:56.909020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3da4bee9-6a44-4709-b980-22657d2d3384 req-75419a8b-3ad2-4f1b-a898-62ed95a82d5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:56.940643 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3da4bee9-6a44-4709-b980-22657d2d3384 req-75419a8b-3ad2-4f1b-a898-62ed95a82d5f service nova] Creating event network-changed:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:56:56.966582 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3da4bee9-6a44-4709-b980-22657d2d3384 req-75419a8b-3ad2-4f1b-a898-62ed95a82d5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093557 Jul 01 10:56:56.970211 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2808/5508] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:56:57.063616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:57.064373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:57.082648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:57.083512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:57.085227 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:57.085908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:57.245506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:57.254515 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a3025eca-06e7-46e4-8ed2-9b609eda39e0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1293 microversion: 2.1 time: 0.216204 Jul 01 10:56:57.255663 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2809/5509] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:57 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1293 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:56:57.980008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:57.990310 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8ff2735-6e87-46df-a29f-33cb52d47af4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1564 microversion: 2.1 time: 1.136862 Jul 01 10:56:58.005657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2701/5510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:56 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1564 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:58.272410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:58.274634 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:58.291140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:58.292423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:58.301656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:58.302521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:58.517769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:58.555008 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c924b720-9b59-4199-b936-f03ace49c1c9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1299 microversion: 2.1 time: 0.286986 Jul 01 10:56:58.562600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2810/5511] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:58 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:56:59.585186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:56:59.586689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:56:59.607154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:59.607578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:59.608397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:56:59.614547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:56:59.787400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:56:59.800295 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68459658-31e9-4b03-869a-6dd1c710161b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1299 microversion: 2.1 time: 0.220156 Jul 01 10:56:59.800890 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2702/5512] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:56:59 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:00.818624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:00.819311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:00.835277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:00.836114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:00.838450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:00.841596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:01.133585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:01.145647 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ced766d-6136-4976-a6e3-ef3d356628ae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.331692 Jul 01 10:57:01.154941 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2811/5513] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:00 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:02.169841 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:02.173676 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:02.196228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:02.209485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:02.209485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:02.209485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:02.248765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ebe8288f-f043-4516-b858-81879cf51266 req-fddd781c-934d-4894-ad68-2c305dda4e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426aecd8-2290-4d35-aba7-bf5cf900f1e0", "tag": "1df1b029-3ae1-4ca8-8084-abdf2eec4749"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:02.264309 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ebe8288f-f043-4516-b858-81879cf51266 req-fddd781c-934d-4894-ad68-2c305dda4e6b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:02.266937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ebe8288f-f043-4516-b858-81879cf51266 req-fddd781c-934d-4894-ad68-2c305dda4e6b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:02.319722 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ebe8288f-f043-4516-b858-81879cf51266 req-fddd781c-934d-4894-ad68-2c305dda4e6b service nova] Creating event network-changed:1df1b029-3ae1-4ca8-8084-abdf2eec4749 for instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 on n-h2-master-1 Jul 01 10:57:02.336632 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ebe8288f-f043-4516-b858-81879cf51266 req-fddd781c-934d-4894-ad68-2c305dda4e6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091314 Jul 01 10:57:02.337819 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2812/5514] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:02.814412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:02.824432 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-85b72add-f7c9-4151-992d-b2ab4af06adf tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.665680 Jul 01 10:57:02.831211 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2703/5515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:02 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:03.843522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:03.844608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:03.859417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:03.863891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:03.864864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:03.865354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:04.105732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:04.123240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3bada606-b2aa-4fa9-b47d-62e0f9c584a7 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.279385 Jul 01 10:57:04.123240 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2813/5516] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:03 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:05.137775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:05.139230 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:05.147278 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:05.149644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:05.150517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:05.154149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:05.155261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:05.421531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:05.430466 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f5f93aa-a26c-476c-8bc1-9d84a73037bb tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.299501 Jul 01 10:57:05.431079 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2704/5517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:05 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:06.449291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:06.450052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:06.455646 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:06.457389 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:06.459400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:06.460140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:06.460915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:06.461524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:06.630522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:06.638898 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a321c92f-3a9f-4294-8a3e-8e53f777ac9a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.194487 Jul 01 10:57:06.649334 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2814/5518] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:06 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:07.665081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:07.666142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:07.678858 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:07.679600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:07.680718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:07.681656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:07.898726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:07.907032 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:07.918047 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d7460ab4-4a09-40da-ad42-3fb268fb019b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.255586 Jul 01 10:57:07.918733 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2705/5519] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:07 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:08.936433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:08.937209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:08.946377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:08.948090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:08.953443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:08.953877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:08.957331 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=91 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:09.191032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:09.199945 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-de67faaa-8fb2-45d7-a55c-ace2aeddca13 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.268546 Jul 01 10:57:09.200640 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2815/5520] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:08 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:10.217947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:10.219399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:10.227560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:10.229375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:10.230431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:10.230871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:10.416531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:10.426584 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31386f4c-66f8-4cfa-8e85-bcf97e37cdad tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.212154 Jul 01 10:57:10.438586 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2706/5521] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:10 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:10.714142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6027d7c4-5964-4e58-becf-ae61efbbac66 req-f19c9db9-c329-444a-956a-3a0ec0e76a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426aecd8-2290-4d35-aba7-bf5cf900f1e0", "name": "network-vif-plugged", "status": "completed", "tag": "1df1b029-3ae1-4ca8-8084-abdf2eec4749"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:10.738259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6027d7c4-5964-4e58-becf-ae61efbbac66 req-f19c9db9-c329-444a-956a-3a0ec0e76a51 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:10.743601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6027d7c4-5964-4e58-becf-ae61efbbac66 req-f19c9db9-c329-444a-956a-3a0ec0e76a51 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:10.756808 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6027d7c4-5964-4e58-becf-ae61efbbac66 req-f19c9db9-c329-444a-956a-3a0ec0e76a51 service nova] Creating event network-vif-plugged:1df1b029-3ae1-4ca8-8084-abdf2eec4749 for instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 on n-h2-master-1 Jul 01 10:57:10.763993 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6027d7c4-5964-4e58-becf-ae61efbbac66 req-f19c9db9-c329-444a-956a-3a0ec0e76a51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054034 Jul 01 10:57:10.777325 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2816/5522] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:11.447408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:11.448379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:11.466634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:11.470074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:11.471661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:11.473328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:11.656164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:11.662162 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf9a3255-9fb4-498a-8f54-ef34e4851c50 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1367 microversion: 2.1 time: 0.220341 Jul 01 10:57:11.662759 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2707/5523] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:11 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:12.680319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:12.681689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:12.707208 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:12.709508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:12.711519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:12.714051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:13.034894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:13.047636 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-081b1abb-6fb6-466a-ab9d-6638ef3943db tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1558 microversion: 2.1 time: 0.370053 Jul 01 10:57:13.048886 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2817/5524] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:12 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1558 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:13.065687 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d588eda-d78f-4b5e-b4ba-ca68e7f270fd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:13.068287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d588eda-d78f-4b5e-b4ba-ca68e7f270fd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:13.104391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d588eda-d78f-4b5e-b4ba-ca68e7f270fd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:13.107263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d588eda-d78f-4b5e-b4ba-ca68e7f270fd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:13.110240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d588eda-d78f-4b5e-b4ba-ca68e7f270fd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:13.113063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d588eda-d78f-4b5e-b4ba-ca68e7f270fd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:13.314197 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d588eda-d78f-4b5e-b4ba-ca68e7f270fd tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.251595 Jul 01 10:57:13.315209 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2708/5525] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:57:13 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:14.658175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c26d6b2e-1722-4111-b80f-905df49b1499 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:14.658175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c26d6b2e-1722-4111-b80f-905df49b1499 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:14.670579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c26d6b2e-1722-4111-b80f-905df49b1499 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:14.671244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c26d6b2e-1722-4111-b80f-905df49b1499 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:14.674599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c26d6b2e-1722-4111-b80f-905df49b1499 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:14.675255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c26d6b2e-1722-4111-b80f-905df49b1499 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:14.774543 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c26d6b2e-1722-4111-b80f-905df49b1499 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action" status: 200 len: 24567 microversion: 2.1 time: 0.121256 Jul 01 10:57:14.781262 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2818/5526] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:57:14 2022] POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action => generated 24567 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:57:15.125705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4104e57e-d0ba-4959-8a87-de61973d552b req-d0e5d2b6-16ae-46d0-a346-b10133a23a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426aecd8-2290-4d35-aba7-bf5cf900f1e0", "tag": "1df1b029-3ae1-4ca8-8084-abdf2eec4749"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:15.135985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4104e57e-d0ba-4959-8a87-de61973d552b req-d0e5d2b6-16ae-46d0-a346-b10133a23a9b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:15.136722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4104e57e-d0ba-4959-8a87-de61973d552b req-d0e5d2b6-16ae-46d0-a346-b10133a23a9b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:15.149745 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4104e57e-d0ba-4959-8a87-de61973d552b req-d0e5d2b6-16ae-46d0-a346-b10133a23a9b service nova] Creating event network-changed:1df1b029-3ae1-4ca8-8084-abdf2eec4749 for instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 on n-h2-master-1 Jul 01 10:57:15.155801 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4104e57e-d0ba-4959-8a87-de61973d552b req-d0e5d2b6-16ae-46d0-a346-b10133a23a9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033855 Jul 01 10:57:15.162773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2709/5527] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:22.862866 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-295a2800-b3e1-4945-935c-5d2d4d96d6de tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Action: 'create', calling method: .version_select at 0x7f6f91017af0>, body: {"keypair": {"name": "tempest-keypair-665042529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICtE4mWjrDXKCOv0/aPLFnuYjyL4H0nd4j3+tJd0NZ70VcrdByTJXUe9qpizLxXq+ACIJtAExiVla7R5BSEHPACbUCB05GUGpTHqMkaGIv3UqsB/b/PsS5AhVoVW9WmTw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:22.872820 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:22.891086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-295a2800-b3e1-4945-935c-5d2d4d96d6de tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Getting quotas for project 967c76a816e140e9b6f375bfccac2275. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:57:22.899077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-295a2800-b3e1-4945-935c-5d2d4d96d6de tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Getting quotas for user 1921644ad67c45ce96876f62fc4a0d54 and project 967c76a816e140e9b6f375bfccac2275. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:57:23.034732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-295a2800-b3e1-4945-935c-5d2d4d96d6de tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.176095 Jul 01 10:57:23.041065 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2819/5528] 10.222.0.23 () {62 vars in 1199 bytes} [Fri Jul 1 10:57:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 183 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 10:57:25.484652 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:25.485716 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=18 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:25.490517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0aab1e17-1eb6-42be-8422-aa4fbf8853d9 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:25.491240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0aab1e17-1eb6-42be-8422-aa4fbf8853d9 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:25.498531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0aab1e17-1eb6-42be-8422-aa4fbf8853d9 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:25.499355 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0aab1e17-1eb6-42be-8422-aa4fbf8853d9 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:25.500661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0aab1e17-1eb6-42be-8422-aa4fbf8853d9 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:25.501498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0aab1e17-1eb6-42be-8422-aa4fbf8853d9 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:25.764753 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=17 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:25.769575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-91611925", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0b8c5a62-a03b-42f2-acd4-f256a7bdcbfb"}, {"port": "f9e52211-0bf8-46b1-b47d-8a0ba09d2159", "tag": "port-1"}, {"port": "cdd11166-d74f-4788-82c7-c9ebb45b251f", "tag": "port-2"}, {"uuid": "05dc57e2-8cd6-4832-b74a-d7dbd24d9ec3", "tag": "net-1"}, {"uuid": "05dc57e2-8cd6-4832-b74a-d7dbd24d9ec3"}, {"uuid": "36579db5-1947-4b68-87ea-11cbc65fc101", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "36579db5-1947-4b68-87ea-11cbc65fc101", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9171674f-dcf1-468d-806c-01dc5db0613c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4c326ed4-129a-449e-b58c-65323c6ec32d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3bc35ec9-1f89-4e8e-9eac-64be4022aed2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2081903363"}], "key_name": "tempest-keypair-665042529", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:25.819709 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0aab1e17-1eb6-42be-8422-aa4fbf8853d9 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1834 microversion: 2.1 time: 0.337107 Jul 01 10:57:25.820293 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2710/5529] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:25 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1834 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:25.846655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:25.846655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:25.854881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:25.855411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:25.856238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:25.856672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:25.914114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] validate_networks() for [('0b8c5a62-a03b-42f2-acd4-f256a7bdcbfb', None, None, None, None, None), (None, None, 'f9e52211-0bf8-46b1-b47d-8a0ba09d2159', None, None, None), (None, None, 'cdd11166-d74f-4788-82c7-c9ebb45b251f', None, None, None), ('05dc57e2-8cd6-4832-b74a-d7dbd24d9ec3', None, None, None, None, None), ('05dc57e2-8cd6-4832-b74a-d7dbd24d9ec3', None, None, None, None, None), ('36579db5-1947-4b68-87ea-11cbc65fc101', '10.2.2.100', None, None, None, None), ('36579db5-1947-4b68-87ea-11cbc65fc101', '10.2.2.200', None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:57:26.099728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:26.109114 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f1dc1b1e-d91a-4079-a54e-eb46ad6af7cb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1683 microversion: 2.1 time: 0.271836 Jul 01 10:57:26.120296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2711/5530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:25 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1683 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:57:26.211882 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b893c184-b8d5-4b4e-8981-9c8186594ef5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:26.213217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b893c184-b8d5-4b4e-8981-9c8186594ef5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:26.220554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b893c184-b8d5-4b4e-8981-9c8186594ef5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:26.221255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b893c184-b8d5-4b4e-8981-9c8186594ef5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:26.222292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b893c184-b8d5-4b4e-8981-9c8186594ef5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:26.222878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b893c184-b8d5-4b4e-8981-9c8186594ef5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:26.294113 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b893c184-b8d5-4b4e-8981-9c8186594ef5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action" status: 200 len: 32644 microversion: 2.1 time: 0.087842 Jul 01 10:57:26.295405 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2712/5531] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:57:26 2022] POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action => generated 32644 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 10:57:26.483009 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:26.483957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:26.491603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:26.492691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:26.494278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:26.494870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:26.543427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5419133ef0ff47fcad434d1f542a0bf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8363f5d47214ffa95a8f03f74444980', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:26.550366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] flavor_id is None. Assuming migration. {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 01 10:57:26.551174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 10:57:27.100230 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-538c0026-5f51-4f22-992b-00325b7dc341 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action" status: 202 len: 0 microversion: 2.1 time: 0.621884 Jul 01 10:57:27.101431 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2713/5532] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:57:26 2022] POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:57:27.117530 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:27.118653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:27.126644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:27.126978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:27.130667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:27.131112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:27.387920 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:27.403125 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ada753d-5322-4567-8c62-ca0ab7d2fbfc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1692 microversion: 2.1 time: 0.291838 Jul 01 10:57:27.414867 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2714/5533] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:27 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1692 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:57:28.417394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:28.419434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:28.427554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:28.428267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:28.432067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:28.432067 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:29.230301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:29.241450 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d9d75540-af24-475f-afab-6a033ceb59ea tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1692 microversion: 2.1 time: 0.827867 Jul 01 10:57:29.243142 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2715/5534] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:28 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1692 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:29.371753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:57:29.372231 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:57:29.372688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:57:29.373205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:57:29.373649 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:57:29.383121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:29.384782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:29.384782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:29.384992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:29.405200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Getting quotas for project 967c76a816e140e9b6f375bfccac2275. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:57:29.411564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Getting quotas for user 1921644ad67c45ce96876f62fc4a0d54 and project 967c76a816e140e9b6f375bfccac2275. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:57:29.593026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:57:29.596442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9171674f-dcf1-468d-806c-01dc5db0613c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4c326ed4-129a-449e-b58c-65323c6ec32d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3bc35ec9-1f89-4e8e-9eac-64be4022aed2',volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:57:30.259916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:30.260694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:30.285069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:30.285554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:30.286351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:30.286786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:30.496877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:30.504783 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d3359e9-bf98-4ae2-96c9-3eb7af897d01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1692 microversion: 2.1 time: 0.248901 Jul 01 10:57:30.505415 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2716/5535] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:30 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1692 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:57:30.939169 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d05db6b-ee58-4529-bd1f-2fdf431e729a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.175802 Jul 01 10:57:30.945116 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2820/5536] 10.222.0.23 () {62 vars in 1188 bytes} [Fri Jul 1 10:57:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 5182 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 10:57:30.950971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96773a90-20eb-4108-a585-7a71b0932e2d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:30.951708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96773a90-20eb-4108-a585-7a71b0932e2d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:31.106727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96773a90-20eb-4108-a585-7a71b0932e2d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:31.119877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96773a90-20eb-4108-a585-7a71b0932e2d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:31.121662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96773a90-20eb-4108-a585-7a71b0932e2d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:31.126989 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96773a90-20eb-4108-a585-7a71b0932e2d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1283 microversion: 2.32 time: 0.180551 Jul 01 10:57:31.127888 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2717/5537] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:30 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:31.522660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:31.523378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:31.530082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:31.530629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:31.531311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:31.531740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:31.749317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:31.772667 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60b9d660-61a8-4eff-a4ca-4f47b586b9dc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1692 microversion: 2.1 time: 0.253734 Jul 01 10:57:31.778317 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2821/5538] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:31 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1692 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:32.147333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-22c1f4d0-39f4-4d64-a89c-cea4ec5aa964 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:32.147950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-22c1f4d0-39f4-4d64-a89c-cea4ec5aa964 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:32.207346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-22c1f4d0-39f4-4d64-a89c-cea4ec5aa964 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:32.215236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-22c1f4d0-39f4-4d64-a89c-cea4ec5aa964 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:32.216621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-22c1f4d0-39f4-4d64-a89c-cea4ec5aa964 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:32.217791 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-22c1f4d0-39f4-4d64-a89c-cea4ec5aa964 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1283 microversion: 2.32 time: 0.074415 Jul 01 10:57:32.218682 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2718/5539] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:32 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1283 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:32.792119 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:32.792770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:32.810056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:32.813793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:32.813793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:32.813793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:32.996464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:33.005665 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b1597ad-038b-49f6-a80a-4d211877f170 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.218271 Jul 01 10:57:33.006393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2822/5540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:32 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:33.237532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:33.238475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:33.246810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:33.247568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:33.248658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:33.249360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:33.328571 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:33.339271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:33.341090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:33.342405 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-233433be-e385-4f79-8ed3-5d30db49ad55 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1573 microversion: 2.32 time: 0.109227 Jul 01 10:57:33.343102 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2719/5541] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:33 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1573 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:34.026255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:34.027879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:34.037839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:34.038495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:34.040382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:34.041275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:34.268453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:34.277642 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9f72e227-9391-471e-8772-60c6de549b97 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.255981 Jul 01 10:57:34.278908 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2823/5542] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:34 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:34.367912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:34.369783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:34.377516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:34.378531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:34.394712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:34.401732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:34.527143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:34.540820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:34.542888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:34.544719 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-692823ed-9132-4b81-9e85-71ab3bee242b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1591 microversion: 2.32 time: 0.186241 Jul 01 10:57:34.545647 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2720/5543] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:34 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1591 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:35.305235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:35.307055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:35.328663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:35.328663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:35.328663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:35.328952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:35.570256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:35.570891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:35.589705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:35.590197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:35.591014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:35.591454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:35.624575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:35.633558 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa69c9ad-5854-4fe7-97af-10195805eddd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.341714 Jul 01 10:57:35.634269 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2824/5544] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:35 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:35.895551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:35.913958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:35.916016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:35.925266 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b878e2b0-1b95-4b1a-a46e-42b205a7b460 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1659 microversion: 2.32 time: 0.352899 Jul 01 10:57:35.927432 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2721/5545] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:35 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1659 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:57:36.651616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:36.652739 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:36.662718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:36.663425 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:36.666302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:36.667128 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:36.872541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:36.881989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc7260ee-c5f1-4cc4-89bd-05c7397418f8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.234927 Jul 01 10:57:36.893065 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2825/5546] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:36 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:36.947541 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:36.948164 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:36.967129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:36.967573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:36.968316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:36.968760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:37.231554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:37.270185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:37.275956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:37.284516 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-619b1061-f0d2-471b-87d0-5e6a9fc3d610 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1706 microversion: 2.32 time: 0.337647 Jul 01 10:57:37.291329 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2722/5547] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:36 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1706 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:37.900603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:37.901308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:37.917716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:37.918169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:37.926701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:37.927443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:38.204009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:38.216445 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc70e566-0183-4f44-8b75-931fd8e49e6c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.318862 Jul 01 10:57:38.217767 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2826/5548] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:37 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:38.311685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:38.312307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:38.323103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:38.323560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:38.324349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:38.326575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:38.563743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:38.583723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:38.585997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:38.588943 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f6375ef2-d2df-4724-b13e-e70fa6298271 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1753 microversion: 2.32 time: 0.282539 Jul 01 10:57:38.595219 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2723/5549] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:38 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1753 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:39.235055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:39.236207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:39.250782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:39.255810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:39.255810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:39.255810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:39.393932 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:39.421285 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:39.577787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:39.591437 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0f2e0ba-3004-4d58-80fd-5af9eed1662f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.358405 Jul 01 10:57:39.598720 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2827/5550] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:39 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:39.620242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:39.621508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:39.650486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:39.650486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:39.650486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:39.650486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:40.046258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:40.061446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:40.064219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:40.065891 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e9eb55b4-1cca-4e0b-a757-8cf93a5339aa tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1800 microversion: 2.32 time: 0.453644 Jul 01 10:57:40.067268 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2724/5551] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:39 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1800 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:40.608415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:40.609159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:40.634271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:40.662344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:40.667891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:40.669679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:40.988237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:41.001597 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8298b49f-d169-49a9-8b63-3dd2a715f82e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.396643 Jul 01 10:57:41.012836 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2828/5552] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:40 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:41.086015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:41.087268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:41.095838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:41.096474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:41.097831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:41.098431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:41.366748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:41.383607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:41.386439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:41.389807 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-88b87ff7-332c-4137-8b42-e035cf678533 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1847 microversion: 2.32 time: 0.307666 Jul 01 10:57:41.391163 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2725/5553] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:41 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1847 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:41.977132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-83ed8e1a-59f9-41c2-a464-75d8f64bcce2 req-cf20fde0-3f12-4132-a179-f48dcf4597c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "77966735-1c04-4005-be41-194f63188932"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:42.014351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83ed8e1a-59f9-41c2-a464-75d8f64bcce2 req-cf20fde0-3f12-4132-a179-f48dcf4597c3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:42.014813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83ed8e1a-59f9-41c2-a464-75d8f64bcce2 req-cf20fde0-3f12-4132-a179-f48dcf4597c3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:42.020263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:42.021369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:42.039003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:42.039737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:42.042938 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-83ed8e1a-59f9-41c2-a464-75d8f64bcce2 req-cf20fde0-3f12-4132-a179-f48dcf4597c3 service nova] Creating event network-changed:77966735-1c04-4005-be41-194f63188932 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:57:42.044652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:42.045921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:42.061321 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-83ed8e1a-59f9-41c2-a464-75d8f64bcce2 req-cf20fde0-3f12-4132-a179-f48dcf4597c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081834 Jul 01 10:57:42.062430 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2829/5554] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:42.214005 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:42.382061 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:42.395624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ea0ef44-ff7a-440c-9822-57fb08c29c7b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.379978 Jul 01 10:57:42.401939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2726/5555] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:42 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:42.412178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:42.416829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:42.420895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:42.421380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:42.422166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:42.422639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:43.029870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:43.044307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:43.047616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:43.050028 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9e8058b2-2437-4429-bf9b-f8573037d3a1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1847 microversion: 2.32 time: 0.642504 Jul 01 10:57:43.057130 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2830/5556] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:42 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1847 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:43.420739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:43.423107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:43.429291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:43.430000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:43.431235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:43.432286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:43.455119 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:43.859473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:43.880891 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-125f65e2-5a71-436a-9912-bac33aa65a35 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1697 microversion: 2.1 time: 0.466244 Jul 01 10:57:43.881551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2727/5557] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:43 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1697 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:44.070125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:44.070731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:44.078661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:44.079168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:44.080141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:44.080603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:44.193559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-dbd75db9-0f82-4763-b6f7-810b5f273263 req-1432449f-9fc1-435f-87cb-8ae2aeb49706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "f9e52211-0bf8-46b1-b47d-8a0ba09d2159"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:44.233427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dbd75db9-0f82-4763-b6f7-810b5f273263 req-1432449f-9fc1-435f-87cb-8ae2aeb49706 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:44.234091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dbd75db9-0f82-4763-b6f7-810b5f273263 req-1432449f-9fc1-435f-87cb-8ae2aeb49706 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:44.250880 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-dbd75db9-0f82-4763-b6f7-810b5f273263 req-1432449f-9fc1-435f-87cb-8ae2aeb49706 service nova] Creating event network-changed:f9e52211-0bf8-46b1-b47d-8a0ba09d2159 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:57:44.257603 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-dbd75db9-0f82-4763-b6f7-810b5f273263 req-1432449f-9fc1-435f-87cb-8ae2aeb49706 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067397 Jul 01 10:57:44.259070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2728/5558] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:44.808529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:44.827392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:44.830845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:44.836334 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ca068526-1876-4cc3-b668-b3398eec76a3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1868 microversion: 2.32 time: 0.770382 Jul 01 10:57:44.839858 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2831/5559] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:44 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1868 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:44.899759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:44.901603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:44.913391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:44.915993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:44.916810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:44.920023 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:45.386646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:45.396341 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42bd2e5d-1f0e-4111-8420-7d6c8b733930 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1696 microversion: 2.1 time: 0.501821 Jul 01 10:57:45.400810 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2729/5560] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:44 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1696 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:45.899791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:45.900520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:45.921751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:45.922169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:45.925327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:45.925780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:46.341168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e280191b-1383-41d1-8394-6989ea914ec8 req-ba432c56-6af5-4d70-a086-4e3dd105967c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "name": "network-vif-unplugged", "status": "completed", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:46.363054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e280191b-1383-41d1-8394-6989ea914ec8 req-ba432c56-6af5-4d70-a086-4e3dd105967c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:46.366739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e280191b-1383-41d1-8394-6989ea914ec8 req-ba432c56-6af5-4d70-a086-4e3dd105967c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:46.412469 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e280191b-1383-41d1-8394-6989ea914ec8 req-ba432c56-6af5-4d70-a086-4e3dd105967c service nova] Creating event network-vif-unplugged:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h2-master-1 Jul 01 10:57:46.429622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-e280191b-1383-41d1-8394-6989ea914ec8 req-ba432c56-6af5-4d70-a086-4e3dd105967c service nova] Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:57:46.453229 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e280191b-1383-41d1-8394-6989ea914ec8 req-ba432c56-6af5-4d70-a086-4e3dd105967c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116039 Jul 01 10:57:46.459361 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2730/5561] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:46.480427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:46.481437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:46.498255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:46.498965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:46.499945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:46.500541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:47.199613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:47.221357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:47.225358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:47.226594 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f850f924-8ba7-441b-8bb1-bbe76752d8b3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 1.348593 Jul 01 10:57:47.230128 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2832/5562] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:45 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:47.276947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:47.285377 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eb3467dd-ece6-4c63-b5c2-59f5e07c2f80 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1696 microversion: 2.1 time: 0.824762 Jul 01 10:57:47.291943 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2731/5563] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:46 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1696 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:48.249293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:48.250028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:48.263328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:48.263816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:48.265108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:48.268017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:48.308758 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:48.310630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:48.332846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:48.333688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:48.337523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:48.343148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:48.845327 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:48.856276 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-adc74189-c1c8-488c-883c-604cb298d067 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1696 microversion: 2.1 time: 0.552208 Jul 01 10:57:48.858202 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2732/5564] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:48 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1696 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:48.868669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0812f525-d965-4b8c-b60c-393c8724419b req-806d0ede-e68a-4bf6-93ca-73bd0f93d4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "cdd11166-d74f-4788-82c7-c9ebb45b251f"}, {"name": "network-changed", "server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:48.888921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0812f525-d965-4b8c-b60c-393c8724419b req-806d0ede-e68a-4bf6-93ca-73bd0f93d4dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:48.891513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0812f525-d965-4b8c-b60c-393c8724419b req-806d0ede-e68a-4bf6-93ca-73bd0f93d4dc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:48.932833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0812f525-d965-4b8c-b60c-393c8724419b req-806d0ede-e68a-4bf6-93ca-73bd0f93d4dc service nova] Creating event network-changed:cdd11166-d74f-4788-82c7-c9ebb45b251f for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:57:48.933680 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0812f525-d965-4b8c-b60c-393c8724419b req-806d0ede-e68a-4bf6-93ca-73bd0f93d4dc service nova] Creating event network-changed:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h2-master-1 Jul 01 10:57:48.947490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-0812f525-d965-4b8c-b60c-393c8724419b req-806d0ede-e68a-4bf6-93ca-73bd0f93d4dc service nova] Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:57:48.961308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:48.976161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:48.998387 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:49.003572 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae844705-3628-4a6d-a69f-52eadf33693b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 0.761135 Jul 01 10:57:49.018604 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2833/5565] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:48 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:49.026781 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0812f525-d965-4b8c-b60c-393c8724419b req-806d0ede-e68a-4bf6-93ca-73bd0f93d4dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.162159 Jul 01 10:57:49.027582 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2733/5566] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:49.839521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28e53a11-63b7-4362-9b15-b1f2ba20123e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:49.840063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-28e53a11-63b7-4362-9b15-b1f2ba20123e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:49.853509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28e53a11-63b7-4362-9b15-b1f2ba20123e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:49.854152 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28e53a11-63b7-4362-9b15-b1f2ba20123e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:49.855137 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28e53a11-63b7-4362-9b15-b1f2ba20123e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:49.861484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-28e53a11-63b7-4362-9b15-b1f2ba20123e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:49.874241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:49.875645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:49.895866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:49.896641 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:49.903049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:49.903784 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:49.944895 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28e53a11-63b7-4362-9b15-b1f2ba20123e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/ips" status: 200 len: 151 microversion: 2.1 time: 0.109263 Jul 01 10:57:49.946900 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2834/5567] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:57:49 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/ips => generated 151 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:50.048205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:50.051201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:50.067804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:50.069768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:50.070780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:50.076532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:50.541689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:50.553576 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-65d1cb91-3c9a-47e2-bbaf-166886bbc7ff tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1696 microversion: 2.1 time: 0.681599 Jul 01 10:57:50.555806 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2734/5568] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:49 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1696 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:51.126504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:51.131246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d882ac94-acca-48d9-93f3-670593ebcc13 req-fafd6cc1-7584-496c-a895-a13a2f5457f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "044f5b59-e5a0-48b2-864b-fb9be08789bb"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:51.144180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:51.151070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d882ac94-acca-48d9-93f3-670593ebcc13 req-fafd6cc1-7584-496c-a895-a13a2f5457f7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:51.153614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:51.153755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d882ac94-acca-48d9-93f3-670593ebcc13 req-fafd6cc1-7584-496c-a895-a13a2f5457f7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:51.157762 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d84b0d1c-476a-4041-8f96-c997b44d177f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 1.119884 Jul 01 10:57:51.159716 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2835/5569] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:50 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:51.182339 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d882ac94-acca-48d9-93f3-670593ebcc13 req-fafd6cc1-7584-496c-a895-a13a2f5457f7 service nova] Creating event network-changed:044f5b59-e5a0-48b2-864b-fb9be08789bb for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:57:51.195382 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d882ac94-acca-48d9-93f3-670593ebcc13 req-fafd6cc1-7584-496c-a895-a13a2f5457f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068830 Jul 01 10:57:51.199833 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2735/5570] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:51.572052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:51.573204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:51.591846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:51.597077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:51.597964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:51.605241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:52.179869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:52.186448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:52.210953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:52.214691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:52.218185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:52.229843 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:52.413993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:52.429999 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-05f01dd3-c17f-407f-9b1f-186f7d72bd3d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1694 microversion: 2.1 time: 0.862398 Jul 01 10:57:52.431155 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2836/5571] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:51 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1694 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:53.324505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:53.345194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:53.348240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:53.349680 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-56a6d03c-4c3c-4b6d-99ff-6ffcf365d0e8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 1.175598 Jul 01 10:57:53.366196 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2736/5572] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:52 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:53.418202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d5f9cf1-3d79-42a1-9283-3d95e39477b0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "985c2383-57ee-4e24-b64a-704696663273"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:53.419387 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d5f9cf1-3d79-42a1-9283-3d95e39477b0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:53.427012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d5f9cf1-3d79-42a1-9283-3d95e39477b0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:53.427525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d5f9cf1-3d79-42a1-9283-3d95e39477b0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:53.428548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d5f9cf1-3d79-42a1-9283-3d95e39477b0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:53.429044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d5f9cf1-3d79-42a1-9283-3d95e39477b0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:53.454369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:53.454810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:53.465392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:53.466289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:53.469241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:53.470140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:53.812514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:53.825859 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-05d50c7a-9856-430f-9231-768fb0ea622e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1691 microversion: 2.1 time: 0.379342 Jul 01 10:57:53.828948 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2737/5573] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:53 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1691 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:57:53.842300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ce031ddc-4c6d-4ee2-bb31-481657b11c5b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:53.842848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ce031ddc-4c6d-4ee2-bb31-481657b11c5b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:53.855218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce031ddc-4c6d-4ee2-bb31-481657b11c5b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:53.857547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce031ddc-4c6d-4ee2-bb31-481657b11c5b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:53.857547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce031ddc-4c6d-4ee2-bb31-481657b11c5b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:53.857547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce031ddc-4c6d-4ee2-bb31-481657b11c5b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:53.892252 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:54.254360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ce031ddc-4c6d-4ee2-bb31-481657b11c5b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action" status: 202 len: 0 microversion: 2.1 time: 0.415531 Jul 01 10:57:54.256305 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2738/5574] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:57:53 2022] POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 10:57:54.265183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d65604ac-3231-442d-a296-1d7680609b6f req-72a19743-6a16-4007-bfd7-e725fdb46609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "28700afe-1082-43ca-8db3-5596ec5ccaf8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:54.280639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d65604ac-3231-442d-a296-1d7680609b6f req-72a19743-6a16-4007-bfd7-e725fdb46609 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:54.281289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d65604ac-3231-442d-a296-1d7680609b6f req-72a19743-6a16-4007-bfd7-e725fdb46609 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:54.334390 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d65604ac-3231-442d-a296-1d7680609b6f req-72a19743-6a16-4007-bfd7-e725fdb46609 service nova] Creating event network-changed:28700afe-1082-43ca-8db3-5596ec5ccaf8 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:57:54.349980 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d65604ac-3231-442d-a296-1d7680609b6f req-72a19743-6a16-4007-bfd7-e725fdb46609 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090786 Jul 01 10:57:54.350818 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2739/5575] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:54.365189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:54.365189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:54.376062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:54.376379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:54.377167 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:54.377781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:54.619112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d5f9cf1-3d79-42a1-9283-3d95e39477b0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.205080 Jul 01 10:57:54.622695 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2837/5576] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:57:53 2022] POST /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 194 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:54.649777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:54.650543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:54.678122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:54.678571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:54.694621 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:54.694621 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:56.082229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:56.102759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:56.107731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:56.110673 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dac85ddf-2758-4fb9-b148-b2c4d7676dce tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 1.485124 Jul 01 10:57:56.114719 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2838/5577] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:54 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:56.235434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:56.249902 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f2b8d8d8-678d-4505-80e5-80e4ea04c3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1690 microversion: 2.1 time: 1.897853 Jul 01 10:57:56.257945 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2740/5578] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:54 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1690 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:57.137738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:57.139598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:57.156704 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=73 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:57.158732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:57.159439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:57.160479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:57.163500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:57.502507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d674ff0f-e19a-4d8f-8560-a8d243d71561 req-07db6c28-115a-46c7-9395-0d73af3ff96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "name": "network-vif-plugged", "status": "completed", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:57.507521 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:57:57.530439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d674ff0f-e19a-4d8f-8560-a8d243d71561 req-07db6c28-115a-46c7-9395-0d73af3ff96e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:57.552574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d674ff0f-e19a-4d8f-8560-a8d243d71561 req-07db6c28-115a-46c7-9395-0d73af3ff96e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:57.584307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d674ff0f-e19a-4d8f-8560-a8d243d71561 req-07db6c28-115a-46c7-9395-0d73af3ff96e service nova] Creating event network-vif-plugged:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h2-master-1 Jul 01 10:57:57.597967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-d674ff0f-e19a-4d8f-8560-a8d243d71561 req-07db6c28-115a-46c7-9395-0d73af3ff96e service nova] Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:57:57.623536 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d674ff0f-e19a-4d8f-8560-a8d243d71561 req-07db6c28-115a-46c7-9395-0d73af3ff96e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.558618 Jul 01 10:57:57.629834 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2839/5579] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:57:57.634349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:57.635458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:57.653949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:57.656726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:57.659551 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:57.660867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:57.722572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:57.743382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:57.747302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:57.748685 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad5cc98b-ea3e-40a1-97de-1fed19a139c0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 0.619166 Jul 01 10:57:57.752005 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2741/5580] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:57 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:57.773096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c3233179-e463-4988-ad04-c210ebb6b40e req-43960cca-6f2b-45a3-a031-e529f19187d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "7753f5a0-0a8b-4a41-ae5e-b645aa7af02d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:57.775010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c3233179-e463-4988-ad04-c210ebb6b40e req-43960cca-6f2b-45a3-a031-e529f19187d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:57.775783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c3233179-e463-4988-ad04-c210ebb6b40e req-43960cca-6f2b-45a3-a031-e529f19187d4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:57.790531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c3233179-e463-4988-ad04-c210ebb6b40e req-43960cca-6f2b-45a3-a031-e529f19187d4 service nova] Creating event network-changed:7753f5a0-0a8b-4a41-ae5e-b645aa7af02d for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:57:57.809055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c3233179-e463-4988-ad04-c210ebb6b40e req-43960cca-6f2b-45a3-a031-e529f19187d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055058 Jul 01 10:57:57.810057 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2742/5581] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:57:58.292066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:58.306905 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5e1ccfc-5b05-4be0-9b56-57da9b731276 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1690 microversion: 2.1 time: 0.677291 Jul 01 10:57:58.310210 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2840/5582] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:57 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1690 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:58.773082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:58.774728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:58.783174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:58.783801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:58.784606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:58.785048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:59.217646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:59.230398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:59.232228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:59.234869 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47c794eb-818e-46cf-ab1c-41065ab281ec tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 0.467178 Jul 01 10:57:59.235950 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2743/5583] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:57:58 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:57:59.326654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:57:59.328616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:57:59.336797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:59.337709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:59.339202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:59.339989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:59.717825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:57:59.727520 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3712656-c4ad-476c-8ede-845d7a51239f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1690 microversion: 2.1 time: 0.406053 Jul 01 10:57:59.737752 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2841/5584] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:57:59 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1690 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:57:59.861534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0fd1fb66-99a7-4031-b855-94d73de28b58 req-bdcbe04d-54f9-4a63-8155-abdcfebfaa5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "7360206d-5c44-4232-a000-d876f44d6379"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:57:59.875064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0fd1fb66-99a7-4031-b855-94d73de28b58 req-bdcbe04d-54f9-4a63-8155-abdcfebfaa5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:57:59.879725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0fd1fb66-99a7-4031-b855-94d73de28b58 req-bdcbe04d-54f9-4a63-8155-abdcfebfaa5f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:57:59.899487 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0fd1fb66-99a7-4031-b855-94d73de28b58 req-bdcbe04d-54f9-4a63-8155-abdcfebfaa5f service nova] Creating event network-changed:7360206d-5c44-4232-a000-d876f44d6379 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:57:59.909050 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0fd1fb66-99a7-4031-b855-94d73de28b58 req-bdcbe04d-54f9-4a63-8155-abdcfebfaa5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051741 Jul 01 10:57:59.910936 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2744/5585] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:00.255505 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:00.256796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:00.271763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:00.272594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:00.274494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:00.275976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:00.683790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:00.694814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:00.697389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:00.698981 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-009598bb-1fad-4c51-a393-7960d30f4f1c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 0.448402 Jul 01 10:58:00.700333 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2842/5586] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:00 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:00.749105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:00.750679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:00.759675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:00.760814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:00.761957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:00.762781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:01.157560 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:01.164252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e9dc2bbd-b949-47ce-b078-0ba30f0dc4cc tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1690 microversion: 2.1 time: 0.422640 Jul 01 10:58:01.177600 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2745/5587] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:00 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1690 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:01.718802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:01.719575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:01.729736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:01.731924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:01.732828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:01.737449 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:02.183049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:02.184316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:02.191772 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:02.192483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:02.193495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:02.194164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:02.216672 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:02.641876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:02.657101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:02.660934 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-049a8baa-c6b1-4695-ab74-c82f1c6399f2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1690 microversion: 2.1 time: 0.475871 Jul 01 10:58:02.667176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:02.667904 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2746/5588] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:02 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1690 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:02.672824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:02.680686 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0111c02d-3e24-4e00-a742-4939ac2c93cc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 0.965391 Jul 01 10:58:02.680951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c7170ba4-ea3a-4cd6-af5a-04251910440b req-5c235563-60c4-4438-b93c-03b4d1d17797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "name": "network-vif-unplugged", "status": "completed", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:02.681574 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2843/5589] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:01 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:02.701321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c7170ba4-ea3a-4cd6-af5a-04251910440b req-5c235563-60c4-4438-b93c-03b4d1d17797 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:02.702196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c7170ba4-ea3a-4cd6-af5a-04251910440b req-5c235563-60c4-4438-b93c-03b4d1d17797 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:02.718194 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c7170ba4-ea3a-4cd6-af5a-04251910440b req-5c235563-60c4-4438-b93c-03b4d1d17797 service nova] Creating event network-vif-unplugged:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:58:02.724939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-c7170ba4-ea3a-4cd6-af5a-04251910440b req-5c235563-60c4-4438-b93c-03b4d1d17797 service nova] Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:58:02.738110 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c7170ba4-ea3a-4cd6-af5a-04251910440b req-5c235563-60c4-4438-b93c-03b4d1d17797 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068677 Jul 01 10:58:02.739129 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2747/5590] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:03.684986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:03.688880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:03.701202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:03.701922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:03.705589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:03.705589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:03.705589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:03.706666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:03.721260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:03.721651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:03.723043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:03.723508 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:04.205525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:04.225717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:04.239811 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68867706-488f-466b-ac4d-3400ef91f5bf tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1690 microversion: 2.1 time: 0.542223 Jul 01 10:58:04.243058 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2844/5591] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:03 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1690 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:04.251689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:04.258053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:04.260023 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e24b8937-3100-41d7-9d94-da88b1d7bba4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 0.564266 Jul 01 10:58:04.260893 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2748/5592] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:03 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:04.757258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-252abbdc-6acc-490e-a53e-3bb11bb22982 req-bca77621-ce51-41a6-9d18-0961ffb16475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:04.769457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-252abbdc-6acc-490e-a53e-3bb11bb22982 req-bca77621-ce51-41a6-9d18-0961ffb16475 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:04.770242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-252abbdc-6acc-490e-a53e-3bb11bb22982 req-bca77621-ce51-41a6-9d18-0961ffb16475 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:04.789490 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-252abbdc-6acc-490e-a53e-3bb11bb22982 req-bca77621-ce51-41a6-9d18-0961ffb16475 service nova] Creating event network-changed:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:58:04.796503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-252abbdc-6acc-490e-a53e-3bb11bb22982 req-bca77621-ce51-41a6-9d18-0961ffb16475 service nova] Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 10:58:04.808876 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-252abbdc-6acc-490e-a53e-3bb11bb22982 req-bca77621-ce51-41a6-9d18-0961ffb16475 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055470 Jul 01 10:58:04.809976 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2845/5593] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:58:05.280264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:05.281206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:05.290890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:05.294535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:05.297261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:05.299287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:05.628845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:05.630244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:05.645646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:05.647027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:05.647994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:05.649209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:05.966000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:05.982464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:05.984388 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:05.987030 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5a153bb-5444-43c6-919a-b0b1df8b26f6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1889 microversion: 2.32 time: 0.711116 Jul 01 10:58:05.988151 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2846/5594] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:05 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1889 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:06.235835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:06.248758 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-34331848-e612-47ff-a137-2e21906c1a2e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1690 microversion: 2.1 time: 0.993052 Jul 01 10:58:06.252108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2749/5595] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:05 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1690 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:07.005694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:07.006346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:07.014031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:07.014502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:07.015253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:07.015722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:07.266405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:07.267036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:07.280227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:07.280951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:07.281935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:07.282539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:07.417202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:07.432960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:07.437067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:07.440655 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c813b8f4-2d51-49be-bcd8-870ba413c0b4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.439073 Jul 01 10:58:07.442952 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2847/5596] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:07 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:07.607193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:07.615396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a3e927d3-1741-4b52-86c2-eaa5dd6bbf02 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1683 microversion: 2.1 time: 0.352793 Jul 01 10:58:07.616592 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2750/5597] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:07 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1683 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:08.464868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:08.465611 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:08.473413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:08.474013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:08.474794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:08.475232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:08.695577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:08.706306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:08.707830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:08.709173 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dfe2f235-3b6b-4634-89ed-bc4c7d90e8c7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.249237 Jul 01 10:58:08.709867 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2848/5598] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:08 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:58:09.719199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f4ee1b41-9e03-44dc-a588-df5cb0b2bb66 req-4d320623-af64-4c27-a850-ed1df6b530b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "name": "network-vif-plugged", "status": "completed", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:09.737875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:09.739207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:09.747860 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f4ee1b41-9e03-44dc-a588-df5cb0b2bb66 req-4d320623-af64-4c27-a850-ed1df6b530b6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:09.752256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:09.753862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f4ee1b41-9e03-44dc-a588-df5cb0b2bb66 req-4d320623-af64-4c27-a850-ed1df6b530b6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:09.761653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:09.766427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:09.767428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:09.789996 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f4ee1b41-9e03-44dc-a588-df5cb0b2bb66 req-4d320623-af64-4c27-a850-ed1df6b530b6 service nova] Creating event network-vif-plugged:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:58:09.803504 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f4ee1b41-9e03-44dc-a588-df5cb0b2bb66 req-4d320623-af64-4c27-a850-ed1df6b530b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089397 Jul 01 10:58:09.805962 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2751/5599] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:58:10.040093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:10.050061 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:10.052481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:10.054001 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d08f0178-dcf6-43fe-b4c9-2427ed4d7dbc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.322214 Jul 01 10:58:10.066647 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2849/5600] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:09 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:11.074747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:11.076131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:11.083667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:11.084209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:11.085062 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:11.085633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:11.292800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:11.307840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:11.310839 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:11.313040 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-774def54-6c1d-4d62-ae77-7dd420c30385 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.243322 Jul 01 10:58:11.314167 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2752/5601] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:11 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:12.337515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:12.338769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:12.346016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:12.346650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:12.347758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:12.348343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:12.604208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:12.631323 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:12.633596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:12.635531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c69455d3-9db3-4c0d-b021-b42c4eca62db tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.301730 Jul 01 10:58:12.647264 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2850/5602] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:12 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:12.747714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "985c2383-57ee-4e24-b64a-704696663273"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:12.748844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:12.765622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:12.765622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:12.765622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:12.765622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:12.860961 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Invalid volume: volume 985c2383-57ee-4e24-b64a-704696663273 is already attached to instances: 426aecd8-2290-4d35-aba7-bf5cf900f1e0 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments HTTP/1.1 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 74 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: {"volumeAttachment": {"volumeId": "985c2383-57ee-4e24-b64a-704696663273"}} Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid volume: volume 985c2383-57ee-4e24-b64a-704696663273 is already attached to instances: 426aecd8-2290-4d35-aba7-bf5cf900f1e0 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '426aecd8-2290-4d35-aba7-bf5cf900f1e0', 'body': {'volumeAttachment': {'volumeId': '985c2383-57ee-4e24-b64a-704696663273'}}} Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 985c2383-57ee-4e24-b64a-704696663273 is already attached to instances: 426aecd8-2290-4d35-aba7-bf5cf900f1e0 Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:58:12.862762 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 985c2383-57ee-4e24-b64a-704696663273 is already attached to instances: 426aecd8-2290-4d35-aba7-bf5cf900f1e0 Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 985c2383-57ee-4e24-b64a-704696663273 is already attached to instances: 426aecd8-2290-4d35-aba7-bf5cf900f1e0 Jul 01 10:58:12.866920 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:12.869933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 400 to user: Invalid volume: volume 985c2383-57ee-4e24-b64a-704696663273 is already attached to instances: 426aecd8-2290-4d35-aba7-bf5cf900f1e0 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:58:12.870825 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c63675c5-98b0-4443-b3c1-b544fdadcf07 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127489 Jul 01 10:58:12.874918 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2753/5603] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:58:12 2022] POST /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 10:58:12.964195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:12.964969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:12.971944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:12.972503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:12.973302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:12.973735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:13.091783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lazy-loading 'services' on Instance uuid 426aecd8-2290-4d35-aba7-bf5cf900f1e0 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:58:13.276408 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5112ce08-8a99-4dcf-8958-0b97faeb23d8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments/985c2383-57ee-4e24-b64a-704696663273" status: 202 len: 0 microversion: 2.1 time: 0.317551 Jul 01 10:58:13.277385 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2851/5604] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:58:12 2022] DELETE /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments/985c2383-57ee-4e24-b64a-704696663273 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:58:13.285289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1b4ea3e4-d9b0-4cb9-ad94-72c89f6ca233 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:13.286284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1b4ea3e4-d9b0-4cb9-ad94-72c89f6ca233 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:13.299331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b4ea3e4-d9b0-4cb9-ad94-72c89f6ca233 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:13.299892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b4ea3e4-d9b0-4cb9-ad94-72c89f6ca233 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:13.300854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b4ea3e4-d9b0-4cb9-ad94-72c89f6ca233 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:13.301324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b4ea3e4-d9b0-4cb9-ad94-72c89f6ca233 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:13.341298 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1b4ea3e4-d9b0-4cb9-ad94-72c89f6ca233 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059831 Jul 01 10:58:13.346062 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2754/5605] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:13 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:13.676666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:13.677515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:13.688286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:13.690747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:13.691592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:13.692012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:13.913116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:13.923270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:13.924797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:13.926211 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e8111f99-a615-4c07-8521-fb88b9815ebf tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.254017 Jul 01 10:58:13.938728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2852/5606] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:13 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:14.353962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-346c5cc7-e13b-4542-a0a8-6184556282ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:14.355490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-346c5cc7-e13b-4542-a0a8-6184556282ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:14.363623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-346c5cc7-e13b-4542-a0a8-6184556282ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:14.364292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-346c5cc7-e13b-4542-a0a8-6184556282ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:14.365290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-346c5cc7-e13b-4542-a0a8-6184556282ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:14.365916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-346c5cc7-e13b-4542-a0a8-6184556282ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:14.403396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-346c5cc7-e13b-4542-a0a8-6184556282ec tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053386 Jul 01 10:58:14.404722 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2755/5607] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:14 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:14.948794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:14.950386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:14.958648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:14.959235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:14.960175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:14.961401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:14.992161 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:15.289648 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:15.305413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:15.307247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:15.309901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5710acd7-db98-4762-8f66-314f7492383d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.365914 Jul 01 10:58:15.322925 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2853/5608] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:14 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:15.416131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7228279-53ce-40b8-828f-97623cf7cb71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:15.417075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c7228279-53ce-40b8-828f-97623cf7cb71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:15.430194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7228279-53ce-40b8-828f-97623cf7cb71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:15.430651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7228279-53ce-40b8-828f-97623cf7cb71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:15.431437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7228279-53ce-40b8-828f-97623cf7cb71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:15.431875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7228279-53ce-40b8-828f-97623cf7cb71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:15.493100 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c7228279-53ce-40b8-828f-97623cf7cb71 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081450 Jul 01 10:58:15.494267 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2756/5609] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:15 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:58:16.336410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:16.336410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:16.343424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:16.344026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:16.344948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:16.345521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:16.504984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-220d8757-b2d7-411b-bc1d-8d84d5f88676 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:16.506035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-220d8757-b2d7-411b-bc1d-8d84d5f88676 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:16.519785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-220d8757-b2d7-411b-bc1d-8d84d5f88676 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:16.519785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-220d8757-b2d7-411b-bc1d-8d84d5f88676 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:16.519785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-220d8757-b2d7-411b-bc1d-8d84d5f88676 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:16.519785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-220d8757-b2d7-411b-bc1d-8d84d5f88676 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:16.557894 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-220d8757-b2d7-411b-bc1d-8d84d5f88676 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056801 Jul 01 10:58:16.559385 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2757/5610] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:16 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:58:16.582264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:16.592931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:16.594475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:16.605308 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00fc51ca-4fa4-457d-91cf-9307dd1a6963 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.267653 Jul 01 10:58:16.605308 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2854/5611] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:16 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:17.572414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-272afe9f-eb4e-4081-bf95-44fd56ef4ac3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:17.575143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-272afe9f-eb4e-4081-bf95-44fd56ef4ac3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:17.585289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272afe9f-eb4e-4081-bf95-44fd56ef4ac3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:17.586322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272afe9f-eb4e-4081-bf95-44fd56ef4ac3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:17.587313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272afe9f-eb4e-4081-bf95-44fd56ef4ac3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:17.587752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-272afe9f-eb4e-4081-bf95-44fd56ef4ac3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:17.617830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:17.619029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:17.626757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:17.627447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:17.628441 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-272afe9f-eb4e-4081-bf95-44fd56ef4ac3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061801 Jul 01 10:58:17.628619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:17.629211 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:17.629798 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2758/5612] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:17 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:17.849663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:17.864863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:17.868603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:17.872159 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d968b310-14c5-43e3-bff8-7f1a08b38f63 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.257218 Jul 01 10:58:17.872159 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2855/5613] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:17 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:18.649331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4232934-c509-4b1c-8136-3f3396cb2922 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:18.650275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f4232934-c509-4b1c-8136-3f3396cb2922 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:18.657520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4232934-c509-4b1c-8136-3f3396cb2922 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:18.657979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4232934-c509-4b1c-8136-3f3396cb2922 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:18.658815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4232934-c509-4b1c-8136-3f3396cb2922 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:18.659252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4232934-c509-4b1c-8136-3f3396cb2922 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:18.718341 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f4232934-c509-4b1c-8136-3f3396cb2922 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073575 Jul 01 10:58:18.720452 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2759/5614] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:18 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:18.891172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:18.891172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:18.898168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:18.898611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:18.899401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:18.899839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:19.128086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:19.138151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:19.140714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:19.141199 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-faf13c66-c680-4803-b950-e471770ed494 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.254953 Jul 01 10:58:19.141933 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2856/5615] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:18 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:19.733998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d163ac2b-31b9-4b7f-b776-5653509b46b4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:19.735085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d163ac2b-31b9-4b7f-b776-5653509b46b4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:19.748523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d163ac2b-31b9-4b7f-b776-5653509b46b4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:19.750833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d163ac2b-31b9-4b7f-b776-5653509b46b4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:19.750833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d163ac2b-31b9-4b7f-b776-5653509b46b4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:19.751154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d163ac2b-31b9-4b7f-b776-5653509b46b4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:19.784591 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d163ac2b-31b9-4b7f-b776-5653509b46b4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058311 Jul 01 10:58:19.789010 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2760/5616] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:19 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:20.161491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:20.163020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:20.181961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:20.183886 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:20.187114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:20.187640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:20.474148 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:20.489981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:20.494645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:20.496242 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81b3c238-8e4e-4683-9583-05866774c295 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.339612 Jul 01 10:58:20.497485 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2857/5617] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:20 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:20.800453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d4c5fce2-5e18-4741-bcae-f402c21c4f0f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:20.802883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d4c5fce2-5e18-4741-bcae-f402c21c4f0f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:20.814193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4c5fce2-5e18-4741-bcae-f402c21c4f0f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:20.814961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4c5fce2-5e18-4741-bcae-f402c21c4f0f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:20.815950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4c5fce2-5e18-4741-bcae-f402c21c4f0f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:20.816632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4c5fce2-5e18-4741-bcae-f402c21c4f0f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:20.861005 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d4c5fce2-5e18-4741-bcae-f402c21c4f0f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068270 Jul 01 10:58:20.862368 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2761/5618] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:58:20 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:58:20.936933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:20.942044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:20.944516 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:20.945164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:20.945978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:20.946405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:20.973083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:58:21.337387 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-67eed4bc-fc3e-48bf-b787-2c5944d30a4f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 204 len: 0 microversion: 2.1 time: 0.404570 Jul 01 10:58:21.339077 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2858/5619] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:58:20 2022] DELETE /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:58:21.348508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:21.349337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:21.362662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:21.362662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:21.362662 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:21.363207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:21.516055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:21.517105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:21.526297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:21.528431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:21.530221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:21.530666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:21.677301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:21.703338 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-34558ad9-99e8-4c53-a578-a7167754a939 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1683 microversion: 2.1 time: 0.359602 Jul 01 10:58:21.705814 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2762/5620] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:21 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1683 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:21.808574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:21.821864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:21.830567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:21.830567 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-785246a8-43d2-4103-b3d5-4ca141858fdc tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.314376 Jul 01 10:58:21.830567 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2859/5621] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:21 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:22.722122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:22.723033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:22.730689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:22.731750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:22.733673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:22.734481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:22.848355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:22.849851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:22.859667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:22.860730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:22.868493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:22.868493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:23.054675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:23.066679 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:23.074566 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f60719e1-0890-486a-90e9-ff085186d8cc tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1683 microversion: 2.1 time: 0.354962 Jul 01 10:58:23.077469 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2763/5622] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:22 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1683 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:23.168480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:23.180532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:23.183195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:23.185400 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-482f8e71-de19-4e2d-a02b-f07cfaaff7ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.341280 Jul 01 10:58:23.198277 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2860/5623] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:22 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:58:24.011091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-272311189", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "f6dc4dcc-124b-44ec-90bd-bd9bf06b44e5"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:24.077990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] validate_networks() for [('f6dc4dcc-124b-44ec-90bd-bd9bf06b44e5', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:58:24.093380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:24.095757 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:24.106938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:24.108458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:24.110184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:24.113175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:24.211641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:24.220893 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-565dd2e6-915b-4363-bdcc-cec2847dc9a5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1615 microversion: 2.1 time: 0.132171 Jul 01 10:58:24.221533 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2861/5624] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:24 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1615 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:24.227363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:24.228170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:24.234350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:24.234801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:24.235816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:24.236258 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:24.581332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:24.597837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:24.599344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:24.600501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4af7097b-96b6-484d-a947-3f17f67f1ca3 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.377851 Jul 01 10:58:24.639298 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2862/5625] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:24 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:24.701301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b9d13e5a-a9da-47d4-b9ce-99f3a568ecb5 req-b187d701-a2bc-423c-b976-282b72124799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426aecd8-2290-4d35-aba7-bf5cf900f1e0", "name": "network-vif-deleted", "tag": "1df1b029-3ae1-4ca8-8084-abdf2eec4749"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:24.714470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b9d13e5a-a9da-47d4-b9ce-99f3a568ecb5 req-b187d701-a2bc-423c-b976-282b72124799 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:24.715159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b9d13e5a-a9da-47d4-b9ce-99f3a568ecb5 req-b187d701-a2bc-423c-b976-282b72124799 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:24.726893 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b9d13e5a-a9da-47d4-b9ce-99f3a568ecb5 req-b187d701-a2bc-423c-b976-282b72124799 service nova] Creating event network-vif-deleted:1df1b029-3ae1-4ca8-8084-abdf2eec4749 for instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 on n-h2-master-1 Jul 01 10:58:24.732381 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b9d13e5a-a9da-47d4-b9ce-99f3a568ecb5 req-b187d701-a2bc-423c-b976-282b72124799 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118693 Jul 01 10:58:24.732999 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2863/5626] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:24.839915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:58:24.840399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:58:24.840982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:58:24.841598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:58:24.842222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:58:24.857984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:24.858718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:24.859734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:24.860558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:24.888049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Getting quotas for project 00389c8362164e7383579785af4706d1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:58:24.895200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Getting quotas for user d91054c43200415cbda26ec365faf269 and project 00389c8362164e7383579785af4706d1. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:58:24.917344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:58:24.920010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:58:25.243547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:25.248396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:25.267155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:25.267155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:25.267155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:25.267155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:25.316767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:25.318877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:25.320339 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lazy-loading 'fault' on Instance uuid 426aecd8-2290-4d35-aba7-bf5cf900f1e0 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:58:25.354384 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bab7428f-20c6-4a2b-b4b6-423398320ef6 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473307 Jul 01 10:58:25.355591 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2764/5627] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:58:25.374277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1006ea32-7f55-439b-9027-869b9fb7127d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:25.375278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1006ea32-7f55-439b-9027-869b9fb7127d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:25.439878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:25.449196 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-893a61bd-a7f3-44fb-8b74-b5e89d94515d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 200 len: 1331 microversion: 2.1 time: 0.213288 Jul 01 10:58:25.449787 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2864/5628] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:25 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 1331 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:25.524951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1006ea32-7f55-439b-9027-869b9fb7127d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:25.534396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1006ea32-7f55-439b-9027-869b9fb7127d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1213 microversion: 2.1 time: 0.172716 Jul 01 10:58:25.535399 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2765/5629] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:25 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:25.651143 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:25.652564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:25.661499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:25.662336 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:25.668073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:25.670526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:25.990011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:26.000529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:26.002714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:26.003894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ffbd59d-ab52-43cb-ada7-88fedf001cb9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.363090 Jul 01 10:58:26.004461 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2865/5630] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:25 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:26.467033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:26.468543 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:26.477308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:26.478052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:26.479074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:26.479747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:26.499269 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 HTTP/1.1 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '426aecd8-2290-4d35-aba7-bf5cf900f1e0'} Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:26.501078 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82f8f7a8-64a1-4d72-a0f8-581b7eeeb321 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 404 len: 111 microversion: 2.1 time: 0.039546 Jul 01 10:58:26.510520 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2766/5631] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:26 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:58:26.515748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-152c7a5d-2934-43bc-aab1-6f5911188798 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '.version_select at 0x7f6f90b8cd30>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:26.553138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a976681-ce1a-4976-8842-3262ecbaec10 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:26.555148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0a976681-ce1a-4976-8842-3262ecbaec10 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:26.597989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-152c7a5d-2934-43bc-aab1-6f5911188798 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619567855" status: 202 len: 0 microversion: 2.1 time: 0.087231 Jul 01 10:58:26.599262 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2866/5632] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 10:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619567855 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:58:26.640724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0a976681-ce1a-4976-8842-3262ecbaec10 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:26.649176 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a976681-ce1a-4976-8842-3262ecbaec10 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1213 microversion: 2.1 time: 0.101104 Jul 01 10:58:26.658977 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2767/5633] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:26 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:27.037846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:27.041589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:27.060142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:27.062323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:27.063388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:27.065713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:27.369628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:27.391674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:27.394572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:27.407941 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e725098e-d89b-40ac-9978-8c62f411ade8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.373767 Jul 01 10:58:27.407941 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2867/5634] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:27 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:27.668546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:27.669163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:27.672197 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:27.690677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:27.693742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:27.695345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:27.696002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:27.779359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4550f22-14e5-4a6d-9ce7-fa2044f3165c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: .version_select at 0x7f6f90b410d0>, body: {"keypair": {"name": "tempest-keypair-981196586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxZgv2Ise6aKw9kM3Wxl3uKwXr4abngPJ8Li2aTG91Ob0ZkbzVdRIeInzQS14dJoCnyiHIEfouM/5pa3y3IbVGpreLiHPzzkAmQ9kK6F3xg0gBoHfKkXgi1qv2N1jSUlA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:27.797178 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:27.801343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:27.825461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b6d794b-870f-4c73-afe8-b57f1bc72ac9 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1265 microversion: 2.1 time: 0.161243 Jul 01 10:58:27.829637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2768/5635] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:27 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:27.841251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b4550f22-14e5-4a6d-9ce7-fa2044f3165c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:58:27.849833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b4550f22-14e5-4a6d-9ce7-fa2044f3165c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:58:27.984903 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4550f22-14e5-4a6d-9ce7-fa2044f3165c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.210714 Jul 01 10:58:27.986072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2868/5636] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:58:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:28.417048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:28.418086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:28.435916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:28.436471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:28.437501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:28.438155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:28.681842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:28.695107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:28.696952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:28.698535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a44e338-0ba9-4ea0-9e3b-b3bbe827e314 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.286742 Jul 01 10:58:28.699459 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2769/5637] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:28 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:58:28.847367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:28.848022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:28.865397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:28.865851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:28.867197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:28.867619 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:28.953826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:28.963283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08ccdc9a-4815-4e30-8838-e72463665f6c tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1271 microversion: 2.1 time: 0.122258 Jul 01 10:58:28.964162 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2869/5638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:28 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:29.718204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:29.719006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:29.734697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:29.735499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:29.736459 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:29.737537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:29.986794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:29.987409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:30.018364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:30.018364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:30.018364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:30.018364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:30.256174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:30.267837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:30.270338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:30.275751 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c271bb3a-bfec-48e8-9f8f-3b049ff0801d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.561825 Jul 01 10:58:30.276507 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2770/5639] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:29 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:30.301193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:30.305709 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:30.323679 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bf3a4866-cfd1-442c-a5bf-c4f26fc3b771 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.340918 Jul 01 10:58:30.324586 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2870/5640] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:29 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:30.390507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f03267c7-dcca-4264-95dc-9629f117cb19 req-3fc3f26d-6813-4f7e-b729-8145d8ca4e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9498fdce-0fa4-434e-acd8-b0ea9945f260", "tag": "ab8be7ef-f65c-4cae-a50a-1f17513d90fe"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:30.406501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f03267c7-dcca-4264-95dc-9629f117cb19 req-3fc3f26d-6813-4f7e-b729-8145d8ca4e2e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:30.407479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f03267c7-dcca-4264-95dc-9629f117cb19 req-3fc3f26d-6813-4f7e-b729-8145d8ca4e2e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:30.430642 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f03267c7-dcca-4264-95dc-9629f117cb19 req-3fc3f26d-6813-4f7e-b729-8145d8ca4e2e service nova] Creating event network-changed:ab8be7ef-f65c-4cae-a50a-1f17513d90fe for instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 on n-h2-master-1 Jul 01 10:58:30.437067 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f03267c7-dcca-4264-95dc-9629f117cb19 req-3fc3f26d-6813-4f7e-b729-8145d8ca4e2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052680 Jul 01 10:58:30.438214 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2771/5641] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:31.217561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-207814404", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54ddbd62-ac58-4a67-a02d-423b9dfccc04"}], "security_groups": [{"name": "tempest-securitygroup--723596296"}], "key_name": "tempest-keypair-981196586", "user_data": "}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:31.311598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:31.316563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:31.323826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:31.324370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:31.325243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:31.325937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:31.374688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] validate_networks() for [('54ddbd62-ac58-4a67-a02d-423b9dfccc04', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:58:31.662349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:31.675179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:31.677082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:31.678393 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7eb53f56-22dc-4eee-8684-db2ec00f7ab6 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.385576 Jul 01 10:58:31.686490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2772/5642] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:31 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:31.686490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:31.687241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:31.697350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:31.697927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:31.701898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:31.701898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:31.950138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:31.957459 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc7fd2ba-545d-4ea5-afa6-dde247596940 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.275792 Jul 01 10:58:31.978733 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2773/5643] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:31 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:31.992143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-421a1b6d-df4b-4d93-9235-f6d6ffbff68b req-879894f1-5b26-4adf-b466-f4e7adc4abfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-plugged", "status": "completed", "tag": "77966735-1c04-4005-be41-194f63188932"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:32.002979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-421a1b6d-df4b-4d93-9235-f6d6ffbff68b req-879894f1-5b26-4adf-b466-f4e7adc4abfd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.007750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-421a1b6d-df4b-4d93-9235-f6d6ffbff68b req-879894f1-5b26-4adf-b466-f4e7adc4abfd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.027899 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-421a1b6d-df4b-4d93-9235-f6d6ffbff68b req-879894f1-5b26-4adf-b466-f4e7adc4abfd service nova] Creating event network-vif-plugged:77966735-1c04-4005-be41-194f63188932 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:32.034169 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-421a1b6d-df4b-4d93-9235-f6d6ffbff68b req-879894f1-5b26-4adf-b466-f4e7adc4abfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051848 Jul 01 10:58:32.034998 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2774/5644] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:32.041280 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-53fbc2f2-35ff-4d48-8198-33fc3fdac3b8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:32.042567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-53fbc2f2-35ff-4d48-8198-33fc3fdac3b8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:32.049294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53fbc2f2-35ff-4d48-8198-33fc3fdac3b8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.050028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53fbc2f2-35ff-4d48-8198-33fc3fdac3b8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.050967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53fbc2f2-35ff-4d48-8198-33fc3fdac3b8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.051546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53fbc2f2-35ff-4d48-8198-33fc3fdac3b8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.132922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:58:32.136516 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:58:32.137215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:58:32.138058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:58:32.139200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:58:32.160722 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-53fbc2f2-35ff-4d48-8198-33fc3fdac3b8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action" status: 200 len: 63179 microversion: 2.1 time: 0.121856 Jul 01 10:58:32.164185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.164871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.166462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.166679 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2775/5645] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:58:32 2022] POST /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51/action => generated 63179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:58:32.167321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.188604 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:58:32.195226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Getting quotas for user c8bcd1d3a1bd400e8ceb24213bf04cd8 and project ad6adb79b33148c19ad178ec781bbb3f. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:58:32.210932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:58:32.213303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:58:32.338075 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-71a6a6d3-8000-4a1c-9298-fcd692b5d443 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.126257 Jul 01 10:58:32.344324 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2871/5646] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:58:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:58:32.350566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fde7a713-5b15-4b5d-917e-42012c29fc70 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:32.351819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fde7a713-5b15-4b5d-917e-42012c29fc70 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:32.443306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fde7a713-5b15-4b5d-917e-42012c29fc70 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:32.451046 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fde7a713-5b15-4b5d-917e-42012c29fc70 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1240 microversion: 2.1 time: 0.104882 Jul 01 10:58:32.451654 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2776/5647] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:32 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:32.698590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:32.699492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:32.718598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.718598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.720206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.722062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.926528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:32.937661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:32.939805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:32.940982 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0d08a39-4a0b-442c-a6c7-49bfa0b8ee72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.246559 Jul 01 10:58:32.942072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2872/5648] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:32 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:32.977728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:32.978558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:32.989415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.990397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:32.992441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:32.993467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:33.142863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:33.153830 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-22814bab-5357-4d49-8a20-646021715707 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.182478 Jul 01 10:58:33.164106 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2777/5649] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:32 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:33.467843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:33.468869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:33.481923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:33.489292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:33.490889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:33.492164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:33.566911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:33.575280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3fad226-21bd-47aa-b417-b342f1d54d6a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1244 microversion: 2.1 time: 0.111217 Jul 01 10:58:33.575871 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2873/5650] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:33 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:33.960987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:33.961765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:33.968769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:33.969357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:33.970194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:33.970726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:34.083923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0d07161e-c712-45bf-8363-765c2d8d6bbe req-7f8f3299-b6e8-4142-9c61-b55074d648fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-plugged", "status": "completed", "tag": "cdd11166-d74f-4788-82c7-c9ebb45b251f"}, {"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-plugged", "status": "completed", "tag": "28700afe-1082-43ca-8db3-5596ec5ccaf8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:34.099791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0d07161e-c712-45bf-8363-765c2d8d6bbe req-7f8f3299-b6e8-4142-9c61-b55074d648fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:34.099791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0d07161e-c712-45bf-8363-765c2d8d6bbe req-7f8f3299-b6e8-4142-9c61-b55074d648fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:34.113609 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0d07161e-c712-45bf-8363-765c2d8d6bbe req-7f8f3299-b6e8-4142-9c61-b55074d648fb service nova] Creating event network-vif-plugged:cdd11166-d74f-4788-82c7-c9ebb45b251f for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:34.114368 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0d07161e-c712-45bf-8363-765c2d8d6bbe req-7f8f3299-b6e8-4142-9c61-b55074d648fb service nova] Creating event network-vif-plugged:28700afe-1082-43ca-8db3-5596ec5ccaf8 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:34.120678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0d07161e-c712-45bf-8363-765c2d8d6bbe req-7f8f3299-b6e8-4142-9c61-b55074d648fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040720 Jul 01 10:58:34.121747 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2874/5651] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:58:34.167373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:34.177231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:34.178790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:34.180203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93bbb102-9347-45d0-9dfd-c303fbc97f20 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.223819 Jul 01 10:58:34.181216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:34.181354 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2778/5652] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:33 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:34.182258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:34.191684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:34.195680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:34.195680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:34.195680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:34.381017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:34.390490 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9eb6a58-1a31-49b4-9b34-698dc5f800dc tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.217723 Jul 01 10:58:34.401985 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2875/5653] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:34 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:34.592017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:34.592954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:34.600006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:34.601246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:34.602268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:34.602891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:34.734622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:34.743292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c223ea21-9d57-4b53-a21a-01e98158ef54 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1310 microversion: 2.1 time: 0.155104 Jul 01 10:58:34.744376 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2779/5654] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:34 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:35.200717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:35.204436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:35.220810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:35.221531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:35.222869 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:35.223631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:35.409463 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:35.410202 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:35.417646 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:35.430363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:35.431250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:35.433598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:35.435377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:35.531939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:35.548679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:35.550308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:35.551602 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2a82adf-c29b-4fe1-b3ae-8ef2ce5ea4cb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.355376 Jul 01 10:58:35.552393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2876/5655] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:35 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:35.747216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:35.759935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:35.760540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:35.767083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:35.779909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:35.779909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:35.779909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:35.780208 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee7f5583-81de-43a5-b260-d8b6aa99e11d tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.372882 Jul 01 10:58:35.790888 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2780/5656] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:35 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:35.890172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:35.899546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-df816972-f410-4070-b3ff-9008667bfa99 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1298 microversion: 2.1 time: 0.143554 Jul 01 10:58:35.900718 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2877/5657] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:35 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:36.143559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ddd826f9-99a6-46f2-a0ab-e81c459c1598 req-1b0733b9-97cc-4fb6-bf33-e3e379f1c3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-plugged", "status": "completed", "tag": "7360206d-5c44-4232-a000-d876f44d6379"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:36.153605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ddd826f9-99a6-46f2-a0ab-e81c459c1598 req-1b0733b9-97cc-4fb6-bf33-e3e379f1c3f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:36.154200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ddd826f9-99a6-46f2-a0ab-e81c459c1598 req-1b0733b9-97cc-4fb6-bf33-e3e379f1c3f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:36.168573 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ddd826f9-99a6-46f2-a0ab-e81c459c1598 req-1b0733b9-97cc-4fb6-bf33-e3e379f1c3f4 service nova] Creating event network-vif-plugged:7360206d-5c44-4232-a000-d876f44d6379 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:36.178560 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ddd826f9-99a6-46f2-a0ab-e81c459c1598 req-1b0733b9-97cc-4fb6-bf33-e3e379f1c3f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038673 Jul 01 10:58:36.180356 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2781/5658] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:36.596443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:36.597815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:36.607184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:36.607785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:36.608572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:36.609007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:36.794437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:36.795847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:36.808309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:36.813614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:36.813614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:36.813614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:36.997780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:37.007805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:37.009334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:37.010529 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3196c672-0926-43f7-9708-5dfa40b7f506 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.436247 Jul 01 10:58:37.018159 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2878/5659] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:36 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:37.023489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:37.028824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:37.049073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:37.049073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:37.052365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:37.052946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:37.221058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:37.229365 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13e73ef0-6790-4f08-b189-30b3d130dae5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.439238 Jul 01 10:58:37.233369 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2782/5660] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:36 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:37.406376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:37.415346 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8bfd9bb8-468c-45b7-b73a-e225b31df775 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1365 microversion: 2.1 time: 0.395687 Jul 01 10:58:37.416253 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2879/5661] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:37 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:37.610308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-624646ae-95e9-4a19-b789-33cb29ed15b0 req-88e03c17-5c78-42f2-9065-f43b204aa74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fb7fbd-a894-4725-8e33-a863e6c4a827", "tag": "295b8b5b-9e30-4992-b81a-4f6d8fc32ad6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:37.619436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-624646ae-95e9-4a19-b789-33cb29ed15b0 req-88e03c17-5c78-42f2-9065-f43b204aa74c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:37.620150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-624646ae-95e9-4a19-b789-33cb29ed15b0 req-88e03c17-5c78-42f2-9065-f43b204aa74c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:37.646963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-624646ae-95e9-4a19-b789-33cb29ed15b0 req-88e03c17-5c78-42f2-9065-f43b204aa74c service nova] Creating event network-changed:295b8b5b-9e30-4992-b81a-4f6d8fc32ad6 for instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 on n-h1-master-1 Jul 01 10:58:37.650901 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-624646ae-95e9-4a19-b789-33cb29ed15b0 req-88e03c17-5c78-42f2-9065-f43b204aa74c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037079 Jul 01 10:58:37.652510 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2783/5662] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:38.040713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:38.042076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:38.049803 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.050637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.051492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.051994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.198639 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-plugged", "status": "completed", "tag": "044f5b59-e5a0-48b2-864b-fb9be08789bb"}, {"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-plugged", "status": "completed", "tag": "7753f5a0-0a8b-4a41-ae5e-b645aa7af02d"}, {"server_uuid": "9498fdce-0fa4-434e-acd8-b0ea9945f260", "name": "network-vif-plugged", "status": "completed", "tag": "ab8be7ef-f65c-4cae-a50a-1f17513d90fe"}, {"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-plugged", "status": "completed", "tag": "f9e52211-0bf8-46b1-b47d-8a0ba09d2159"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:38.215454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.215974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.240492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] Creating event network-vif-plugged:044f5b59-e5a0-48b2-864b-fb9be08789bb for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:38.242015 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] Creating event network-vif-plugged:7753f5a0-0a8b-4a41-ae5e-b645aa7af02d for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:38.242820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] Creating event network-vif-plugged:ab8be7ef-f65c-4cae-a50a-1f17513d90fe for instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 on n-h2-master-1 Jul 01 10:58:38.243658 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] Creating event network-vif-plugged:f9e52211-0bf8-46b1-b47d-8a0ba09d2159 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:38.254514 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-75c6dc40-e16c-4ae9-9a41-8a0e6825085c req-8f48c157-c627-44ba-8ca0-c6b774df05cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.060752 Jul 01 10:58:38.255890 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2784/5663] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:38.265262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:38.267187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:38.276166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.277043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.278349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.279036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.312144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:38.332790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:38.334684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:38.336586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60b9deab-eee6-42e0-b289-f8312aec0d00 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.300333 Jul 01 10:58:38.337159 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2880/5664] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:38 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:38.592786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ceda35a-0563-4c2f-927b-9c7b4c5da9f5 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:38.593426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ceda35a-0563-4c2f-927b-9c7b4c5da9f5 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:38.604762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ceda35a-0563-4c2f-927b-9c7b4c5da9f5 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.605255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ceda35a-0563-4c2f-927b-9c7b4c5da9f5 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.606045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ceda35a-0563-4c2f-927b-9c7b4c5da9f5 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.606482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ceda35a-0563-4c2f-927b-9c7b4c5da9f5 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.637749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:38.648688 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8db50254-4f3a-4283-b8e5-9246e1354103 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.390158 Jul 01 10:58:38.649300 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2785/5665] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:38 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:38.656832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:38.658346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:38.666283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.666901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.667755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:38.668268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:38.931133 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ceda35a-0563-4c2f-927b-9c7b4c5da9f5 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1834 microversion: 2.1 time: 0.508136 Jul 01 10:58:38.933434 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2881/5666] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:38 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1834 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 10:58:38.951170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:38.958959 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cba988f9-b683-4cae-9b99-30f10bc3ea61 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1365 microversion: 2.1 time: 0.308670 Jul 01 10:58:38.960054 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2786/5667] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:38 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:39.357297 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:39.357921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:39.371688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:39.372144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:39.372931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:39.373650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:39.618025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:39.641965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:39.649279 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:39.649279 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c511b731-e334-4e81-8726-e8777aa1a5d4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.293247 Jul 01 10:58:39.649279 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2882/5668] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:39 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:39.666156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:39.667932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:39.676339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:39.679189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:39.679189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:39.679189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:39.855953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:39.865326 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cca4199e-ecdd-4892-b681-e2e7d98ffc8f tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1313 microversion: 2.1 time: 0.203432 Jul 01 10:58:39.866193 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2787/5669] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:39 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:39.978147 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:39.979184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:39.987396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:39.988464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:39.989508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:39.990355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:40.169477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:40.178973 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-457b3275-d008-4956-a562-807784638905 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1365 microversion: 2.1 time: 0.206546 Jul 01 10:58:40.180030 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2883/5670] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:39 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:40.356290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:40.356983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:40.358210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8b96900b-ba00-4184-9c5f-04b089110d70 req-cb5ec7c1-43c0-47eb-a3b3-b9acd1c79166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:40.365294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:40.367567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:40.368569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:40.369220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:40.377019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8b96900b-ba00-4184-9c5f-04b089110d70 req-cb5ec7c1-43c0-47eb-a3b3-b9acd1c79166 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:40.377629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8b96900b-ba00-4184-9c5f-04b089110d70 req-cb5ec7c1-43c0-47eb-a3b3-b9acd1c79166 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:40.386966 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:40.403688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:58:40.404879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8b96900b-ba00-4184-9c5f-04b089110d70 req-cb5ec7c1-43c0-47eb-a3b3-b9acd1c79166 service nova] Creating event network-changed:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:58:40.429668 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8b96900b-ba00-4184-9c5f-04b089110d70 req-cb5ec7c1-43c0-47eb-a3b3-b9acd1c79166 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074149 Jul 01 10:58:40.430786 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2884/5671] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:40.669268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:40.669981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:40.676721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:40.677348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:40.681464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:40.681464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:40.699749 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d25da45b-a913-4f38-a650-3cb9518e3e4f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 204 len: 0 microversion: 2.1 time: 0.350920 Jul 01 10:58:40.701814 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2788/5672] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:58:40 2022] DELETE /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:58:40.711504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:40.712569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:40.720709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:40.721700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:40.722699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:40.723348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:41.011174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:41.023371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:41.024863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:41.026050 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f9693fd0-9c26-4ed7-97ed-b787daa58f33 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1877 microversion: 2.32 time: 0.363613 Jul 01 10:58:41.026615 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2885/5673] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:40 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1877 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 10:58:41.041304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:41.041931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:41.062524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:41.062979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:41.063758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:41.064477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:41.072214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:41.089073 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42bb62fc-2695-465c-8af0-3576770d787c tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1689 microversion: 2.1 time: 0.382668 Jul 01 10:58:41.089706 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2789/5674] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:40 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1689 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:41.263633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:41.281501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:41.281501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:41.288963 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86090305-ca10-4bba-8f1f-8fa040a619b5 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1497 microversion: 2.1 time: 0.244835 Jul 01 10:58:41.290607 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2886/5675] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:41 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:41.291477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:41.291933 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:41.292912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:41.293550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:41.517227 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:41.527286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8400b49-f64d-4fd9-90e8-4740d69975a9 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1365 microversion: 2.1 time: 0.334152 Jul 01 10:58:41.539939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2790/5676] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:41 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:42.045936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:42.046543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:42.054395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.054927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.056354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.064272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.115022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:42.118060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:42.131455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.132032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.133970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.134432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.178181 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:42.206115 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:42.448239 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:42.618825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:42.631530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-63b944e4-dd71-44c3-a531-d37f133978dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1689 microversion: 2.1 time: 0.522416 Jul 01 10:58:42.632388 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2791/5677] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:42 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1689 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:42.638788 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:42.639714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:42.646437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.647046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:42.647503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.648524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.649430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.666995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:42.668518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:42.669850 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-36f4ab0f-cedf-45cb-8ce7-b812f3413d58 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2829 microversion: 2.32 time: 0.629024 Jul 01 10:58:42.687097 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2887/5678] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 10:58:42 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2829 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:42.710768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c3e1642-5e9c-4118-b31c-840dfc16b586 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:42.712109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c3e1642-5e9c-4118-b31c-840dfc16b586 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:42.733414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c3e1642-5e9c-4118-b31c-840dfc16b586 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.756738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c3e1642-5e9c-4118-b31c-840dfc16b586 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.756738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c3e1642-5e9c-4118-b31c-840dfc16b586 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:42.756738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c3e1642-5e9c-4118-b31c-840dfc16b586 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:42.983638 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c3e1642-5e9c-4118-b31c-840dfc16b586 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.295249 Jul 01 10:58:42.984830 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2888/5679] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Jul 1 10:58:42 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281/os-interface => generated 1831 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 10:58:43.176025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:43.187247 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14faf73e-6d06-45b5-8484-b73d4a036d5a tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1365 microversion: 2.1 time: 0.552744 Jul 01 10:58:43.198437 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2792/5680] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:42 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1365 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:43.440763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-dfd90c0e-d6f6-4147-bf14-4401f73b1f6f req-f9c1331f-d7d2-4892-bcdb-ebf59244d171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fb7fbd-a894-4725-8e33-a863e6c4a827", "name": "network-vif-plugged", "status": "completed", "tag": "295b8b5b-9e30-4992-b81a-4f6d8fc32ad6"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:43.451932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-dfd90c0e-d6f6-4147-bf14-4401f73b1f6f req-f9c1331f-d7d2-4892-bcdb-ebf59244d171 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:43.452671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-dfd90c0e-d6f6-4147-bf14-4401f73b1f6f req-f9c1331f-d7d2-4892-bcdb-ebf59244d171 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:43.466022 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-dfd90c0e-d6f6-4147-bf14-4401f73b1f6f req-f9c1331f-d7d2-4892-bcdb-ebf59244d171 service nova] Creating event network-vif-plugged:295b8b5b-9e30-4992-b81a-4f6d8fc32ad6 for instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 on n-h1-master-1 Jul 01 10:58:43.471598 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-dfd90c0e-d6f6-4147-bf14-4401f73b1f6f req-f9c1331f-d7d2-4892-bcdb-ebf59244d171 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036527 Jul 01 10:58:43.479287 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2889/5681] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:43.663721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:43.663721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:43.704764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:43.705446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:43.706290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:43.706903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:44.040167 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a6d429bb-1d5c-475a-bf58-ed96733767f5 req-157fb53f-e73d-4d37-be7e-61d25e1a8a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab01774-32df-4cc9-b5ac-81f5beb05a51", "name": "network-vif-deleted", "tag": "60756b6e-f6e0-4495-9d3f-ea9d8dd2704a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:44.058689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a6d429bb-1d5c-475a-bf58-ed96733767f5 req-157fb53f-e73d-4d37-be7e-61d25e1a8a35 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:44.059392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a6d429bb-1d5c-475a-bf58-ed96733767f5 req-157fb53f-e73d-4d37-be7e-61d25e1a8a35 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:44.087103 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a6d429bb-1d5c-475a-bf58-ed96733767f5 req-157fb53f-e73d-4d37-be7e-61d25e1a8a35 service nova] Creating event network-vif-deleted:60756b6e-f6e0-4495-9d3f-ea9d8dd2704a for instance bab01774-32df-4cc9-b5ac-81f5beb05a51 on n-h1-master-1 Jul 01 10:58:44.089772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:44.094177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a6d429bb-1d5c-475a-bf58-ed96733767f5 req-157fb53f-e73d-4d37-be7e-61d25e1a8a35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058444 Jul 01 10:58:44.095474 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2890/5682] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:44.098552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cfea8c12-7819-416f-8017-5cb42cacee4e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1570 microversion: 2.1 time: 0.451674 Jul 01 10:58:44.099129 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2793/5683] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:43 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1570 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:44.227433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:44.228625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:44.236490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:44.237431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:44.238682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:44.239340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:44.267423 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:58:44.477651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:44.481851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b780457a-9e06-48b3-b1e2-f77198546c1e req-a781ce8e-0e2e-4534-8279-1ff793752761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "tag": "77966735-1c04-4005-be41-194f63188932"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:44.486722 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e633c02e-d38a-4dac-8cda-5167e71ea4ed tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1365 microversion: 2.1 time: 0.266329 Jul 01 10:58:44.496006 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2891/5684] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:44 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:44.496288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b780457a-9e06-48b3-b1e2-f77198546c1e req-a781ce8e-0e2e-4534-8279-1ff793752761 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:44.497085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b780457a-9e06-48b3-b1e2-f77198546c1e req-a781ce8e-0e2e-4534-8279-1ff793752761 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:44.519095 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b780457a-9e06-48b3-b1e2-f77198546c1e req-a781ce8e-0e2e-4534-8279-1ff793752761 service nova] Creating event network-changed:77966735-1c04-4005-be41-194f63188932 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 10:58:44.527008 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b780457a-9e06-48b3-b1e2-f77198546c1e req-a781ce8e-0e2e-4534-8279-1ff793752761 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051786 Jul 01 10:58:44.528153 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2794/5685] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:58:45.117010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:45.117773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:45.125529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:45.129860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:45.156264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:45.166958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:45.235204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:45.235915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:45.236821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lazy-loading 'fault' on Instance uuid bab01774-32df-4cc9-b5ac-81f5beb05a51 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:58:45.297254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:45.308165 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-714f904d-be30-459f-80c0-5a5ed4e2afa3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 200 len: 1356 microversion: 2.1 time: 0.196713 Jul 01 10:58:45.320695 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2892/5686] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:45 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 1356 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:45.512461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:45.514011 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:45.524555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:45.525338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:45.526314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:45.526921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:46.281815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:46.287234 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-863f005b-a3ac-4c90-bebe-4ef1cd3526e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1556 microversion: 2.1 time: 0.778928 Jul 01 10:58:46.288928 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2795/5687] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:45 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1556 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:46.308290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9c94e42-7f97-4bf6-8207-22cfa0b94a4d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:46.309536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9c94e42-7f97-4bf6-8207-22cfa0b94a4d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:46.317185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c94e42-7f97-4bf6-8207-22cfa0b94a4d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:46.318236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c94e42-7f97-4bf6-8207-22cfa0b94a4d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:46.320259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c94e42-7f97-4bf6-8207-22cfa0b94a4d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:46.320882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9c94e42-7f97-4bf6-8207-22cfa0b94a4d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:46.326708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:46.327763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: bab01774-32df-4cc9-b5ac-81f5beb05a51] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:46.334695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:46.335440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:46.336449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:46.337086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:46.380872 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] HTTP exception thrown: Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 could not be found. Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Request method failure captured: Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 HTTP/1.1 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtIMAE4-bQXaEWnIiv5xqMUHPv0jdduWWZpIoL5be7dlGtfQRFL8NNsCC8ke9IXOipeg42ChW0EIK3ytKLDH2l7c8k0hc5J5oKDbzBtFHorJrWbPnlCUbp9XAxMzLNPQCml9MqGh9WTkCve-gvYt6xltduu4CnNUodriQSOL1yJGoCQ Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3844c974f9d84827a9d501d426da8817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3844c974f9d84827a9d501d426da8817", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 0e83529d6b134262849efc588712bd0f Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: exception: Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 could not be found. Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'bab01774-32df-4cc9-b5ac-81f5beb05a51'} Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 could not be found. Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 could not be found. Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:46.383656 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 could not be found. Jul 01 10:58:46.387666 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:46.390895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Returning 404 to user: Instance bab01774-32df-4cc9-b5ac-81f5beb05a51 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:58:46.392072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-19db71c0-57bb-40eb-854a-24f6f8bdecbb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51" status: 404 len: 111 microversion: 2.1 time: 0.069691 Jul 01 10:58:46.393865 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2796/5688] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:46 2022] GET /compute/v2.1/servers/bab01774-32df-4cc9-b5ac-81f5beb05a51 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:58:46.474411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:46.475762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:46.483106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:46.483899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:46.485086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:46.485768 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:46.516864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:58:46.522924 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9c94e42-7f97-4bf6-8207-22cfa0b94a4d tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221533 Jul 01 10:58:46.530453 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2893/5689] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 10:58:46 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:47.065307 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb3cfbf9-8442-4aeb-82cf-ff24e097ac0a tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 204 len: 0 microversion: 2.1 time: 0.594396 Jul 01 10:58:47.066025 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2797/5690] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:58:46 2022] DELETE /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:58:47.075397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:47.076265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:47.083354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:47.083748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:47.086933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:47.087465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:47.581001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:47.590398 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8cc68c71-ef1f-4ab8-9466-fca9f7ba81e8 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1503 microversion: 2.1 time: 0.519254 Jul 01 10:58:47.591601 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2894/5691] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:47 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1503 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:47.979720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-840cd37b-9842-4d60-987d-65ec691fd9cb req-c8de3eac-082f-4b31-a76d-c02dfb4f611b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fb7fbd-a894-4725-8e33-a863e6c4a827", "tag": "295b8b5b-9e30-4992-b81a-4f6d8fc32ad6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:47.988809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-840cd37b-9842-4d60-987d-65ec691fd9cb req-c8de3eac-082f-4b31-a76d-c02dfb4f611b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:47.989439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-840cd37b-9842-4d60-987d-65ec691fd9cb req-c8de3eac-082f-4b31-a76d-c02dfb4f611b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:48.001958 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-840cd37b-9842-4d60-987d-65ec691fd9cb req-c8de3eac-082f-4b31-a76d-c02dfb4f611b service nova] Creating event network-changed:295b8b5b-9e30-4992-b81a-4f6d8fc32ad6 for instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 on n-h1-master-1 Jul 01 10:58:48.007009 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-840cd37b-9842-4d60-987d-65ec691fd9cb req-c8de3eac-082f-4b31-a76d-c02dfb4f611b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032110 Jul 01 10:58:48.008097 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2798/5692] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:48.607971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:48.608583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:48.615523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:48.623626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:48.624764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:48.625409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:49.005966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:49.018847 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96c80791-f794-4fd4-82de-7a39a9384295 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1503 microversion: 2.1 time: 0.414740 Jul 01 10:58:49.030284 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2895/5693] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:48 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:49.561511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-33665df0-83ae-48d9-99e7-c5f9817f011d req-81b07fd3-7a73-429d-9959-9cdde54a484c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9498fdce-0fa4-434e-acd8-b0ea9945f260", "name": "network-vif-deleted", "tag": "ab8be7ef-f65c-4cae-a50a-1f17513d90fe"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:49.580072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-33665df0-83ae-48d9-99e7-c5f9817f011d req-81b07fd3-7a73-429d-9959-9cdde54a484c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:49.583296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-33665df0-83ae-48d9-99e7-c5f9817f011d req-81b07fd3-7a73-429d-9959-9cdde54a484c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:49.593679 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-33665df0-83ae-48d9-99e7-c5f9817f011d req-81b07fd3-7a73-429d-9959-9cdde54a484c service nova] Creating event network-vif-deleted:ab8be7ef-f65c-4cae-a50a-1f17513d90fe for instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 on n-h2-master-1 Jul 01 10:58:49.599065 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-33665df0-83ae-48d9-99e7-c5f9817f011d req-81b07fd3-7a73-429d-9959-9cdde54a484c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051633 Jul 01 10:58:49.600264 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2799/5694] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:58:50.041728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:50.042916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:50.051951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:50.052730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:50.054855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:50.055527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:50.548169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:50.549315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:50.549938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lazy-loading 'fault' on Instance uuid 9498fdce-0fa4-434e-acd8-b0ea9945f260 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:58:50.634713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd91054c43200415cbda26ec365faf269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00389c8362164e7383579785af4706d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:58:50.656303 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4f3ef98d-9db1-4ea3-a46d-e7d1edcaf6c0 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 200 len: 1303 microversion: 2.1 time: 0.623476 Jul 01 10:58:50.658074 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2896/5695] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:50 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 1303 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:58:51.697789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:51.702062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] [instance: 9498fdce-0fa4-434e-acd8-b0ea9945f260] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:58:51.706134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:51.706722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:51.707620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:58:51.708124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:58:51.723530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] HTTP exception thrown: Instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 could not be found. Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Request method failure captured: Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 HTTP/1.1 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtNN1SOZMnB4hu-valjrFG0CEDEW0TmjN6a0zVuN4M4OytcXHb1iTzKiDNkw3KYAqGkgMOl_SMo1_JJurY5UOsY9A-YlymQ9KR9wRvmffCXj5KXfkMJ8IKs_jhKGsgf3BAG44elPomN7Kr8yR2BlGnfHExnyNtZgMwsTpKt_xX57rwE Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 00389c8362164e7383579785af4706d1 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesActionsTest-1477429012 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/00389c8362164e7383579785af4706d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/00389c8362164e7383579785af4706d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_00389c8362164e7383579785af4706d1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/00389c8362164e7383579785af4706d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesActionsTest-1477429012 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 00389c8362164e7383579785af4706d1 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesActionsTest-1477429012 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesActionsTest-1477429012-project Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: d91054c43200415cbda26ec365faf269 Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesActionsTest-1477429012-project Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 could not be found. Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '9498fdce-0fa4-434e-acd8-b0ea9945f260'} Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 could not be found. Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 could not be found. Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:58:51.725838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 could not be found. Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] Returning 404 to user: Instance 9498fdce-0fa4-434e-acd8-b0ea9945f260 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a8abffb8-5c9e-4946-95c6-568457e4fb52 tempest-VolumesActionsTest-1477429012 tempest-VolumesActionsTest-1477429012-project] 10.222.0.23 "GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260" status: 404 len: 111 microversion: 2.1 time: 0.035699 Jul 01 10:58:51.734461 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2800/5696] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:58:51 2022] GET /compute/v2.1/servers/9498fdce-0fa4-434e-acd8-b0ea9945f260 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:58:52.191810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a71bd616-1976-4e7d-8aab-2f5df239a960 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '.version_select at 0x7f6f90aec3a0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:58:52.298937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a71bd616-1976-4e7d-8aab-2f5df239a960 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1069309161" status: 202 len: 0 microversion: 2.1 time: 0.111652 Jul 01 10:58:52.299761 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2897/5697] 10.222.0.23 () {58 vars in 1283 bytes} [Fri Jul 1 10:58:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1069309161 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:58:52.345118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f136404c-b4da-483a-9189-06c8d4852a85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: .version_select at 0x7f6f909aa820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-5074149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBydFfBIUOXGH5+5cKGRj0sEshVvHQZRDgD767uUdt9djg4teSIQCafrLZkRP8d41hSz/q3wWfw4y9sfUHWy3SPq/Q9dpLz9owRXyoHU0pYUqrSLDHlR4OEyZqTge/k/Qg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:58:52.379728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f136404c-b4da-483a-9189-06c8d4852a85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:58:52.386577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-f136404c-b4da-483a-9189-06c8d4852a85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:58:52.479223 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f136404c-b4da-483a-9189-06c8d4852a85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.138439 Jul 01 10:58:52.485164 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2801/5698] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 10:58:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:03.064491 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=36 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:03.065948 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:03.071402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1772812659", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "50635989-93ae-4a56-b91a-a5c0feb336b9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-5074149", "security_groups": [{"name": "tempest-secgroup-smoke-48924011"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:03.258224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] validate_networks() for [('50635989-93ae-4a56-b91a-a5c0feb336b9', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 10:59:03.910829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 10:59:03.915769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 10:59:03.915769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 10:59:03.915769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 10:59:03.915769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 10:59:03.927588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:03.929193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:03.930280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:03.931145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:03.975756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 10:59:03.990142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 10:59:04.016804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 10:59:04.019163 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 10:59:04.218155 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8e632a9f-a55a-4a1c-91e0-a313e65c2c7a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.155445 Jul 01 10:59:04.219124 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2898/5699] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 10:59:03 2022] POST /compute/v2.1/servers => generated 404 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 10:59:04.233881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98c1b201-1060-4cc6-b7c0-344b099fd033 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:04.235435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98c1b201-1060-4cc6-b7c0-344b099fd033 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:04.246066 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:04.250661 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:04.259184 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:04.411077 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98c1b201-1060-4cc6-b7c0-344b099fd033 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:04.411077 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98c1b201-1060-4cc6-b7c0-344b099fd033 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1264 microversion: 2.1 time: 0.176047 Jul 01 10:59:04.411077 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2802/5700] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:04 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:05.427302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:05.433239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:05.442106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:05.442814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:05.446212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:05.447090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:05.561585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:05.584386 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8fe8820c-c5f0-4de9-8e5c-603d314375e0 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1268 microversion: 2.1 time: 0.160928 Jul 01 10:59:05.595796 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2899/5701] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:05 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:06.602375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:06.603779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:06.612581 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:06.613470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:06.614573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:06.615830 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:06.774587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:06.800087 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-487abe25-38db-4802-b1b3-2d2b74a23fc7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1316 microversion: 2.1 time: 0.202012 Jul 01 10:59:06.801216 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2803/5702] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:06 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:07.825498 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:07.826215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:07.838777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:07.839404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:07.840494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:07.841206 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:07.930296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:07.939318 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9397569f-20bc-4b5f-b576-9433cb092204 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1322 microversion: 2.1 time: 0.118519 Jul 01 10:59:07.940287 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2900/5703] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:07 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1322 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:08.965265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:08.965897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:09.007111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:09.007391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:09.021208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:09.025826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:09.362513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:09.387297 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea984a10-29ee-4061-8480-1a5cea0c4e65 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.432990 Jul 01 10:59:09.387987 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2804/5704] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:08 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:09.831808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4a0a051b-e19f-405c-be42-4c52c4193ca0 req-48bc9ec2-0b47-4158-bc68-849781488d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:09.853961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4a0a051b-e19f-405c-be42-4c52c4193ca0 req-48bc9ec2-0b47-4158-bc68-849781488d73 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:09.864725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4a0a051b-e19f-405c-be42-4c52c4193ca0 req-48bc9ec2-0b47-4158-bc68-849781488d73 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:09.893134 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4a0a051b-e19f-405c-be42-4c52c4193ca0 req-48bc9ec2-0b47-4158-bc68-849781488d73 service nova] Creating event network-changed:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h2-master-1 Jul 01 10:59:09.905584 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4a0a051b-e19f-405c-be42-4c52c4193ca0 req-48bc9ec2-0b47-4158-bc68-849781488d73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077293 Jul 01 10:59:09.909473 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2901/5705] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:10.405998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:10.407417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:10.420912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:10.425106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:10.426293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:10.426940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:10.715428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:10.726842 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b5d074bd-5236-453e-a98f-30267573f34b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.325588 Jul 01 10:59:10.736732 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2805/5706] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:10 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:11.745409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:11.746249 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:11.754622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:11.755196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:11.756144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:11.756591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:12.024487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:12.035037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-840eab5a-9e83-4c17-a77f-13ed2f43ca56 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.294363 Jul 01 10:59:12.035796 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2902/5707] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:11 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:13.058655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:13.060038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:13.090929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:13.091606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:13.094431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:13.095523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:13.259295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:13.269163 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e50929b4-30f8-411a-8e32-87b9474dc268 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.220513 Jul 01 10:59:13.270436 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2806/5708] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:13 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:14.286380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:14.287667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:14.290465 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:14.291019 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:14.295959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:14.296411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:14.297250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:14.297658 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:14.446872 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:14.454848 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab93e25b-0578-4b3a-b667-e3f1f56d2b9f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.172399 Jul 01 10:59:14.457573 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2903/5709] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:14 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:15.476419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:15.478522 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:15.485395 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:15.487850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:15.488471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:15.489310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:15.490655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:15.676976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:15.680894 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a44781c-1afb-4f4f-9ffb-cdb5cb5a7722 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.209997 Jul 01 10:59:15.681732 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2807/5710] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:15 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:16.698487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:16.699193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:16.706733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:16.707286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:16.708159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:16.709232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:16.854550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:16.881207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-36ac5b91-1215-43fe-a7cf-1ea20e2ac3f3 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.169527 Jul 01 10:59:16.881207 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2904/5711] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:16 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:17.345922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-21f0d510-fb08-499d-977d-69ffc8d47e2d req-5170df75-beea-411d-95cb-b9095a28418e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "name": "network-vif-plugged", "status": "completed", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:17.357488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-21f0d510-fb08-499d-977d-69ffc8d47e2d req-5170df75-beea-411d-95cb-b9095a28418e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:17.358174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-21f0d510-fb08-499d-977d-69ffc8d47e2d req-5170df75-beea-411d-95cb-b9095a28418e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:17.371575 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-21f0d510-fb08-499d-977d-69ffc8d47e2d req-5170df75-beea-411d-95cb-b9095a28418e service nova] Creating event network-vif-plugged:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h2-master-1 Jul 01 10:59:17.377680 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-21f0d510-fb08-499d-977d-69ffc8d47e2d req-5170df75-beea-411d-95cb-b9095a28418e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035983 Jul 01 10:59:17.379203 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2808/5712] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:17.885601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:17.886888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:17.901119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:17.901119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:17.901119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:17.902344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:18.154817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:18.163825 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3fb64050-0d13-4aa7-9149-50d89f18ba16 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1388 microversion: 2.1 time: 0.285538 Jul 01 10:59:18.173699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2905/5713] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:17 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1388 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:19.181747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:19.183099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:19.201208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:19.201862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:19.202811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:19.203410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:19.509648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:19.520992 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aac1e639-8846-416c-9aef-04879f12e581 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1561 microversion: 2.1 time: 0.343889 Jul 01 10:59:19.527076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2809/5714] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:19 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1561 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:19.539037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:19.539658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:19.559536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:19.559536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:19.561178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:19.561628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:20.338752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:20.361258 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6bf55028-9ae3-4545-b0f3-2948eaec541d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1561 microversion: 2.1 time: 0.817913 Jul 01 10:59:20.361258 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2906/5715] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:19 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1561 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:22.688995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5b107611-2b6a-4dd6-8587-f8f52db4b449 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:22.690626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5b107611-2b6a-4dd6-8587-f8f52db4b449 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:22.705322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b107611-2b6a-4dd6-8587-f8f52db4b449 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:22.705322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b107611-2b6a-4dd6-8587-f8f52db4b449 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:22.705322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b107611-2b6a-4dd6-8587-f8f52db4b449 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:22.705322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b107611-2b6a-4dd6-8587-f8f52db4b449 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:22.738834 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5b107611-2b6a-4dd6-8587-f8f52db4b449 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/ips" status: 200 len: 150 microversion: 2.1 time: 0.054104 Jul 01 10:59:22.740993 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2810/5716] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 10:59:22 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:59:22.822945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:22.828799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f0c79faa-41de-434a-a7f1-6318b1d30f96 req-913948e8-9601-49a8-8b15-0996de236546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:22.830081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:22.839258 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0c79faa-41de-434a-a7f1-6318b1d30f96 req-913948e8-9601-49a8-8b15-0996de236546 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:22.839865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0c79faa-41de-434a-a7f1-6318b1d30f96 req-913948e8-9601-49a8-8b15-0996de236546 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:22.845218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:22.845677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:22.846463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:22.846903 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:22.859837 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f0c79faa-41de-434a-a7f1-6318b1d30f96 req-913948e8-9601-49a8-8b15-0996de236546 service nova] Creating event network-changed:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h2-master-1 Jul 01 10:59:22.867198 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f0c79faa-41de-434a-a7f1-6318b1d30f96 req-913948e8-9601-49a8-8b15-0996de236546 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041833 Jul 01 10:59:22.867823 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2811/5717] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:23.062686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:23.072690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f77b89b-6570-47db-9bfd-986fbe89a9a6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1561 microversion: 2.1 time: 0.253707 Jul 01 10:59:23.073296 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2907/5718] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:22 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:25.715381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd708cdc-7d2e-4463-ae60-2f9ae73d4c44 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd984393-81a8-43a8-a722-28c2542ec163"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:25.716760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd708cdc-7d2e-4463-ae60-2f9ae73d4c44 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:25.723389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd708cdc-7d2e-4463-ae60-2f9ae73d4c44 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:25.724605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd708cdc-7d2e-4463-ae60-2f9ae73d4c44 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:25.725481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd708cdc-7d2e-4463-ae60-2f9ae73d4c44 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:25.725957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd708cdc-7d2e-4463-ae60-2f9ae73d4c44 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:26.778517 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd708cdc-7d2e-4463-ae60-2f9ae73d4c44 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "POST /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.068339 Jul 01 10:59:26.785450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2812/5719] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 10:59:25 2022] POST /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 194 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:39.926712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:39.928903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:39.930848 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:39.931515 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=52 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:39.936647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:39.937097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:39.937894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:39.938327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:40.022435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lazy-loading 'services' on Instance uuid 28fb7fbd-a894-4725-8e33-a863e6c4a827 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:59:40.320728 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b22b5a3d-accc-44a0-894c-8234cc0b7725 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments/bd984393-81a8-43a8-a722-28c2542ec163" status: 202 len: 0 microversion: 2.1 time: 0.397966 Jul 01 10:59:40.325379 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2908/5720] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 10:59:39 2022] DELETE /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments/bd984393-81a8-43a8-a722-28c2542ec163 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:59:40.330606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed8efa20-f638-426c-b690-c69f2ac2b4f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:40.331741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed8efa20-f638-426c-b690-c69f2ac2b4f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:40.336726 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=24 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:40.337433 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 10:59:40.342435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed8efa20-f638-426c-b690-c69f2ac2b4f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:40.342869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed8efa20-f638-426c-b690-c69f2ac2b4f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:40.343774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed8efa20-f638-426c-b690-c69f2ac2b4f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:40.344219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed8efa20-f638-426c-b690-c69f2ac2b4f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:40.373628 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed8efa20-f638-426c-b690-c69f2ac2b4f5 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047545 Jul 01 10:59:40.374198 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2813/5721] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:59:40 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:41.386429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fdd8391a-b0fc-4b50-abd2-004d45eed24b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:41.387619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fdd8391a-b0fc-4b50-abd2-004d45eed24b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:41.395887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdd8391a-b0fc-4b50-abd2-004d45eed24b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:41.396381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdd8391a-b0fc-4b50-abd2-004d45eed24b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:41.397219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdd8391a-b0fc-4b50-abd2-004d45eed24b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:41.397666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdd8391a-b0fc-4b50-abd2-004d45eed24b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:41.443075 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fdd8391a-b0fc-4b50-abd2-004d45eed24b tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061193 Jul 01 10:59:41.447155 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2909/5722] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:59:41 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:42.455570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d823563-18bc-4ab7-b1e8-c778a9122bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:42.456724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d823563-18bc-4ab7-b1e8-c778a9122bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:42.469961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d823563-18bc-4ab7-b1e8-c778a9122bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:42.470233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d823563-18bc-4ab7-b1e8-c778a9122bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:42.471188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d823563-18bc-4ab7-b1e8-c778a9122bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:42.471802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d823563-18bc-4ab7-b1e8-c778a9122bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:42.503569 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d823563-18bc-4ab7-b1e8-c778a9122bae tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052705 Jul 01 10:59:42.504145 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2814/5723] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:59:42 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:43.517184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd161893-8d14-4dfe-bebc-d9a8a7d5f6f0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:43.519125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dd161893-8d14-4dfe-bebc-d9a8a7d5f6f0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:43.531026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd161893-8d14-4dfe-bebc-d9a8a7d5f6f0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:43.531866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd161893-8d14-4dfe-bebc-d9a8a7d5f6f0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:43.533701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd161893-8d14-4dfe-bebc-d9a8a7d5f6f0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:43.534461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd161893-8d14-4dfe-bebc-d9a8a7d5f6f0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:43.569868 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd161893-8d14-4dfe-bebc-d9a8a7d5f6f0 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058176 Jul 01 10:59:43.570544 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2910/5724] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:59:43 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:44.582783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-640096a3-2032-459e-a7c3-ef2916e656d2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:44.584402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-640096a3-2032-459e-a7c3-ef2916e656d2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:44.595063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640096a3-2032-459e-a7c3-ef2916e656d2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:44.595540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640096a3-2032-459e-a7c3-ef2916e656d2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:44.596317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640096a3-2032-459e-a7c3-ef2916e656d2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:44.596750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-640096a3-2032-459e-a7c3-ef2916e656d2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:44.652290 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-640096a3-2032-459e-a7c3-ef2916e656d2 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074023 Jul 01 10:59:44.661608 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2815/5725] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:59:44 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:45.464968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d131f8f6-3f51-47cd-b2c3-648ecc349365 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:45.466062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d131f8f6-3f51-47cd-b2c3-648ecc349365 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:45.473136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d131f8f6-3f51-47cd-b2c3-648ecc349365 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:45.473622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d131f8f6-3f51-47cd-b2c3-648ecc349365 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:45.474424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d131f8f6-3f51-47cd-b2c3-648ecc349365 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:45.478891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d131f8f6-3f51-47cd-b2c3-648ecc349365 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:45.529937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d131f8f6-3f51-47cd-b2c3-648ecc349365 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action" status: 200 len: 24563 microversion: 2.1 time: 0.068465 Jul 01 10:59:45.530527 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2911/5726] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:59:45 2022] POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action => generated 24563 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:59:45.668733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-77a85d0c-d2ff-4c8a-878d-29edb35ff585 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:45.669900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-77a85d0c-d2ff-4c8a-878d-29edb35ff585 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:45.679063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77a85d0c-d2ff-4c8a-878d-29edb35ff585 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:45.684715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77a85d0c-d2ff-4c8a-878d-29edb35ff585 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:45.684715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77a85d0c-d2ff-4c8a-878d-29edb35ff585 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:45.684715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-77a85d0c-d2ff-4c8a-878d-29edb35ff585 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:45.713593 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-77a85d0c-d2ff-4c8a-878d-29edb35ff585 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048503 Jul 01 10:59:45.717647 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2816/5727] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:59:45 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 10:59:46.727865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a9bbc9b-ef7d-49a7-ad84-d25d3b9abdde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:46.729835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a9bbc9b-ef7d-49a7-ad84-d25d3b9abdde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:46.743942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a9bbc9b-ef7d-49a7-ad84-d25d3b9abdde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:46.745434 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a9bbc9b-ef7d-49a7-ad84-d25d3b9abdde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:46.746730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a9bbc9b-ef7d-49a7-ad84-d25d3b9abdde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:46.747418 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7a9bbc9b-ef7d-49a7-ad84-d25d3b9abdde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:46.789238 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a9bbc9b-ef7d-49a7-ad84-d25d3b9abdde tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067548 Jul 01 10:59:46.790960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2912/5728] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 10:59:46 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 10:59:46.868572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:46.869307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:46.879485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:46.883740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:46.883740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:46.883740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:46.917398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 10:59:47.295051 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4328c240-94e7-4b0d-a309-745328078604 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 204 len: 0 microversion: 2.1 time: 0.429644 Jul 01 10:59:47.296317 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2817/5729] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:59:46 2022] DELETE /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 10:59:47.306827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:47.307827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:47.317022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:47.318504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:47.319613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:47.320276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:47.497352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:47.506135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc661928-36c4-45b4-902d-e24e8c129a5e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1680 microversion: 2.1 time: 0.204667 Jul 01 10:59:47.507280 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2913/5730] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:47 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:48.530097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:48.530097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:48.533401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:48.533963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:48.535060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:48.535573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:48.711065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:48.719207 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7155605f-d015-42e4-b871-87dce8a4d52c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1680 microversion: 2.1 time: 0.198872 Jul 01 10:59:48.723807 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2818/5731] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:48 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:49.736244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:49.737619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:49.751083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:49.760392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:49.761661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:49.762305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:50.012245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:50.034695 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba2f1c33-1832-4eba-8a9b-124de442f279 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1613 microversion: 2.1 time: 0.291548 Jul 01 10:59:50.034695 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2914/5732] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:49 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1613 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:50.081983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d653aadd-1390-49d0-9807-9d8d138d10b9 req-8b555250-b8e3-4e5f-8cdc-fd0dc70b2c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fb7fbd-a894-4725-8e33-a863e6c4a827", "name": "network-vif-deleted", "tag": "295b8b5b-9e30-4992-b81a-4f6d8fc32ad6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:50.115253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d653aadd-1390-49d0-9807-9d8d138d10b9 req-8b555250-b8e3-4e5f-8cdc-fd0dc70b2c4b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:50.117965 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d653aadd-1390-49d0-9807-9d8d138d10b9 req-8b555250-b8e3-4e5f-8cdc-fd0dc70b2c4b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:50.148275 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d653aadd-1390-49d0-9807-9d8d138d10b9 req-8b555250-b8e3-4e5f-8cdc-fd0dc70b2c4b service nova] Creating event network-vif-deleted:295b8b5b-9e30-4992-b81a-4f6d8fc32ad6 for instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 on n-h1-master-1 Jul 01 10:59:50.163012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d653aadd-1390-49d0-9807-9d8d138d10b9 req-8b555250-b8e3-4e5f-8cdc-fd0dc70b2c4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082755 Jul 01 10:59:50.165749 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2819/5733] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 10:59:51.045071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:51.046420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:51.069782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:51.070716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:51.071938 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:51.074878 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:51.174062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:51.174824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:51.175646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lazy-loading 'fault' on Instance uuid 28fb7fbd-a894-4725-8e33-a863e6c4a827 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:59:51.303920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bcd1d3a1bd400e8ceb24213bf04cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6adb79b33148c19ad178ec781bbb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:51.325990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0383abd2-4902-47e9-b6a0-7e7a6178617c tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 200 len: 1330 microversion: 2.1 time: 0.280318 Jul 01 10:59:51.327793 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2915/5734] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:51 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 1330 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:52.347326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:52.348717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:52.358589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:52.359511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:52.360490 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:52.361116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:52.379778 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 HTTP/1.1 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '28fb7fbd-a894-4725-8e33-a863e6c4a827'} Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:59:52.382433 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f99aea6f-4977-468f-85aa-38b0c27e1853 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 404 len: 111 microversion: 2.1 time: 0.043424 Jul 01 10:59:52.387125 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2820/5735] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:52 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 10:59:52.393457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79cb12a9-1dd0-4a5e-a38b-733cd851f9e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '.version_select at 0x7f6f90b4f550>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:52.476747 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79cb12a9-1dd0-4a5e-a38b-733cd851f9e3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981196586" status: 202 len: 0 microversion: 2.1 time: 0.087413 Jul 01 10:59:52.477930 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2916/5736] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Jul 1 10:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981196586 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 10:59:56.507715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:56.509127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:56.517566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:56.518319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:56.519402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:56.520017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:56.691896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 10:59:56.711275 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e57979d-2679-48ee-a180-f9f9c740ca3e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1680 microversion: 2.1 time: 0.200580 Jul 01 10:59:56.711275 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2821/5737] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:56 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:56.821974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b41bcff9-9c04-47db-82fe-d2b5c7bec0df tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:56.823538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b41bcff9-9c04-47db-82fe-d2b5c7bec0df tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:56.835411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b41bcff9-9c04-47db-82fe-d2b5c7bec0df tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:56.836060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b41bcff9-9c04-47db-82fe-d2b5c7bec0df tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:56.837413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b41bcff9-9c04-47db-82fe-d2b5c7bec0df tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:56.837606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b41bcff9-9c04-47db-82fe-d2b5c7bec0df tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:56.900450 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b41bcff9-9c04-47db-82fe-d2b5c7bec0df tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action" status: 200 len: 32635 microversion: 2.1 time: 0.083408 Jul 01 10:59:56.901855 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2917/5738] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:59:56 2022] POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action => generated 32635 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 10:59:57.146493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc7e0c4c-1aa0-4a9a-a5c6-926cf474270e tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:57.147221 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc7e0c4c-1aa0-4a9a-a5c6-926cf474270e tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:57.153822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc7e0c4c-1aa0-4a9a-a5c6-926cf474270e tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.154270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc7e0c4c-1aa0-4a9a-a5c6-926cf474270e tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.155036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc7e0c4c-1aa0-4a9a-a5c6-926cf474270e tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.155467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc7e0c4c-1aa0-4a9a-a5c6-926cf474270e tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.296535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc7e0c4c-1aa0-4a9a-a5c6-926cf474270e tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1831 microversion: 2.1 time: 0.154470 Jul 01 10:59:57.297556 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2822/5739] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:57 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1831 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 10:59:57.323902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 10:59:57.325654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:57.333298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.333782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.334519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.334945 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.362748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lazy-loading 'flavor' on Instance uuid 3b28128d-fe89-4682-8e17-83d6b60a91dd {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 10:59:57.375509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Going to try to live migrate instance to another host {{(pid=119764) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 01 10:59:57.791214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:57.791719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:57.798793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.799876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.800127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.800562 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.815663 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 HTTP/1.1 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '28fb7fbd-a894-4725-8e33-a863e6c4a827'} Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:59:57.818448 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-36d7e688-b850-4cd8-8120-62237d275464 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 404 len: 111 microversion: 2.1 time: 0.034021 Jul 01 10:59:57.823957 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2823/5740] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 10:59:57 2022] DELETE /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 10:59:57.828956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 10:59:57.833894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 28fb7fbd-a894-4725-8e33-a863e6c4a827] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 10:59:57.836322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.836783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.837577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 10:59:57.838110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 10:59:57.852284 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 HTTP/1.1 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '28fb7fbd-a894-4725-8e33-a863e6c4a827'} Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 10:59:57.853845 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance 28fb7fbd-a894-4725-8e33-a863e6c4a827 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-56b52f19-e3fe-4d50-a4f6-cc24527be3b8 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827" status: 404 len: 111 microversion: 2.1 time: 0.030625 Jul 01 10:59:57.863625 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2824/5741] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 10:59:57 2022] GET /compute/v2.1/servers/28fb7fbd-a894-4725-8e33-a863e6c4a827 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:00.775083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f6f8a0a-2cec-4c8d-9fe1-def6b1293a69 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action" status: 202 len: 0 microversion: 2.1 time: 3.455561 Jul 01 11:00:00.775746 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2918/5742] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 10:59:57 2022] POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action => generated 0 bytes in 3457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:00:00.784825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:00.785423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:00.794035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:00.794492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:00.795348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:00.795791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:00.945361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:00.953307 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ac43dd8f-c0ce-4987-93a1-0615cab18a60 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.172212 Jul 01 11:00:00.957570 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2825/5743] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:00 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:01.972592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:01.973907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:01.982324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:01.982772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:01.983577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:01.984015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.290421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:02.307164 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f5916ee6-e98a-431b-aee1-9b64020ad9d2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.336984 Jul 01 11:00:02.318065 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2919/5744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:01 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:02.461960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:02.462523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:02.470277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.470952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.471798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.472327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.484662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-89e03569-60a5-4762-b04a-74c4c69944c0 req-84dbc252-d4c8-4aa7-8c77-b077a8602746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "name": "network-vif-unplugged", "status": "completed", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:02.489953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-89e03569-60a5-4762-b04a-74c4c69944c0 req-84dbc252-d4c8-4aa7-8c77-b077a8602746 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.490636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-89e03569-60a5-4762-b04a-74c4c69944c0 req-84dbc252-d4c8-4aa7-8c77-b077a8602746 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.490848 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 HTTP/1.1 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '426aecd8-2290-4d35-aba7-bf5cf900f1e0'} Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:00:02.492967 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f415fde0-7dcc-4187-80f7-f64bd5147f59 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 404 len: 111 microversion: 2.1 time: 0.037107 Jul 01 11:00:02.497043 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2826/5745] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:00:02 2022] DELETE /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:02.508790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:02.509443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: 426aecd8-2290-4d35-aba7-bf5cf900f1e0] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:02.517800 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-89e03569-60a5-4762-b04a-74c4c69944c0 req-84dbc252-d4c8-4aa7-8c77-b077a8602746 service nova] Creating event network-vif-unplugged:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h2-master-1 Jul 01 11:00:02.517800 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-89e03569-60a5-4762-b04a-74c4c69944c0 req-84dbc252-d4c8-4aa7-8c77-b077a8602746 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040890 Jul 01 11:00:02.518580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.518715 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2920/5746] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:00:02.519029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.519805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.520263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.535559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 HTTP/1.1 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '426aecd8-2290-4d35-aba7-bf5cf900f1e0'} Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.538040 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance 426aecd8-2290-4d35-aba7-bf5cf900f1e0 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec3e3f49-03f5-4c71-9c4b-3a45eed4c074 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0" status: 404 len: 111 microversion: 2.1 time: 0.039701 Jul 01 11:00:02.543492 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2827/5747] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:02 2022] GET /compute/v2.1/servers/426aecd8-2290-4d35-aba7-bf5cf900f1e0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:02.553202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:02.554782 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:02.564265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.565332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.566252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.566835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.586471 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 HTTP/1.1 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: exception: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'de93a5a5-d4c6-4279-8f6a-aab9eae133e7'} Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:00:02.588800 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.594303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:02.596249 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33d4a672-c24d-4ffe-99ed-6c2e1123a3c4 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 404 len: 111 microversion: 2.1 time: 0.047474 Jul 01 11:00:02.600668 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2921/5748] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:00:02 2022] DELETE /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:02.609649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:02.610559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: de93a5a5-d4c6-4279-8f6a-aab9eae133e7] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:02.621529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.622094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.623142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:02.625417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:02.666360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 HTTP/1.1 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: exception: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'de93a5a5-d4c6-4279-8f6a-aab9eae133e7'} Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:02.682155 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.687966 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:02.687966 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:02.687966 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:02.687966 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:02.687966 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:02.687966 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. Jul 01 11:00:02.687966 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:02.689189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance de93a5a5-d4c6-4279-8f6a-aab9eae133e7 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:02.693437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d7c84ab-3409-47cd-995c-60fa1a03aa1f tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7" status: 404 len: 111 microversion: 2.1 time: 0.089100 Jul 01 11:00:02.701979 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2828/5749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:02 2022] GET /compute/v2.1/servers/de93a5a5-d4c6-4279-8f6a-aab9eae133e7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:03.324532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:03.325991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:03.339723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:03.340511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:03.341564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:03.345904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:03.587178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:03.595824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-238387c9-aaa1-459d-860d-82bd0495118a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.275101 Jul 01 11:00:03.596850 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2922/5750] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:03 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:04.532451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6fe6a4fe-8f42-4179-a0ec-a4d0d67885ae req-660ed7ba-c38f-4568-af91-1321facff214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:04.544821 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6fe6a4fe-8f42-4179-a0ec-a4d0d67885ae req-660ed7ba-c38f-4568-af91-1321facff214 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:04.545620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6fe6a4fe-8f42-4179-a0ec-a4d0d67885ae req-660ed7ba-c38f-4568-af91-1321facff214 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:04.562671 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6fe6a4fe-8f42-4179-a0ec-a4d0d67885ae req-660ed7ba-c38f-4568-af91-1321facff214 service nova] Creating event network-changed:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h2-master-1 Jul 01 11:00:04.569082 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6fe6a4fe-8f42-4179-a0ec-a4d0d67885ae req-660ed7ba-c38f-4568-af91-1321facff214 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040436 Jul 01 11:00:04.569849 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2829/5751] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:04.615439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:04.616680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:04.636574 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:04.660908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:04.663109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:04.667354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:04.857933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:04.867690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1d257019-dffb-4584-979b-605963c8ed48 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.256077 Jul 01 11:00:04.868784 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2923/5752] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:04 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:05.887128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:05.887862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:05.894190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:05.894634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:05.895444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:05.895903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:06.124552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:06.135072 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61007189-2913-42f3-91c5-aef9de99c46f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.253138 Jul 01 11:00:06.135637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2830/5753] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:05 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:07.155023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:07.155670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:07.163552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:07.164026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:07.168308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:07.169020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:07.275706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:07.276090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:07.287925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:07.288610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:07.289452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:07.289895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:07.307282 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea HTTP/1.1 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: exception: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'aff1e9b5-e3df-4e72-bb71-4af64102f8ea'} Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:00:07.308984 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5586a4d6-e8e3-4218-8bda-6a22b11d36d3 tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 404 len: 111 microversion: 2.1 time: 0.040359 Jul 01 11:00:07.317659 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2831/5754] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:00:07 2022] DELETE /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:07.320953 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:07.321603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] [instance: aff1e9b5-e3df-4e72-bb71-4af64102f8ea] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:07.327646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:07.328098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:07.328911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:07.329377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:07.344214 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:07.347758 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] HTTP exception thrown: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Request method failure captured: Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea HTTP/1.1 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtI0m-lX94r2PHMPwo8KoD2pINBs2lb0QWWbZ9FKcqi72eD6K9bdedADLfUlCtd7SvwTfFSTrrSUAMD6Tlsi7AHV4Kauk6Y9ZjytfnIWVA51LdPdVgt6Ruj5F4m5We8zC9OffbPKHs2tftM8aB2aYuEhR3hwijKraFeHA7szQVs3dsg Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad6adb79b33148c19ad178ec781bbb3f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad6adb79b33148c19ad178ec781bbb3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: ad6adb79b33148c19ad178ec781bbb3f Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252575932 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c8bcd1d3a1bd400e8ceb24213bf04cd8 Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-AttachVolumeNegativeTest-1252575932-project Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: exception: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'aff1e9b5-e3df-4e72-bb71-4af64102f8ea'} Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:07.349392 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:00:07.355691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] Returning 404 to user: Instance aff1e9b5-e3df-4e72-bb71-4af64102f8ea could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:07.356736 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:07.360803 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-463ea691-d417-4f66-9ed3-4c6ee658702e tempest-AttachVolumeNegativeTest-1252575932 tempest-AttachVolumeNegativeTest-1252575932-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea" status: 404 len: 111 microversion: 2.1 time: 0.034193 Jul 01 11:00:07.360803 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2832/5755] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:07 2022] GET /compute/v2.1/servers/aff1e9b5-e3df-4e72-bb71-4af64102f8ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:07.361274 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-422d92ef-c55f-47d2-9b3f-f2fb83aa0dc4 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.206658 Jul 01 11:00:07.361274 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2924/5756] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:07 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:08.377002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:08.377695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:08.385030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:08.385521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:08.386305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:08.386744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:08.556835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:08.566962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-101c0ef9-bf88-4a28-a672-2e9790e803ab tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.193122 Jul 01 11:00:08.572351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2833/5757] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:08 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:09.481951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4575d37a-ea8b-467a-bafb-113fab0fd9df req-0fc1dd6a-3ebe-4465-b9fd-b33ec16f7c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "name": "network-vif-unplugged", "status": "completed", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:09.500088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4575d37a-ea8b-467a-bafb-113fab0fd9df req-0fc1dd6a-3ebe-4465-b9fd-b33ec16f7c59 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:09.500088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4575d37a-ea8b-467a-bafb-113fab0fd9df req-0fc1dd6a-3ebe-4465-b9fd-b33ec16f7c59 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:09.519599 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4575d37a-ea8b-467a-bafb-113fab0fd9df req-0fc1dd6a-3ebe-4465-b9fd-b33ec16f7c59 service nova] Creating event network-vif-unplugged:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h2-master-1 Jul 01 11:00:09.528496 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4575d37a-ea8b-467a-bafb-113fab0fd9df req-0fc1dd6a-3ebe-4465-b9fd-b33ec16f7c59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052714 Jul 01 11:00:09.529135 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2925/5758] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:09.583775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:09.584552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:09.591719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:09.592292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:09.593123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:09.593673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:09.613563 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:09.770822 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:09.788517 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b8a2949a-fbac-448b-8390-4d85d424f1a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.207843 Jul 01 11:00:09.789846 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2834/5759] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:09 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:10.807441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:10.819197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:10.819197 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:10.821468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:10.822122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:10.822905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:10.823347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:11.097275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:11.138224 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-621851dd-3f80-4d55-acce-211a147e7521 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.336129 Jul 01 11:00:11.142669 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2926/5760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:10 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:12.163225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:12.163864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:12.171500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:12.174315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:12.176657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:12.177370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:12.399295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:12.409074 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf42244a-94e1-4234-992c-e641b54e219b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1690 microversion: 2.1 time: 0.253284 Jul 01 11:00:12.409703 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2835/5761] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:12 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1690 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:13.426905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:13.428966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:13.442038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:13.442541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:13.443784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:13.445077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:13.703470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:13.713068 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0bc40b44-6036-4bc0-9056-b48d9d4b52bd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1680 microversion: 2.1 time: 0.291489 Jul 01 11:00:13.714473 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2927/5762] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:13 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:13.730885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-80c810a7-f8a9-4ace-9b70-db0faa5c9057 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:13.731564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-80c810a7-f8a9-4ace-9b70-db0faa5c9057 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:13.734901 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:13.742656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80c810a7-f8a9-4ace-9b70-db0faa5c9057 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:13.751104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80c810a7-f8a9-4ace-9b70-db0faa5c9057 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:13.751104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80c810a7-f8a9-4ace-9b70-db0faa5c9057 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:13.751104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-80c810a7-f8a9-4ace-9b70-db0faa5c9057 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:13.913083 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-80c810a7-f8a9-4ace-9b70-db0faa5c9057 tempest-TestNetworkAdvancedServerOps-1529674871 tempest-TestNetworkAdvancedServerOps-1529674871-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1831 microversion: 2.1 time: 0.186415 Jul 01 11:00:13.917911 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2836/5763] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:13 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1831 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:13.932164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:13.932777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:13.940120 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:13.948921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:13.948921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:13.948921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:14.084284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:14.092081 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b89a4992-fab5-4796-b70f-d518b53895c8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1680 microversion: 2.1 time: 0.164456 Jul 01 11:00:14.092649 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2928/5764] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:13 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:15.248770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8711fce6-6b44-44bd-9fe1-c7af23f3fcbd tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Action: 'create', calling method: .version_select at 0x7f6f90ce51f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-715532474", "metadata": {"Type": "work"}}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:16.145401 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8711fce6-6b44-44bd-9fe1-c7af23f3fcbd tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.017082 Jul 01 11:00:16.146026 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2837/5765] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Jul 1 11:00:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1018 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 11:00:16.158748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-76deec79-8981-42ff-b3de-fcf739e55fbc tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f90c49f70>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:16.200960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6a5db23-f76b-48a0-b07d-1a911643910f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:16.202763 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6a5db23-f76b-48a0-b07d-1a911643910f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:16.213318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a5db23-f76b-48a0-b07d-1a911643910f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:16.213771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a5db23-f76b-48a0-b07d-1a911643910f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:16.214597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a5db23-f76b-48a0-b07d-1a911643910f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:16.215574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a5db23-f76b-48a0-b07d-1a911643910f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:16.218637 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-76deec79-8981-42ff-b3de-fcf739e55fbc tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 200 len: 352 microversion: 2.1 time: 0.064248 Jul 01 11:00:16.219212 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2929/5766] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:16 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:16.283438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6a5db23-f76b-48a0-b07d-1a911643910f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action" status: 200 len: 38624 microversion: 2.1 time: 0.087222 Jul 01 11:00:16.284121 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2838/5767] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:00:16 2022] POST /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd/action => generated 38624 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 11:00:17.231926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c24a6213-681c-47d6-b5db-5321c75f0016 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f90c9b1f0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:17.310809 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c24a6213-681c-47d6-b5db-5321c75f0016 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 200 len: 352 microversion: 2.1 time: 0.083178 Jul 01 11:00:17.311902 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2930/5768] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:17 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:17.527689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:17.528289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:17.542012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:17.542834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:17.543886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:17.544598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:17.561379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0c91276e-d54e-4ce0-aafc-effa8ffaa521 req-07ab6f80-cde9-4632-9d3c-9ac5f4ccfd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:17.573409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0c91276e-d54e-4ce0-aafc-effa8ffaa521 req-07ab6f80-cde9-4632-9d3c-9ac5f4ccfd32 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:17.574691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0c91276e-d54e-4ce0-aafc-effa8ffaa521 req-07ab6f80-cde9-4632-9d3c-9ac5f4ccfd32 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:17.588904 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0c91276e-d54e-4ce0-aafc-effa8ffaa521 req-07ab6f80-cde9-4632-9d3c-9ac5f4ccfd32 service nova] Creating event network-changed:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h1-master-1 Jul 01 11:00:17.608215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:00:17.619615 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0c91276e-d54e-4ce0-aafc-effa8ffaa521 req-07ab6f80-cde9-4632-9d3c-9ac5f4ccfd32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076885 Jul 01 11:00:17.655789 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2931/5769] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:18.029771 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-373e9fb0-ef3e-4a7d-b3ba-e5789b0112d5 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 204 len: 0 microversion: 2.1 time: 0.507022 Jul 01 11:00:18.030746 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2839/5770] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:00:17 2022] DELETE /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:00:18.039865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:18.040931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:18.048121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:18.048882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:18.050005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:18.050671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:18.249956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:18.263264 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29a6d37a-93fc-4494-803c-06d8e06dd054 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1686 microversion: 2.1 time: 0.227849 Jul 01 11:00:18.264462 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2932/5771] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:18 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1686 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:00:18.330062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0cb71f9c-7b6c-4cac-ab1a-7d46e7b6e300 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f909aa9d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:18.388637 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0cb71f9c-7b6c-4cac-ab1a-7d46e7b6e300 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 200 len: 353 microversion: 2.1 time: 0.063967 Jul 01 11:00:18.389605 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2840/5772] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:18 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:18.401104 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-126647da-43e5-44c5-8350-4daa771a2fcc tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f90c49a60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:18.452114 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-126647da-43e5-44c5-8350-4daa771a2fcc tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 200 len: 353 microversion: 2.1 time: 0.055474 Jul 01 11:00:18.452788 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2933/5773] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:18 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:18.471793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e0d77ea8-e501-4c01-85df-2196f6385a41 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f907eb1f0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:18.682258 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e0d77ea8-e501-4c01-85df-2196f6385a41 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 202 len: 0 microversion: 2.1 time: 0.219138 Jul 01 11:00:18.683836 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2841/5774] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Jul 1 11:00:18 2022] DELETE /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:00:18.694025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-557231e6-55b9-4816-bae7-c45811ef7be3 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f90b41c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:18.775837 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-557231e6-55b9-4816-bae7-c45811ef7be3 tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 200 len: 352 microversion: 2.1 time: 0.086981 Jul 01 11:00:18.776416 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2934/5775] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:18 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:19.287009 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:19.288320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:19.298627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:19.300276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:19.301767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:19.302380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:19.437104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:19.445652 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ff0d3bd-a951-4580-b1e4-88ace2dd919e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 200 len: 1501 microversion: 2.1 time: 0.164289 Jul 01 11:00:19.446233 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2842/5776] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:19 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:19.670256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b4fbe3f0-69a5-49f3-9473-5a0e39313850 req-54ca8f75-e125-4626-a5cd-b4d41ef93073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b28128d-fe89-4682-8e17-83d6b60a91dd", "name": "network-vif-deleted", "tag": "0a74e4ea-ff23-4efb-914f-797ea17d4cc8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:19.681431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b4fbe3f0-69a5-49f3-9473-5a0e39313850 req-54ca8f75-e125-4626-a5cd-b4d41ef93073 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:19.681968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b4fbe3f0-69a5-49f3-9473-5a0e39313850 req-54ca8f75-e125-4626-a5cd-b4d41ef93073 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:19.695643 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b4fbe3f0-69a5-49f3-9473-5a0e39313850 req-54ca8f75-e125-4626-a5cd-b4d41ef93073 service nova] Creating event network-vif-deleted:0a74e4ea-ff23-4efb-914f-797ea17d4cc8 for instance 3b28128d-fe89-4682-8e17-83d6b60a91dd on n-h1-master-1 Jul 01 11:00:19.705578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b4fbe3f0-69a5-49f3-9473-5a0e39313850 req-54ca8f75-e125-4626-a5cd-b4d41ef93073 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039764 Jul 01 11:00:19.706876 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2935/5777] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:19.788392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82894c73-42c8-461a-ad4a-9764baeefb6e tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f90787af0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:19.867750 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82894c73-42c8-461a-ad4a-9764baeefb6e tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 200 len: 352 microversion: 2.1 time: 0.083810 Jul 01 11:00:19.868656 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2843/5778] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:19 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:20.464654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:20.465595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: 3b28128d-fe89-4682-8e17-83d6b60a91dd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:20.473793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:20.474358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:20.475283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:20.475788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:20.497987 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] HTTP exception thrown: Instance 3b28128d-fe89-4682-8e17-83d6b60a91dd could not be found. Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Request method failure captured: Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd HTTP/1.1 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtIMAE4-bQXaEWnIiv5xqMUHPv0jdduWWZpIoL5be7dlGtfQRFL8NNsCC8ke9IXOipeg42ChW0EIK3ytKLDH2l7c8k0hc5J5oKDbzBtFHorJrWbPnlCUbp9XAxMzLNPQCml9MqGh9WTkCve-gvYt6xltduu4CnNUodriQSOL1yJGoCQ Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3844c974f9d84827a9d501d426da8817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3844c974f9d84827a9d501d426da8817", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0e83529d6b134262849efc588712bd0f Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3b28128d-fe89-4682-8e17-83d6b60a91dd could not be found. Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3b28128d-fe89-4682-8e17-83d6b60a91dd'} Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b28128d-fe89-4682-8e17-83d6b60a91dd could not be found. Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b28128d-fe89-4682-8e17-83d6b60a91dd could not be found. Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:20.499833 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b28128d-fe89-4682-8e17-83d6b60a91dd could not be found. Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Returning 404 to user: Instance 3b28128d-fe89-4682-8e17-83d6b60a91dd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00357bd5-730e-451e-a6cc-a03aa51e984a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd" status: 404 len: 111 microversion: 2.1 time: 0.041761 Jul 01 11:00:20.516063 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2936/5779] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:20 2022] GET /compute/v2.1/servers/3b28128d-fe89-4682-8e17-83d6b60a91dd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:20.882796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e3c1bb3a-437d-4e93-9e8f-30b0736ef92a tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f90a05b80>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:20.949910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e3c1bb3a-437d-4e93-9e8f-30b0736ef92a tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 200 len: 352 microversion: 2.1 time: 0.073389 Jul 01 11:00:20.950702 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2844/5780] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:20 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:21.967943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6ad1309-6eb2-4654-b0d9-131d4791957f tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Calling method '.version_select at 0x7f6f90c490d0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:22.002901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b6ad1309-6eb2-4654-b0d9-131d4791957f tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] HTTP exception thrown: Volume 20fd3752-5b27-47bd-a533-ca4807129ac6 could not be found. Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6ad1309-6eb2-4654-b0d9-131d4791957f tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Request method failure captured: Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 HTTP/1.1 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtO_vVxLPz31oEkiKgHpijEkTbvlnCToFhitRwCLbZ9asVvwqREJyVbdPzNv-tKDYAaRdGG3zvbw8VCffJR3LL7N-GP3Ur00aHdDmTdDI9YkoiqbD7syd8TZ0VZQDVXqsxkqGBjgzOnvLezFrfYbK8SgN347KqZjWeYqW9iMRStpD4Y Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3fdf46e3b42e4c9fbba6a3f771d5f8fe Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesGetTestJSON-1554922816 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fdf46e3b42e4c9fbba6a3f771d5f8fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fdf46e3b42e4c9fbba6a3f771d5f8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fdf46e3b42e4c9fbba6a3f771d5f8fe", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fdf46e3b42e4c9fbba6a3f771d5f8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesGetTestJSON-1554922816 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3fdf46e3b42e4c9fbba6a3f771d5f8fe Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesGetTestJSON-1554922816 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesGetTestJSON-1554922816-project Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 8c88f73476ad47cc8cd864ca0d926af1 Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesGetTestJSON-1554922816-project Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: method: Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: exception: Volume 20fd3752-5b27-47bd-a533-ca4807129ac6 could not be found. Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '20fd3752-5b27-47bd-a533-ca4807129ac6'} Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20fd3752-5b27-47bd-a533-ca4807129ac6 could not be found. (HTTP 404) (Request-ID: req-ed06155c-adac-4591-995c-176bc799a6ea) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 11:00:22.004984 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20fd3752-5b27-47bd-a533-ca4807129ac6 could not be found. Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20fd3752-5b27-47bd-a533-ca4807129ac6 could not be found. Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20fd3752-5b27-47bd-a533-ca4807129ac6 could not be found. Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6ad1309-6eb2-4654-b0d9-131d4791957f tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] Returning 404 to user: Volume 20fd3752-5b27-47bd-a533-ca4807129ac6 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6ad1309-6eb2-4654-b0d9-131d4791957f tempest-VolumesGetTestJSON-1554922816 tempest-VolumesGetTestJSON-1554922816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6" status: 404 len: 109 microversion: 2.1 time: 0.045604 Jul 01 11:00:22.014071 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2937/5781] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Jul 1 11:00:21 2022] GET /compute/v2.1/os-volumes/20fd3752-5b27-47bd-a533-ca4807129ac6 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:00:25.036386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87898d9e-9ee9-489e-97dc-808743715ad7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '.version_select at 0x7f6f906c7280>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:25.150123 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87898d9e-9ee9-489e-97dc-808743715ad7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-5074149" status: 202 len: 0 microversion: 2.1 time: 0.117319 Jul 01 11:00:25.150123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2845/5782] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 11:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-5074149 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:00:25.191183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60b49fe6-ae9e-4510-a126-3fc0426cd63a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: .version_select at 0x7f6f90b3bb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-567536112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm7UcpnjUYm1ZhHSt/k+yYZH07vnlu8hDmz70KuVM4DERtSENzLo8u3RAA6bn30MqC00IQW+CDwIKI+1QHX2G/CZ2TJo6l9V7ABkOFBivaWM/CgHg2QzWjFvHS+NKIIGQ=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:25.223859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-60b49fe6-ae9e-4510-a126-3fc0426cd63a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:00:25.231713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-60b49fe6-ae9e-4510-a126-3fc0426cd63a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:00:25.344777 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60b49fe6-ae9e-4510-a126-3fc0426cd63a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.161197 Jul 01 11:00:25.345409 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2938/5783] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:00:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:25.375449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:25.376082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:25.383893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:25.384332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:25.387198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:25.387198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:25.641355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:25.650194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:25.655895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:25.657574 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f34cf39a-8394-47f4-9740-0024fbc28f59 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2948 microversion: 2.32 time: 0.288147 Jul 01 11:00:25.673295 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2846/5784] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:00:25 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2948 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:00:25.682949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-13dd111e-e05a-442d-b7e1-c2c64d438007 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:25.684277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-13dd111e-e05a-442d-b7e1-c2c64d438007 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:25.696733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13dd111e-e05a-442d-b7e1-c2c64d438007 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:25.697222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13dd111e-e05a-442d-b7e1-c2c64d438007 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:25.698017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13dd111e-e05a-442d-b7e1-c2c64d438007 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:25.698457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-13dd111e-e05a-442d-b7e1-c2c64d438007 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:25.893631 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-13dd111e-e05a-442d-b7e1-c2c64d438007 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.214642 Jul 01 11:00:25.894233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2939/5785] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Jul 1 11:00:25 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281/os-interface => generated 1831 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:00:36.247716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-273040600", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "6cbde098-bd87-4959-afb6-8dd8788105cf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-567536112", "security_groups": [{"name": "tempest-secgroup-smoke-720963068"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:36.261201 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:36.261201 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:36.416401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] validate_networks() for [('6cbde098-bd87-4959-afb6-8dd8788105cf', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:00:37.243972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:00:37.244803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:00:37.245711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:00:37.246100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:00:37.246414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:00:37.264547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:37.265287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:37.265890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:37.266326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:37.294023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:00:37.319344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Getting quotas for user 0e83529d6b134262849efc588712bd0f and project 3844c974f9d84827a9d501d426da8817. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:00:37.390218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:00:37.406214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:00:37.559461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5dcc4dd9-752f-46f2-97f5-7457884e79e1 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.318150 Jul 01 11:00:37.561205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2847/5786] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:00:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:00:37.568806 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:37.569773 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:37.570674 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=36 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:37.574755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af761a78-2593-4544-9dc2-e6a1195165e2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:37.575492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af761a78-2593-4544-9dc2-e6a1195165e2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:37.714185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af761a78-2593-4544-9dc2-e6a1195165e2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:37.738549 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af761a78-2593-4544-9dc2-e6a1195165e2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1265 microversion: 2.1 time: 0.171430 Jul 01 11:00:37.747794 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2940/5787] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:37 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:38.757455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:38.758152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:38.788008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:38.788905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:38.789846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:38.790378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:38.899041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:38.907515 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b9c2442-499a-4deb-971b-45b0ca010905 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1269 microversion: 2.1 time: 0.155846 Jul 01 11:00:38.919263 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2848/5788] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:38 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:39.927573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:39.930023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:39.954600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:39.955957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:39.959534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:39.961968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:40.062868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:40.071403 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c754cafa-fbab-476e-8972-bb98cade9d98 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1317 microversion: 2.1 time: 0.148980 Jul 01 11:00:40.081871 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2941/5789] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:39 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:41.093402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:41.094637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:41.102789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:41.108410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:41.108410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:41.108410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:41.219896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:41.241552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fd87680-2372-4ea3-b781-3ecb887b244e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1323 microversion: 2.1 time: 0.152607 Jul 01 11:00:41.243208 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2849/5790] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:41 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:42.259134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:42.259732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:42.275329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:42.275460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:42.276176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:42.278204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:42.451189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:42.459957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96689373-c9e5-4d4b-86ad-240e7711dc04 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.205056 Jul 01 11:00:42.461045 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2942/5791] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:42 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:43.023017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-98661afb-119d-41d4-8021-7141be6e1961 req-3e2e8c2f-3578-4c4b-b1c7-cb7ec4976dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ed1f8c-7c00-486c-a625-240c57ff013d", "tag": "1d195029-c58f-42c6-aa29-7c4277a447cc"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:43.040593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-98661afb-119d-41d4-8021-7141be6e1961 req-3e2e8c2f-3578-4c4b-b1c7-cb7ec4976dda service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:43.042191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-98661afb-119d-41d4-8021-7141be6e1961 req-3e2e8c2f-3578-4c4b-b1c7-cb7ec4976dda service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:43.068533 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-98661afb-119d-41d4-8021-7141be6e1961 req-3e2e8c2f-3578-4c4b-b1c7-cb7ec4976dda service nova] Creating event network-changed:1d195029-c58f-42c6-aa29-7c4277a447cc for instance c2ed1f8c-7c00-486c-a625-240c57ff013d on n-h2-master-1 Jul 01 11:00:43.074915 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-98661afb-119d-41d4-8021-7141be6e1961 req-3e2e8c2f-3578-4c4b-b1c7-cb7ec4976dda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058249 Jul 01 11:00:43.075650 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2850/5792] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:43.491034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:43.491747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:43.500406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:43.500873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:43.502306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:43.503033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:43.777559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:43.787758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-975f0133-d579-4155-b943-0dfb2cfb0002 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.300779 Jul 01 11:00:43.789126 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2943/5793] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:43 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:44.809197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:44.810451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:44.827202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:44.827202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:44.827202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:44.827202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:45.032049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:45.040088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51fb8345-27ac-4845-b523-4fe71b043493 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.239744 Jul 01 11:00:45.040857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2851/5794] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:44 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:46.057725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:46.058352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:46.094018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:46.096752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:46.097900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:46.098353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:46.304612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:46.316641 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f037ecfb-8f73-420a-a7d8-5f153e9eda26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.263301 Jul 01 11:00:46.318787 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2944/5795] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:46 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:47.336128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:47.336845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:47.339403 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:47.341179 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:47.344839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:47.345335 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:47.346105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:47.346542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:47.498519 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:47.507333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f9024ced-7819-4b61-ba6b-6a3ae7dcd005 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.175809 Jul 01 11:00:47.507904 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2852/5796] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:47 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:48.525428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:48.529776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:48.529776 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:00:48.534905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:48.535421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:48.536705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:48.537134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:48.712067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:48.720946 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c80e9eb0-fcdd-4554-80cf-56a6cc5af9e7 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.199699 Jul 01 11:00:48.722105 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2945/5797] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:48 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:49.739697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:49.741089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:49.749025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:49.749766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:49.750741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:49.751254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:49.865561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4baec532-b494-422d-b50c-95a06d6d3941 req-4b661ecf-44f1-4c08-bdf4-b4e5f7d723bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ed1f8c-7c00-486c-a625-240c57ff013d", "name": "network-vif-plugged", "status": "completed", "tag": "1d195029-c58f-42c6-aa29-7c4277a447cc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:49.893111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4baec532-b494-422d-b50c-95a06d6d3941 req-4b661ecf-44f1-4c08-bdf4-b4e5f7d723bb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:49.893909 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4baec532-b494-422d-b50c-95a06d6d3941 req-4b661ecf-44f1-4c08-bdf4-b4e5f7d723bb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:49.926100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4baec532-b494-422d-b50c-95a06d6d3941 req-4b661ecf-44f1-4c08-bdf4-b4e5f7d723bb service nova] Creating event network-vif-plugged:1d195029-c58f-42c6-aa29-7c4277a447cc for instance c2ed1f8c-7c00-486c-a625-240c57ff013d on n-h2-master-1 Jul 01 11:00:49.934221 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4baec532-b494-422d-b50c-95a06d6d3941 req-4b661ecf-44f1-4c08-bdf4-b4e5f7d723bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078409 Jul 01 11:00:49.941632 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2946/5798] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:00:50.285898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:50.295293 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ebd2880-598d-4cc1-9671-bdf37c414183 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.560302 Jul 01 11:00:50.320461 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2853/5799] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:49 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:51.322659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:51.323369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:51.330495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:51.331219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:51.331997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:51.332437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:51.742344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:51.754642 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-509ca732-5994-4300-8ccb-030230b3d6bb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1390 microversion: 2.1 time: 0.435889 Jul 01 11:00:51.755570 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2947/5800] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:51 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1390 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:52.772681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:52.773331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:52.792619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:52.793479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:52.794718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:52.795360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:52.963760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:52.973112 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd467d69-96db-4f94-99cc-f17c95029714 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1563 microversion: 2.1 time: 0.205195 Jul 01 11:00:52.973790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2854/5801] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:52 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:52.993552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:52.994423 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:53.002299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:53.002747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:53.003737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:53.004421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:53.174255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:53.182850 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93013836-ab88-4953-ad78-0ce3fb923cc2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1563 microversion: 2.1 time: 0.193901 Jul 01 11:00:53.184015 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2948/5802] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:52 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:00:55.563944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:00:55.565429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-40e6f734-2b38-4142-8e4e-79ff49a2038f req-a807521d-3ae8-4ddc-8605-49528befea76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ed1f8c-7c00-486c-a625-240c57ff013d", "tag": "1d195029-c58f-42c6-aa29-7c4277a447cc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:00:55.566583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:00:55.578025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:55.584304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:55.585415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:55.586147 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-40e6f734-2b38-4142-8e4e-79ff49a2038f req-a807521d-3ae8-4ddc-8605-49528befea76 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:00:55.592318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:55.598890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-40e6f734-2b38-4142-8e4e-79ff49a2038f req-a807521d-3ae8-4ddc-8605-49528befea76 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:00:55.628513 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-40e6f734-2b38-4142-8e4e-79ff49a2038f req-a807521d-3ae8-4ddc-8605-49528befea76 service nova] Creating event network-changed:1d195029-c58f-42c6-aa29-7c4277a447cc for instance c2ed1f8c-7c00-486c-a625-240c57ff013d on n-h2-master-1 Jul 01 11:00:55.656319 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-40e6f734-2b38-4142-8e4e-79ff49a2038f req-a807521d-3ae8-4ddc-8605-49528befea76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092890 Jul 01 11:00:55.657226 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2949/5803] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:00:55.858280 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:00:55.866396 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21760066-aa37-4df2-b369-6bdcbae8598a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1563 microversion: 2.1 time: 0.311964 Jul 01 11:00:55.866978 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2855/5804] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:00:55 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1563 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:18.298025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db6d1e0e-b447-4e66-ad65-8095d2a3fc09 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:01:18.313678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db6d1e0e-b447-4e66-ad65-8095d2a3fc09 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:18.313678 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=22 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:01:18.313678 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=46 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:01:18.324995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db6d1e0e-b447-4e66-ad65-8095d2a3fc09 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:18.326139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db6d1e0e-b447-4e66-ad65-8095d2a3fc09 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:18.327239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db6d1e0e-b447-4e66-ad65-8095d2a3fc09 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:18.327941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db6d1e0e-b447-4e66-ad65-8095d2a3fc09 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:18.420093 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db6d1e0e-b447-4e66-ad65-8095d2a3fc09 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d/action" status: 200 len: 24567 microversion: 2.1 time: 0.127994 Jul 01 11:01:18.421816 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2950/5805] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:01:18 2022] POST /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d/action => generated 24567 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:01:29.328548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:01:29.330090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:29.332203 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:01:29.332878 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=46 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:01:29.337872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:29.338321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:29.339087 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:29.339523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:29.427079 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:01:29.427504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:01:29.427986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:01:29.428395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:01:29.428810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:01:29.647163 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:29.654316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:29.654863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:29.655709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:29.656231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:29.686513 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42685d4d-f7d5-4e50-b530-fe724bc93be6 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d/action" status: 202 len: 1138 microversion: 2.1 time: 0.361612 Jul 01 11:01:29.686513 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2856/5806] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:01:29 2022] POST /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d/action => generated 1138 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 01 11:01:29.702347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:29.703052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:29.711973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:29.712426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:29.713244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:29.713689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:29.945906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:29.954068 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-371704bf-957c-453d-9e3f-fbbecb2b03dd tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.256229 Jul 01 11:01:29.954849 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2951/5807] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:29 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:30.972112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:30.972892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:30.980620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:30.981068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:30.981864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:30.982295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:31.126648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:31.138718 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-210e495d-7656-4c84-9c48-dbf78ebe1715 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.170539 Jul 01 11:01:31.139401 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2857/5808] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:30 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:32.155838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:32.156454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:32.163805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:32.164256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:32.165038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:32.177371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:32.339942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:32.348735 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2b54aa08-71bf-4735-a7a4-54ee0060ba06 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.196816 Jul 01 11:01:32.349955 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2952/5809] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:32 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:33.366441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:33.367121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:33.374851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:33.375303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:33.376115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:33.376554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:33.595185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:33.603060 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e687e2dd-0887-4b7e-b508-789ff4377e1e tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.240746 Jul 01 11:01:33.604303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2858/5810] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:33 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:34.622266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:34.623620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:34.651979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:34.652747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:34.653820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:34.654435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:34.863205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:34.871697 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9306c537-52dd-4564-b574-49ca62bb4b4d tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.254437 Jul 01 11:01:34.876458 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2953/5811] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:34 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:35.889037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:35.890081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:35.899291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:35.899817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:35.900604 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:35.901068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:36.065865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:36.073659 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d4c0a4d-7a5a-4ef1-ac8f-f7de1eedfd9b tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.188712 Jul 01 11:01:36.074232 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2859/5812] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:35 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:37.090724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:37.091651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:37.101786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:37.101786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:37.101786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:37.101786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:37.263772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:37.274037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f2400ac1-4217-4aec-8a49-f8259d516555 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.187276 Jul 01 11:01:37.285732 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2954/5813] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:37 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:38.290937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:38.291561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:38.298529 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:38.298975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:38.299745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:38.300377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:38.475408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:38.483419 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f4c1b42e-a029-44e1-92aa-41606f7f8d85 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.196383 Jul 01 11:01:38.493933 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2860/5814] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:38 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:39.501180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:39.501796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:39.516347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:39.517008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:39.517993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:39.518668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:39.715162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:39.724980 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ef6b0cc-9949-4627-9e64-e70b0586678a tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.227683 Jul 01 11:01:39.727308 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2955/5815] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:39 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:40.742982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:40.744734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:40.751325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:40.751778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:40.752948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:40.754057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:41.009599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:41.028040 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e034b434-91d9-4df7-b9d7-3628261a3d86 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.289180 Jul 01 11:01:41.028927 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2861/5816] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:40 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:42.047054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:42.047667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:42.054728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:42.055180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:42.055963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:42.056400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:42.246198 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:42.258550 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3085365-3cb3-4a57-a204-170e0a4ce520 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1691 microversion: 2.1 time: 0.217262 Jul 01 11:01:42.259815 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2956/5817] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:42 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1691 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:43.275891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:43.276454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:43.283535 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:43.283978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:43.297545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:43.299102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:43.473681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:43.482914 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cba7e07b-9cf3-40b4-b151-28038d3dfc89 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1697 microversion: 2.1 time: 0.210855 Jul 01 11:01:43.483500 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2862/5818] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:43 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:44.502362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:44.503750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:44.510798 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:44.511779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:44.512811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:44.519097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:44.814127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:44.843755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-52622508-1158-4eff-bf45-a2110d455a0f tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1697 microversion: 2.1 time: 0.345978 Jul 01 11:01:44.844373 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2957/5819] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:44 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1697 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:45.864399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:01:45.865729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:01:45.880290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:45.880920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:45.894497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:45.894497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:46.342715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:01:46.351383 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4336c28d-bad8-4cf0-a269-1e87e390cf00 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1682 microversion: 2.1 time: 0.491520 Jul 01 11:01:46.365672 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2863/5820] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:01:45 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1682 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:01:46.602863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b4e93a6b-1d6f-4954-ad71-b80d041f2f4d req-849efab1-ec0f-407d-af45-38b9b5bc244b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ed1f8c-7c00-486c-a625-240c57ff013d", "name": "network-vif-unplugged", "status": "completed", "tag": "1d195029-c58f-42c6-aa29-7c4277a447cc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:01:46.619275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b4e93a6b-1d6f-4954-ad71-b80d041f2f4d req-849efab1-ec0f-407d-af45-38b9b5bc244b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:46.619737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b4e93a6b-1d6f-4954-ad71-b80d041f2f4d req-849efab1-ec0f-407d-af45-38b9b5bc244b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:46.653873 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b4e93a6b-1d6f-4954-ad71-b80d041f2f4d req-849efab1-ec0f-407d-af45-38b9b5bc244b service nova] Creating event network-vif-unplugged:1d195029-c58f-42c6-aa29-7c4277a447cc for instance c2ed1f8c-7c00-486c-a625-240c57ff013d on n-h2-master-1 Jul 01 11:01:46.662848 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b4e93a6b-1d6f-4954-ad71-b80d041f2f4d req-849efab1-ec0f-407d-af45-38b9b5bc244b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063707 Jul 01 11:01:46.663812 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2958/5821] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:01:50.328172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-bb157f13-e088-45a8-ab82-d93c8270d862 req-fa959355-ac2b-4ad7-a2f4-ac942bfc164d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ed1f8c-7c00-486c-a625-240c57ff013d", "name": "network-vif-plugged", "status": "completed", "tag": "1d195029-c58f-42c6-aa29-7c4277a447cc"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:01:50.342839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bb157f13-e088-45a8-ab82-d93c8270d862 req-fa959355-ac2b-4ad7-a2f4-ac942bfc164d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:01:50.343282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bb157f13-e088-45a8-ab82-d93c8270d862 req-fa959355-ac2b-4ad7-a2f4-ac942bfc164d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:01:50.376153 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-bb157f13-e088-45a8-ab82-d93c8270d862 req-fa959355-ac2b-4ad7-a2f4-ac942bfc164d service nova] Creating event network-vif-plugged:1d195029-c58f-42c6-aa29-7c4277a447cc for instance c2ed1f8c-7c00-486c-a625-240c57ff013d on n-h2-master-1 Jul 01 11:01:50.383091 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-bb157f13-e088-45a8-ab82-d93c8270d862 req-fa959355-ac2b-4ad7-a2f4-ac942bfc164d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058444 Jul 01 11:01:50.383857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2864/5822] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:12.594842 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=18 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:12.595595 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=48 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:12.600438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab5410db-fd54-46d0-ac53-e43a901e91fb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:12.601554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab5410db-fd54-46d0-ac53-e43a901e91fb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:12.607875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab5410db-fd54-46d0-ac53-e43a901e91fb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:12.608349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab5410db-fd54-46d0-ac53-e43a901e91fb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:12.609365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab5410db-fd54-46d0-ac53-e43a901e91fb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:12.609800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab5410db-fd54-46d0-ac53-e43a901e91fb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:12.673330 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab5410db-fd54-46d0-ac53-e43a901e91fb tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "POST /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d/action" status: 200 len: 24572 microversion: 2.1 time: 0.080213 Jul 01 11:02:12.674008 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2959/5823] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:02:12 2022] POST /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d/action => generated 24572 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:02:14.096678 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=22 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:14.097571 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:14.101631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-520287967", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "f2121174-f447-454c-80ee-1552a61e1b21"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:14.158924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] validate_networks() for [('f2121174-f447-454c-80ee-1552a61e1b21', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:02:14.748538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:02:14.749357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:02:14.750069 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:02:14.750772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:02:14.751433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:02:14.769690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:14.773266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:14.773266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:14.773266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:14.791550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Getting quotas for project adeeb0d6512244a485d04dcf1e43cdab. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:02:14.798647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Getting quotas for user db3b812d82b843da837229bf82f78229 and project adeeb0d6512244a485d04dcf1e43cdab. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:02:14.813720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:02:14.816143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:02:14.943546 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e577a68e-a8a5-455a-9a3e-fb84a3556027 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849039 Jul 01 11:02:14.944290 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2865/5824] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 11:02:14.961478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1507afc7-e7a5-408e-b277-2c3a9828be5d tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:14.962328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1507afc7-e7a5-408e-b277-2c3a9828be5d tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:15.041507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1507afc7-e7a5-408e-b277-2c3a9828be5d tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:15.052822 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1507afc7-e7a5-408e-b277-2c3a9828be5d tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1218 microversion: 2.1 time: 0.096120 Jul 01 11:02:15.053607 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2960/5825] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:14 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:16.071222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98ea0884-1802-473c-b84b-a6a20c776ee1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:16.071984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98ea0884-1802-473c-b84b-a6a20c776ee1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:16.162898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98ea0884-1802-473c-b84b-a6a20c776ee1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:16.170978 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98ea0884-1802-473c-b84b-a6a20c776ee1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1218 microversion: 2.1 time: 0.104479 Jul 01 11:02:16.172637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2866/5826] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:16 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:17.191159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:17.191937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:17.202649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:17.203344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:17.204276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:17.204849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:17.274728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:17.283277 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a98f768-c7dc-4856-b1a6-9ec18cc3d149 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1270 microversion: 2.1 time: 0.097646 Jul 01 11:02:17.284044 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2961/5827] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:17 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:18.302701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:18.303475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:18.314706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:18.316782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:18.318059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:18.318524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:18.407772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:18.420496 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8afb9183-044f-430a-9272-150800695426 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1276 microversion: 2.1 time: 0.124277 Jul 01 11:02:18.430581 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2867/5828] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:18 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:19.439329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:19.439859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:19.451431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:19.454767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:19.457544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:19.458200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:19.695551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:19.704570 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ee9c84e6-dd16-4412-a836-889c9e9f44d5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1318 microversion: 2.1 time: 0.269645 Jul 01 11:02:19.707024 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2962/5829] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:19 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:20.723144 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:20.724499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:20.731959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:20.733007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:20.734301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:20.735094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:20.946375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d1780554-d81b-43ac-bfec-f34b8c20be6b req-1011e617-12b6-40be-a389-4f005e5345e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969e30d9-1829-4d26-b18c-f8032875b451", "tag": "173c088a-3dbd-46e3-bc0d-805e9624e14a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:20.970122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d1780554-d81b-43ac-bfec-f34b8c20be6b req-1011e617-12b6-40be-a389-4f005e5345e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:20.970122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d1780554-d81b-43ac-bfec-f34b8c20be6b req-1011e617-12b6-40be-a389-4f005e5345e9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:20.978110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:20.990292 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d1780554-d81b-43ac-bfec-f34b8c20be6b req-1011e617-12b6-40be-a389-4f005e5345e9 service nova] Creating event network-changed:173c088a-3dbd-46e3-bc0d-805e9624e14a for instance 969e30d9-1829-4d26-b18c-f8032875b451 on n-h2-master-1 Jul 01 11:02:21.001736 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-778fb996-739b-4153-afea-5c0069192434 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1318 microversion: 2.1 time: 0.283368 Jul 01 11:02:21.006183 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d1780554-d81b-43ac-bfec-f34b8c20be6b req-1011e617-12b6-40be-a389-4f005e5345e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063301 Jul 01 11:02:21.007079 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2963/5830] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:02:21.012364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2868/5831] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:20 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:22.026978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:22.028641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:22.040744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:22.049006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:22.049006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:22.049006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:22.551470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:22.559630 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d770a9d0-25f4-4e4e-bdac-e2a43e7f7ee4 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1318 microversion: 2.1 time: 0.543890 Jul 01 11:02:22.560215 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2964/5832] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:22 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:23.578741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:23.578741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:23.586654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:23.587185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:23.588154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:23.588819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:23.805322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:23.816581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-efa6ff3d-e10c-4aa7-a83b-729102babcda tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1318 microversion: 2.1 time: 0.242560 Jul 01 11:02:23.822005 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2869/5833] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:23 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:24.843317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:24.849778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:24.856923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:24.857595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:24.859689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:24.862026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:25.053017 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:25.509697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:25.524824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be97437b-59a4-447e-907e-bf4f839719cc tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1318 microversion: 2.1 time: 0.686501 Jul 01 11:02:25.529230 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2965/5834] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:24 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:25.768843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:25.769657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:25.777365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ad0b793e-a0a5-4e32-9cbd-7d4a81b61200 req-f7fa0eca-b90d-4e13-9a70-5044f19ba7db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ed1f8c-7c00-486c-a625-240c57ff013d", "tag": "1d195029-c58f-42c6-aa29-7c4277a447cc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:25.790343 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:25.803099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ad0b793e-a0a5-4e32-9cbd-7d4a81b61200 req-f7fa0eca-b90d-4e13-9a70-5044f19ba7db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:25.803547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ad0b793e-a0a5-4e32-9cbd-7d4a81b61200 req-f7fa0eca-b90d-4e13-9a70-5044f19ba7db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:25.808039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:25.808498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:25.813731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:25.813857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:25.834276 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ad0b793e-a0a5-4e32-9cbd-7d4a81b61200 req-f7fa0eca-b90d-4e13-9a70-5044f19ba7db service nova] Creating event network-changed:1d195029-c58f-42c6-aa29-7c4277a447cc for instance c2ed1f8c-7c00-486c-a625-240c57ff013d on n-h2-master-1 Jul 01 11:02:25.852358 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ad0b793e-a0a5-4e32-9cbd-7d4a81b61200 req-f7fa0eca-b90d-4e13-9a70-5044f19ba7db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080547 Jul 01 11:02:25.855701 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2966/5835] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:25.891989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:02:26.168247 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:26.274586 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d8f4b30-1f7c-4a6c-a433-13b080818f01 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 204 len: 0 microversion: 2.1 time: 0.509344 Jul 01 11:02:26.275681 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2870/5836] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:02:25 2022] DELETE /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 11:02:26.286574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:26.288046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:26.309558 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:26.310563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:26.312515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:26.313165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:26.547303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:26.550620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:26.569572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:26.571315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:26.573451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:26.573924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:26.731689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:26.758434 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a96b8533-671c-496c-b933-5c702fe935a8 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1688 microversion: 2.1 time: 0.477875 Jul 01 11:02:26.759272 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2967/5837] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:26 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1688 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:26.854453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c72cb532-ba3f-4e62-9d54-57188edfdc55 req-e1a9f8c0-7473-4b59-8279-fe8cce19953a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969e30d9-1829-4d26-b18c-f8032875b451", "name": "network-vif-plugged", "status": "completed", "tag": "173c088a-3dbd-46e3-bc0d-805e9624e14a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:26.870783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c72cb532-ba3f-4e62-9d54-57188edfdc55 req-e1a9f8c0-7473-4b59-8279-fe8cce19953a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:26.871573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c72cb532-ba3f-4e62-9d54-57188edfdc55 req-e1a9f8c0-7473-4b59-8279-fe8cce19953a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:26.901831 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c72cb532-ba3f-4e62-9d54-57188edfdc55 req-e1a9f8c0-7473-4b59-8279-fe8cce19953a service nova] Creating event network-vif-plugged:173c088a-3dbd-46e3-bc0d-805e9624e14a for instance 969e30d9-1829-4d26-b18c-f8032875b451 on n-h2-master-1 Jul 01 11:02:26.902443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:26.910966 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c72cb532-ba3f-4e62-9d54-57188edfdc55 req-e1a9f8c0-7473-4b59-8279-fe8cce19953a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065806 Jul 01 11:02:26.912163 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2968/5838] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:26.916506 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31b51fa3-7604-4ad9-b1ea-fab2d1e80b3c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1318 microversion: 2.1 time: 0.371855 Jul 01 11:02:26.917794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2871/5839] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:26 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:27.029809 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:02:27.029977 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:02:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:02:27.777737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:27.779037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:27.789601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:27.795440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:27.796503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:27.797602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:27.935506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:27.936122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:27.944327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:27.945027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:27.946051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:27.946626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:28.365383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:28.374970 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd2392eb-db7e-4b3e-b712-8459e3099f92 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1688 microversion: 2.1 time: 0.602321 Jul 01 11:02:28.376583 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2969/5840] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:27 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1688 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:28.490610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:28.524408 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-043635f4-3c11-4e6b-84b7-b1ce990be10f tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1318 microversion: 2.1 time: 0.592454 Jul 01 11:02:28.525626 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2872/5841] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:27 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:02:29.107562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-29683f4d-06d7-45af-b3b8-b94b71dea45d req-03f8e8db-a4c7-4fa6-b830-7d53e66ae0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ed1f8c-7c00-486c-a625-240c57ff013d", "name": "network-vif-deleted", "tag": "1d195029-c58f-42c6-aa29-7c4277a447cc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:29.124649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-29683f4d-06d7-45af-b3b8-b94b71dea45d req-03f8e8db-a4c7-4fa6-b830-7d53e66ae0d7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:29.126289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-29683f4d-06d7-45af-b3b8-b94b71dea45d req-03f8e8db-a4c7-4fa6-b830-7d53e66ae0d7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:29.146989 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-29683f4d-06d7-45af-b3b8-b94b71dea45d req-03f8e8db-a4c7-4fa6-b830-7d53e66ae0d7 service nova] Creating event network-vif-deleted:1d195029-c58f-42c6-aa29-7c4277a447cc for instance c2ed1f8c-7c00-486c-a625-240c57ff013d on n-h2-master-1 Jul 01 11:02:29.153644 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-29683f4d-06d7-45af-b3b8-b94b71dea45d req-03f8e8db-a4c7-4fa6-b830-7d53e66ae0d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218054 Jul 01 11:02:29.154951 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2970/5842] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:29.394857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:29.397088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:29.404818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:29.405347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:29.406120 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:29.406551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:29.444443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:29.444940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:29.445542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lazy-loading 'fault' on Instance uuid c2ed1f8c-7c00-486c-a625-240c57ff013d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:02:29.515979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e83529d6b134262849efc588712bd0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3844c974f9d84827a9d501d426da8817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:29.524532 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c655d626-ae6c-4cac-a28c-86021fbbaf26 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 200 len: 1355 microversion: 2.1 time: 0.134240 Jul 01 11:02:29.526440 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2873/5843] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:29 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 1355 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:29.543193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:29.544697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:29.553888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:29.555212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:29.556519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:29.557222 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:29.820406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:29.828046 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-158784f3-d0da-41f2-89f8-6a078255d970 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1507 microversion: 2.1 time: 0.289623 Jul 01 11:02:29.828612 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2971/5844] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:29 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:02:30.220795 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:30.221393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:30.240598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:30.241247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:30.242242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:30.242806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:30.280258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:02:30.554787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:30.560394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] [instance: c2ed1f8c-7c00-486c-a625-240c57ff013d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:30.576109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:30.582025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:30.583239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:30.583917 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:30.607485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] HTTP exception thrown: Instance c2ed1f8c-7c00-486c-a625-240c57ff013d could not be found. Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Request method failure captured: Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d HTTP/1.1 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtIMAE4-bQXaEWnIiv5xqMUHPv0jdduWWZpIoL5be7dlGtfQRFL8NNsCC8ke9IXOipeg42ChW0EIK3ytKLDH2l7c8k0hc5J5oKDbzBtFHorJrWbPnlCUbp9XAxMzLNPQCml9MqGh9WTkCve-gvYt6xltduu4CnNUodriQSOL1yJGoCQ Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3844c974f9d84827a9d501d426da8817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3844c974f9d84827a9d501d426da8817", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3844c974f9d84827a9d501d426da8817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 3844c974f9d84827a9d501d426da8817 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1118778763 Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 0e83529d6b134262849efc588712bd0f Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1118778763-project Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: exception: Instance c2ed1f8c-7c00-486c-a625-240c57ff013d could not be found. Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'c2ed1f8c-7c00-486c-a625-240c57ff013d'} Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ed1f8c-7c00-486c-a625-240c57ff013d could not be found. Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ed1f8c-7c00-486c-a625-240c57ff013d could not be found. Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:02:30.610214 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ed1f8c-7c00-486c-a625-240c57ff013d could not be found. Jul 01 11:02:30.614686 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:02:30.616170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Returning 404 to user: Instance c2ed1f8c-7c00-486c-a625-240c57ff013d could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:02:30.617136 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f568b089-6b8e-44c6-a4a1-f92b60b9d3b2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d" status: 404 len: 111 microversion: 2.1 time: 0.078079 Jul 01 11:02:30.617734 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2972/5845] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:02:30 2022] GET /compute/v2.1/servers/c2ed1f8c-7c00-486c-a625-240c57ff013d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:02:30.685863 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-394585c9-5834-4c11-a030-36dc4852c94a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 204 len: 0 microversion: 2.32 time: 0.619153 Jul 01 11:02:30.687323 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2874/5846] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 11:02:30 2022] DELETE /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 11:02:30.696479 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:30.698003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:30.706705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:30.707472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:30.708793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:30.709413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:31.464292 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:31.478107 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:31.480988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:31.482837 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-896c0a89-39dd-428c-a2b5-3832321210b7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2954 microversion: 2.32 time: 0.790629 Jul 01 11:02:31.484058 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2973/5847] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:30 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2954 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:32.506332 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:32.507088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:32.515814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:32.516839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:32.518478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:32.523787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:32.871360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:32.897273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:32.899324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:32.901048 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00ec4c9c-421c-4874-bf98-6e9672d752e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2954 microversion: 2.32 time: 0.401342 Jul 01 11:02:32.902904 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2875/5848] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:32 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2954 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:33.925776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:33.927353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:33.939729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:33.940380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:33.943123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:33.943895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:35.011025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:35.040420 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:35.043492 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:35.058070 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bf7c5d48-4884-436d-bacd-6fc0128dd66f tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2954 microversion: 2.32 time: 1.135636 Jul 01 11:02:35.058070 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2974/5849] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:33 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2954 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:36.086269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:36.087628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:36.096332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:36.096973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:36.098471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:36.099079 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:36.770474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:36.780821 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:36.791902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:36.794138 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-49fb8663-11d7-4a9e-9cca-0d9b010d0bc1 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2933 microversion: 2.32 time: 0.711988 Jul 01 11:02:36.801271 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2876/5850] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:36 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2933 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:37.822472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:37.823236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:37.829709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:37.833960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:37.833960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:37.833960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:38.084271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8da30b56-127a-41a9-a38a-052392a3c2a2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] Calling method '.version_select at 0x7f6f9068a940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:38.185320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:38.202320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:38.202320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:38.202320 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e49124a-f834-416f-9755-dbe12c9b6156 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2912 microversion: 2.32 time: 0.385547 Jul 01 11:02:38.204965 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2975/5851] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:37 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2912 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:38.211906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2e8399e7-a747-4858-b4b1-64470b7a04cd req-b718f951-baa6-43c5-832d-d9670d2acc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-unplugged", "status": "completed", "tag": "77966735-1c04-4005-be41-194f63188932"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:38.217080 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8da30b56-127a-41a9-a38a-052392a3c2a2 tempest-TestNetworkAdvancedServerOps-1118778763 tempest-TestNetworkAdvancedServerOps-1118778763-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-567536112" status: 202 len: 0 microversion: 2.1 time: 0.138175 Jul 01 11:02:38.218080 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2877/5852] 10.222.0.23 () {58 vars in 1280 bytes} [Fri Jul 1 11:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-567536112 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:02:38.232705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2e8399e7-a747-4858-b4b1-64470b7a04cd req-b718f951-baa6-43c5-832d-d9670d2acc34 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:38.232705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2e8399e7-a747-4858-b4b1-64470b7a04cd req-b718f951-baa6-43c5-832d-d9670d2acc34 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:38.276718 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2e8399e7-a747-4858-b4b1-64470b7a04cd req-b718f951-baa6-43c5-832d-d9670d2acc34 service nova] Creating event network-vif-unplugged:77966735-1c04-4005-be41-194f63188932 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:38.287766 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2e8399e7-a747-4858-b4b1-64470b7a04cd req-b718f951-baa6-43c5-832d-d9670d2acc34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078826 Jul 01 11:02:38.287766 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2976/5853] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:39.228117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:39.229376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:39.249717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:39.250143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:39.251256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:39.256992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:39.720961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7837ac15-42d9-4d14-b008-7317d9bee336 req-2b2fa798-4418-4078-9a9d-c5f1de54daa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-deleted", "tag": "77966735-1c04-4005-be41-194f63188932"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:39.730773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7837ac15-42d9-4d14-b008-7317d9bee336 req-2b2fa798-4418-4078-9a9d-c5f1de54daa4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:39.731566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7837ac15-42d9-4d14-b008-7317d9bee336 req-2b2fa798-4418-4078-9a9d-c5f1de54daa4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:39.746380 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7837ac15-42d9-4d14-b008-7317d9bee336 req-2b2fa798-4418-4078-9a9d-c5f1de54daa4 service nova] Creating event network-vif-deleted:77966735-1c04-4005-be41-194f63188932 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:39.752692 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7837ac15-42d9-4d14-b008-7317d9bee336 req-2b2fa798-4418-4078-9a9d-c5f1de54daa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036134 Jul 01 11:02:39.753893 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2977/5854] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:02:40.183427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:40.196969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:40.213087 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:40.214598 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c34e978-845e-42cb-988b-f599560cb401 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2865 microversion: 2.32 time: 0.994259 Jul 01 11:02:40.216046 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2878/5855] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:39 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2865 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:40.362349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ef9a9c77-2145-4d7a-872e-7397444610f0 req-b0039b1f-a33d-4b83-996a-d130c8a3d8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-unplugged", "status": "completed", "tag": "044f5b59-e5a0-48b2-864b-fb9be08789bb"}, {"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-unplugged", "status": "completed", "tag": "7360206d-5c44-4232-a000-d876f44d6379"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:40.389747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ef9a9c77-2145-4d7a-872e-7397444610f0 req-b0039b1f-a33d-4b83-996a-d130c8a3d8e5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:40.390270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ef9a9c77-2145-4d7a-872e-7397444610f0 req-b0039b1f-a33d-4b83-996a-d130c8a3d8e5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:40.423243 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ef9a9c77-2145-4d7a-872e-7397444610f0 req-b0039b1f-a33d-4b83-996a-d130c8a3d8e5 service nova] Creating event network-vif-unplugged:044f5b59-e5a0-48b2-864b-fb9be08789bb for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:40.424178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ef9a9c77-2145-4d7a-872e-7397444610f0 req-b0039b1f-a33d-4b83-996a-d130c8a3d8e5 service nova] Creating event network-vif-unplugged:7360206d-5c44-4232-a000-d876f44d6379 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:40.439184 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ef9a9c77-2145-4d7a-872e-7397444610f0 req-b0039b1f-a33d-4b83-996a-d130c8a3d8e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.084720 Jul 01 11:02:40.439808 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2978/5856] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:41.238702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:41.240003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:41.259293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:41.259734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:41.260536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:41.260981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:41.785937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fa5bf675-37e7-45bd-991f-3b7ca858b087 req-a56eba10-391e-4b3f-8e89-52d248c8d958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-deleted", "tag": "7753f5a0-0a8b-4a41-ae5e-b645aa7af02d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:41.832403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:41.848592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fa5bf675-37e7-45bd-991f-3b7ca858b087 req-a56eba10-391e-4b3f-8e89-52d248c8d958 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:41.849072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fa5bf675-37e7-45bd-991f-3b7ca858b087 req-a56eba10-391e-4b3f-8e89-52d248c8d958 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:41.854636 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:41.857685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:41.877702 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6a3bc73-f4ce-4258-9963-3f5d9c17cf1a tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2531 microversion: 2.32 time: 0.644533 Jul 01 11:02:41.878306 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2879/5857] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:41 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2531 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 11:02:41.907468 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fa5bf675-37e7-45bd-991f-3b7ca858b087 req-a56eba10-391e-4b3f-8e89-52d248c8d958 service nova] Creating event network-vif-deleted:7753f5a0-0a8b-4a41-ae5e-b645aa7af02d for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:41.941504 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fa5bf675-37e7-45bd-991f-3b7ca858b087 req-a56eba10-391e-4b3f-8e89-52d248c8d958 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164761 Jul 01 11:02:41.942443 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2979/5858] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:42.479897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-806d7f9c-813f-4da2-831d-bc511a62dc45 req-3512e40c-8f23-46c0-9fe6-2f8213229cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-unplugged", "status": "completed", "tag": "7753f5a0-0a8b-4a41-ae5e-b645aa7af02d"}, {"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-unplugged", "status": "completed", "tag": "28700afe-1082-43ca-8db3-5596ec5ccaf8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:42.491592 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-806d7f9c-813f-4da2-831d-bc511a62dc45 req-3512e40c-8f23-46c0-9fe6-2f8213229cb4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:42.492281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-806d7f9c-813f-4da2-831d-bc511a62dc45 req-3512e40c-8f23-46c0-9fe6-2f8213229cb4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:42.505131 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-806d7f9c-813f-4da2-831d-bc511a62dc45 req-3512e40c-8f23-46c0-9fe6-2f8213229cb4 service nova] Creating event network-vif-unplugged:7753f5a0-0a8b-4a41-ae5e-b645aa7af02d for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:42.505966 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-806d7f9c-813f-4da2-831d-bc511a62dc45 req-3512e40c-8f23-46c0-9fe6-2f8213229cb4 service nova] Creating event network-vif-unplugged:28700afe-1082-43ca-8db3-5596ec5ccaf8 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:42.511746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-806d7f9c-813f-4da2-831d-bc511a62dc45 req-3512e40c-8f23-46c0-9fe6-2f8213229cb4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.035525 Jul 01 11:02:42.512360 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2880/5859] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:42.904995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:42.905731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:42.917404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:42.921919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:42.922685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:42.923112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:43.540545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:43.557536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:43.561980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:43.563306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9056a0c5-7d2b-48b7-a61d-c355b8ba43b0 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2370 microversion: 2.32 time: 0.665020 Jul 01 11:02:43.568537 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2980/5860] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:42 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2370 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:44.143357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f7a245bd-9471-4274-b385-a84c3b94002d req-97ae80e4-e7a2-4f26-85bb-c96e0cdbc00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-deleted", "tag": "28700afe-1082-43ca-8db3-5596ec5ccaf8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:44.156388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f7a245bd-9471-4274-b385-a84c3b94002d req-97ae80e4-e7a2-4f26-85bb-c96e0cdbc00b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:44.157377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f7a245bd-9471-4274-b385-a84c3b94002d req-97ae80e4-e7a2-4f26-85bb-c96e0cdbc00b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:44.164620 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:44.175536 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f7a245bd-9471-4274-b385-a84c3b94002d req-97ae80e4-e7a2-4f26-85bb-c96e0cdbc00b service nova] Creating event network-vif-deleted:28700afe-1082-43ca-8db3-5596ec5ccaf8 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:44.185798 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f7a245bd-9471-4274-b385-a84c3b94002d req-97ae80e4-e7a2-4f26-85bb-c96e0cdbc00b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046977 Jul 01 11:02:44.185798 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2881/5861] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:02:44.585701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:44.587115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:44.599210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:44.600031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:44.601507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:44.602833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:44.957765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:44.987760 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=93 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:45.002408 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:45.006373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:45.006373 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ddca5a9-ec91-4b43-9bb5-637df249d3e7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2210 microversion: 2.32 time: 0.425699 Jul 01 11:02:45.009086 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2981/5862] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:44 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2210 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:46.026404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:46.027120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:46.041045 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:46.044810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:46.047672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:46.047672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:46.047672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:46.218957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:46.244155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:46.248834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-666c44ba-455b-4a61-b5f6-1eee1e250510 req-526dd22d-3d05-4043-a93a-1dd8abf87c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-deleted", "tag": "7360206d-5c44-4232-a000-d876f44d6379"}, {"server_uuid": "26e010b4-9803-411c-ba2b-e552309cf281", "name": "network-vif-deleted", "tag": "044f5b59-e5a0-48b2-864b-fb9be08789bb"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:46.253187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:46.260534 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f2e1abe1-bf25-4e38-b092-0a44b150195b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 2142 microversion: 2.32 time: 0.235487 Jul 01 11:02:46.261784 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2882/5863] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:46 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 2142 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:46.268866 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=49 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:02:46.281906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-666c44ba-455b-4a61-b5f6-1eee1e250510 req-526dd22d-3d05-4043-a93a-1dd8abf87c39 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:46.282407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-666c44ba-455b-4a61-b5f6-1eee1e250510 req-526dd22d-3d05-4043-a93a-1dd8abf87c39 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:46.325500 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-666c44ba-455b-4a61-b5f6-1eee1e250510 req-526dd22d-3d05-4043-a93a-1dd8abf87c39 service nova] Creating event network-vif-deleted:7360206d-5c44-4232-a000-d876f44d6379 for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:46.333459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-666c44ba-455b-4a61-b5f6-1eee1e250510 req-526dd22d-3d05-4043-a93a-1dd8abf87c39 service nova] Creating event network-vif-deleted:044f5b59-e5a0-48b2-864b-fb9be08789bb for instance 26e010b4-9803-411c-ba2b-e552309cf281 on n-h1-master-1 Jul 01 11:02:46.343578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-666c44ba-455b-4a61-b5f6-1eee1e250510 req-526dd22d-3d05-4043-a93a-1dd8abf87c39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100126 Jul 01 11:02:46.344676 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2982/5864] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:02:47.283651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:47.284274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:47.297106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:47.297106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:47.297106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:47.297106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:47.544964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:47.568309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:47.571249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:47.572834 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c0829fa2-9dd5-43c0-adcf-fa8f0c05f8ba tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.295487 Jul 01 11:02:47.574451 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2883/5865] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:47 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:48.604624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:48.604624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:48.608716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:48.609275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:48.610518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:48.611564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:48.754529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:48.772680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:48.777969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:48.777969 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b677cf9-e551-4d07-8572-553711d2ed65 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.183330 Jul 01 11:02:48.779974 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2983/5866] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:48 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:49.795726 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:49.796467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:49.810364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:49.815168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:49.816286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:49.821121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:49.979074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:49.993330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:49.995270 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:49.998456 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c161234b-6b15-44ae-9830-42332793bc3c tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.206652 Jul 01 11:02:50.002619 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2884/5867] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:49 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:51.092545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:51.092545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:51.092545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:51.092545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:51.092545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:51.092545 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:51.217839 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:51.229886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:51.231905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:51.245643 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3b2966b0-407f-4475-86ce-81060808b246 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.204084 Jul 01 11:02:51.258548 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2984/5868] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:51 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:52.319145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:52.319145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:52.319145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:52.319145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:52.319145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:52.319145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:52.414978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:52.432386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:52.441802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:52.446465 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-966ab036-8cb2-4ad5-861b-ee0703973c47 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.182496 Jul 01 11:02:52.467164 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2885/5869] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:52 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:53.473811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:53.475265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:53.484317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:53.488616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:53.488616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:53.488616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:53.717031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:53.737921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:53.746831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:53.754446 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce6f72d8-4973-4826-9b36-4eca3b694ca9 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.284481 Jul 01 11:02:53.767801 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2985/5870] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:53 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:54.773118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:54.773603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:54.784124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:54.784589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:54.792588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:54.792588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:54.958026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:54.971471 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:54.978652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:54.980003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c27e755-a6d2-4298-8499-4f91326d62f7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.211306 Jul 01 11:02:54.980617 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2886/5871] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:54 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:56.002978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:56.003633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:56.018512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:56.018966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:56.019760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:56.021010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:56.154429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:56.173799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:56.176080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:56.179971 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a9ccc1b3-37df-4bab-b67c-a4cd880a1b5d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.181664 Jul 01 11:02:56.183421 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2986/5872] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:55 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:57.202544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:57.203226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:57.247555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:57.249063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:57.249063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:57.278792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:57.507211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:57.541948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:57.543576 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:57.544821 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ccb2eab4-417d-4a12-b3a7-fc574b989c6b tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.346479 Jul 01 11:02:57.553907 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2887/5873] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:57 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 11:02:57.762986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5dc20de5-6de2-4f0a-98d3-8f3731dab27b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Action: 'create', calling method: .version_select at 0x7f6f970dd1f0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-308278340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBgFJIFr0kCCZso3A4FnB97U2x3T81UwSqjjj2L60sd6H41e1nF968HTb52VZJncag3yC46Z0nO3+0IBWlUR0cfgvpuiMbCkIT8382Uvp0Ow7x8i0q3YHHc4NAfdv6NTg=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:02:57.797710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5dc20de5-6de2-4f0a-98d3-8f3731dab27b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Getting quotas for project 662ddba9a14c4711b17f5df267ef48b6. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:02:57.821084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-5dc20de5-6de2-4f0a-98d3-8f3731dab27b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Getting quotas for user 5af9f39fc9a742f2b9a24bf221f2550c and project 662ddba9a14c4711b17f5df267ef48b6. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:02:57.968036 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5dc20de5-6de2-4f0a-98d3-8f3731dab27b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.566426 Jul 01 11:02:57.969486 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2987/5874] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:02:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:02:58.573316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:58.574814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:58.588518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:58.589299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:58.593218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:58.598473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:58.836039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:58.856167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:58.861592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:02:58.864032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-996ea824-2a5d-4d01-873f-26ee9e99d7c4 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.294511 Jul 01 11:02:58.868350 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2888/5875] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:58 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:02:59.908754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:02:59.908754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:02:59.945376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:59.946102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:02:59.952644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:02:59.953328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:00.279943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:00.306501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:00.316883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:00.322513 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2daccc7b-7156-4d1d-b966-fc08ecd7d298 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.439799 Jul 01 11:03:00.327516 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2988/5876] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:02:59 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:01.348195 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:01.349329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:01.363722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:01.364314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:01.369597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:01.370373 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:01.509166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:01.525999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:01.529984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:01.531509 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-da6c918b-acdd-4ca6-a585-ae2e34e80c72 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.188489 Jul 01 11:03:01.534361 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2889/5877] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:01 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:02.555025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:02.555646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:02.578236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:02.579660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:02.581310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:02.582642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:02.841229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:02.858725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:02.870824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:02.876045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-efc3aad1-6046-4fde-8d76-e7b1c4c50cda tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.326210 Jul 01 11:03:02.881653 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2989/5878] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:02 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 11:03:03.901069 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:03.902479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:03.916408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:03.919381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:03.921617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:03.925806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:04.162039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:04.174312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:04.180181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:04.184905 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3db7624-932d-4bf6-8994-329ae2bc9635 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.288610 Jul 01 11:03:04.189185 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2890/5879] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:03 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:05.205856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:05.206627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:05.218828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:05.222091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:05.223804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:05.225796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:05.432019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:05.446744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:05.467135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:05.469668 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0582a103-4fa6-4b40-babd-e1425f1bb657 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.267897 Jul 01 11:03:05.480533 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2990/5880] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:05 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:06.492880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:06.494224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:06.515934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:06.519663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:06.521683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:06.523300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:06.701265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:06.721704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:06.725710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:06.728321 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7ac720fb-cc1d-4754-b824-1ecb76f357be tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.241167 Jul 01 11:03:06.734696 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2891/5881] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:06 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:07.752886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:07.753566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:07.767698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:07.769553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:07.770822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:07.772294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:07.848869 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:07.912021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:07.924283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:07.931844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:07.938211 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2115611a-9984-4e45-a671-243d60daab78 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.187602 Jul 01 11:03:07.941171 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2991/5882] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:07 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:08.967093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:08.967093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:08.972544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:08.974451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:08.976686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:08.977841 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:09.090526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:09.104307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:09.111122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:09.112579 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-646cb324-9aee-4873-95d5-f3df4f6786a7 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.158791 Jul 01 11:03:09.113377 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2892/5883] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:08 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:10.043475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f46fd260-954a-43ad-8c63-9893db2f681a tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "925fd34c-bbb7-43de-b192-b401b8ab2611", "device": "/dev/sdb"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:03:10.044371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f46fd260-954a-43ad-8c63-9893db2f681a tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:10.071393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f46fd260-954a-43ad-8c63-9893db2f681a tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:10.075423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f46fd260-954a-43ad-8c63-9893db2f681a tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:10.075423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f46fd260-954a-43ad-8c63-9893db2f681a tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:10.075423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f46fd260-954a-43ad-8c63-9893db2f681a tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:10.132300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:10.133075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:10.146491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:10.149417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:10.150280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:10.150727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:10.267880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:10.280520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:10.283657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:10.284870 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1272d08e-ce0c-4a1a-96a8-ef4d1766b142 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1602 microversion: 2.32 time: 0.157049 Jul 01 11:03:10.288484 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2893/5884] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:10 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 11:03:11.238297 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f46fd260-954a-43ad-8c63-9893db2f681a tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "POST /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.203782 Jul 01 11:03:11.247605 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2992/5885] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 11:03:10 2022] POST /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:03:11.306216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:11.306895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:11.316875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:11.317375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:11.318450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:11.319080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:11.437882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:11.438382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:11.438848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lazy-loading 'fault' on Instance uuid 26e010b4-9803-411c-ba2b-e552309cf281 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:03:11.549110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:11.589344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:11.600787 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1921644ad67c45ce96876f62fc4a0d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967c76a816e140e9b6f375bfccac2275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:11.606757 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2f387f7-3d29-4486-a86b-1803438fcaa5 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 200 len: 1607 microversion: 2.32 time: 0.305782 Jul 01 11:03:11.620142 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2894/5886] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:11 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 1607 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 11:03:12.632778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:12.633547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:12.650077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:12.651476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:12.669928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:12.671547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:12.711805 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] HTTP exception thrown: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Request method failure captured: Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 HTTP/1.1 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtLEt6WwxQAALDdCKhk-S4uNj1ampNrCKCqDj62Es1NkavRnGfMI1h5Yht37Sdz65k7RtIuk182iyA8qTgU0rCOaK0jADELKszf4eiMH0TDvtGHurDWphM2hZ1ZLMwpG9_NHpc_KQDlBE9Ixu2JVy79ExnhtmmJ1F3kOEzIvHgQjfHM Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Openstack-Nova-Api-Version: 2.32 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 967c76a816e140e9b6f375bfccac2275 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_967c76a816e140e9b6f375bfccac2275", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 967c76a816e140e9b6f375bfccac2275 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TaggedBootDevicesTest-106839141-project Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 1921644ad67c45ce96876f62fc4a0d54 Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TaggedBootDevicesTest-106839141-project Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '26e010b4-9803-411c-ba2b-e552309cf281'} Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:03:12.717057 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:03:12.720896 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:12.720896 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:03:12.720896 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:03:12.720896 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:03:12.720896 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:03:12.720896 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:12.720896 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:03:12.722473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Returning 404 to user: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:03:12.723553 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eb3f58ad-bd2b-4530-93f7-99e3b1f2cedb tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 404 len: 111 microversion: 2.32 time: 0.099710 Jul 01 11:03:12.724140 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2993/5887] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:12 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:03:12.733709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5fbc1e8c-cef1-48b0-9a16-1a23de63d11d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '.version_select at 0x7f6f90759c10>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:12.822173 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5fbc1e8c-cef1-48b0-9a16-1a23de63d11d tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665042529" status: 204 len: 0 microversion: 2.32 time: 0.093217 Jul 01 11:03:12.823061 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2895/5888] 10.222.0.23 () {60 vars in 1258 bytes} [Fri Jul 1 11:03:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665042529 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 11:03:13.039623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1255095362-access_point-2017167133", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "0c08f6bc-a680-4988-acf7-1ed8208e7037"}], "key_name": "tempest-TestSecurityGroupsBasicOps-308278340", "security_groups": [{"name": "tempest-secgroup_access--998775325"}, {"name": "tempest-secgroup_general--907755899"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:03:13.308100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] validate_networks() for [('0c08f6bc-a680-4988-acf7-1ed8208e7037', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:03:14.387644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:03:14.388227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:03:14.388535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:03:14.388941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:03:14.390253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:03:14.405118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:14.407806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:14.408618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:14.409062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:14.462973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Getting quotas for project 662ddba9a14c4711b17f5df267ef48b6. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:03:14.478312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Getting quotas for user 5af9f39fc9a742f2b9a24bf221f2550c and project 662ddba9a14c4711b17f5df267ef48b6. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:03:14.524099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:03:14.528906 n-d-master-1 devstack@n-api.service[119764]: WARNING nova.utils [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1255095362-access_point-2017167133 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1255095362-ac Jul 01 11:03:14.530211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:03:14.760755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-61bda864-b08a-4536-afbb-183c882309e3 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.724997 Jul 01 11:03:14.770574 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2994/5889] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:03:13 2022] POST /compute/v2.1/servers => generated 456 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:03:14.773905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa2bc1ee-ddee-49b9-9c03-7c44f1ff206a tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:14.774528 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa2bc1ee-ddee-49b9-9c03-7c44f1ff206a tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:14.891685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa2bc1ee-ddee-49b9-9c03-7c44f1ff206a tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:14.908181 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa2bc1ee-ddee-49b9-9c03-7c44f1ff206a tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1294 microversion: 2.1 time: 0.139972 Jul 01 11:03:14.912511 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2896/5890] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:14 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1294 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:15.934047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f7e86ef-4ca7-4f91-bb8f-485252f9c2a8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:15.935487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2f7e86ef-4ca7-4f91-bb8f-485252f9c2a8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:16.096472 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2f7e86ef-4ca7-4f91-bb8f-485252f9c2a8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:16.111356 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2f7e86ef-4ca7-4f91-bb8f-485252f9c2a8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1294 microversion: 2.1 time: 0.182720 Jul 01 11:03:16.120803 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2995/5891] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:15 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:17.131951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:17.131951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:17.147748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:17.155391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:17.159191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:17.159676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:17.352216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:17.362966 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6f81d130-b2ff-4225-8d82-49b23aa8ad45 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1290 microversion: 2.1 time: 0.238763 Jul 01 11:03:17.372426 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2897/5892] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:17 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1290 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:18.387301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:18.388858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:18.399550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:18.400392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:18.401726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:18.402341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:18.416115 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:18.717806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:18.726018 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01e90897-645f-4c22-b97f-5e800b91b0af tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1352 microversion: 2.1 time: 0.343281 Jul 01 11:03:18.740497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2996/5893] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:18 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1352 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:19.748051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:19.749266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:19.780364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:19.780799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:19.783086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:19.784378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:19.823351 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=90 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:19.938597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:19.951376 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0591cb3b-a3a8-4449-8770-ab9b20281b0b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1352 microversion: 2.1 time: 0.207524 Jul 01 11:03:19.952617 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2898/5894] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:19 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:20.971353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:20.971838 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:20.977837 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:21.001114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:21.001600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:21.002428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:21.002875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:21.128899 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:21.130064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:21.135848 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:21.140367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:21.141619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:21.142640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:21.143228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:21.163820 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] HTTP exception thrown: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Request method failure captured: Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 HTTP/1.1 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtLEt6WwxQAALDdCKhk-S4uNj1ampNrCKCqDj62Es1NkavRnGfMI1h5Yht37Sdz65k7RtIuk182iyA8qTgU0rCOaK0jADELKszf4eiMH0TDvtGHurDWphM2hZ1ZLMwpG9_NHpc_KQDlBE9Ixu2JVy79ExnhtmmJ1F3kOEzIvHgQjfHM Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.32 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 967c76a816e140e9b6f375bfccac2275 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_967c76a816e140e9b6f375bfccac2275", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 967c76a816e140e9b6f375bfccac2275 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TaggedBootDevicesTest-106839141-project Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 1921644ad67c45ce96876f62fc4a0d54 Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TaggedBootDevicesTest-106839141-project Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '26e010b4-9803-411c-ba2b-e552309cf281'} Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:03:21.165647 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Returning 404 to user: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:03:21.169278 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ae8080d-73b2-4389-bfea-140b4ddc5208 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 404 len: 111 microversion: 2.32 time: 0.042553 Jul 01 11:03:21.170751 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2899/5895] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Jul 1 11:03:21 2022] DELETE /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:03:21.175453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:21.176352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] [instance: 26e010b4-9803-411c-ba2b-e552309cf281] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:21.183306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:21.183825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:21.184872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:21.185523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:21.208117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] HTTP exception thrown: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Request method failure captured: Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 HTTP/1.1 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtLEt6WwxQAALDdCKhk-S4uNj1ampNrCKCqDj62Es1NkavRnGfMI1h5Yht37Sdz65k7RtIuk182iyA8qTgU0rCOaK0jADELKszf4eiMH0TDvtGHurDWphM2hZ1ZLMwpG9_NHpc_KQDlBE9Ixu2JVy79ExnhtmmJ1F3kOEzIvHgQjfHM Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Openstack-Nova-Api-Version: 2.32 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 967c76a816e140e9b6f375bfccac2275 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_967c76a816e140e9b6f375bfccac2275", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967c76a816e140e9b6f375bfccac2275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 967c76a816e140e9b6f375bfccac2275 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TaggedBootDevicesTest-106839141 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TaggedBootDevicesTest-106839141-project Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 1921644ad67c45ce96876f62fc4a0d54 Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TaggedBootDevicesTest-106839141-project Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '26e010b4-9803-411c-ba2b-e552309cf281'} Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:03:21.210068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] Returning 404 to user: Instance 26e010b4-9803-411c-ba2b-e552309cf281 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8745063c-7518-4da9-b4ed-1feef82f0af8 tempest-TaggedBootDevicesTest-106839141 tempest-TaggedBootDevicesTest-106839141-project] 10.222.0.23 "GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281" status: 404 len: 111 microversion: 2.32 time: 0.039758 Jul 01 11:03:21.213857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2900/5896] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Jul 1 11:03:21 2022] GET /compute/v2.1/servers/26e010b4-9803-411c-ba2b-e552309cf281 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:03:21.459966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:21.472188 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a78954af-44c8-44b5-865b-63110f16d896 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.506724 Jul 01 11:03:21.473247 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2997/5897] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:20 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:22.493063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:22.501642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:22.516223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7eea2dbb-5281-4151-a0ee-4db9ed5cd6fe req-5ae9872b-1870-4674-90bc-cf1d34795736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b0d09c-a428-49fa-b576-716777f3c784", "tag": "d6126ee6-6edf-45a2-ac96-5a68c0da71b6"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:03:22.527657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:22.532481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:22.533324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:22.534053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:22.534463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7eea2dbb-5281-4151-a0ee-4db9ed5cd6fe req-5ae9872b-1870-4674-90bc-cf1d34795736 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:22.536230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7eea2dbb-5281-4151-a0ee-4db9ed5cd6fe req-5ae9872b-1870-4674-90bc-cf1d34795736 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:22.573539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7eea2dbb-5281-4151-a0ee-4db9ed5cd6fe req-5ae9872b-1870-4674-90bc-cf1d34795736 service nova] Creating event network-changed:d6126ee6-6edf-45a2-ac96-5a68c0da71b6 for instance 96b0d09c-a428-49fa-b576-716777f3c784 on n-h1-master-1 Jul 01 11:03:22.593633 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7eea2dbb-5281-4151-a0ee-4db9ed5cd6fe req-5ae9872b-1870-4674-90bc-cf1d34795736 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080771 Jul 01 11:03:22.594296 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2998/5898] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:03:22.947875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:22.962569 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dbd99100-c4d7-4eab-b112-6f4aec0b8b82 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.476287 Jul 01 11:03:22.964777 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2901/5899] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:22 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:23.982583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:23.983431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:23.990440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:23.990893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:23.991663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:23.992128 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:24.154411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:24.157589 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23485712-b8a7-40a7-b3d4-9f4e7a4a9b8d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.180244 Jul 01 11:03:24.165454 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 2999/5900] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:23 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:25.175288 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:25.175911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:25.179913 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:25.194418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:25.194940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:25.195951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:25.196243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:25.464931 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:25.477755 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d547e107-748f-4e54-bb14-709a5a6e7260 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.307042 Jul 01 11:03:25.478364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2902/5901] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:25 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:26.494741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:26.495986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:26.506468 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:26.510906 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:26.513820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:26.514299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:26.517649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:26.518111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:27.024514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:27.053918 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-85b923bc-3180-4a42-89c9-1a9a562558f8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.549466 Jul 01 11:03:27.055670 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3000/5902] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:26 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:28.074078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:28.075276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:28.106352 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:28.112550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:28.113689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:28.114300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:28.418992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:28.430115 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03c1f4fc-4ff0-4d2f-92d0-94e8ffa373b7 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.362408 Jul 01 11:03:28.440302 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2903/5903] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:28 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:29.447963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:29.449191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:29.471453 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:29.471910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:29.472701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:29.473162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:29.759592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:29.767036 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3be6442-6038-49df-9463-c482b0ed8ea5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.322816 Jul 01 11:03:29.777951 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3001/5904] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:29 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:30.784008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:30.784625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:30.789506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f154b325-3fba-4dd5-8e8d-de694e0ee951 req-e2730da7-42a1-4295-8b1b-98632d11a7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b0d09c-a428-49fa-b576-716777f3c784", "name": "network-vif-plugged", "status": "completed", "tag": "d6126ee6-6edf-45a2-ac96-5a68c0da71b6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:03:30.792281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:30.792734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:30.793630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:30.794068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:30.798992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f154b325-3fba-4dd5-8e8d-de694e0ee951 req-e2730da7-42a1-4295-8b1b-98632d11a7a7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:30.799706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f154b325-3fba-4dd5-8e8d-de694e0ee951 req-e2730da7-42a1-4295-8b1b-98632d11a7a7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:30.813983 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f154b325-3fba-4dd5-8e8d-de694e0ee951 req-e2730da7-42a1-4295-8b1b-98632d11a7a7 service nova] Creating event network-vif-plugged:d6126ee6-6edf-45a2-ac96-5a68c0da71b6 for instance 96b0d09c-a428-49fa-b576-716777f3c784 on n-h1-master-1 Jul 01 11:03:30.819429 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f154b325-3fba-4dd5-8e8d-de694e0ee951 req-e2730da7-42a1-4295-8b1b-98632d11a7a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134766 Jul 01 11:03:30.820640 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2904/5905] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:03:31.059384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:31.069459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c39fa353-0958-47d3-a31d-68321e17f06c tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.289293 Jul 01 11:03:31.070334 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3002/5906] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:30 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:32.090186 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:32.091464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:32.106289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:32.106289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:32.106289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:32.108870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:32.395583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:32.405766 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d0ed8bb-8e1e-41b9-b0e8-2decab20ee43 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1470 microversion: 2.1 time: 0.320060 Jul 01 11:03:32.411164 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2905/5907] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:32 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:33.431566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:33.432276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:33.457994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:33.458457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:33.465260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:33.467189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:33.860741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:33.887300 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6bf5d31b-1c6f-4765-a522-e319d433640b tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1641 microversion: 2.1 time: 0.457884 Jul 01 11:03:33.888085 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3003/5908] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:33 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1641 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:33.905363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:33.906572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:33.934661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:33.935619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:33.938371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:33.939050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:34.163174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:34.172150 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1c9512d4-ef30-4f7d-b36a-fe2a7b9ce147 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1641 microversion: 2.1 time: 0.270177 Jul 01 11:03:34.173435 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2906/5909] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:33 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1641 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:34.190380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4954cd66-39a6-43c1-ade4-0c0c8e0ec86b tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:34.197397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4954cd66-39a6-43c1-ade4-0c0c8e0ec86b tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:34.197397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4954cd66-39a6-43c1-ade4-0c0c8e0ec86b tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:34.198047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4954cd66-39a6-43c1-ade4-0c0c8e0ec86b tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:34.198524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4954cd66-39a6-43c1-ade4-0c0c8e0ec86b tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:34.198978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4954cd66-39a6-43c1-ade4-0c0c8e0ec86b tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:34.773185 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4954cd66-39a6-43c1-ade4-0c0c8e0ec86b tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1792 microversion: 2.1 time: 0.587912 Jul 01 11:03:34.775920 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3004/5910] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:34 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1792 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:38.495123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f0e0445b-ceae-4327-a269-54292f89ef4e req-6ae3fbd3-bb30-4e39-a79c-c514091ce1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b0d09c-a428-49fa-b576-716777f3c784", "tag": "d6126ee6-6edf-45a2-ac96-5a68c0da71b6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:03:38.510911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0e0445b-ceae-4327-a269-54292f89ef4e req-6ae3fbd3-bb30-4e39-a79c-c514091ce1f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:38.511725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0e0445b-ceae-4327-a269-54292f89ef4e req-6ae3fbd3-bb30-4e39-a79c-c514091ce1f4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:38.546395 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f0e0445b-ceae-4327-a269-54292f89ef4e req-6ae3fbd3-bb30-4e39-a79c-c514091ce1f4 service nova] Creating event network-changed:d6126ee6-6edf-45a2-ac96-5a68c0da71b6 for instance 96b0d09c-a428-49fa-b576-716777f3c784 on n-h1-master-1 Jul 01 11:03:38.555552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f0e0445b-ceae-4327-a269-54292f89ef4e req-6ae3fbd3-bb30-4e39-a79c-c514091ce1f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182265 Jul 01 11:03:38.556182 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2907/5911] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:03:48.479978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:48.480627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:48.483571 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=15 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:48.484270 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=49 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:48.489433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:48.489914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:48.490705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:48.491146 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:48.598831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lazy-loading 'services' on Instance uuid 969e30d9-1829-4d26-b18c-f8032875b451 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:03:48.885337 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65f93f1a-7b0c-4d20-8867-cb562044be23 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451/os-volume_attachments/925fd34c-bbb7-43de-b192-b401b8ab2611" status: 202 len: 0 microversion: 2.1 time: 0.409685 Jul 01 11:03:48.909641 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3005/5912] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:03:48 2022] DELETE /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451/os-volume_attachments/925fd34c-bbb7-43de-b192-b401b8ab2611 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:03:55.612349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:55.613938 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:55.629070 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=17 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:55.644869 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=40 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:03:55.666744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:55.666744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:55.666744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:55.666744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:55.685478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:03:56.062629 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20215c00-245d-4017-8db2-0a15ea15c746 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 204 len: 0 microversion: 2.1 time: 0.455541 Jul 01 11:03:56.068488 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2908/5913] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:03:55 2022] DELETE /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:03:56.074445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:56.075775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:56.083107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:56.083630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:56.084473 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:56.084977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:56.290186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:56.314066 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2da26fa3-507e-4c9f-82a3-aafe32a657c8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1513 microversion: 2.1 time: 0.241484 Jul 01 11:03:56.314066 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3006/5914] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:56 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:03:57.337725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:57.338582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:57.351039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:57.351504 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:57.352310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:57.352726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:57.588685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:57.596794 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1c9b7fd9-c956-4caf-902a-c3cff667206c tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1513 microversion: 2.1 time: 0.271878 Jul 01 11:03:57.601060 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2909/5915] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:57 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:58.615082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:03:58.615869 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:03:58.628870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:58.631831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:58.633939 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:58.635068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:59.119680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:03:59.141766 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0d73847-412c-4071-b6a3-ce4eea04d131 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1513 microversion: 2.1 time: 0.531430 Jul 01 11:03:59.142374 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3007/5916] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:03:58 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1513 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:03:59.558348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6bf3766f-c0fe-47ec-a134-891b0706c06d req-79846e8e-d62a-47ad-b771-c6e3c197da88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969e30d9-1829-4d26-b18c-f8032875b451", "name": "network-vif-deleted", "tag": "173c088a-3dbd-46e3-bc0d-805e9624e14a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:03:59.570022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6bf3766f-c0fe-47ec-a134-891b0706c06d req-79846e8e-d62a-47ad-b771-c6e3c197da88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:03:59.570811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6bf3766f-c0fe-47ec-a134-891b0706c06d req-79846e8e-d62a-47ad-b771-c6e3c197da88 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:03:59.585638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6bf3766f-c0fe-47ec-a134-891b0706c06d req-79846e8e-d62a-47ad-b771-c6e3c197da88 service nova] Creating event network-vif-deleted:173c088a-3dbd-46e3-bc0d-805e9624e14a for instance 969e30d9-1829-4d26-b18c-f8032875b451 on n-h2-master-1 Jul 01 11:03:59.591483 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6bf3766f-c0fe-47ec-a134-891b0706c06d req-79846e8e-d62a-47ad-b771-c6e3c197da88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037697 Jul 01 11:03:59.593320 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2910/5917] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:00.159645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:00.160303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:00.198323 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:00.199182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:00.200578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:00.201283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:00.247839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:00.248292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:00.249333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lazy-loading 'fault' on Instance uuid 969e30d9-1829-4d26-b18c-f8032875b451 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:04:00.336997 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:00.357566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-41d60395-335b-4292-b13d-413bb99ae49b tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 200 len: 1308 microversion: 2.1 time: 0.202159 Jul 01 11:04:00.365304 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3008/5918] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:00 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:01.375725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:01.376439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 969e30d9-1829-4d26-b18c-f8032875b451] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:01.396348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:01.396800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:01.397652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:01.398090 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:01.436069 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] HTTP exception thrown: Instance 969e30d9-1829-4d26-b18c-f8032875b451 could not be found. Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Request method failure captured: Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 HTTP/1.1 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtPchoZgaZz8IRek9-wwiYhoynsx5q39fw2zpAYd2fYzUDBMz3cly0EGlGn690lAA40R2XWdpuTue_DSMeH7Ivhrxtk_7dczwSYlB6YfjbgFO97xbp2h3_zO0H8D4ITf6Hff9gFdVLsw1MHwtA8b5IhX9nOyxgynpD7tZhSmViJBWKc Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: adeeb0d6512244a485d04dcf1e43cdab Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1054096975 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/adeeb0d6512244a485d04dcf1e43cdab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/adeeb0d6512244a485d04dcf1e43cdab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_adeeb0d6512244a485d04dcf1e43cdab", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/adeeb0d6512244a485d04dcf1e43cdab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesSnapshotTestJSON-1054096975 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: adeeb0d6512244a485d04dcf1e43cdab Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1054096975 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesSnapshotTestJSON-1054096975-project Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: db3b812d82b843da837229bf82f78229 Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesSnapshotTestJSON-1054096975-project Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 969e30d9-1829-4d26-b18c-f8032875b451 could not be found. Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '969e30d9-1829-4d26-b18c-f8032875b451'} Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969e30d9-1829-4d26-b18c-f8032875b451 could not be found. Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969e30d9-1829-4d26-b18c-f8032875b451 could not be found. Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:01.438526 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:01.442974 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:01.442974 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:01.442974 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:01.442974 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:04:01.442974 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:04:01.442974 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969e30d9-1829-4d26-b18c-f8032875b451 could not be found. Jul 01 11:04:01.442974 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:01.451403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Returning 404 to user: Instance 969e30d9-1829-4d26-b18c-f8032875b451 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:01.453006 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dbbc1142-e061-45f4-b03f-2706804a0a70 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451" status: 404 len: 111 microversion: 2.1 time: 0.081625 Jul 01 11:04:01.454222 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2911/5919] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:01 2022] GET /compute/v2.1/servers/969e30d9-1829-4d26-b18c-f8032875b451 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:04:03.459878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-222601377", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:03.535566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] validate_networks() for [('aada89a3-5931-4b92-8707-ffbf634027be', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:04:04.304401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:04:04.304827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:04:04.305694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:04:04.305823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:04:04.306187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:04:04.323058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:04.323857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:04.325597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:04.325597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:04.350320 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Getting quotas for project c2402923640f4f38ada7d4f753d441f7. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:04:04.360886 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Getting quotas for user f2a32580357b4bdf962288dd472ab4bf and project c2402923640f4f38ada7d4f753d441f7. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:04:04.375647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:04:04.378224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:04:04.535145 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8905b44a-bed2-478d-ac9e-b229fe98ffce tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.405794 Jul 01 11:04:04.542411 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3009/5920] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:04:04.549661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6f36c5e6-6af0-4a93-8ffd-a6f1e2722600 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:04.551159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6f36c5e6-6af0-4a93-8ffd-a6f1e2722600 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:04.671349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6f36c5e6-6af0-4a93-8ffd-a6f1e2722600 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:04.682938 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6f36c5e6-6af0-4a93-8ffd-a6f1e2722600 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1223 microversion: 2.1 time: 0.138469 Jul 01 11:04:04.683898 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2912/5921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:04 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:05.702168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc31474e-53b4-4ded-91bd-2388fed89736 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:05.703745 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc31474e-53b4-4ded-91bd-2388fed89736 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:05.773411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc31474e-53b4-4ded-91bd-2388fed89736 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:05.783803 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc31474e-53b4-4ded-91bd-2388fed89736 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1223 microversion: 2.1 time: 0.086678 Jul 01 11:04:05.785036 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3010/5922] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:05 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:06.804423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:06.805916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:06.814958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:06.815878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:06.816962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:06.837487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:06.999046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:07.009989 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d25ec91-baae-4177-ba88-05a37e6c7bd5 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1275 microversion: 2.1 time: 0.209929 Jul 01 11:04:07.011792 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2913/5923] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:06 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:08.032398 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:08.034073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:08.043268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:08.044054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:08.045165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:08.046982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:08.183639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:08.198209 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99372f3c-30c2-4b77-b5d3-be306a9fa6e9 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1281 microversion: 2.1 time: 0.174375 Jul 01 11:04:08.198810 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3011/5924] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:08 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:09.215890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:09.217051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:09.240092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:09.241074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:09.250518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:09.251257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:09.606722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:09.621893 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ddb13c56-338b-495e-ab0d-4a63bad8d2ac tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.409781 Jul 01 11:04:09.637277 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2914/5925] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:09 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:10.639863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:10.641431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:10.650088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:10.650538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:10.651332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:10.651769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:10.989521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:11.002327 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f508bdc-1b8d-4945-863c-f71113620397 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.364410 Jul 01 11:04:11.003241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3012/5926] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:10 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:11.717593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ebe379a5-e4da-4912-8674-e1f1c1f3c2f6 req-6a88bd66-4c89-476f-bc79-db1540a29475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc9d8fd-67b5-4f9b-865b-b7c0c2077626", "tag": "3c54b887-c07a-4a13-b6f8-563a9713b986"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:11.733783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ebe379a5-e4da-4912-8674-e1f1c1f3c2f6 req-6a88bd66-4c89-476f-bc79-db1540a29475 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:11.744201 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ebe379a5-e4da-4912-8674-e1f1c1f3c2f6 req-6a88bd66-4c89-476f-bc79-db1540a29475 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:11.759804 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ebe379a5-e4da-4912-8674-e1f1c1f3c2f6 req-6a88bd66-4c89-476f-bc79-db1540a29475 service nova] Creating event network-changed:3c54b887-c07a-4a13-b6f8-563a9713b986 for instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 on n-h2-master-1 Jul 01 11:04:11.766806 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ebe379a5-e4da-4912-8674-e1f1c1f3c2f6 req-6a88bd66-4c89-476f-bc79-db1540a29475 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053197 Jul 01 11:04:11.774484 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2915/5927] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:12.025582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:12.026790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:12.041558 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:12.042414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:12.043564 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:12.046282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:12.366842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:12.377679 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a51e6c1-c39a-4385-83fe-58eb1f7f6250 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.357565 Jul 01 11:04:12.380392 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3013/5928] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:12 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:13.400399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:13.401117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:13.410048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:13.418928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:13.420696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:13.421316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:13.617184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:13.641076 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-92376fc6-c24a-433b-930c-e67ad7d09845 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.246064 Jul 01 11:04:13.658982 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2916/5929] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:13 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:13.798899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-641254598", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "f2121174-f447-454c-80ee-1552a61e1b21"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:13.900052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] validate_networks() for [('f2121174-f447-454c-80ee-1552a61e1b21', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:04:14.338711 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:14.660838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:14.663094 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:14.674992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:14.677351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:14.678257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:14.680969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:14.682037 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:15.154414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:15.160190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:04:15.161390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:04:15.162024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:04:15.162758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:04:15.163802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:04:15.193412 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee197c55-fa65-4af7-b33e-5e2a98f53bf0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.537164 Jul 01 11:04:15.198302 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2917/5930] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:14 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:15.208276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:15.209060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:15.210226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:15.214030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:15.270543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Getting quotas for project adeeb0d6512244a485d04dcf1e43cdab. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:04:15.288487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Getting quotas for user db3b812d82b843da837229bf82f78229 and project adeeb0d6512244a485d04dcf1e43cdab. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:04:15.332034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:04:15.349909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:04:15.540156 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c2213ad8-427a-4e41-8610-475c336d75f1 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.739379 Jul 01 11:04:15.541650 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3014/5931] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:04:15.551941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-70147858-c409-4af1-b157-23d9a2dcc605 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:15.553370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-70147858-c409-4af1-b157-23d9a2dcc605 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:15.745969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-70147858-c409-4af1-b157-23d9a2dcc605 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:15.753514 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-70147858-c409-4af1-b157-23d9a2dcc605 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1218 microversion: 2.1 time: 0.205686 Jul 01 11:04:15.754112 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2918/5932] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:15 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:16.217199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:16.222056 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:16.240969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:16.244340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:16.252595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:16.252595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:16.775408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee33ddb9-7f67-46ea-85f4-40f8e5c20c29 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:16.785214 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee33ddb9-7f67-46ea-85f4-40f8e5c20c29 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:17.104679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee33ddb9-7f67-46ea-85f4-40f8e5c20c29 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:17.117398 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee33ddb9-7f67-46ea-85f4-40f8e5c20c29 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1218 microversion: 2.1 time: 0.345502 Jul 01 11:04:17.118348 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2919/5933] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:16 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1218 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:17.179393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:17.194415 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e872c45d-f2c7-4e12-8fe6-c6e5aba61124 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.987224 Jul 01 11:04:17.195208 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3015/5934] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:16 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:18.136139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:18.137095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:18.156342 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:18.156951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:18.157871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:18.158416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:18.212153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:18.216359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:18.242341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:18.243505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:18.247160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:18.247790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:18.958802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:18.973793 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9e4d8752-6730-49dd-95fd-df1bd30cf80e tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1270 microversion: 2.1 time: 0.836874 Jul 01 11:04:18.975934 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2920/5935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:18 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1270 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:18.994730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1125885971", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "506377c6-2c41-4351-9cfe-5c83a2e64a6e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-308278340", "security_groups": []}, "os:scheduler_hints": {"different_host": ["96b0d09c-a428-49fa-b576-716777f3c784"]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:19.100954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] validate_networks() for [('506377c6-2c41-4351-9cfe-5c83a2e64a6e', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:04:19.411519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:19.414052 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:19.422385 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-421c839c-2a79-45c0-b027-72cab7aa3c94 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 1.214151 Jul 01 11:04:19.432187 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3016/5936] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:18 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:19.993311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:19.994229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:20.008018 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:20.009845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:20.010475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:20.011437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:20.021956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:20.235506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:20.235506 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eda428a4-ab2d-4dd4-aa18-9d97596eda37 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1276 microversion: 2.1 time: 0.244560 Jul 01 11:04:20.235506 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3017/5937] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:19 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:20.440242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:20.440823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:20.453164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:20.456001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:20.456001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:20.456001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:20.681933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:04:20.681933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:04:20.681933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:04:20.681933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:04:20.681933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:04:20.690420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:20.691063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:20.692175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:20.692778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:20.711962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Getting quotas for project 662ddba9a14c4711b17f5df267ef48b6. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:04:20.718059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Getting quotas for user 5af9f39fc9a742f2b9a24bf221f2550c and project 662ddba9a14c4711b17f5df267ef48b6. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:04:20.731436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:04:20.734180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:04:20.829903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:20.844123 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d652cff-dd5b-49d9-963b-2b1eed839b14 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.408599 Jul 01 11:04:20.854145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3018/5938] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:20 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:20.896612 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2f0dc0be-6252-481d-8ed1-3189d36e1b7d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.917222 Jul 01 11:04:20.902450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2921/5939] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:18 2022] POST /compute/v2.1/servers => generated 361 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:04:20.911099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c4037af-85f3-4318-836e-801892da4a71 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:20.912099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c4037af-85f3-4318-836e-801892da4a71 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:21.028611 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c4037af-85f3-4318-836e-801892da4a71 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:21.033721 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c4037af-85f3-4318-836e-801892da4a71 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1241 microversion: 2.1 time: 0.126834 Jul 01 11:04:21.035166 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3019/5940] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:20 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:21.252725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:21.253517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:21.262100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:21.263024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:21.264658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:21.265274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:21.611959 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-852762b1-d349-40f1-99a0-deb4ed4425b0 req-eb0db0ac-2834-4e42-a06c-8a51960daf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc9d8fd-67b5-4f9b-865b-b7c0c2077626", "name": "network-vif-plugged", "status": "completed", "tag": "3c54b887-c07a-4a13-b6f8-563a9713b986"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:21.626999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-852762b1-d349-40f1-99a0-deb4ed4425b0 req-eb0db0ac-2834-4e42-a06c-8a51960daf1f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:21.627991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-852762b1-d349-40f1-99a0-deb4ed4425b0 req-eb0db0ac-2834-4e42-a06c-8a51960daf1f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:21.676328 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-852762b1-d349-40f1-99a0-deb4ed4425b0 req-eb0db0ac-2834-4e42-a06c-8a51960daf1f service nova] Creating event network-vif-plugged:3c54b887-c07a-4a13-b6f8-563a9713b986 for instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 on n-h2-master-1 Jul 01 11:04:21.710152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:21.724263 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-852762b1-d349-40f1-99a0-deb4ed4425b0 req-eb0db0ac-2834-4e42-a06c-8a51960daf1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118234 Jul 01 11:04:21.728279 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17e11820-5d12-4a83-ae3a-9ea78e737db0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.480554 Jul 01 11:04:21.731798 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2922/5941] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:21 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:21.732782 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3020/5942] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:21.865191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:21.865191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:21.873733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:21.874626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:21.875955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:21.876541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:22.056875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ca45c1d-0201-451e-94ab-16ce8e914b3e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:22.058135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ca45c1d-0201-451e-94ab-16ce8e914b3e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:22.202670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0ca45c1d-0201-451e-94ab-16ce8e914b3e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:22.217314 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ca45c1d-0201-451e-94ab-16ce8e914b3e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1241 microversion: 2.1 time: 0.168882 Jul 01 11:04:22.218786 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3021/5943] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:22 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:22.281083 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:22.290349 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93967094-9641-4caa-8424-ff80882173fb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.432299 Jul 01 11:04:22.294786 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2923/5944] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:21 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:22.747845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:22.750189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:22.759942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:22.761394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:22.762089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:22.763309 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:23.074488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:23.082887 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6ecdd4f-f1ff-4b87-99fa-45e1cab64fd8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.339341 Jul 01 11:04:23.087750 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3022/5945] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:22 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:23.235939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:23.237096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:23.267979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:23.268589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:23.269658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:23.270253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:23.308268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:23.309100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:23.333948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:23.334450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:23.342060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:23.342709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:23.443440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:23.455185 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0057df93-663b-4f1b-9ce5-d1fa66aabc8e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1293 microversion: 2.1 time: 0.223156 Jul 01 11:04:23.456727 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2924/5946] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:23 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1293 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:23.739504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:23.749835 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9560ff9e-9dd0-446e-9f8d-407af57154cb tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1323 microversion: 2.1 time: 0.445429 Jul 01 11:04:23.751465 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3023/5947] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:23 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:23.930181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7cf9ebfb-4238-4edb-98f6-5469c3e9f0f6 req-a5ffe343-36b1-4c39-8299-a81906a3f070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c605aa5-cd3b-4b93-884e-368eb6846b7c", "tag": "cf811a47-a3e3-4cf7-bd62-8fa763619c66"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:23.948205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7cf9ebfb-4238-4edb-98f6-5469c3e9f0f6 req-a5ffe343-36b1-4c39-8299-a81906a3f070 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:23.948648 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7cf9ebfb-4238-4edb-98f6-5469c3e9f0f6 req-a5ffe343-36b1-4c39-8299-a81906a3f070 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:23.985690 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7cf9ebfb-4238-4edb-98f6-5469c3e9f0f6 req-a5ffe343-36b1-4c39-8299-a81906a3f070 service nova] Creating event network-changed:cf811a47-a3e3-4cf7-bd62-8fa763619c66 for instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c on n-h1-master-1 Jul 01 11:04:23.995113 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7cf9ebfb-4238-4edb-98f6-5469c3e9f0f6 req-a5ffe343-36b1-4c39-8299-a81906a3f070 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075700 Jul 01 11:04:23.996026 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2925/5948] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:04:24.104121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:24.105126 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:24.118256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:24.120891 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:24.121961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:24.124266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:24.474102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:24.474924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:24.485086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:24.489707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:24.489707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:24.489707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:24.617217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:24.618995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:24.629449 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-19df13d0-a47c-42f7-b058-66b2fc012c01 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.529115 Jul 01 11:04:24.639910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d05d930-ec68-432d-93c5-c251a66d0127 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.168079 Jul 01 11:04:24.656664 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3024/5949] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:24 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:24.658107 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2926/5950] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:24 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:24.767750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:24.768392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:24.788718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:24.789731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:24.790525 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:24.791104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:25.151563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:25.159883 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d3eeade4-d692-4b82-b744-e9014eb30159 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1520 microversion: 2.1 time: 0.395939 Jul 01 11:04:25.163186 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3025/5951] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:24 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:25.272364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f4df645-d9b8-4280-a40f-1c140fccec9b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-253839317", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f4df645-d9b8-4280-a40f-1c140fccec9b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 242 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-253839317", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-253839317', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'aada89a3-5931-4b92-8707-ffbf634027be'}]}}} Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:04:25.282256 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.287338 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.289208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f4df645-d9b8-4280-a40f-1c140fccec9b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:25.290209 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f4df645-d9b8-4280-a40f-1c140fccec9b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.021725 Jul 01 11:04:25.291255 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2927/5952] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:25 2022] POST /compute/v2.1/servers => generated 175 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:04:25.303355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1c49c41-173a-44d5-adc4-0dda4b1fa81d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:25.303355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1c49c41-173a-44d5-adc4-0dda4b1fa81d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: f79e5535-7d41-4dc0-bbbf-bc7e20d830b7] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:25.305499 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:25.312699 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f1c49c41-173a-44d5-adc4-0dda4b1fa81d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] HTTP exception thrown: Instance f79e5535-7d41-4dc0-bbbf-bc7e20d830b7 could not be found. Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1c49c41-173a-44d5-adc4-0dda4b1fa81d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/f79e5535-7d41-4dc0-bbbf-bc7e20d830b7/metadata HTTP/1.1 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f79e5535-7d41-4dc0-bbbf-bc7e20d830b7 could not be found. Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': 'f79e5535-7d41-4dc0-bbbf-bc7e20d830b7'} Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79e5535-7d41-4dc0-bbbf-bc7e20d830b7 could not be found. Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79e5535-7d41-4dc0-bbbf-bc7e20d830b7 could not be found. Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.330363 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.334943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:04:25.334943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:04:25.334943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79e5535-7d41-4dc0-bbbf-bc7e20d830b7 could not be found. Jul 01 11:04:25.334943 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.334943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1c49c41-173a-44d5-adc4-0dda4b1fa81d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 404 to user: Instance f79e5535-7d41-4dc0-bbbf-bc7e20d830b7 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:25.334943 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1c49c41-173a-44d5-adc4-0dda4b1fa81d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/f79e5535-7d41-4dc0-bbbf-bc7e20d830b7/metadata" status: 404 len: 111 microversion: 2.1 time: 0.034574 Jul 01 11:04:25.334943 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3026/5953] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Jul 1 11:04:25 2022] GET /compute/v2.1/servers/f79e5535-7d41-4dc0-bbbf-bc7e20d830b7/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:04:25.396183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4b1b169-98aa-433d-98d3-5dd074f86be0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1144744364", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4b1b169-98aa-433d-98d3-5dd074f86be0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 499 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1144744364", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1144744364', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'aada89a3-5931-4b92-8707-ffbf634027be'}]}}} Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 01 11:04:25.399235 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4b1b169-98aa-433d-98d3-5dd074f86be0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4b1b169-98aa-433d-98d3-5dd074f86be0 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.008417 Jul 01 11:04:25.406352 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2928/5954] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:25 2022] POST /compute/v2.1/servers => generated 687 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:04:25.459140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b27c83fe-db2f-4661-a181-38d0f60e72d6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1169467460", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b27c83fe-db2f-4661-a181-38d0f60e72d6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 500 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1169467460", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1169467460', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'aada89a3-5931-4b92-8707-ffbf634027be'}]}}} Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 01 11:04:25.462920 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.465620 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.470124 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b27c83fe-db2f-4661-a181-38d0f60e72d6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:25.471537 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b27c83fe-db2f-4661-a181-38d0f60e72d6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016834 Jul 01 11:04:25.472203 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3027/5955] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:25 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:04:25.525409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fbb10ac2-fbe7-4238-a6f4-de9e873a397b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-643593613", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fbb10ac2-fbe7-4238-a6f4-de9e873a397b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 753 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-643593613", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-643593613', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'aada89a3-5931-4b92-8707-ffbf634027be'}]}}} Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 11:04:25.530032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise error Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 11:04:25.532587 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 11:04:25.535057 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.535057 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.540906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fbb10ac2-fbe7-4238-a6f4-de9e873a397b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:25.542159 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fbb10ac2-fbe7-4238-a6f4-de9e873a397b tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021892 Jul 01 11:04:25.543241 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2929/5956] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:25 2022] POST /compute/v2.1/servers => generated 1197 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 01 11:04:25.612443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e541261e-04b5-4d7e-8318-1aaa14f332c6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1625775543", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e541261e-04b5-4d7e-8318-1aaa14f332c6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 1266 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1625775543", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "aada89a3-5931-4b92-8707-ffbf634027be"}]}} Jul 01 11:04:25.615720 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1625775543', 'imageRef': 'f784d1ed-9670-424c-abfe-e98e973ecb0e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'aada89a3-5931-4b92-8707-ffbf634027be'}]}}} Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.617693 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 11:04:25.618680 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 11:04:25.620205 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 01 11:04:25.620205 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.620205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e541261e-04b5-4d7e-8318-1aaa14f332c6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:25.620205 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e541261e-04b5-4d7e-8318-1aaa14f332c6 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011316 Jul 01 11:04:25.633617 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3028/5957] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Jul 1 11:04:25 2022] POST /compute/v2.1/servers => generated 2221 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 01 11:04:25.647773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8eb22c58-0d69-442e-8f44-abbf2958303a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:25.653835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8eb22c58-0d69-442e-8f44-abbf2958303a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 57cd377c-0b10-4bf6-a650-7fc5e2d0be60] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:25.655795 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:25.656771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:25.667404 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-8eb22c58-0d69-442e-8f44-abbf2958303a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] HTTP exception thrown: Instance 57cd377c-0b10-4bf6-a650-7fc5e2d0be60 could not be found. Jul 01 11:04:25.670911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8eb22c58-0d69-442e-8f44-abbf2958303a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/57cd377c-0b10-4bf6-a650-7fc5e2d0be60/metadata/test2 HTTP/1.1 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 57cd377c-0b10-4bf6-a650-7fc5e2d0be60 could not be found. Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '57cd377c-0b10-4bf6-a650-7fc5e2d0be60', 'id': 'test2'} Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cd377c-0b10-4bf6-a650-7fc5e2d0be60 could not be found. Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cd377c-0b10-4bf6-a650-7fc5e2d0be60 could not be found. Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:25.671613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:25.675361 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:04:25.675361 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:04:25.675361 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cd377c-0b10-4bf6-a650-7fc5e2d0be60 could not be found. Jul 01 11:04:25.675361 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:25.677090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:25.678093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8eb22c58-0d69-442e-8f44-abbf2958303a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 404 to user: Instance 57cd377c-0b10-4bf6-a650-7fc5e2d0be60 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:25.679147 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:25.680205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8eb22c58-0d69-442e-8f44-abbf2958303a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/57cd377c-0b10-4bf6-a650-7fc5e2d0be60/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.038886 Jul 01 11:04:25.680849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:25.683288 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2930/5958] 10.222.0.23 () {58 vars in 1280 bytes} [Fri Jul 1 11:04:25 2022] GET /compute/v2.1/servers/57cd377c-0b10-4bf6-a650-7fc5e2d0be60/metadata/test2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:04:25.710896 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:25.739338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:25.757800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:25.761670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:25.766672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:25.767220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:26.008689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:26.027962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:26.030841 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-44b5cb62-033f-40ce-8f61-fcb6397a7777 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.386777 Jul 01 11:04:26.031856 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3029/5959] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:25 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:26.037710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:26.038463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:26.043534 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-756400b2-33b0-4996-bc1f-b7646da0594d tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.356306 Jul 01 11:04:26.045767 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2931/5960] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:25 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:26.050268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:26.056097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:26.059596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:26.060060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:26.137029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:04:26.455245 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-35683f2a-7fc1-484e-9dfd-4e9019d5728c tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 204 len: 0 microversion: 2.1 time: 0.421893 Jul 01 11:04:26.455841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3030/5961] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:04:26 2022] DELETE /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:04:26.463964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:26.465421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:26.469017 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:26.472491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:26.472962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:26.473736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:26.474163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:26.478387 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:26.838022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:26.850993 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0984edcd-fc5b-4dc0-a015-fe7ad20b07dc tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1526 microversion: 2.1 time: 0.390490 Jul 01 11:04:26.860364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2932/5962] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:26 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1526 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:27.006918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f397c545-f4df-4347-9ed9-e7917aab7318 req-98856a4d-191a-4344-afdf-c9504a2fb5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545f9822-7171-4438-9986-a931cfd71a0f", "tag": "5f83a4fc-b927-42aa-bd3f-41f2536256ab"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:27.023253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f397c545-f4df-4347-9ed9-e7917aab7318 req-98856a4d-191a-4344-afdf-c9504a2fb5bc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:27.023814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f397c545-f4df-4347-9ed9-e7917aab7318 req-98856a4d-191a-4344-afdf-c9504a2fb5bc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:27.036197 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f397c545-f4df-4347-9ed9-e7917aab7318 req-98856a4d-191a-4344-afdf-c9504a2fb5bc service nova] Creating event network-changed:5f83a4fc-b927-42aa-bd3f-41f2536256ab for instance 545f9822-7171-4438-9986-a931cfd71a0f on n-h2-master-1 Jul 01 11:04:27.041061 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f397c545-f4df-4347-9ed9-e7917aab7318 req-98856a4d-191a-4344-afdf-c9504a2fb5bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051330 Jul 01 11:04:27.042156 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3031/5963] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:27.048777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:27.049486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:27.055946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:27.056682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:27.057755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:27.058293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:27.061427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:27.062394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:27.072721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:27.073181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:27.073966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:27.074403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:27.242311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:27.254764 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bd88691c-429e-4d16-a496-6c808f452f5e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.196169 Jul 01 11:04:27.255907 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3032/5964] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:27 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:27.288603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:27.296299 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02cb480a-d4a1-49fc-b8bf-71cb86e71ac5 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.252204 Jul 01 11:04:27.305750 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2933/5965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:27 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:27.877197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:27.878294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:27.884649 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:27.885406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:27.886403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:27.887044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:28.103274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:28.111630 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1f8db25b-a65c-49bf-87cb-e65fabacfb9a tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1526 microversion: 2.1 time: 0.238807 Jul 01 11:04:28.112811 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3033/5966] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:27 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:28.273805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:28.276250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:28.287397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:28.288183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:28.289191 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:28.289830 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:28.317453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:28.318078 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:28.330824 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:28.331274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:28.334961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:28.336290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:28.865811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:28.890134 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48b40692-309f-45d8-9e24-3be1d8eb6a90 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.618251 Jul 01 11:04:28.894009 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2934/5967] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:28 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:29.017070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:29.034442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-627353f1-a7c6-4889-aa1e-2e5ca7ec18d2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.723255 Jul 01 11:04:29.038806 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3034/5968] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:28 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:29.133719 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:29.136613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:29.138645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d5bb8af5-2504-43bf-b9e1-2f504e12975a req-40afe677-ce80-49ef-9971-8bbe99a13303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc9d8fd-67b5-4f9b-865b-b7c0c2077626", "name": "network-vif-deleted", "tag": "3c54b887-c07a-4a13-b6f8-563a9713b986"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:29.143820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:29.144572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:29.145744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:29.146407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:29.158292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d5bb8af5-2504-43bf-b9e1-2f504e12975a req-40afe677-ce80-49ef-9971-8bbe99a13303 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:29.158744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d5bb8af5-2504-43bf-b9e1-2f504e12975a req-40afe677-ce80-49ef-9971-8bbe99a13303 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:29.185283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d5bb8af5-2504-43bf-b9e1-2f504e12975a req-40afe677-ce80-49ef-9971-8bbe99a13303 service nova] Creating event network-vif-deleted:3c54b887-c07a-4a13-b6f8-563a9713b986 for instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 on n-h2-master-1 Jul 01 11:04:29.195240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d5bb8af5-2504-43bf-b9e1-2f504e12975a req-40afe677-ce80-49ef-9971-8bbe99a13303 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061020 Jul 01 11:04:29.195889 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3035/5969] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:29.265377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:29.278886 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39908ce7-de2f-478f-82e4-00ad5335ef4d tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1484 microversion: 2.1 time: 0.153454 Jul 01 11:04:29.281011 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2935/5970] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:29 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1484 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:29.913808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:29.914537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:29.921790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:29.922435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:29.923250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:29.923697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:30.053596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:30.054563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:30.062867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:30.063489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:30.065462 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:30.066124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:30.124352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:30.149194 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6503cafa-bc8f-40e4-9f65-b0962e4631a5 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.243371 Jul 01 11:04:30.150050 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3036/5971] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:29 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:30.267918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:30.275701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b21d56eb-2b5f-49a7-a7ee-33cea8735dbb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.226093 Jul 01 11:04:30.276291 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2936/5972] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:30 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:30.297521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:30.298143 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:30.305994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:30.306461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:30.307245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:30.307695 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:30.423506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a32580357b4bdf962288dd472ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2402923640f4f38ada7d4f753d441f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:30.432854 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9422ab01-b32e-4542-9578-a113cb75b730 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 200 len: 1308 microversion: 2.1 time: 0.139654 Jul 01 11:04:30.433547 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3037/5973] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:30 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 1308 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:30.984957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-cd9f1672-973b-4535-9810-c842a7941b85 req-737d167f-28e0-4abc-bff8-9dbb24664554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c605aa5-cd3b-4b93-884e-368eb6846b7c", "name": "network-vif-plugged", "status": "completed", "tag": "cf811a47-a3e3-4cf7-bd62-8fa763619c66"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:30.988895 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:30.995190 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:31.003489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cd9f1672-973b-4535-9810-c842a7941b85 req-737d167f-28e0-4abc-bff8-9dbb24664554 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:31.004096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cd9f1672-973b-4535-9810-c842a7941b85 req-737d167f-28e0-4abc-bff8-9dbb24664554 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:31.019412 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-cd9f1672-973b-4535-9810-c842a7941b85 req-737d167f-28e0-4abc-bff8-9dbb24664554 service nova] Creating event network-vif-plugged:cf811a47-a3e3-4cf7-bd62-8fa763619c66 for instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c on n-h1-master-1 Jul 01 11:04:31.025656 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-cd9f1672-973b-4535-9810-c842a7941b85 req-737d167f-28e0-4abc-bff8-9dbb24664554 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045542 Jul 01 11:04:31.026955 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2937/5974] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:31.166393 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:31.167084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:31.184396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:31.193042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:31.196399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:31.201553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:31.294132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:31.296337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:31.317213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:31.317213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:31.317213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:31.317213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:31.397673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:31.412401 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:31.416575 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ae8bafa-8a4a-4b59-88f8-4983ed5142df tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.254120 Jul 01 11:04:31.428676 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3038/5975] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:31 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:31.451663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:31.452195 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] [instance: 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:31.459013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:31.459467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:31.460240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:31.460840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:31.478394 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] HTTP exception thrown: Instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 could not be found. Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Request method failure captured: Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 HTTP/1.1 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtSiavFgQEwLgcD0qVNJKrPlg78-rbOI1X6sHm35p4R6jcyfpfDwinFJ_EFUdgncH_PEHs6IUZrZyo5O9tAzBFqERriILcHHyq4V_-kyHLWsVZPK01BFvcLsviLjTiW1R4AQrH9cSGf6pWM9U95pgnBlYT9wKUyquNx-rhQUavberq0 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c2402923640f4f38ada7d4f753d441f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c2402923640f4f38ada7d4f753d441f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c2402923640f4f38ada7d4f753d441f7 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-567200995 Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f2a32580357b4bdf962288dd472ab4bf Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-567200995-project Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 could not be found. Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '9dc9d8fd-67b5-4f9b-865b-b7c0c2077626'} Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 could not be found. Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 could not be found. Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:31.480765 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 could not be found. Jul 01 11:04:31.485204 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:31.487395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] Returning 404 to user: Instance 9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:31.488425 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cccd5c6c-6f07-4848-96d2-16713cba3493 tempest-ServerMetadataNegativeTestJSON-567200995 tempest-ServerMetadataNegativeTestJSON-567200995-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626" status: 404 len: 111 microversion: 2.1 time: 0.041546 Jul 01 11:04:31.492960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3039/5976] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:31 2022] GET /compute/v2.1/servers/9dc9d8fd-67b5-4f9b-865b-b7c0c2077626 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:04:31.564513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:31.578920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13daa549-ef12-4450-8713-5941cd73b9b2 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1318 microversion: 2.1 time: 0.290124 Jul 01 11:04:31.590501 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2938/5977] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:31 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:32.436345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:32.437906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:32.443485 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=18 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:32.449107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:32.449821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:32.451400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:32.452715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:32.580209 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:32.589536 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e3f08ff-dd52-4105-b53f-3c684ecb0847 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.157160 Jul 01 11:04:32.600950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:32.600950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:32.606414 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3040/5978] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:32 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:32.611303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:32.611808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:32.613275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:32.613794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:32.873695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:32.882330 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ce415904-7255-4d21-a65d-6e2c71329117 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1507 microversion: 2.1 time: 0.290267 Jul 01 11:04:32.883599 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2939/5979] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:32 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:32.900045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-924a5ed4-3bbe-4ac2-a3f2-6e9e71c105eb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43da7ce4-7e26-4950-9419-80e0274269d0", "device": "/dev/sdb"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:32.902303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-924a5ed4-3bbe-4ac2-a3f2-6e9e71c105eb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:32.933685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924a5ed4-3bbe-4ac2-a3f2-6e9e71c105eb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:32.934490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924a5ed4-3bbe-4ac2-a3f2-6e9e71c105eb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:32.936068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924a5ed4-3bbe-4ac2-a3f2-6e9e71c105eb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:32.936977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-924a5ed4-3bbe-4ac2-a3f2-6e9e71c105eb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:33.048794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-67286580-e5f4-4f91-9ef6-32c9deb932ed req-ae9f3439-b3ac-4cde-b6b5-b303332a3228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545f9822-7171-4438-9986-a931cfd71a0f", "name": "network-vif-plugged", "status": "completed", "tag": "5f83a4fc-b927-42aa-bd3f-41f2536256ab"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:33.058447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-67286580-e5f4-4f91-9ef6-32c9deb932ed req-ae9f3439-b3ac-4cde-b6b5-b303332a3228 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:33.059165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-67286580-e5f4-4f91-9ef6-32c9deb932ed req-ae9f3439-b3ac-4cde-b6b5-b303332a3228 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:33.073381 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-67286580-e5f4-4f91-9ef6-32c9deb932ed req-ae9f3439-b3ac-4cde-b6b5-b303332a3228 service nova] Creating event network-vif-plugged:5f83a4fc-b927-42aa-bd3f-41f2536256ab for instance 545f9822-7171-4438-9986-a931cfd71a0f on n-h2-master-1 Jul 01 11:04:33.079895 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-67286580-e5f4-4f91-9ef6-32c9deb932ed req-ae9f3439-b3ac-4cde-b6b5-b303332a3228 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035362 Jul 01 11:04:33.085651 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2940/5980] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:04:33.609961 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:33.612663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:33.619686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:33.620197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:33.621036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:33.621543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:33.736086 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:33.745266 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-69cce63b-c236-4d0e-beb2-0c962534a2cb tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1299 microversion: 2.1 time: 0.140783 Jul 01 11:04:33.753220 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2941/5981] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:33 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:33.852631 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-924a5ed4-3bbe-4ac2-a3f2-6e9e71c105eb tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "POST /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.956510 Jul 01 11:04:33.868509 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3041/5982] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 11:04:32 2022] POST /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:34.762475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:34.763012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:34.778109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:34.778483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:34.779987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:34.780438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.039895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:35.067840 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-93b28aba-d9ac-4144-99c5-0140961d5e0f tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1471 microversion: 2.1 time: 0.301437 Jul 01 11:04:35.067840 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2942/5983] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:34 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:35.083626 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:35.084178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:35.100921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.101625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.102586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.103195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.238024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:35.253309 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa9fcaf3-80ec-4e84-89ec-aae6586b64c1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1471 microversion: 2.1 time: 0.168833 Jul 01 11:04:35.261732 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3042/5984] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:35 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:35.265101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e2ace6e8-90c4-4d5e-a5f8-3d376ce0cc8c tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:35.266050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e2ace6e8-90c4-4d5e-a5f8-3d376ce0cc8c tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:35.273455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2ace6e8-90c4-4d5e-a5f8-3d376ce0cc8c tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.274161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2ace6e8-90c4-4d5e-a5f8-3d376ce0cc8c tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.275203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2ace6e8-90c4-4d5e-a5f8-3d376ce0cc8c tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.275820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e2ace6e8-90c4-4d5e-a5f8-3d376ce0cc8c tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.379647 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e2ace6e8-90c4-4d5e-a5f8-3d376ce0cc8c tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1622 microversion: 2.1 time: 0.118681 Jul 01 11:04:35.390535 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2943/5985] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:35 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1622 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:35.397484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6ab148d-20ae-4ab4-9f92-3103114d3795 tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:35.399009 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6ab148d-20ae-4ab4-9f92-3103114d3795 tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:35.407268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6ab148d-20ae-4ab4-9f92-3103114d3795 tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.408283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6ab148d-20ae-4ab4-9f92-3103114d3795 tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.409538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6ab148d-20ae-4ab4-9f92-3103114d3795 tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.410866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6ab148d-20ae-4ab4-9f92-3103114d3795 tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.800926 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6ab148d-20ae-4ab4-9f92-3103114d3795 tempest-TestSecurityGroupsBasicOps-1263888857 tempest-TestSecurityGroupsBasicOps-1263888857-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1911 microversion: 2.1 time: 0.407041 Jul 01 11:04:35.801567 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3043/5986] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:35 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1911 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:35.895813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:35.905832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:35.913793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.914789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.916137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:35.916769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:35.960554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:04:36.449850 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35d4b6d5-5c62-4209-bc53-1d448a76af35 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "DELETE /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 204 len: 0 microversion: 2.1 time: 0.560746 Jul 01 11:04:36.450464 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2944/5987] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:04:35 2022] DELETE /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:04:36.460488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:36.461749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:36.487249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:36.491751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:36.491751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:36.491751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:36.732675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:36.745992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51318126-4b1a-40df-85df-185d04acc424 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1477 microversion: 2.1 time: 0.289504 Jul 01 11:04:36.753042 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3044/5988] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:36 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1477 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:37.771071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:37.777972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:37.796397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:37.801732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:37.802668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:37.803208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:37.927577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:37.946331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7480c5c6-348f-4105-b7cc-87659e84f01e tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1477 microversion: 2.1 time: 0.180178 Jul 01 11:04:37.967908 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2945/5989] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:37 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1477 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:38.964602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:38.966543 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:38.975980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:38.975980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:38.976252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:38.976692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:39.068372 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:39.081884 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-855af05a-08ee-4fce-8b22-24de4300fe42 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1477 microversion: 2.1 time: 0.121479 Jul 01 11:04:39.083201 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3045/5990] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:38 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1477 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:39.387242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ff175076-9971-4d6e-810b-d44bb65198de req-15d5e235-a5e8-4cd8-bdb1-78db3d8fbf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545f9822-7171-4438-9986-a931cfd71a0f", "name": "network-vif-deleted", "tag": "5f83a4fc-b927-42aa-bd3f-41f2536256ab"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:39.408217 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ff175076-9971-4d6e-810b-d44bb65198de req-15d5e235-a5e8-4cd8-bdb1-78db3d8fbf3e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:39.408670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ff175076-9971-4d6e-810b-d44bb65198de req-15d5e235-a5e8-4cd8-bdb1-78db3d8fbf3e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:39.425929 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ff175076-9971-4d6e-810b-d44bb65198de req-15d5e235-a5e8-4cd8-bdb1-78db3d8fbf3e service nova] Creating event network-vif-deleted:5f83a4fc-b927-42aa-bd3f-41f2536256ab for instance 545f9822-7171-4438-9986-a931cfd71a0f on n-h2-master-1 Jul 01 11:04:39.440232 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ff175076-9971-4d6e-810b-d44bb65198de req-15d5e235-a5e8-4cd8-bdb1-78db3d8fbf3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053282 Jul 01 11:04:39.440232 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2946/5991] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:40.101450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:40.103152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:40.135124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:40.135594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:40.140303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:40.143041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:40.245283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:40.245825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:40.246597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lazy-loading 'fault' on Instance uuid 545f9822-7171-4438-9986-a931cfd71a0f {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:04:40.298905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:40.307363 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8e85f335-6d22-4ed9-b486-51ff128ae4d1 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 200 len: 1331 microversion: 2.1 time: 0.212677 Jul 01 11:04:40.318912 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3046/5992] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:40 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 1331 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:41.328981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:41.330769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 545f9822-7171-4438-9986-a931cfd71a0f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:41.338677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:41.339448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:41.340439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:41.351477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:41.374450 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] HTTP exception thrown: Instance 545f9822-7171-4438-9986-a931cfd71a0f could not be found. Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Request method failure captured: Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f HTTP/1.1 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtReKmY9ulMqtOml8tMra_04Xjlozt8qlhpxqN_zDsuyzMfpGBu27VkVT4ZXwOO2IOlnAO7yMPVumwXKB-duNHHmLTmI5FxWS64t8vBLWPblmHG7pSdpvt0eKNKKEry539wLmg_zRM70MBzHBBdrC4htguJj9lujvll9_uX1f1ecXko Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 662ddba9a14c4711b17f5df267ef48b6 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1255095362 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/662ddba9a14c4711b17f5df267ef48b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/662ddba9a14c4711b17f5df267ef48b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_662ddba9a14c4711b17f5df267ef48b6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/662ddba9a14c4711b17f5df267ef48b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1255095362 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 662ddba9a14c4711b17f5df267ef48b6 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1255095362 Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestSecurityGroupsBasicOps-1255095362-project Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 5af9f39fc9a742f2b9a24bf221f2550c Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1255095362-project Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 545f9822-7171-4438-9986-a931cfd71a0f could not be found. Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '545f9822-7171-4438-9986-a931cfd71a0f'} Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545f9822-7171-4438-9986-a931cfd71a0f could not be found. Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545f9822-7171-4438-9986-a931cfd71a0f could not be found. Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:41.376473 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:41.380265 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:41.380265 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:41.380265 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:41.380265 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:04:41.380265 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:04:41.380265 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545f9822-7171-4438-9986-a931cfd71a0f could not be found. Jul 01 11:04:41.380265 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:04:41.382804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Returning 404 to user: Instance 545f9822-7171-4438-9986-a931cfd71a0f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:41.383882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-524e0762-2754-4c8e-b70d-666d6cdf9345 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f" status: 404 len: 111 microversion: 2.1 time: 0.060842 Jul 01 11:04:41.388608 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2947/5993] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:41 2022] GET /compute/v2.1/servers/545f9822-7171-4438-9986-a931cfd71a0f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:04:49.267247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:49.278502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:49.278852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-46a92336-f214-4da8-8ea8-fb5701c248a7 req-ca58bf91-1f84-434b-be9d-e06c56319730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b0d09c-a428-49fa-b576-716777f3c784", "tag": "d6126ee6-6edf-45a2-ac96-5a68c0da71b6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:49.280567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:49.281034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:49.281863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:49.282324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:49.286634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-46a92336-f214-4da8-8ea8-fb5701c248a7 req-ca58bf91-1f84-434b-be9d-e06c56319730 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:49.294323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-46a92336-f214-4da8-8ea8-fb5701c248a7 req-ca58bf91-1f84-434b-be9d-e06c56319730 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:49.317822 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-46a92336-f214-4da8-8ea8-fb5701c248a7 req-ca58bf91-1f84-434b-be9d-e06c56319730 service nova] Creating event network-changed:d6126ee6-6edf-45a2-ac96-5a68c0da71b6 for instance 96b0d09c-a428-49fa-b576-716777f3c784 on n-h1-master-1 Jul 01 11:04:49.336656 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-46a92336-f214-4da8-8ea8-fb5701c248a7 req-ca58bf91-1f84-434b-be9d-e06c56319730 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065233 Jul 01 11:04:49.337514 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2948/5994] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 01 11:04:49.363438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:04:49.899531 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d0831ca1-c00d-4be7-a0b1-b9cf2a37bfe8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 204 len: 0 microversion: 2.1 time: 0.636350 Jul 01 11:04:49.902546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3047/5995] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:04:49 2022] DELETE /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:04:49.917688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:49.918498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:49.933096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:49.933797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:49.936091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:49.937479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:50.342019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:50.351490 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5a08b920-3151-47e5-ab9d-6770cce456d8 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1766 microversion: 2.1 time: 0.441425 Jul 01 11:04:50.354015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2949/5996] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:49 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1766 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:51.371473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:51.373047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:51.385023 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:51.400511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:51.402074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:51.403095 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:51.405729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:51.713552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:51.727257 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7c95094f-b28d-490e-9488-829e96f31a31 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1766 microversion: 2.1 time: 0.360535 Jul 01 11:04:51.728104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3048/5997] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:51 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1766 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:04:52.297762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b095d414-950e-4756-97c5-375bb28dc984 req-7f039f81-1600-4520-9cf0-1725d27c544f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b0d09c-a428-49fa-b576-716777f3c784", "name": "network-vif-deleted", "tag": "d6126ee6-6edf-45a2-ac96-5a68c0da71b6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:52.323656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b095d414-950e-4756-97c5-375bb28dc984 req-7f039f81-1600-4520-9cf0-1725d27c544f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:52.325935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b095d414-950e-4756-97c5-375bb28dc984 req-7f039f81-1600-4520-9cf0-1725d27c544f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:52.356778 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b095d414-950e-4756-97c5-375bb28dc984 req-7f039f81-1600-4520-9cf0-1725d27c544f service nova] Creating event network-vif-deleted:d6126ee6-6edf-45a2-ac96-5a68c0da71b6 for instance 96b0d09c-a428-49fa-b576-716777f3c784 on n-h1-master-1 Jul 01 11:04:52.391835 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b095d414-950e-4756-97c5-375bb28dc984 req-7f039f81-1600-4520-9cf0-1725d27c544f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094353 Jul 01 11:04:52.391835 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2950/5998] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:04:52.746399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:52.747568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:52.773622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:52.773622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:52.773622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:52.773622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:52.865320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:52.865740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:52.866199 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lazy-loading 'fault' on Instance uuid 96b0d09c-a428-49fa-b576-716777f3c784 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:04:52.951670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af9f39fc9a742f2b9a24bf221f2550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ddba9a14c4711b17f5df267ef48b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:52.960064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f85df6fa-5f3c-49d9-941b-14cf115ba447 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 200 len: 1384 microversion: 2.1 time: 0.217753 Jul 01 11:04:52.961380 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3049/5999] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:52 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 1384 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:53.739980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-355400502", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "78135f7f-0d95-473d-81b6-dfd1361d50bf"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:04:53.832558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] validate_networks() for [('78135f7f-0d95-473d-81b6-dfd1361d50bf', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:04:53.978010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:53.979346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] [instance: 96b0d09c-a428-49fa-b576-716777f3c784] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:53.991150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:54.002058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:54.003151 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:54.003743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:54.029098 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] HTTP exception thrown: Instance 96b0d09c-a428-49fa-b576-716777f3c784 could not be found. Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Request method failure captured: Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 HTTP/1.1 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtReKmY9ulMqtOml8tMra_04Xjlozt8qlhpxqN_zDsuyzMfpGBu27VkVT4ZXwOO2IOlnAO7yMPVumwXKB-duNHHmLTmI5FxWS64t8vBLWPblmHG7pSdpvt0eKNKKEry539wLmg_zRM70MBzHBBdrC4htguJj9lujvll9_uX1f1ecXko Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 662ddba9a14c4711b17f5df267ef48b6 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1255095362 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/662ddba9a14c4711b17f5df267ef48b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/662ddba9a14c4711b17f5df267ef48b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_662ddba9a14c4711b17f5df267ef48b6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/662ddba9a14c4711b17f5df267ef48b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1255095362 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 662ddba9a14c4711b17f5df267ef48b6 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1255095362 Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestSecurityGroupsBasicOps-1255095362-project Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 5af9f39fc9a742f2b9a24bf221f2550c Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1255095362-project Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 96b0d09c-a428-49fa-b576-716777f3c784 could not be found. Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '96b0d09c-a428-49fa-b576-716777f3c784'} Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b0d09c-a428-49fa-b576-716777f3c784 could not be found. Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b0d09c-a428-49fa-b576-716777f3c784 could not be found. Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:04:54.031602 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:54.035788 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:04:54.035788 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:04:54.035788 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:04:54.035788 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:04:54.035788 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:04:54.035788 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b0d09c-a428-49fa-b576-716777f3c784 could not be found. Jul 01 11:04:54.035788 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:04:54.042025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Returning 404 to user: Instance 96b0d09c-a428-49fa-b576-716777f3c784 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:04:54.042025 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ed0bc43-873d-4549-b0e6-ffb8eb5193d9 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784" status: 404 len: 111 microversion: 2.1 time: 0.064613 Jul 01 11:04:54.042025 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3050/6000] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:53 2022] GET /compute/v2.1/servers/96b0d09c-a428-49fa-b576-716777f3c784 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:04:54.537133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:04:54.537593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:04:54.538063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:04:54.538469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:04:54.538876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:04:54.567146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:54.567593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:54.568397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:54.568829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:54.596297 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:54.652742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Getting quotas for project 419d161553314578b3ac5a8ea6955adb. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:04:54.683908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Getting quotas for user 7437c53d1bf14c52a753602bdb7b0cd9 and project 419d161553314578b3ac5a8ea6955adb. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:04:54.712974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:04:54.716267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:04:54.948120 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8dcdb9db-2587-413a-992c-3a4230463688 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.450967 Jul 01 11:04:54.951014 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2951/6001] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:04:54.961756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-46628229-7be4-44a2-a42a-6f78c8338505 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:54.962592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-46628229-7be4-44a2-a42a-6f78c8338505 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:55.160724 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-46628229-7be4-44a2-a42a-6f78c8338505 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:55.171555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-46628229-7be4-44a2-a42a-6f78c8338505 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1215 microversion: 2.1 time: 0.213807 Jul 01 11:04:55.182922 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3051/6002] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:54 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:56.190198 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c95df352-d7d3-446d-9e32-fb06d7e925c9 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:56.191439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c95df352-d7d3-446d-9e32-fb06d7e925c9 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:56.273450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c95df352-d7d3-446d-9e32-fb06d7e925c9 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:56.282804 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c95df352-d7d3-446d-9e32-fb06d7e925c9 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1215 microversion: 2.1 time: 0.098629 Jul 01 11:04:56.284228 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2952/6003] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:56 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:57.306965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:57.306965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:57.318526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:57.318988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:57.319787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:57.320234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:57.407225 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:57.422130 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e571fa8f-13cc-4724-8676-9708475a01fc tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1211 microversion: 2.1 time: 0.115516 Jul 01 11:04:57.422808 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3052/6004] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:57 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:58.440611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:58.441240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:58.444149 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:04:58.454698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:58.455155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:58.455931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:58.456545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:58.661545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:58.676379 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51d3e2a8-856b-4a21-bfdd-788ebac107b7 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1285 microversion: 2.1 time: 0.241487 Jul 01 11:04:58.676997 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2953/6005] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:58 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1285 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:04:59.694663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:04:59.695510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:04:59.703511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:59.704165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:59.704942 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:04:59.705572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:04:59.770103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:04:59.778441 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f999654-f319-463c-b6aa-1ef08e449e82 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1273 microversion: 2.1 time: 0.087627 Jul 01 11:04:59.779010 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3053/6006] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:04:59 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:00.795527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:00.796238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:00.812452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:00.812452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:00.823130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:00.831137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:01.591622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:01.615252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d17e8408-0653-4b04-a84c-6a71add387ba tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.823524 Jul 01 11:05:01.619104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2954/6007] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:00 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:02.313771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-32600da5-9eca-4831-928f-be75b362e449 req-09e378b9-1980-4c9b-adf8-52cdc30ffbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a96f717-277f-404c-ae1c-657d5f608448", "tag": "8e25bc5a-ac58-44e5-9e5c-6f5664e34e05"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:05:02.354238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-32600da5-9eca-4831-928f-be75b362e449 req-09e378b9-1980-4c9b-adf8-52cdc30ffbd4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:02.354703 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-32600da5-9eca-4831-928f-be75b362e449 req-09e378b9-1980-4c9b-adf8-52cdc30ffbd4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:02.469599 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:05:02.471818 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-32600da5-9eca-4831-928f-be75b362e449 req-09e378b9-1980-4c9b-adf8-52cdc30ffbd4 service nova] Creating event network-changed:8e25bc5a-ac58-44e5-9e5c-6f5664e34e05 for instance 4a96f717-277f-404c-ae1c-657d5f608448 on n-h2-master-1 Jul 01 11:05:02.482447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-32600da5-9eca-4831-928f-be75b362e449 req-09e378b9-1980-4c9b-adf8-52cdc30ffbd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176152 Jul 01 11:05:02.486703 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3054/6008] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:05:02.636692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:02.648059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:02.655613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:02.656056 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:02.656839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:02.657943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:02.916138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:02.926174 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-061394d0-56a7-4511-b225-dc1fb020dcf3 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.293329 Jul 01 11:05:02.936457 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2955/6009] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:02 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:03.895328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62a40d9a-4794-42f4-b33b-e82717abfab0 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] Calling method '.version_select at 0x7f6f970a7c10>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:03.944049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:03.946176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:03.960570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:03.961097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:03.962026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:03.962533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:04.026384 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62a40d9a-4794-42f4-b33b-e82717abfab0 tempest-TestSecurityGroupsBasicOps-1255095362 tempest-TestSecurityGroupsBasicOps-1255095362-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-308278340" status: 202 len: 0 microversion: 2.1 time: 0.135904 Jul 01 11:05:04.027138 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3055/6010] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 11:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-308278340 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:05:04.185855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:04.196970 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9b6420d-5824-4e42-82da-961161a019fe tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.256901 Jul 01 11:05:04.197617 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2956/6011] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:03 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:05:05.216527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:05.217442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:05.221285 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:05:05.227274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:05.227721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:05.228985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:05.229579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:05.382895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:05.405437 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9b1b4906-695b-47b4-9b28-888b00dea24b tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.194433 Jul 01 11:05:05.406192 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3056/6012] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:05 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:05:05.674057 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:05.674618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:05.676706 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:05:05.683220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:05.683764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:05.685175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:05.685673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:05.781201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lazy-loading 'services' on Instance uuid 9c605aa5-cd3b-4b93-884e-368eb6846b7c {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:05:06.019439 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-568df4b3-36f9-4dbe-95ee-4887a681c5b8 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c/os-volume_attachments/43da7ce4-7e26-4950-9419-80e0274269d0" status: 202 len: 0 microversion: 2.1 time: 0.348589 Jul 01 11:05:06.021788 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2957/6013] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:05:05 2022] DELETE /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c/os-volume_attachments/43da7ce4-7e26-4950-9419-80e0274269d0 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:05:06.422502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:06.423168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:06.441450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:06.442196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:06.443200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:06.443988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:06.602513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:06.611456 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad5d29d3-129e-40ac-890e-614175d1bc15 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.193718 Jul 01 11:05:06.612379 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3057/6014] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:06 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:07.626683 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:05:07.632384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:07.633098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:07.651370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:07.652295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:07.653292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:07.653894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:07.900494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:07.908587 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aef02ebf-d7f0-46a4-817d-bdedadef450c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.282820 Jul 01 11:05:07.909861 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2958/6015] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:07 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:08.927085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:08.927706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:08.940052 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:08.940504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:08.942927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:08.943375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:09.111860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-112543d8-2c9e-4a9c-97aa-a807aff9a7ac req-31e774a1-d2db-4701-9b68-97789a588dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a96f717-277f-404c-ae1c-657d5f608448", "name": "network-vif-plugged", "status": "completed", "tag": "8e25bc5a-ac58-44e5-9e5c-6f5664e34e05"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:05:09.130642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-112543d8-2c9e-4a9c-97aa-a807aff9a7ac req-31e774a1-d2db-4701-9b68-97789a588dc8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:09.131242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-112543d8-2c9e-4a9c-97aa-a807aff9a7ac req-31e774a1-d2db-4701-9b68-97789a588dc8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:09.151917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-112543d8-2c9e-4a9c-97aa-a807aff9a7ac req-31e774a1-d2db-4701-9b68-97789a588dc8 service nova] Creating event network-vif-plugged:8e25bc5a-ac58-44e5-9e5c-6f5664e34e05 for instance 4a96f717-277f-404c-ae1c-657d5f608448 on n-h2-master-1 Jul 01 11:05:09.162963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-112543d8-2c9e-4a9c-97aa-a807aff9a7ac req-31e774a1-d2db-4701-9b68-97789a588dc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055031 Jul 01 11:05:09.168437 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2959/6016] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:05:09.179347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:09.188766 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbaff269-a933-4f2a-8cfb-3923d16b7475 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.266997 Jul 01 11:05:09.189648 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3058/6017] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:08 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:10.208566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:10.209856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:10.218298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:10.218971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:10.221020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:10.221644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:10.414711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:10.421694 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67f054bb-3c00-4997-9b99-f49bb0395734 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1315 microversion: 2.1 time: 0.218079 Jul 01 11:05:10.422533 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2960/6018] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:10 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:11.438293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:11.439467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:11.455058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:11.460456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:11.461448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:11.462005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:11.733607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:11.742866 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ce67e061-c2c3-466b-8e9d-2ce3edd39490 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1502 microversion: 2.1 time: 0.308920 Jul 01 11:05:11.744209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3059/6019] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:11 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:11.761436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fb81587-f297-43b5-8f58-d9fcf59b0b1f tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:11.763120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fb81587-f297-43b5-8f58-d9fcf59b0b1f tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:11.780613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fb81587-f297-43b5-8f58-d9fcf59b0b1f tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:11.781080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fb81587-f297-43b5-8f58-d9fcf59b0b1f tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:11.781907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fb81587-f297-43b5-8f58-d9fcf59b0b1f tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:11.782504 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fb81587-f297-43b5-8f58-d9fcf59b0b1f tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.004892 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fb81587-f297-43b5-8f58-d9fcf59b0b1f tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.247462 Jul 01 11:05:12.005785 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2961/6020] 10.222.0.23 () {58 vars in 1295 bytes} [Fri Jul 1 11:05:11 2022] DELETE /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448/os-server-password => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:05:12.016798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-14b158ae-3eb7-4f53-bc5c-0be45a0146db tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:12.017560 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-14b158ae-3eb7-4f53-bc5c-0be45a0146db tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:12.026280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14b158ae-3eb7-4f53-bc5c-0be45a0146db tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.026806 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14b158ae-3eb7-4f53-bc5c-0be45a0146db tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.027792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14b158ae-3eb7-4f53-bc5c-0be45a0146db tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.028299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14b158ae-3eb7-4f53-bc5c-0be45a0146db tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.073424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-14b158ae-3eb7-4f53-bc5c-0be45a0146db tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.051076 Jul 01 11:05:12.081575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3060/6021] 10.222.0.23 () {58 vars in 1292 bytes} [Fri Jul 1 11:05:12 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448/os-server-password => generated 16 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 11:05:12.086331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:12.086833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:12.094241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.094946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.095871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.096681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.147491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:05:12.472686 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-159c1330-92ae-45b0-85c2-918bcd76eea0 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 204 len: 0 microversion: 2.1 time: 0.390946 Jul 01 11:05:12.475434 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2962/6022] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:05:12 2022] DELETE /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:05:12.483752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:12.484375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:12.491436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.492117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.493065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.493757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.601448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:12.602268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:12.610970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.611627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.612687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:12.613467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:12.668769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:05:12.766251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:12.774094 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ed5a80e-1113-4538-8abe-ef3767049542 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1508 microversion: 2.1 time: 0.294665 Jul 01 11:05:12.774889 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3061/6023] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:12 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:13.070837 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd8f6fc6-5de4-422f-8f1d-35c0c5ff9bc0 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 204 len: 0 microversion: 2.1 time: 0.474113 Jul 01 11:05:13.071438 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2963/6024] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:05:12 2022] DELETE /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:05:13.080791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:13.081803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:13.092060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:13.092892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:13.094781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:13.095469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:13.783039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:13.793264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:13.793966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:13.795926 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eab8eae7-b99d-452d-9bea-097d8c061a22 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1513 microversion: 2.1 time: 0.719953 Jul 01 11:05:13.796685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3062/6025] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:13 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1513 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:13.817448 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:13.817901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:13.819153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:13.819153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:14.059888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:14.062506 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=7,nova_cell1:UPDATE=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:05:14.074549 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1b0665be-67d6-4b7f-9057-3da028d2d640 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1508 microversion: 2.1 time: 0.286015 Jul 01 11:05:14.075683 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2964/6026] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:13 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:05:14.562327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-948c66c7-0545-4f11-b74b-d26be2095d56 req-bd22c262-b082-4dfb-a2cf-cd3eed0cb55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a96f717-277f-404c-ae1c-657d5f608448", "name": "network-vif-deleted", "tag": "8e25bc5a-ac58-44e5-9e5c-6f5664e34e05"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:05:14.578129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-948c66c7-0545-4f11-b74b-d26be2095d56 req-bd22c262-b082-4dfb-a2cf-cd3eed0cb55b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:14.578987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-948c66c7-0545-4f11-b74b-d26be2095d56 req-bd22c262-b082-4dfb-a2cf-cd3eed0cb55b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:14.592953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-948c66c7-0545-4f11-b74b-d26be2095d56 req-bd22c262-b082-4dfb-a2cf-cd3eed0cb55b service nova] Creating event network-vif-deleted:8e25bc5a-ac58-44e5-9e5c-6f5664e34e05 for instance 4a96f717-277f-404c-ae1c-657d5f608448 on n-h2-master-1 Jul 01 11:05:14.600683 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-948c66c7-0545-4f11-b74b-d26be2095d56 req-bd22c262-b082-4dfb-a2cf-cd3eed0cb55b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042950 Jul 01 11:05:14.602368 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3063/6027] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:05:14.814945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:14.815513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:14.823351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:14.823802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:14.825131 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:14.825787 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:15.092767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:15.093754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:15.100925 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:15.101540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:15.102413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:15.103084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:15.136034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:15.137667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:15.138337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:15.138980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lazy-loading 'fault' on Instance uuid 4a96f717-277f-404c-ae1c-657d5f608448 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:05:15.146170 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5dd9acf8-68ad-4fcf-ad65-74cc5bba78dd tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1513 microversion: 2.1 time: 0.335386 Jul 01 11:05:15.155548 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2965/6028] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:14 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:15.203704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7437c53d1bf14c52a753602bdb7b0cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419d161553314578b3ac5a8ea6955adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:15.224421 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c0ca0ef4-7561-403c-b4c6-a636e6983a7c tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 200 len: 1305 microversion: 2.1 time: 0.136114 Jul 01 11:05:15.234232 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3064/6029] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:15 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:15.654904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-30891b67-0758-4f4d-a9ce-9d2748115950 req-85dd2a46-f2e4-46da-975a-3ef60a2a6f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c605aa5-cd3b-4b93-884e-368eb6846b7c", "name": "network-vif-deleted", "tag": "cf811a47-a3e3-4cf7-bd62-8fa763619c66"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:05:15.663283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-30891b67-0758-4f4d-a9ce-9d2748115950 req-85dd2a46-f2e4-46da-975a-3ef60a2a6f10 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:15.664053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-30891b67-0758-4f4d-a9ce-9d2748115950 req-85dd2a46-f2e4-46da-975a-3ef60a2a6f10 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:15.676095 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-30891b67-0758-4f4d-a9ce-9d2748115950 req-85dd2a46-f2e4-46da-975a-3ef60a2a6f10 service nova] Creating event network-vif-deleted:cf811a47-a3e3-4cf7-bd62-8fa763619c66 for instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c on n-h1-master-1 Jul 01 11:05:15.681002 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-30891b67-0758-4f4d-a9ce-9d2748115950 req-85dd2a46-f2e4-46da-975a-3ef60a2a6f10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030599 Jul 01 11:05:15.681875 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2966/6030] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:05:16.163820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:16.163820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:16.185173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:16.185618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:16.186406 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:16.187106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:16.239632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:16.240317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:16.245948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:16.245948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] [instance: 4a96f717-277f-404c-ae1c-657d5f608448] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:16.247345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lazy-loading 'fault' on Instance uuid 9c605aa5-cd3b-4b93-884e-368eb6846b7c {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:05:16.251450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:16.252216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:16.253338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:16.253914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:16.281841 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] HTTP exception thrown: Instance 4a96f717-277f-404c-ae1c-657d5f608448 could not be found. Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Request method failure captured: Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 HTTP/1.1 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtTVCuv7f9WzUi6bYajiKVyI-8RMcMDO_a1_3BmSZDhLDW8uRt5CVOCOO-6GbB5DRjKNcQTJck1M11hixWUnaawvcaqEi6945oCALeuYZmKajMMH0OZHWIkQ1mOKwzbQu7JyVZlBlBcytdK6V_9_zJNXxB2MIxssF87LNF1DNVowXUg Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 419d161553314578b3ac5a8ea6955adb Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerPasswordTestJSON-971351347 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419d161553314578b3ac5a8ea6955adb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419d161553314578b3ac5a8ea6955adb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419d161553314578b3ac5a8ea6955adb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419d161553314578b3ac5a8ea6955adb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerPasswordTestJSON-971351347 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 419d161553314578b3ac5a8ea6955adb Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerPasswordTestJSON-971351347 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerPasswordTestJSON-971351347-project Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 7437c53d1bf14c52a753602bdb7b0cd9 Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerPasswordTestJSON-971351347-project Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 4a96f717-277f-404c-ae1c-657d5f608448 could not be found. Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '4a96f717-277f-404c-ae1c-657d5f608448'} Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a96f717-277f-404c-ae1c-657d5f608448 could not be found. Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a96f717-277f-404c-ae1c-657d5f608448 could not be found. Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:05:16.283722 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a96f717-277f-404c-ae1c-657d5f608448 could not be found. Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] Returning 404 to user: Instance 4a96f717-277f-404c-ae1c-657d5f608448 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2d5f566-d309-4a1b-8ba8-81b563b92264 tempest-ServerPasswordTestJSON-971351347 tempest-ServerPasswordTestJSON-971351347-project] 10.222.0.23 "GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448" status: 404 len: 111 microversion: 2.1 time: 0.049115 Jul 01 11:05:16.290559 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2967/6031] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:16 2022] GET /compute/v2.1/servers/4a96f717-277f-404c-ae1c-657d5f608448 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:05:16.311919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3b812d82b843da837229bf82f78229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeeb0d6512244a485d04dcf1e43cdab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:05:16.319785 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cff0e496-2394-462d-a4da-aa7ab108a215 tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 200 len: 1308 microversion: 2.1 time: 0.160476 Jul 01 11:05:16.320354 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3065/6032] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:16 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:05:17.336997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:05:17.337723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] [instance: 9c605aa5-cd3b-4b93-884e-368eb6846b7c] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:05:17.350791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:17.351527 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:17.352482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:05:17.356651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:05:17.382147 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] HTTP exception thrown: Instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c could not be found. Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Request method failure captured: Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c HTTP/1.1 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtPchoZgaZz8IRek9-wwiYhoynsx5q39fw2zpAYd2fYzUDBMz3cly0EGlGn690lAA40R2XWdpuTue_DSMeH7Ivhrxtk_7dczwSYlB6YfjbgFO97xbp2h3_zO0H8D4ITf6Hff9gFdVLsw1MHwtA8b5IhX9nOyxgynpD7tZhSmViJBWKc Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: adeeb0d6512244a485d04dcf1e43cdab Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1054096975 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/adeeb0d6512244a485d04dcf1e43cdab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/adeeb0d6512244a485d04dcf1e43cdab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_adeeb0d6512244a485d04dcf1e43cdab", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/adeeb0d6512244a485d04dcf1e43cdab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesSnapshotTestJSON-1054096975 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: adeeb0d6512244a485d04dcf1e43cdab Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1054096975 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesSnapshotTestJSON-1054096975-project Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: db3b812d82b843da837229bf82f78229 Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesSnapshotTestJSON-1054096975-project Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c could not be found. Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '9c605aa5-cd3b-4b93-884e-368eb6846b7c'} Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c could not be found. Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c could not be found. Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:05:17.384759 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c could not be found. Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] Returning 404 to user: Instance 9c605aa5-cd3b-4b93-884e-368eb6846b7c could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:05:17.388559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f743cc24-5809-4028-9fd2-833d55c69eff tempest-VolumesSnapshotTestJSON-1054096975 tempest-VolumesSnapshotTestJSON-1054096975-project] 10.222.0.23 "GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c" status: 404 len: 111 microversion: 2.1 time: 0.053440 Jul 01 11:05:17.403940 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2968/6033] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:05:17 2022] GET /compute/v2.1/servers/9c605aa5-cd3b-4b93-884e-368eb6846b7c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:05:47.041818 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:05:47.041818 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:06:09.429427 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b987d35f-ce96-4c09-a4c2-2122b3cb9b5d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Action: 'create', calling method: .version_select at 0x7f6f96f66f70>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-937841094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO85Q3cXRyXMhd6XHDl1DwK/1kVEmw2mCLtWWO8DHUO+dx8nMGNasp2uMEU2FlAOnx+JlfP3l4Q2jCtnxdQMCUoEV+VMqtSUv9iaR3RSCJc2DoNa9xkKxT2VWPRcSF6hKA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:06:09.439507 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:06:09.440995 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=59 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:06:09.452260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b987d35f-ce96-4c09-a4c2-2122b3cb9b5d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Getting quotas for project b6b29550aee140c09ae491927b701b6b. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:06:09.459794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b987d35f-ce96-4c09-a4c2-2122b3cb9b5d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Getting quotas for user bc2934a36b2e44d99a6b0c1379d94df0 and project b6b29550aee140c09ae491927b701b6b. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:06:09.574515 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b987d35f-ce96-4c09-a4c2-2122b3cb9b5d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.152356 Jul 01 11:06:09.578268 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3066/6034] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:06:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:06:13.356852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1865826524", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f8a1e993-6c9a-46bb-b1b7-2f0922b9f7fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-937841094", "security_groups": [{"name": "tempest-secgroup-smoke-1574778005"}], "networks": [{"uuid": "7d97be28-90a9-478f-84fc-d0299df2aa40"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:06:13.366816 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:06:13.367478 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=13 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:06:13.860290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] validate_networks() for [('7d97be28-90a9-478f-84fc-d0299df2aa40', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:06:14.333574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:06:14.334002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:06:14.334476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:06:14.334950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:06:14.335399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:06:14.344989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:14.345487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:14.346284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:14.346719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:14.363671 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Getting quotas for project b6b29550aee140c09ae491927b701b6b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:06:14.370220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Getting quotas for user bc2934a36b2e44d99a6b0c1379d94df0 and project b6b29550aee140c09ae491927b701b6b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:06:14.429955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:06:14.432065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8a1e993-6c9a-46bb-b1b7-2f0922b9f7fd',volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:06:14.934756 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cec3ed7f-e958-4efa-863c-60a54111d2fb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.582375 Jul 01 11:06:14.935623 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2969/6035] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:06:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:06:14.946854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b29ea8f9-a405-4ad4-b88b-ee055514c977 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:14.947806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b29ea8f9-a405-4ad4-b88b-ee055514c977 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:15.112448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b29ea8f9-a405-4ad4-b88b-ee055514c977 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:15.121559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b29ea8f9-a405-4ad4-b88b-ee055514c977 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1098 microversion: 2.1 time: 0.179258 Jul 01 11:06:15.122743 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3067/6036] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:14 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1098 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:16.140984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:16.141681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:16.148707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:16.149220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:16.150004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:16.150464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:16.237507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:16.248187 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdad54e5-42a7-4087-8125-6669090f4ebb tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1148 microversion: 2.1 time: 0.112869 Jul 01 11:06:16.248781 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2970/6037] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:16 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1148 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:17.268050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:17.268624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:17.294427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:17.294973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:17.295834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:17.296297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:17.423454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:17.434856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10c5e6cc-d52d-4856-a189-2c57087cf53c tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1204 microversion: 2.1 time: 0.172484 Jul 01 11:06:17.436022 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3068/6038] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:17 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1204 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:18.452183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:18.452881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:18.479933 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:18.480390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:18.481259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:18.481711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:18.914598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:18.926936 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0c35e52-e115-4edd-b284-9956fc9a3114 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1282 microversion: 2.1 time: 0.478620 Jul 01 11:06:18.938107 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2971/6039] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:18 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1282 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:19.906363 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9e84cebe-7cb4-429e-bd85-3176de032b04 req-81747af5-2e92-4596-81a0-6220680d5ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f44819-4b58-420f-99cb-77059e1dd0ae", "tag": "15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:06:19.922572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e84cebe-7cb4-429e-bd85-3176de032b04 req-81747af5-2e92-4596-81a0-6220680d5ef0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:19.925836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e84cebe-7cb4-429e-bd85-3176de032b04 req-81747af5-2e92-4596-81a0-6220680d5ef0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:19.951533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:19.952152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:19.980674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:19.991580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:19.997063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:20.000679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:20.005283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9e84cebe-7cb4-429e-bd85-3176de032b04 req-81747af5-2e92-4596-81a0-6220680d5ef0 service nova] Creating event network-changed:15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0 for instance 96f44819-4b58-420f-99cb-77059e1dd0ae on n-h2-master-1 Jul 01 11:06:20.056615 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9e84cebe-7cb4-429e-bd85-3176de032b04 req-81747af5-2e92-4596-81a0-6220680d5ef0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153754 Jul 01 11:06:20.057260 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3069/6040] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:06:20.555369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:20.579688 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8fdd9dd7-6071-46c6-a841-1d1244331458 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1282 microversion: 2.1 time: 0.631962 Jul 01 11:06:20.580459 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2972/6041] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:19 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1282 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:21.597208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:21.597883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:21.608125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:21.608593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:21.609440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:21.609881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:21.868240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:21.875958 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aaf96f53-c7f8-4bb7-8981-d11f163f2f9d tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1282 microversion: 2.1 time: 0.283806 Jul 01 11:06:21.876541 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3070/6042] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:21 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1282 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:22.892971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:22.893830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:22.910452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:22.910907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:22.911685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:22.912115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:23.206218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:23.228157 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e17f7997-268a-4d07-b525-9df35cdebda8 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1282 microversion: 2.1 time: 0.337035 Jul 01 11:06:23.230513 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2973/6043] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:22 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1282 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:24.247605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:24.248843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:24.262455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:24.269291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:24.269291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:24.269291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:24.534990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:24.545994 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a3053cb-b710-4eb9-86df-190396c5f6dd tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1282 microversion: 2.1 time: 0.303429 Jul 01 11:06:24.546839 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3071/6044] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:24 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1282 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:25.563753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:25.565010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:25.572096 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:06:25.573305 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:06:25.575245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:25.575976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:25.576906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:25.577518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:25.784648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:25.793617 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9a3f8fc2-069a-40e3-8a27-7a6d34c8f367 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.234217 Jul 01 11:06:25.810146 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2974/6045] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:25 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:26.816642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:26.817411 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:26.819417 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:06:26.825817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:26.826273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:26.827044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:26.827480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:27.042136 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:27.053782 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f4d9f6d-47b1-459e-9d5d-5d1df395eb50 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.240614 Jul 01 11:06:27.054541 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3072/6046] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:26 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:28.071013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:28.073589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:28.082629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:28.084042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:28.085427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:28.086052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:28.254399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:28.263460 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-34a92c63-074f-4177-a96a-c740452de490 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.196096 Jul 01 11:06:28.272855 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2975/6047] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:28 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:29.295623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:29.295623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:29.295623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:29.295623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:29.296281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:29.296281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:29.434705 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:29.442814 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ceda735-ac3d-4668-930f-2b23f3401244 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.166878 Jul 01 11:06:29.443408 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3073/6048] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:29 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:30.460143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:30.460756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:30.468303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:30.469181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:30.470186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:30.470775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:30.635499 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:30.657713 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aee421db-3807-4c9f-a017-5a4afa2213d1 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.201304 Jul 01 11:06:30.658493 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2976/6049] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:30 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:31.675501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:31.676099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:31.684850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:31.685736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:31.686708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:31.687674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:31.847996 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:31.861639 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d055ba8b-3459-4bdb-b371-71269ad38277 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.189700 Jul 01 11:06:31.862775 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3074/6050] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:31 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:32.879717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:32.881773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:32.889771 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:32.890503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:32.891699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:32.892307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:33.058247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:33.068948 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c97ac81e-432f-4548-80d6-e5bd872a03d3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.193886 Jul 01 11:06:33.070364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2977/6051] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:32 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:34.086873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:34.087533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:34.098990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:34.098990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:34.098990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:34.098990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:34.242446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:34.257432 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9f6586d4-4881-4eaa-96eb-4448431f767a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.174541 Jul 01 11:06:34.265233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3075/6052] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:34 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:35.277006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:35.279396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:35.293818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:35.297005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:35.299963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:35.300667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:35.404200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3c75137b-862b-4ee4-b6c2-313a1d997d92 req-cc961543-9775-4182-bf73-29a784bf3930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f44819-4b58-420f-99cb-77059e1dd0ae", "name": "network-vif-plugged", "status": "completed", "tag": "15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:06:35.418529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3c75137b-862b-4ee4-b6c2-313a1d997d92 req-cc961543-9775-4182-bf73-29a784bf3930 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:35.418969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3c75137b-862b-4ee4-b6c2-313a1d997d92 req-cc961543-9775-4182-bf73-29a784bf3930 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:35.433271 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3c75137b-862b-4ee4-b6c2-313a1d997d92 req-cc961543-9775-4182-bf73-29a784bf3930 service nova] Creating event network-vif-plugged:15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0 for instance 96f44819-4b58-420f-99cb-77059e1dd0ae on n-h2-master-1 Jul 01 11:06:35.448758 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3c75137b-862b-4ee4-b6c2-313a1d997d92 req-cc961543-9775-4182-bf73-29a784bf3930 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050408 Jul 01 11:06:35.449702 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3076/6053] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:06:35.491878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:35.504738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff6be74e-56a2-4123-a2f1-efe06bc39ced tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.231938 Jul 01 11:06:35.505914 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2978/6054] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:35 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:36.523075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:36.523812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:36.530223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:36.530705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:36.531475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:36.531911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:36.706672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:36.729992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3b66e428-e545-41fe-be3b-948874d0c6fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1270 microversion: 2.1 time: 0.210477 Jul 01 11:06:36.730599 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3077/6055] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:36 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:37.746470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:37.747331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:37.770106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:37.770106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:37.770106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:37.770439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:37.912060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:37.920093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ac35e990-b863-4c21-bc21-a210d1a76a62 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1460 microversion: 2.1 time: 0.178151 Jul 01 11:06:37.920673 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2979/6056] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:37 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1460 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:37.937725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:06:37.938384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:06:37.944898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:37.945393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:37.946161 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:37.946596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:38.111603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:06:38.119857 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-badaa768-3e06-45c2-95dc-6719560071c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1460 microversion: 2.1 time: 0.186478 Jul 01 11:06:38.120515 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3078/6057] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:06:37 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1460 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:06:41.231505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d21e9354-34e7-4503-9592-e15c651ac4bd req-190cea49-0e0e-48b7-b748-101594fdaf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f44819-4b58-420f-99cb-77059e1dd0ae", "tag": "15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:06:41.241586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d21e9354-34e7-4503-9592-e15c651ac4bd req-190cea49-0e0e-48b7-b748-101594fdaf2b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:41.244192 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d21e9354-34e7-4503-9592-e15c651ac4bd req-190cea49-0e0e-48b7-b748-101594fdaf2b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:41.258293 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d21e9354-34e7-4503-9592-e15c651ac4bd req-190cea49-0e0e-48b7-b748-101594fdaf2b service nova] Creating event network-changed:15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0 for instance 96f44819-4b58-420f-99cb-77059e1dd0ae on n-h2-master-1 Jul 01 11:06:41.266316 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d21e9354-34e7-4503-9592-e15c651ac4bd req-190cea49-0e0e-48b7-b748-101594fdaf2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039412 Jul 01 11:06:41.272668 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2980/6058] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:06:43.291380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0b0a837c-db7b-4468-a288-9ad362455a2b req-bee964ad-443d-41ce-b81f-16a6d4aaa171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f44819-4b58-420f-99cb-77059e1dd0ae", "tag": "15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0"}, {"name": "network-changed", "server_uuid": "96f44819-4b58-420f-99cb-77059e1dd0ae", "tag": "15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:06:43.325296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0b0a837c-db7b-4468-a288-9ad362455a2b req-bee964ad-443d-41ce-b81f-16a6d4aaa171 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:06:43.325759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0b0a837c-db7b-4468-a288-9ad362455a2b req-bee964ad-443d-41ce-b81f-16a6d4aaa171 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:06:43.378186 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0b0a837c-db7b-4468-a288-9ad362455a2b req-bee964ad-443d-41ce-b81f-16a6d4aaa171 service nova] Creating event network-changed:15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0 for instance 96f44819-4b58-420f-99cb-77059e1dd0ae on n-h2-master-1 Jul 01 11:06:43.378719 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0b0a837c-db7b-4468-a288-9ad362455a2b req-bee964ad-443d-41ce-b81f-16a6d4aaa171 service nova] Creating event network-changed:15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0 for instance 96f44819-4b58-420f-99cb-77059e1dd0ae on n-h2-master-1 Jul 01 11:06:43.390827 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0b0a837c-db7b-4468-a288-9ad362455a2b req-bee964ad-443d-41ce-b81f-16a6d4aaa171 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109724 Jul 01 11:06:43.395503 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3079/6059] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:07:01.252357 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:01.253281 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=64 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:01.725544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39cff2b4-23f5-41b5-8dc6-5fe3413082f1 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Action: 'create', calling method: .version_select at 0x7f6f90695b80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-482532548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr6+ybKKYekp7odSsC7OzBsSYQlBo+GUu0dmscu9ZuAMAKKwRf2LiapBH5/rX/cvI+exvXs4WqVePmETMucAMwj8oyWCSvFOR1V3L4MdWTSD9x4qh7lFLfYZrTyUW50NQ=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:07:01.775952 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-39cff2b4-23f5-41b5-8dc6-5fe3413082f1 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Getting quotas for project bcc8c6d3ac9b4615a54d8c99d19f999c. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:07:01.790820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-39cff2b4-23f5-41b5-8dc6-5fe3413082f1 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Getting quotas for user f3b71f050e4349368c371d815d637649 and project bcc8c6d3ac9b4615a54d8c99d19f999c. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:07:01.906145 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39cff2b4-23f5-41b5-8dc6-5fe3413082f1 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.660311 Jul 01 11:07:01.907446 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2981/6060] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:07:01 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:07:05.159976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-654256646", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-482532548", "security_groups": [{"name": "tempest-secgroup-smoke-1032588895"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "8d50ec5e-64ae-4a13-939a-95609149e788"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:07:05.168513 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:05.181881 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=60 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:05.296125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] validate_networks() for [('8d50ec5e-64ae-4a13-939a-95609149e788', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:07:05.945224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Getting quotas for project bcc8c6d3ac9b4615a54d8c99d19f999c. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:07:05.952895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Getting quotas for user f3b71f050e4349368c371d815d637649 and project bcc8c6d3ac9b4615a54d8c99d19f999c. Resources: dict_keys(['metadata_items']) {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:07:05.981711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:07:05.982515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:07:05.983232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:07:05.983907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:07:05.984550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:07:05.997768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:05.999179 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:05.999633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:06.000548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:06.026304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Getting quotas for project bcc8c6d3ac9b4615a54d8c99d19f999c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:07:06.033309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Getting quotas for user f3b71f050e4349368c371d815d637649 and project bcc8c6d3ac9b4615a54d8c99d19f999c. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:07:06.048785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:07:06.051897 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:07:06.228835 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [4e09ed61-704d-4108-a27f-92469a78dc98] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:07:07.236647 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [4e09ed61-704d-4108-a27f-92469a78dc98] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34352. Jul 01 11:07:07.240781 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1dcf767b-84bd-4b1c-970b-2a5cde337a43 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.085017 Jul 01 11:07:07.243879 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3080/6061] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:07:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:07:07.254550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87045767-849e-4e92-8d21-c686549f1213 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:07.255277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87045767-849e-4e92-8d21-c686549f1213 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:07.319690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87045767-849e-4e92-8d21-c686549f1213 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:07.331474 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87045767-849e-4e92-8d21-c686549f1213 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1301 microversion: 2.1 time: 0.081132 Jul 01 11:07:07.333166 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2982/6062] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:07 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:08.354548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c63c2aa-42a9-4142-ae90-fb3687542130 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:08.355188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c63c2aa-42a9-4142-ae90-fb3687542130 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:08.412781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c63c2aa-42a9-4142-ae90-fb3687542130 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:08.420519 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c63c2aa-42a9-4142-ae90-fb3687542130 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1301 microversion: 2.1 time: 0.074381 Jul 01 11:07:08.421101 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3081/6063] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:08 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1301 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:09.439296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:09.440881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:09.450153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:09.450748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:09.452670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:09.453551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:09.554735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:09.563954 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-64611438-9371-4744-8a1d-c20cc66235cc tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1353 microversion: 2.1 time: 0.129790 Jul 01 11:07:09.565140 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2983/6064] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:09 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:07:10.597994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:10.597994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:10.607467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:10.610195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:10.611023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:10.611472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:10.705093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:10.714414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-887655e9-02c9-4a49-9c2a-73b3fec7d9ae tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1371 microversion: 2.1 time: 0.126230 Jul 01 11:07:10.725104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3082/6065] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:10 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:07:11.734990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:11.736247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:11.745461 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:11.746184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:11.747432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:11.749605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:12.102546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:12.114952 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6404ba5d-8770-4d70-ab5b-0a7e17e56315 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.383789 Jul 01 11:07:12.118990 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2984/6066] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:11 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:13.054836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0f628236-defa-47c1-897c-061057e4fa45 req-785eb711-7530-4974-8fcf-d1eb22bce041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa987f2-aaa9-4683-878e-ae9a18726743", "tag": "eea5cf7b-7166-4f05-b853-274e12dde180"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:07:13.080344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0f628236-defa-47c1-897c-061057e4fa45 req-785eb711-7530-4974-8fcf-d1eb22bce041 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:13.081103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0f628236-defa-47c1-897c-061057e4fa45 req-785eb711-7530-4974-8fcf-d1eb22bce041 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:13.104727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0f628236-defa-47c1-897c-061057e4fa45 req-785eb711-7530-4974-8fcf-d1eb22bce041 service nova] Creating event network-changed:eea5cf7b-7166-4f05-b853-274e12dde180 for instance 7aa987f2-aaa9-4683-878e-ae9a18726743 on n-h1-master-1 Jul 01 11:07:13.127137 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0f628236-defa-47c1-897c-061057e4fa45 req-785eb711-7530-4974-8fcf-d1eb22bce041 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080639 Jul 01 11:07:13.128522 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3083/6067] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:07:13.136051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:13.136667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:13.166822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:13.172614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:13.173780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:13.176286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:13.632366 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:13.647110 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ef7f027-1356-47fd-a4f1-3e4cbc0270f0 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.515980 Jul 01 11:07:13.657299 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2985/6068] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:13 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:14.665280 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:14.666184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:14.673169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:14.673850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:14.674623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:14.675065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:14.912129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:14.921312 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-19b92b50-a630-4914-8023-d46681a6ffa4 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.261091 Jul 01 11:07:14.921964 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3084/6069] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:14 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:15.942172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:15.943035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:15.952910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:15.953613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:15.956515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:15.957273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:16.162697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:16.170963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1de971c5-c603-48c7-88fc-26175b2a9305 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.235712 Jul 01 11:07:16.182894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2986/6070] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:15 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:17.189780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:17.190407 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:17.194645 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:17.199379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:17.200030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:17.201286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:17.201902 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:17.383739 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:17.391901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-344e45fd-2c7a-459d-9c42-135929bc4024 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.206572 Jul 01 11:07:17.392749 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3085/6071] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:17 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:18.409551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:18.410909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:18.414826 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:18.420286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:18.420739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:18.421546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:18.421981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:18.570128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:18.578387 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e8dc43a-e6a5-41ac-a994-3ae6ab56760b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.172815 Jul 01 11:07:18.578969 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2987/6072] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:18 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:19.556032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-580d92ad-e3b8-4926-bc1b-93c3bd119bd3 req-914037ef-339f-459f-8ad7-12668c71ad94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa987f2-aaa9-4683-878e-ae9a18726743", "name": "network-vif-plugged", "status": "completed", "tag": "eea5cf7b-7166-4f05-b853-274e12dde180"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:07:19.563665 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:19.570195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-580d92ad-e3b8-4926-bc1b-93c3bd119bd3 req-914037ef-339f-459f-8ad7-12668c71ad94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:19.574083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-580d92ad-e3b8-4926-bc1b-93c3bd119bd3 req-914037ef-339f-459f-8ad7-12668c71ad94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:19.583485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-580d92ad-e3b8-4926-bc1b-93c3bd119bd3 req-914037ef-339f-459f-8ad7-12668c71ad94 service nova] Creating event network-vif-plugged:eea5cf7b-7166-4f05-b853-274e12dde180 for instance 7aa987f2-aaa9-4683-878e-ae9a18726743 on n-h1-master-1 Jul 01 11:07:19.590691 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-580d92ad-e3b8-4926-bc1b-93c3bd119bd3 req-914037ef-339f-459f-8ad7-12668c71ad94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040120 Jul 01 11:07:19.592041 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3086/6073] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:07:19.596510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:19.597131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:19.604039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:19.604491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:19.605298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:19.605733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:20.252257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:20.261550 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef4209fc-dc0d-4cea-8f76-a2c09bd7c696 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.669538 Jul 01 11:07:20.261653 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2988/6074] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:19 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:21.283754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:21.284672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:21.295940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:21.296985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:21.298001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:21.298668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:21.540693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:21.549537 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d0933537-1f7d-4874-a611-c23f217e0f2e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1427 microversion: 2.1 time: 0.274192 Jul 01 11:07:21.550600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3087/6075] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:21 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1427 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:22.575578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:22.575578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:22.579870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:22.580644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:22.582229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:22.582928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:22.790862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:22.799037 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-36c2f5ae-deed-4d98-a1e4-8ad55cc5473b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1607 microversion: 2.1 time: 0.232028 Jul 01 11:07:22.799604 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2989/6076] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:22 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1607 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:22.816749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:22.817392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:22.825281 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:22.825738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:22.826526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:22.826963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:23.054085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:23.064455 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ea3946b-de84-4d4c-bad1-a7b4bf6ce652 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1607 microversion: 2.1 time: 0.251626 Jul 01 11:07:23.076209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3088/6077] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:22 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1607 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:23.082642 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:23.084076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:23.091159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:23.091618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:23.092399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:23.092839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:23.248506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:07:23.256851 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e58c2670-c54d-4cac-ade1-091649d19686 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1607 microversion: 2.1 time: 0.178204 Jul 01 11:07:23.257804 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2990/6078] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:07:23 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1607 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:07:26.844344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3cf7936b-00f6-43c4-b81f-55537387f03d req-591f57fd-2372-470f-9397-59da0c450528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa987f2-aaa9-4683-878e-ae9a18726743", "tag": "eea5cf7b-7166-4f05-b853-274e12dde180"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:07:26.858769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3cf7936b-00f6-43c4-b81f-55537387f03d req-591f57fd-2372-470f-9397-59da0c450528 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:26.864290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3cf7936b-00f6-43c4-b81f-55537387f03d req-591f57fd-2372-470f-9397-59da0c450528 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:26.877280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3cf7936b-00f6-43c4-b81f-55537387f03d req-591f57fd-2372-470f-9397-59da0c450528 service nova] Creating event network-changed:eea5cf7b-7166-4f05-b853-274e12dde180 for instance 7aa987f2-aaa9-4683-878e-ae9a18726743 on n-h1-master-1 Jul 01 11:07:26.886597 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3cf7936b-00f6-43c4-b81f-55537387f03d req-591f57fd-2372-470f-9397-59da0c450528 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049769 Jul 01 11:07:26.898742 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3089/6079] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:07:58.394344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f8c7633-6f0d-4fc2-a2c5-af7455a3159b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:07:58.397247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f8c7633-6f0d-4fc2-a2c5-af7455a3159b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:07:58.406672 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:58.408277 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=48 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:58.412012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8c7633-6f0d-4fc2-a2c5-af7455a3159b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:58.414783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8c7633-6f0d-4fc2-a2c5-af7455a3159b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:58.417307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8c7633-6f0d-4fc2-a2c5-af7455a3159b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:07:58.418360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8c7633-6f0d-4fc2-a2c5-af7455a3159b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:07:58.498718 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f8c7633-6f0d-4fc2-a2c5-af7455a3159b tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.115258 Jul 01 11:07:58.505859 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2991/6080] 10.222.0.23 () {58 vars in 1292 bytes} [Fri Jul 1 11:07:58 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743/os-server-password => generated 116 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:07:59.884275 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:07:59.886627 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=38 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:00.184754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2c175391-0647-4695-af9a-f7ce83cfeb66 req-ee95c5a5-5481-482c-9340-acd50f5d7a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f44819-4b58-420f-99cb-77059e1dd0ae", "tag": "15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:00.204236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2c175391-0647-4695-af9a-f7ce83cfeb66 req-ee95c5a5-5481-482c-9340-acd50f5d7a82 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:00.209520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2c175391-0647-4695-af9a-f7ce83cfeb66 req-ee95c5a5-5481-482c-9340-acd50f5d7a82 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:00.285596 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2c175391-0647-4695-af9a-f7ce83cfeb66 req-ee95c5a5-5481-482c-9340-acd50f5d7a82 service nova] Creating event network-changed:15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0 for instance 96f44819-4b58-420f-99cb-77059e1dd0ae on n-h2-master-1 Jul 01 11:08:00.335686 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2c175391-0647-4695-af9a-f7ce83cfeb66 req-ee95c5a5-5481-482c-9340-acd50f5d7a82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421241 Jul 01 11:08:00.336556 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2992/6081] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:08:00.394743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:00.398474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:00.412798 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:00.413295 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:00.416728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:00.417045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:00.467939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:08:00.930241 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0b1ae9c-9808-424d-812e-4030c33e82a3 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 204 len: 0 microversion: 2.1 time: 1.057683 Jul 01 11:08:00.932365 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3090/6082] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:07:59 2022] DELETE /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:08:00.940962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:00.941696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:00.961832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:00.963099 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:00.964064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:00.964666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:01.159561 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:01.168068 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf75bdb1-9884-4d3e-8dcd-36e4a6df808a tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1584 microversion: 2.1 time: 0.231437 Jul 01 11:08:01.168963 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2993/6083] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:00 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1584 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:02.195102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:02.196048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:02.234750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:02.235218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:02.236017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:02.241792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:02.524817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:02.539135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ad9a479-8771-47d0-817e-8173e14b5665 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1584 microversion: 2.1 time: 0.354813 Jul 01 11:08:02.539737 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3091/6084] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:02 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1584 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:03.458468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0a74b615-7b09-4d39-a18c-228fb5d42d60 req-7f65e974-9269-47b0-8e58-dadceffde7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f44819-4b58-420f-99cb-77059e1dd0ae", "name": "network-vif-deleted", "tag": "15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:03.478093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0a74b615-7b09-4d39-a18c-228fb5d42d60 req-7f65e974-9269-47b0-8e58-dadceffde7a2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:03.478816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0a74b615-7b09-4d39-a18c-228fb5d42d60 req-7f65e974-9269-47b0-8e58-dadceffde7a2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:03.501877 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0a74b615-7b09-4d39-a18c-228fb5d42d60 req-7f65e974-9269-47b0-8e58-dadceffde7a2 service nova] Creating event network-vif-deleted:15dc1bf8-1ace-45e9-a89f-fccdf03bb6d0 for instance 96f44819-4b58-420f-99cb-77059e1dd0ae on n-h2-master-1 Jul 01 11:08:03.526864 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0a74b615-7b09-4d39-a18c-228fb5d42d60 req-7f65e974-9269-47b0-8e58-dadceffde7a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071573 Jul 01 11:08:03.528031 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2994/6085] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:08:03.557600 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:03.558904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:03.576920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:03.580654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:03.581618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:03.582077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:03.730583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:03.743048 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d37b3ead-bc2a-4eb2-895c-1521a538bee6 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1398 microversion: 2.1 time: 0.190706 Jul 01 11:08:03.746063 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3092/6086] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:03 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1398 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:04.762836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:04.763513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:04.778021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:04.778724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:04.780977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:04.781857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:05.030027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:05.039112 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-666bf65e-3624-46d4-86cc-3bdaf46a5683 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1229 microversion: 2.1 time: 0.282751 Jul 01 11:08:05.062930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2995/6087] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:04 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1229 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:06.064132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:06.065526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:06.075709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:06.076409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:06.085764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:06.086510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:06.232920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:06.250305 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f596d97-c984-442e-b0fd-924f70adc261 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1229 microversion: 2.1 time: 0.191973 Jul 01 11:08:06.251522 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3093/6088] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:06 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1229 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:07.269655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:07.270269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:07.278594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:07.279053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:07.279832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:07.280317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:07.413703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:07.424941 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cf52c1c-8a4b-4d0d-ae60-1fc7e2c69159 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1229 microversion: 2.1 time: 0.158924 Jul 01 11:08:07.425695 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2996/6089] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:07 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:08.446495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:08.447132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:08.456831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:08.460288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:08.463198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:08.463882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:08.543570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:08.558014 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4351112-9d0f-4a0f-84d3-c62737e3b569 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1229 microversion: 2.1 time: 0.115533 Jul 01 11:08:08.559306 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3094/6090] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:08 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:09.576277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:09.577196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:09.593313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:09.597752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:09.599295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:09.600804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:09.642665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:09.643437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:09.644123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lazy-loading 'fault' on Instance uuid 96f44819-4b58-420f-99cb-77059e1dd0ae {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:08:09.692481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2934a36b2e44d99a6b0c1379d94df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b29550aee140c09ae491927b701b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:09.700458 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5b504cb-4353-4fea-9e20-00c39e3a54c7 tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 200 len: 1234 microversion: 2.1 time: 0.128037 Jul 01 11:08:09.701810 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2997/6091] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:09 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 1234 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:10.718389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:10.720914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] [instance: 96f44819-4b58-420f-99cb-77059e1dd0ae] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:10.727842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:10.728648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:10.729686 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:10.730440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] HTTP exception thrown: Instance 96f44819-4b58-420f-99cb-77059e1dd0ae could not be found. Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Request method failure captured: Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae HTTP/1.1 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtRXvx9JY-jS1a_Cm2oxUY-IkSxVjZe5yFK7q1CiG_ePk1JSwuxTyXDTj9xrxbNoUSzAb7ovuAuGt8fb-XO6fmyZk62_2056jR6Zv7PoDERE-Afi_E1tckhQwZ21Ge8etDkn706V5LsMSWqnS8U-PHBquKSkpvnfBdcdbKlHUShdUTU Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: b6b29550aee140c09ae491927b701b6b Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBackupRestore-427160381 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6b29550aee140c09ae491927b701b6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b6b29550aee140c09ae491927b701b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b6b29550aee140c09ae491927b701b6b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6b29550aee140c09ae491927b701b6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBackupRestore-427160381 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: b6b29550aee140c09ae491927b701b6b Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBackupRestore-427160381 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBackupRestore-427160381-project Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: bc2934a36b2e44d99a6b0c1379d94df0 Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBackupRestore-427160381-project Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 96f44819-4b58-420f-99cb-77059e1dd0ae could not be found. Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '96f44819-4b58-420f-99cb-77059e1dd0ae'} Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f44819-4b58-420f-99cb-77059e1dd0ae could not be found. Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:08:10.755447 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f44819-4b58-420f-99cb-77059e1dd0ae could not be found. Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f44819-4b58-420f-99cb-77059e1dd0ae could not be found. Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Returning 404 to user: Instance 96f44819-4b58-420f-99cb-77059e1dd0ae could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3496e7de-4ea0-44b4-8698-c14bf746db5f tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae" status: 404 len: 111 microversion: 2.1 time: 0.041507 Jul 01 11:08:10.760931 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3095/6092] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:10 2022] GET /compute/v2.1/servers/96f44819-4b58-420f-99cb-77059e1dd0ae => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:08:11.272469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d82ffa99-8226-4575-8bf4-1d37c9be35fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] Calling method '.version_select at 0x7f6f90778160>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:11.400071 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d82ffa99-8226-4575-8bf4-1d37c9be35fc tempest-TestVolumeBackupRestore-427160381 tempest-TestVolumeBackupRestore-427160381-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-937841094" status: 202 len: 0 microversion: 2.1 time: 0.131344 Jul 01 11:08:11.400674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2998/6093] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Jul 1 11:08:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-937841094 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:08:13.911397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-400642836", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "af700d61-829f-404e-931a-17244ff8a917"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:14.010366 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] validate_networks() for [('af700d61-829f-404e-931a-17244ff8a917', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:08:14.964455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:08:14.965780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:08:14.966462 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:08:14.967102 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:08:14.967789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:08:14.984913 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:14.996413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:14.998069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:15.004044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:15.055932 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Getting quotas for project 4660ccac893c433e91ee42a47befae3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:08:15.068937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Getting quotas for user c26c8e5b7888482888e269dafffc1a23 and project 4660ccac893c433e91ee42a47befae3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:08:15.107296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:08:15.107296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:08:15.333078 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a92dd7e-ffd8-41e4-8f89-548f55c5d568 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.425250 Jul 01 11:08:15.334549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3096/6094] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:08:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:08:15.345315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4b4b55c1-dee4-4436-9b32-be6941d4cc30 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:15.346999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4b4b55c1-dee4-4436-9b32-be6941d4cc30 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:15.475059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4b4b55c1-dee4-4436-9b32-be6941d4cc30 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:15.482596 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4b4b55c1-dee4-4436-9b32-be6941d4cc30 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1213 microversion: 2.1 time: 0.141779 Jul 01 11:08:15.486242 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 2999/6095] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:15 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:16.503511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ba80a29-6551-40e7-ad62-c1546ce6a389 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:16.504778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3ba80a29-6551-40e7-ad62-c1546ce6a389 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:16.619383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3ba80a29-6551-40e7-ad62-c1546ce6a389 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:16.626373 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ba80a29-6551-40e7-ad62-c1546ce6a389 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1213 microversion: 2.1 time: 0.127406 Jul 01 11:08:16.628955 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3097/6096] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:16 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:17.647036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:17.648199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:17.663836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:17.668634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:17.669689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:17.673941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:17.812668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:17.822119 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6768298e-bfb2-4825-a65e-c5b6e05a8432 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1209 microversion: 2.1 time: 0.180347 Jul 01 11:08:17.822717 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3000/6097] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:17 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1209 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:18.842471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:18.845413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:18.881289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:18.882207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:18.886295 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:18.886838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:19.224559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:19.238863 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-54bb7e9e-fb9e-4d6d-a827-c94091021334 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1283 microversion: 2.1 time: 0.401188 Jul 01 11:08:19.241090 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3098/6098] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:18 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1283 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:20.259465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:20.259465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:20.266488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:20.266932 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:20.267698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:20.268129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:20.351009 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:20.361860 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91b6a6da-4044-4d5b-aba7-80d11b418736 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1271 microversion: 2.1 time: 0.109863 Jul 01 11:08:20.362595 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3001/6099] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:20 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:08:21.387714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:21.393811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:21.405367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:21.410330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:21.413011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:21.413698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:21.811373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:21.823618 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c47f414c-cac2-4a32-8551-f79113e1b069 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.445154 Jul 01 11:08:21.825360 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3099/6100] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:21 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:22.194437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a5c1f2fe-bfec-4aaf-bfa0-d33ee373cc97 req-83561ad1-c439-493e-8b32-b4cb107261fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705dd28f-1edf-48c9-8446-8cabecd304a3", "tag": "2ff42cf9-d395-476a-b2aa-2eb1d80c01b3"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:22.220890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a5c1f2fe-bfec-4aaf-bfa0-d33ee373cc97 req-83561ad1-c439-493e-8b32-b4cb107261fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:22.221801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a5c1f2fe-bfec-4aaf-bfa0-d33ee373cc97 req-83561ad1-c439-493e-8b32-b4cb107261fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:22.247701 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a5c1f2fe-bfec-4aaf-bfa0-d33ee373cc97 req-83561ad1-c439-493e-8b32-b4cb107261fb service nova] Creating event network-changed:2ff42cf9-d395-476a-b2aa-2eb1d80c01b3 for instance 705dd28f-1edf-48c9-8446-8cabecd304a3 on n-h2-master-1 Jul 01 11:08:22.268336 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a5c1f2fe-bfec-4aaf-bfa0-d33ee373cc97 req-83561ad1-c439-493e-8b32-b4cb107261fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075717 Jul 01 11:08:22.268336 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3002/6101] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:08:22.842081 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:22.842875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:22.859292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:22.859859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:22.860973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:22.861689 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:23.197593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:23.213102 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60674529-4854-4998-b2a7-f295de6936ba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.375087 Jul 01 11:08:23.223772 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3100/6102] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:22 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:24.231638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:24.232326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:24.240576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:24.241315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:24.242077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:24.243159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:24.415059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:24.427955 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91c68e31-14e6-43d7-acd4-e9829faaeeba tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.201125 Jul 01 11:08:24.428551 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3003/6103] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:24 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:25.445911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:25.446463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:25.449297 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:25.454236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:25.454688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:25.455469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:25.455922 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:25.595266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:25.603743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f809c20-7fb4-438c-9141-56cf9abb285d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.161753 Jul 01 11:08:25.604335 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3101/6104] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:25 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:26.623203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:26.623838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:26.628927 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:26.633458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:26.634108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:26.635137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:26.635874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:26.877543 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:26.889301 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4407f183-8ebe-4711-b230-498868f031ce tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.272972 Jul 01 11:08:26.907654 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3004/6105] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:26 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:27.914546 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:27.915812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:27.918820 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:27.924174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:27.924869 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:27.925877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:27.926478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:28.176185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:28.184511 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c54ecb3f-9c61-4d45-bbf0-d2dfcecb3afa tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.273845 Jul 01 11:08:28.185805 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3102/6106] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:27 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:29.202209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:29.203437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:29.210486 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:29.210966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:29.212681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:29.213127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:29.486181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:29.498070 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48da68c9-9ace-4395-9cd1-5756a8efe4f3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.298944 Jul 01 11:08:29.499074 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3005/6107] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:29 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:30.163171 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-15c87b38-c850-497f-8835-baece094c665 req-e47cf2c4-6470-4290-bb30-29ead4b71fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705dd28f-1edf-48c9-8446-8cabecd304a3", "name": "network-vif-plugged", "status": "completed", "tag": "2ff42cf9-d395-476a-b2aa-2eb1d80c01b3"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:30.180863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-15c87b38-c850-497f-8835-baece094c665 req-e47cf2c4-6470-4290-bb30-29ead4b71fbb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:30.180863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-15c87b38-c850-497f-8835-baece094c665 req-e47cf2c4-6470-4290-bb30-29ead4b71fbb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:30.189765 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-15c87b38-c850-497f-8835-baece094c665 req-e47cf2c4-6470-4290-bb30-29ead4b71fbb service nova] Creating event network-vif-plugged:2ff42cf9-d395-476a-b2aa-2eb1d80c01b3 for instance 705dd28f-1edf-48c9-8446-8cabecd304a3 on n-h2-master-1 Jul 01 11:08:30.209667 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-15c87b38-c850-497f-8835-baece094c665 req-e47cf2c4-6470-4290-bb30-29ead4b71fbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050130 Jul 01 11:08:30.210588 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3103/6108] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:08:30.515527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:30.516122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:30.523455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:30.523905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:30.524698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:30.525130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:30.529294 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=67 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:30.873326 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:30.885260 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e605684c-1bdd-4e73-b128-8c1512dff0d3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.369621 Jul 01 11:08:30.885260 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3006/6109] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:30 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:31.899552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:31.900880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:31.908213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:31.908671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:31.909476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:31.909918 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:31.914053 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:32.358098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:32.373479 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-145beb5c-e204-4cf4-a9d2-f0503f8540d0 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1313 microversion: 2.1 time: 0.477524 Jul 01 11:08:32.374360 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3104/6110] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:31 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:33.391315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:33.395101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:33.395523 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:33.400571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:33.401311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:33.402278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:33.402723 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:33.555049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:33.563729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b60797b8-fd47-4cd9-bee9-071e8fed1e5e tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1498 microversion: 2.1 time: 0.176824 Jul 01 11:08:33.564312 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3007/6111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:33 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:34.439097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:34.439661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:34.442436 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:34.451194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:34.451194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:34.451194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:34.451194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:34.475937 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:08:34.785366 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38c05cef-29cd-4c6c-9441-bf3aa1a450e4 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 204 len: 0 microversion: 2.1 time: 0.350469 Jul 01 11:08:34.786280 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3105/6112] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:08:34 2022] DELETE /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:08:34.794994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:34.795879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:34.805168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:34.806272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:34.807051 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:34.807485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:34.968391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:34.980169 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b2cfd66a-c3df-4e10-99f0-71b5b9960c22 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1504 microversion: 2.1 time: 0.189304 Jul 01 11:08:34.980961 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3008/6113] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:34 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:35.997922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:35.998686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:36.009417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:36.010182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:36.011159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:36.011950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:36.270310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:36.284319 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dd4092da-53f9-4271-b3fb-af6ea858100c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1504 microversion: 2.1 time: 0.290824 Jul 01 11:08:36.294269 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3106/6114] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:35 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:08:37.120128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9302e6e6-e230-461b-ac91-85f8767ab55e req-1dd9b412-6738-4303-b215-425607e05531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705dd28f-1edf-48c9-8446-8cabecd304a3", "name": "network-vif-deleted", "tag": "2ff42cf9-d395-476a-b2aa-2eb1d80c01b3"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:37.129653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9302e6e6-e230-461b-ac91-85f8767ab55e req-1dd9b412-6738-4303-b215-425607e05531 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:37.130096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9302e6e6-e230-461b-ac91-85f8767ab55e req-1dd9b412-6738-4303-b215-425607e05531 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:37.141240 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9302e6e6-e230-461b-ac91-85f8767ab55e req-1dd9b412-6738-4303-b215-425607e05531 service nova] Creating event network-vif-deleted:2ff42cf9-d395-476a-b2aa-2eb1d80c01b3 for instance 705dd28f-1edf-48c9-8446-8cabecd304a3 on n-h2-master-1 Jul 01 11:08:37.146440 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9302e6e6-e230-461b-ac91-85f8767ab55e req-1dd9b412-6738-4303-b215-425607e05531 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Jul 01 11:08:37.147677 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3009/6115] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:08:37.303860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:37.308984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:37.323336 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:37.323771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:37.327297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:37.331302 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:37.489322 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:37.498515 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e25e6e6e-28df-4d2e-aba5-493af0571983 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 200 len: 1298 microversion: 2.1 time: 0.198597 Jul 01 11:08:37.508356 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3107/6116] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:37 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 1298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:38.518796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:38.519420 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 705dd28f-1edf-48c9-8446-8cabecd304a3] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:38.526774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:38.527279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:38.528073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:38.528517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:38.542894 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] HTTP exception thrown: Instance 705dd28f-1edf-48c9-8446-8cabecd304a3 could not be found. Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Request method failure captured: Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 HTTP/1.1 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtWauxGIytLzpKDYMNHU38D-ABIe-lO6T-O84kotQ5i9iqJUVneFl_0Vg08a7WYLYkn5ODbmIMQIkFlEGhyYfSJabh19A8gaCRXyo-NhVdPbn488Oze9z-9LVqpXlWMNjdgisAqK9i5C95VfZRDfSau_v_eL6wNFS7rA5OfpYOt3aJY Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 4660ccac893c433e91ee42a47befae3b Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-VolumesActionsTest-842320077 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4660ccac893c433e91ee42a47befae3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4660ccac893c433e91ee42a47befae3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4660ccac893c433e91ee42a47befae3b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4660ccac893c433e91ee42a47befae3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-VolumesActionsTest-842320077 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 4660ccac893c433e91ee42a47befae3b Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-VolumesActionsTest-842320077 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-VolumesActionsTest-842320077-project Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: c26c8e5b7888482888e269dafffc1a23 Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-VolumesActionsTest-842320077-project Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 705dd28f-1edf-48c9-8446-8cabecd304a3 could not be found. Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '705dd28f-1edf-48c9-8446-8cabecd304a3'} Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705dd28f-1edf-48c9-8446-8cabecd304a3 could not be found. Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705dd28f-1edf-48c9-8446-8cabecd304a3 could not be found. Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:08:38.544838 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705dd28f-1edf-48c9-8446-8cabecd304a3 could not be found. Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Returning 404 to user: Instance 705dd28f-1edf-48c9-8446-8cabecd304a3 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a1f935e-0bda-4e84-8999-23b1dbaadf38 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3" status: 404 len: 111 microversion: 2.1 time: 0.033069 Jul 01 11:08:38.550523 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3010/6117] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:38 2022] GET /compute/v2.1/servers/705dd28f-1edf-48c9-8446-8cabecd304a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:08:38.650924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1212627936", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "af700d61-829f-404e-931a-17244ff8a917"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:38.710099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] validate_networks() for [('af700d61-829f-404e-931a-17244ff8a917', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:08:39.263054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:08:39.264220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:08:39.264220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:08:39.264441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:08:39.264747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:08:39.277959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:39.279408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:39.279787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:39.280372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:39.305541 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Getting quotas for project 4660ccac893c433e91ee42a47befae3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:08:39.311900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Getting quotas for user c26c8e5b7888482888e269dafffc1a23 and project 4660ccac893c433e91ee42a47befae3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:08:39.327389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:08:39.330018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:08:39.465929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d68d4a8-3b06-4b7a-94d4-62133e565184 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819004 Jul 01 11:08:39.467253 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3108/6118] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:08:39.476913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48553a08-2ba8-4f8f-8d14-6acc143869a3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:39.477624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48553a08-2ba8-4f8f-8d14-6acc143869a3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:39.569491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48553a08-2ba8-4f8f-8d14-6acc143869a3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:39.582979 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48553a08-2ba8-4f8f-8d14-6acc143869a3 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1214 microversion: 2.1 time: 0.109933 Jul 01 11:08:39.583558 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3011/6119] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:39 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:40.600368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:40.601383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:40.620953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:40.621562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:40.622726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:40.623611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:40.739226 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:40.760045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af433041-70b0-4cc7-b128-dac3129040c9 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1218 microversion: 2.1 time: 0.162579 Jul 01 11:08:40.760045 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3109/6120] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:40 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:41.778902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:41.780479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:41.795282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:41.796936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:41.798533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:41.800430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:42.079462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:42.092121 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c5d99864-206e-4ccb-b92f-353d57975d46 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1266 microversion: 2.1 time: 0.319205 Jul 01 11:08:42.094171 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3012/6121] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:41 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:43.116511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:43.117738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:43.124797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:43.125342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:43.126488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:43.126634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:43.441044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:43.449572 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9952604b-905e-4417-8539-1767dde43fc7 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 0.336992 Jul 01 11:08:43.469400 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3110/6122] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:43 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:44.468864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:44.470933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:44.490516 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:44.491300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:44.492761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:44.493350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:44.622178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-bae79951-8dd5-4568-8c72-1f223afe7dae req-549ce2b5-a8b2-412f-988e-7bbebb963275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049c0fc0-8cc7-4e99-a300-36d7e8ea5905", "tag": "593fe6ee-1d13-43f2-8b2e-0fcf30b1dd01"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:44.646674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-bae79951-8dd5-4568-8c72-1f223afe7dae req-549ce2b5-a8b2-412f-988e-7bbebb963275 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:44.648640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-bae79951-8dd5-4568-8c72-1f223afe7dae req-549ce2b5-a8b2-412f-988e-7bbebb963275 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:44.661024 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-bae79951-8dd5-4568-8c72-1f223afe7dae req-549ce2b5-a8b2-412f-988e-7bbebb963275 service nova] Creating event network-changed:593fe6ee-1d13-43f2-8b2e-0fcf30b1dd01 for instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 on n-h2-master-1 Jul 01 11:08:44.668095 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-bae79951-8dd5-4568-8c72-1f223afe7dae req-549ce2b5-a8b2-412f-988e-7bbebb963275 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050244 Jul 01 11:08:44.669318 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3111/6123] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:08:44.772674 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:44.781132 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf69e4e2-6f2e-4381-8c1c-5f052c992d20 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 0.318305 Jul 01 11:08:44.781933 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3013/6124] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:44 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:45.807267 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:45.807968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:45.827538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:45.827901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:45.828757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:45.829221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:46.967224 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:46.982845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-360d6b7b-037a-456d-a797-518d89e4e33c tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 1.181261 Jul 01 11:08:46.983629 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3112/6125] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:45 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:48.005469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:48.006702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:48.016773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:48.017251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:48.021752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:48.021752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:48.354815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:48.370218 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e082ed87-68e4-44b2-a561-6917f659e12a tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 0.366814 Jul 01 11:08:48.371148 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3014/6126] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:47 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:49.388232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:49.388851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:49.393575 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:49.393575 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:49.400289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:49.401170 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:49.402512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:49.403034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:49.895062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:49.904682 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e8a40e0-515a-44d0-9afc-6df0c96feafc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 0.520342 Jul 01 11:08:49.909531 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3113/6127] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:49 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:50.931917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:50.939613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:50.944084 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:08:50.959611 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:50.968102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:50.968102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:50.968102 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:51.159537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:51.168543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c99db6f-e105-4cb0-8dce-42e2c228231d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 0.246374 Jul 01 11:08:51.169754 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3015/6128] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:50 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:52.187603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:52.189847 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:52.198451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:52.201070 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:52.202165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:52.202825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:52.610122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:52.631821 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8acca3a6-8f4b-4a91-8e9a-e2aa67453efb tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 0.439068 Jul 01 11:08:52.640898 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3114/6129] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:52 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:52.729554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3e0d28da-7c61-46e8-91a3-15a6b3376e61 req-5cf082b6-1fe1-431b-841c-f3de43d95a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049c0fc0-8cc7-4e99-a300-36d7e8ea5905", "name": "network-vif-plugged", "status": "completed", "tag": "593fe6ee-1d13-43f2-8b2e-0fcf30b1dd01"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:52.738343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3e0d28da-7c61-46e8-91a3-15a6b3376e61 req-5cf082b6-1fe1-431b-841c-f3de43d95a6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:52.738955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3e0d28da-7c61-46e8-91a3-15a6b3376e61 req-5cf082b6-1fe1-431b-841c-f3de43d95a6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:52.751704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3e0d28da-7c61-46e8-91a3-15a6b3376e61 req-5cf082b6-1fe1-431b-841c-f3de43d95a6d service nova] Creating event network-vif-plugged:593fe6ee-1d13-43f2-8b2e-0fcf30b1dd01 for instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 on n-h2-master-1 Jul 01 11:08:52.757054 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3e0d28da-7c61-46e8-91a3-15a6b3376e61 req-5cf082b6-1fe1-431b-841c-f3de43d95a6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429127 Jul 01 11:08:52.764959 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3016/6130] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:08:53.655905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:53.655905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:53.674992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:53.683028 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:53.689952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:53.689952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:53.929777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:53.943243 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e020f644-40db-40fa-a295-d9a8bc0fa03d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1314 microversion: 2.1 time: 0.292416 Jul 01 11:08:53.953795 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3115/6131] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:53 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:08:54.964692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:54.966078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:54.978064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:54.988913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:54.990019 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:54.990660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:55.177018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:55.186360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d57c0bd-10e0-4ef8-9d42-fcf4aca2a3af tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1499 microversion: 2.1 time: 0.228273 Jul 01 11:08:55.198420 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3017/6132] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:54 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1499 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:56.210964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:56.213510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:56.220852 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:56.221549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:56.222916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:56.223789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:56.252015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:08:56.550158 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9709b65-328c-4a30-a16c-bf276656a081 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 204 len: 0 microversion: 2.1 time: 0.343715 Jul 01 11:08:56.552686 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3116/6133] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:08:56 2022] DELETE /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:08:56.560713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:56.561362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:56.568433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:56.568878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:56.569719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:56.570324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:56.842554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1323026516", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2cc5865f-f75a-42ec-b94c-ab80d6f0f3c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc85cd4f-4041-4340-a016-821f51d0f621"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:56.965931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] validate_networks() for [('fc85cd4f-4041-4340-a016-821f51d0f621', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:08:56.970052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:56.987203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a74274b-a40d-4cfa-a81c-edf7ca0bbb4d tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1505 microversion: 2.1 time: 0.428627 Jul 01 11:08:56.988608 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3018/6134] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:56 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:57.585701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:08:57.586590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:08:57.587017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:08:57.587430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:08:57.588244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:08:57.602098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:57.602098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:57.602098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:57.602098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:57.617677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:08:57.623678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:08:57.684317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:08:57.686403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2cc5865f-f75a-42ec-b94c-ab80d6f0f3c9',volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:08:58.011321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:58.017408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:58.027976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:58.028715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:58.031659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:58.032294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:58.154312 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06f4664d-5103-4e95-9ca9-dfae7b8e94cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.320836 Jul 01 11:08:58.155225 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3117/6135] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:08:58.165518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-28383f85-584c-40ac-9334-625841b92292 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:58.166875 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-28383f85-584c-40ac-9334-625841b92292 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:58.266228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:58.274691 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39a85d71-fb42-4036-95d5-df386c70ba80 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1505 microversion: 2.1 time: 0.272900 Jul 01 11:08:58.276755 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3019/6136] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:58 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:08:58.302433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-28383f85-584c-40ac-9334-625841b92292 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:58.310605 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-28383f85-584c-40ac-9334-625841b92292 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1057 microversion: 2.1 time: 0.149143 Jul 01 11:08:58.311193 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3118/6137] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:58 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1057 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:08:58.699515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7bf50c43-0819-470d-ba42-41d6aba717ab req-3883a68f-eec7-45a4-92c2-1d4254e3dbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049c0fc0-8cc7-4e99-a300-36d7e8ea5905", "name": "network-vif-deleted", "tag": "593fe6ee-1d13-43f2-8b2e-0fcf30b1dd01"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:08:58.719120 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7bf50c43-0819-470d-ba42-41d6aba717ab req-3883a68f-eec7-45a4-92c2-1d4254e3dbde service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:58.719797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7bf50c43-0819-470d-ba42-41d6aba717ab req-3883a68f-eec7-45a4-92c2-1d4254e3dbde service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:58.732575 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7bf50c43-0819-470d-ba42-41d6aba717ab req-3883a68f-eec7-45a4-92c2-1d4254e3dbde service nova] Creating event network-vif-deleted:593fe6ee-1d13-43f2-8b2e-0fcf30b1dd01 for instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 on n-h2-master-1 Jul 01 11:08:58.738113 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7bf50c43-0819-470d-ba42-41d6aba717ab req-3883a68f-eec7-45a4-92c2-1d4254e3dbde service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050985 Jul 01 11:08:58.739105 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3020/6138] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:08:59.292777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:59.293421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:59.304596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:59.317307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:59.318370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:59.318842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:59.329658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8cef625-2a29-4db2-92d7-1c2fd41d7cd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:08:59.330367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8cef625-2a29-4db2-92d7-1c2fd41d7cd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:08:59.387775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:08:59.388479 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:08:59.388661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lazy-loading 'fault' on Instance uuid 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:08:59.700823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26c8e5b7888482888e269dafffc1a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4660ccac893c433e91ee42a47befae3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:59.708920 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2cb76efc-c6a0-466f-b86f-52104e2581bc tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 200 len: 1304 microversion: 2.1 time: 0.419908 Jul 01 11:08:59.735757 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3119/6139] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:59 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 1304 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:08:59.736408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8cef625-2a29-4db2-92d7-1c2fd41d7cd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:08:59.736408 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8cef625-2a29-4db2-92d7-1c2fd41d7cd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1057 microversion: 2.1 time: 0.410119 Jul 01 11:08:59.736408 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3021/6140] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:08:59 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1057 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:09:00.743647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:00.744415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] [instance: 049c0fc0-8cc7-4e99-a300-36d7e8ea5905] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:00.753701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:00.754303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:00.757436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:00.758685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:00.761510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:00.762363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:00.786242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:00.786707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:00.787512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:00.787987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:00.795127 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:00.801431 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] HTTP exception thrown: Instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 could not be found. Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Request method failure captured: Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 HTTP/1.1 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtWauxGIytLzpKDYMNHU38D-ABIe-lO6T-O84kotQ5i9iqJUVneFl_0Vg08a7WYLYkn5ODbmIMQIkFlEGhyYfSJabh19A8gaCRXyo-NhVdPbn488Oze9z-9LVqpXlWMNjdgisAqK9i5C95VfZRDfSau_v_eL6wNFS7rA5OfpYOt3aJY Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 4660ccac893c433e91ee42a47befae3b Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-VolumesActionsTest-842320077 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4660ccac893c433e91ee42a47befae3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4660ccac893c433e91ee42a47befae3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4660ccac893c433e91ee42a47befae3b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4660ccac893c433e91ee42a47befae3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-VolumesActionsTest-842320077 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 4660ccac893c433e91ee42a47befae3b Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-VolumesActionsTest-842320077 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-VolumesActionsTest-842320077-project Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: c26c8e5b7888482888e269dafffc1a23 Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-VolumesActionsTest-842320077-project Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 could not be found. Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '049c0fc0-8cc7-4e99-a300-36d7e8ea5905'} Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 could not be found. Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 could not be found. Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:09:00.807558 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 could not be found. Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] Returning 404 to user: Instance 049c0fc0-8cc7-4e99-a300-36d7e8ea5905 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:09:00.816412 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fdc47815-82b3-4123-93a8-00a5c4206c32 tempest-VolumesActionsTest-842320077 tempest-VolumesActionsTest-842320077-project] 10.222.0.23 "GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905" status: 404 len: 111 microversion: 2.1 time: 0.073200 Jul 01 11:09:00.818383 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3120/6141] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:00 2022] GET /compute/v2.1/servers/049c0fc0-8cc7-4e99-a300-36d7e8ea5905 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:09:00.919567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:00.941905 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5baac659-ad74-47a0-8d5d-eba9a3f3f1d6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1163 microversion: 2.1 time: 0.184739 Jul 01 11:09:00.945179 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3022/6142] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:00 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1163 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:09:01.967645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:01.968913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:01.978522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:01.979213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:01.980530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:01.981343 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:02.260109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:02.273530 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-71f38228-b401-4a81-afe2-ebc904cadb81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1215 microversion: 2.1 time: 0.308402 Jul 01 11:09:02.275501 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3121/6143] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:01 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1215 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:02.892171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-41fb208b-bd44-4863-95e8-1bd42a97667e req-ee658289-9582-40e5-922f-2676e18cd5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c3fee7-2327-417b-b02a-a9e94e70ee5d", "tag": "e0d1f9cb-5b7c-48f0-a70e-db6da156ac83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:09:02.922838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-41fb208b-bd44-4863-95e8-1bd42a97667e req-ee658289-9582-40e5-922f-2676e18cd5bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:02.923631 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-41fb208b-bd44-4863-95e8-1bd42a97667e req-ee658289-9582-40e5-922f-2676e18cd5bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:02.946947 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-41fb208b-bd44-4863-95e8-1bd42a97667e req-ee658289-9582-40e5-922f-2676e18cd5bf service nova] Creating event network-changed:e0d1f9cb-5b7c-48f0-a70e-db6da156ac83 for instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d on n-h1-master-1 Jul 01 11:09:02.960240 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-41fb208b-bd44-4863-95e8-1bd42a97667e req-ee658289-9582-40e5-922f-2676e18cd5bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073378 Jul 01 11:09:02.961689 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3023/6144] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:09:03.292237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:03.293090 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:03.304713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:03.305687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:03.306713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:03.307629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:03.574776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:03.593071 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-895dd52c-728b-4780-83b0-6fc4267acc9b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1215 microversion: 2.1 time: 0.304772 Jul 01 11:09:03.594584 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3122/6145] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:03 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:04.611101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:04.611925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:04.614991 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=38 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:04.622429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:04.623183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:04.624406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:04.624901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:04.629663 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=76 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:04.813711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:04.822624 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a8888d6-38ad-4f40-a78d-f9ae0763a5c9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1215 microversion: 2.1 time: 0.215641 Jul 01 11:09:04.823537 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3024/6146] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:04 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:05.839377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:05.840100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:05.851202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:05.854590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:05.858003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:05.858538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:06.090884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:06.105975 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-838b56d1-5ac8-4966-a7e5-c74a1dd4d065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1215 microversion: 2.1 time: 0.267182 Jul 01 11:09:06.105975 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3123/6147] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:05 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:06.271450 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:09:06.271876 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:09:06.754561 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:09:06.755091 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:09:07.123446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:07.124597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:07.135365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:07.135816 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:07.137003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:07.137882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:07.353566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:07.366779 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91217111-c29b-4d60-966a-a06e67ef6136 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1215 microversion: 2.1 time: 0.248523 Jul 01 11:09:07.368403 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3025/6148] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:07 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:09:08.398521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:08.398521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:08.407031 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:08.408188 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:08.409110 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:08.416673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:08.417405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:08.419185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:08.419849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:08.620098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:08.633303 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ebdb1029-dc01-4f16-94a7-777bc53a8195 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.252694 Jul 01 11:09:08.634550 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3124/6149] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:08 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:09.651665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:09.652275 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:09.659025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:09.659770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:09.660704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:09.661133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:09.731713 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:09.869040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:09.877882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fce97122-df5f-4734-ae0c-2e7d3f5cdb54 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.230840 Jul 01 11:09:09.878647 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3026/6150] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:09 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:09:10.896843 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:10.897498 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:10.919144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:10.921977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:10.924216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:10.924843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:11.100766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:11.109843 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9f919609-6928-44a0-ae92-18f69bbb33b4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.217459 Jul 01 11:09:11.110806 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3125/6151] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:10 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:12.127742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:12.128947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:12.136403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:12.137077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:12.138083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:12.138684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:12.332325 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:12.355251 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72ad8562-e80b-4bfe-afba-721e382372e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.231431 Jul 01 11:09:12.362020 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3027/6152] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:12 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:13.374431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:13.375047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:13.383149 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:13.386458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:13.387680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:13.388510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:13.577331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:13.587650 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5204a35f-c244-43d6-8a7c-94513f7b2f12 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.216236 Jul 01 11:09:13.589605 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3126/6153] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:13 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:14.607011 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:14.607735 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:14.615473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:14.615925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:14.616697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:14.617134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:14.753692 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:14.761614 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-260cca9c-457d-45ce-9d7c-b9c618b538b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.158580 Jul 01 11:09:14.762187 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3028/6154] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:14 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:15.815378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:15.817176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:15.825346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:15.825797 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:15.826732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:15.827601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:16.067734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:16.082461 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eaf1f22b-9960-4c1f-b2d5-58e5b32126ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.268336 Jul 01 11:09:16.083096 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3127/6155] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:15 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:17.101063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:17.101747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:17.108503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:17.109491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:17.110514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:17.110951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:17.280768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:17.294589 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-15f20228-b91e-458d-be9f-6f1c01323499 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.197912 Jul 01 11:09:17.301296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3029/6156] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:17 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:09:18.130558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1d93bb58-d3c9-4ea9-8732-c70d83d471dd req-cfde08c3-4c68-4f42-b493-c7f205bd21f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c3fee7-2327-417b-b02a-a9e94e70ee5d", "name": "network-vif-plugged", "status": "completed", "tag": "e0d1f9cb-5b7c-48f0-a70e-db6da156ac83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:09:18.141043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1d93bb58-d3c9-4ea9-8732-c70d83d471dd req-cfde08c3-4c68-4f42-b493-c7f205bd21f1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:18.141538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1d93bb58-d3c9-4ea9-8732-c70d83d471dd req-cfde08c3-4c68-4f42-b493-c7f205bd21f1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:18.155237 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1d93bb58-d3c9-4ea9-8732-c70d83d471dd req-cfde08c3-4c68-4f42-b493-c7f205bd21f1 service nova] Creating event network-vif-plugged:e0d1f9cb-5b7c-48f0-a70e-db6da156ac83 for instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d on n-h1-master-1 Jul 01 11:09:18.161063 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1d93bb58-d3c9-4ea9-8732-c70d83d471dd req-cfde08c3-4c68-4f42-b493-c7f205bd21f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034598 Jul 01 11:09:18.161704 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3128/6157] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:09:18.313603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:18.314284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:18.323733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:18.324315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:18.325257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:18.325849 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:18.503028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:18.515203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6133f679-8867-480a-97ee-6465d56af77f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.205718 Jul 01 11:09:18.516490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3030/6158] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:18 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:19.537935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:19.540789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:19.550774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:19.551260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:19.552280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:19.552725 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:19.788380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:19.797227 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dcf20fdc-50b1-4a86-9354-98ed1b24bf2c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1203 microversion: 2.1 time: 0.268074 Jul 01 11:09:19.807839 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3129/6159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:19 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1203 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:20.815793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:20.816481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:20.826180 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:20.827104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:20.830489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:20.831317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:21.008648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:21.037012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f6799d44-cbf5-45cc-a992-1c7befa94e8e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1390 microversion: 2.1 time: 0.224845 Jul 01 11:09:21.040121 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3031/6160] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:20 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1390 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:21.054359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:21.055643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:21.063043 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:21.063548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:21.064590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:21.065044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:21.280781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:21.295052 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e89a144-be28-4f7e-9d8c-502f9765cd91 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1390 microversion: 2.1 time: 0.244753 Jul 01 11:09:21.297166 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3130/6161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:21 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1390 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:21.312384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:21.315982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:21.320870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:21.321353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:21.322126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:21.322738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:21.476106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:21.507599 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f181b72-eed0-463b-a1d5-e8d54644fd14 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1390 microversion: 2.1 time: 0.176957 Jul 01 11:09:21.507599 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3032/6162] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:21 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:21.507814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:21.507814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:21.508790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:21.509268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:21.510035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:21.510472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:21.534808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:09:22.155393 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cdc3e456-b153-44b3-9e27-85548ae13b71 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 204 len: 0 microversion: 2.1 time: 0.655005 Jul 01 11:09:22.155393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3131/6163] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:09:21 2022] DELETE /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:09:22.162865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:22.163479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:22.170594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:22.171031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:22.171781 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:22.172210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:22.308842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:22.318620 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bbc76ff-100e-484b-b7f4-4311051fefae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1396 microversion: 2.1 time: 0.160210 Jul 01 11:09:22.319207 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3033/6164] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:22 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:23.336357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:23.336913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:23.344920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:23.345415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:23.346177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:23.346614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:23.489659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:23.498213 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1dcb8e81-8ae1-4ccc-b8bb-e0db33111e89 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1396 microversion: 2.1 time: 0.166292 Jul 01 11:09:23.498811 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3132/6165] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:23 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:24.515225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:24.515835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:24.523057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:24.523499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:24.524253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:24.524680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:24.594319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:24.603307 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51ed7f01-dafa-45a5-ba54-147a42cad6f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1354 microversion: 2.1 time: 0.091382 Jul 01 11:09:24.604019 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3034/6166] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:24 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:24.686808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-58399590-bb42-4b76-8ee4-c788696b6e2e req-1dd1e5f9-88c7-49ec-b191-2ad34c7b6288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c3fee7-2327-417b-b02a-a9e94e70ee5d", "name": "network-vif-deleted", "tag": "e0d1f9cb-5b7c-48f0-a70e-db6da156ac83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:09:24.697130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-58399590-bb42-4b76-8ee4-c788696b6e2e req-1dd1e5f9-88c7-49ec-b191-2ad34c7b6288 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:24.697602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-58399590-bb42-4b76-8ee4-c788696b6e2e req-1dd1e5f9-88c7-49ec-b191-2ad34c7b6288 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:24.712715 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-58399590-bb42-4b76-8ee4-c788696b6e2e req-1dd1e5f9-88c7-49ec-b191-2ad34c7b6288 service nova] Creating event network-vif-deleted:e0d1f9cb-5b7c-48f0-a70e-db6da156ac83 for instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d on n-h1-master-1 Jul 01 11:09:24.718178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-58399590-bb42-4b76-8ee4-c788696b6e2e req-1dd1e5f9-88c7-49ec-b191-2ad34c7b6288 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036563 Jul 01 11:09:24.718852 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3133/6167] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:09:25.619138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:25.619754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:25.627134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:25.627582 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:25.628545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:25.629173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:25.712459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:25.721657 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c299310-6173-4c84-929a-8dbfc7633239 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1188 microversion: 2.1 time: 0.106252 Jul 01 11:09:25.722460 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3035/6168] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:25 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1188 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:26.740784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:26.741531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:26.748380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:26.749066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:26.750041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:26.750754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:26.858159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:26.867708 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d739eecc-6536-43e6-b419-ada2994845d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1188 microversion: 2.1 time: 0.132569 Jul 01 11:09:26.868391 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3134/6169] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:26 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:27.894298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:27.895717 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:27.903819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:27.904721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:27.905977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:27.906447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:27.987206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:27.996209 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d95db4f-44e5-449b-a5da-9ab717dfa378 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1188 microversion: 2.1 time: 0.106376 Jul 01 11:09:27.997328 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3036/6170] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:27 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1188 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:29.014426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:29.015711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:29.023089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:29.023609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:29.024654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:29.025191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:29.098371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:29.108426 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b6c6b59-1f76-4334-ae3a-175252f4b4b0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1188 microversion: 2.1 time: 0.099288 Jul 01 11:09:29.109021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3135/6171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:29 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:30.126248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:30.126861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:30.134387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:30.134835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:30.135626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:30.136057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:30.167744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:30.168196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:30.168862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lazy-loading 'fault' on Instance uuid 04c3fee7-2327-417b-b02a-a9e94e70ee5d {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:09:30.216063 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:30.223082 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f426252-8a4f-42bd-ae76-3a819ef2dcc6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 200 len: 1147 microversion: 2.1 time: 0.100852 Jul 01 11:09:30.223661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3037/6172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:30 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 1147 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:31.243694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:31.244297 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 04c3fee7-2327-417b-b02a-a9e94e70ee5d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:31.251417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:31.251864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:31.252740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:31.253195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:31.267683 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d could not be found. Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d HTTP/1.1 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d could not be found. Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '04c3fee7-2327-417b-b02a-a9e94e70ee5d'} Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d could not be found. Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d could not be found. Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:09:31.269460 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d could not be found. Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 04c3fee7-2327-417b-b02a-a9e94e70ee5d could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-456dc6d5-0fa2-45ea-880d-146e506bfe2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d" status: 404 len: 111 microversion: 2.1 time: 0.031641 Jul 01 11:09:31.274185 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3136/6173] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:31 2022] GET /compute/v2.1/servers/04c3fee7-2327-417b-b02a-a9e94e70ee5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:09:41.967212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b981385-d8b3-43ee-afef-8694f62de24f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'create', calling method: .version_select at 0x7f6f907ebdc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-311532750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2ghArydlRb/Y1Cg4QEwWt5hXYB6twH9huFuAEysmtU325pM2VY73ir5mO4ZXnNUn7SDLs5WQuWrC2mR7uyPqcAtT4q9pw/aGT3W6M10mIVrJGWHyOhtvKtIfGGu40bIA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:09:41.976230 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=29 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:41.977442 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=85 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:41.987133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2b981385-d8b3-43ee-afef-8694f62de24f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:09:41.993711 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2b981385-d8b3-43ee-afef-8694f62de24f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for user f2bf9076469441cb8e8a8dca825f1833 and project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:09:42.106499 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b981385-d8b3-43ee-afef-8694f62de24f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.143619 Jul 01 11:09:42.107687 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3038/6174] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:09:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:09:45.101716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1871875268", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "329a6b65-11f1-4391-939b-604abffe464e"}], "key_name": "tempest-TestNetworkBasicOps-311532750", "security_groups": [{"name": "tempest-secgroup-smoke-1573330796"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:09:45.115252 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:45.115927 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:45.250893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] validate_networks() for [('329a6b65-11f1-4391-939b-604abffe464e', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:09:45.743375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:09:45.743798 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:09:45.744265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:09:45.744667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:09:45.745073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:09:45.771774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:45.776009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:45.777887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:45.782084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:45.830298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:09:45.837623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for user f2bf9076469441cb8e8a8dca825f1833 and project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:09:45.855183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:09:45.858086 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:09:46.013929 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f64a732d-a6f6-4298-ab5d-101b5d77da46 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.916390 Jul 01 11:09:46.014978 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3137/6175] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:09:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:09:46.025768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e589eff-f4e2-4682-a261-3d7fe68500c4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:46.028241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e589eff-f4e2-4682-a261-3d7fe68500c4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:46.137987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e589eff-f4e2-4682-a261-3d7fe68500c4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:46.148765 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e589eff-f4e2-4682-a261-3d7fe68500c4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1248 microversion: 2.1 time: 0.126941 Jul 01 11:09:46.150383 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3039/6176] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:46 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1248 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:47.167865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc9ce081-9c68-4913-8e8f-a5a94a78bbdf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:47.169686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc9ce081-9c68-4913-8e8f-a5a94a78bbdf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:47.253384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc9ce081-9c68-4913-8e8f-a5a94a78bbdf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:47.263617 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc9ce081-9c68-4913-8e8f-a5a94a78bbdf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1248 microversion: 2.1 time: 0.100482 Jul 01 11:09:47.264557 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3138/6177] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:47 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1248 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:48.280247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:48.280847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:48.288128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:48.288776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:48.289569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:48.289995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:48.358041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:48.366753 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e295155-1152-47ff-9688-7932d4d3e90b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1300 microversion: 2.1 time: 0.090595 Jul 01 11:09:48.367363 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3040/6178] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:48 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:49.385521 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:49.387012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:49.395190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:49.396583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:49.397663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:49.398111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:49.700896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:49.700896 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c3f537f-851e-4a80-bbec-a565adacbc11 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1306 microversion: 2.1 time: 0.312881 Jul 01 11:09:49.700896 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3139/6179] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:49 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1306 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:50.718545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:50.719464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:50.727393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:50.728108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:50.729070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:50.729543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:50.980358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:50.996359 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c9fa0280-afed-4b80-b08d-c8b9c02ff054 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.281929 Jul 01 11:09:50.997289 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3041/6180] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:50 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:51.295803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d99b56b2-4991-4585-ac1a-1a691367fbf6 req-70e9581a-df3d-4b4c-825b-ea905e7aa762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c0a130-c1db-4864-82f5-889b449a0478", "tag": "6429b232-2710-4969-895d-7c289ded26ce"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:09:51.310249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d99b56b2-4991-4585-ac1a-1a691367fbf6 req-70e9581a-df3d-4b4c-825b-ea905e7aa762 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:51.311065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d99b56b2-4991-4585-ac1a-1a691367fbf6 req-70e9581a-df3d-4b4c-825b-ea905e7aa762 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:51.327073 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d99b56b2-4991-4585-ac1a-1a691367fbf6 req-70e9581a-df3d-4b4c-825b-ea905e7aa762 service nova] Creating event network-changed:6429b232-2710-4969-895d-7c289ded26ce for instance 19c0a130-c1db-4864-82f5-889b449a0478 on n-h2-master-1 Jul 01 11:09:51.330831 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d99b56b2-4991-4585-ac1a-1a691367fbf6 req-70e9581a-df3d-4b4c-825b-ea905e7aa762 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038758 Jul 01 11:09:51.331663 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3140/6181] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:09:52.014076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:52.014605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:52.024691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:52.025540 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:52.032485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:52.032485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:52.269441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:52.278095 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-901c862f-0126-4857-ab6e-cafca27780d4 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.267751 Jul 01 11:09:52.278981 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3042/6182] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:52 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:53.300495 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:53.301240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:53.308585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:53.309039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:53.309846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:53.310294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:53.456562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:53.462465 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4532e7c0-f510-429b-a85c-5828035b29b3 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.166252 Jul 01 11:09:53.463059 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3141/6183] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:53 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:54.479946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:54.480536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:54.487591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:54.488035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:54.488791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:54.489240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:54.629496 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:54.638552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-777b892b-90da-43eb-bcb0-c4a3bef45e83 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.162598 Jul 01 11:09:54.639160 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3043/6184] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:54 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:09:55.656849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:55.657460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:55.665859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:55.666311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:55.667139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:55.667628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:55.817074 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:55.820684 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:55.833771 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2470b55e-bb84-4ac3-9e8b-eaa68b9b010f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.180980 Jul 01 11:09:55.834374 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3142/6185] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:55 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:56.851092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:56.851534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:56.854442 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:56.859600 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:56.860045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:56.860811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:56.861274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:57.022345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:57.030852 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-18361851-55e4-4f99-9c91-e31d86faf247 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.184395 Jul 01 11:09:57.031641 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3044/6186] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:56 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:58.048117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:58.048666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:58.051649 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:09:58.056503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:58.057118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:58.057990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:58.058421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:58.198144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:58.206039 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f18ba31-309e-4ef1-9f95-9fe8c4fc36d6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.162029 Jul 01 11:09:58.210393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3143/6187] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:58 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:09:58.251382 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-61ca5181-dd82-41ee-86a5-da0737d1f49e req-9e6ec9e8-85fa-452f-ad1a-b5c51abc4d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c0a130-c1db-4864-82f5-889b449a0478", "name": "network-vif-plugged", "status": "completed", "tag": "6429b232-2710-4969-895d-7c289ded26ce"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:09:58.260526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-61ca5181-dd82-41ee-86a5-da0737d1f49e req-9e6ec9e8-85fa-452f-ad1a-b5c51abc4d70 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:58.261111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-61ca5181-dd82-41ee-86a5-da0737d1f49e req-9e6ec9e8-85fa-452f-ad1a-b5c51abc4d70 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:58.278917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-61ca5181-dd82-41ee-86a5-da0737d1f49e req-9e6ec9e8-85fa-452f-ad1a-b5c51abc4d70 service nova] Creating event network-vif-plugged:6429b232-2710-4969-895d-7c289ded26ce for instance 19c0a130-c1db-4864-82f5-889b449a0478 on n-h2-master-1 Jul 01 11:09:58.283965 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-61ca5181-dd82-41ee-86a5-da0737d1f49e req-9e6ec9e8-85fa-452f-ad1a-b5c51abc4d70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036392 Jul 01 11:09:58.284592 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3045/6188] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:09:59.224609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:09:59.225262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:09:59.233061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:59.233531 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:59.234306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:09:59.234738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:09:59.390135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:09:59.398049 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-291b3914-4fb6-4ef8-855d-a6b29a057409 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1374 microversion: 2.1 time: 0.178098 Jul 01 11:09:59.398626 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3144/6189] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:09:59 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:00.416756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:00.417562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:00.424948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:00.425423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:00.426343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:00.427764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:00.568458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:00.576388 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-91307183-5132-4607-b1f0-d5e3cc37b316 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1547 microversion: 2.1 time: 0.165299 Jul 01 11:10:00.580789 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3046/6190] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:00 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:00.595830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:00.596446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:00.604376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:00.604827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:00.605637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:00.606192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:00.743632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:00.751216 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-59efa53e-68a8-426b-8bd1-bae06c708774 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1547 microversion: 2.1 time: 0.159329 Jul 01 11:10:00.751840 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3145/6191] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:00 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:03.378209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-561f7d88-2bb9-49c7-9dfd-7b2fe8a9dd47 req-0c44f6e4-fae1-4be9-b5a5-65765306873f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c0a130-c1db-4864-82f5-889b449a0478", "tag": "6429b232-2710-4969-895d-7c289ded26ce"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:03.388129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-561f7d88-2bb9-49c7-9dfd-7b2fe8a9dd47 req-0c44f6e4-fae1-4be9-b5a5-65765306873f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:03.394622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-561f7d88-2bb9-49c7-9dfd-7b2fe8a9dd47 req-0c44f6e4-fae1-4be9-b5a5-65765306873f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:03.400217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-561f7d88-2bb9-49c7-9dfd-7b2fe8a9dd47 req-0c44f6e4-fae1-4be9-b5a5-65765306873f service nova] Creating event network-changed:6429b232-2710-4969-895d-7c289ded26ce for instance 19c0a130-c1db-4864-82f5-889b449a0478 on n-h2-master-1 Jul 01 11:10:03.405547 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-561f7d88-2bb9-49c7-9dfd-7b2fe8a9dd47 req-0c44f6e4-fae1-4be9-b5a5-65765306873f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186121 Jul 01 11:10:03.406235 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3047/6192] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:10:12.705703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1646454131", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "76983566-f447-4745-956c-0cfadf4dbd77", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fc85cd4f-4041-4340-a016-821f51d0f621"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:12.713780 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:12.714453 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=40 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:12.796574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] validate_networks() for [('fc85cd4f-4041-4340-a016-821f51d0f621', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:10:13.220919 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:10:13.221385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:10:13.221870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:10:13.222288 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:10:13.222697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:10:13.232265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:13.232719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:13.233590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:13.234032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:13.252524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:10:13.258545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:10:13.272083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:10:13.274064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='76983566-f447-4745-956c-0cfadf4dbd77',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:10:13.467466 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87c55fdf-c33c-476f-a604-1fe0711f25e5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765871 Jul 01 11:10:13.468438 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3146/6193] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:10:13.477823 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:13.479484 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=40 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:13.483903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e4e6cebd-59cb-4fdd-9f35-f319dd3696d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:13.484628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e4e6cebd-59cb-4fdd-9f35-f319dd3696d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:13.545819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e4e6cebd-59cb-4fdd-9f35-f319dd3696d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:13.553562 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e4e6cebd-59cb-4fdd-9f35-f319dd3696d1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1057 microversion: 2.1 time: 0.077771 Jul 01 11:10:13.554136 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3048/6194] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:13 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1057 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:14.572559 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:14.573196 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:14.580136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:14.586150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:14.586150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:14.586150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:14.643635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:14.651400 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-72ce3624-8069-4983-9734-224268aae49c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1061 microversion: 2.1 time: 0.084397 Jul 01 11:10:14.651963 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3147/6195] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:14 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1061 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:15.678174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:15.678174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:15.683773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:15.684225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:15.685002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:15.687039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:15.762491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:15.770365 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a283ffcd-107d-4886-9c3d-05e338fa112e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1127 microversion: 2.1 time: 0.105810 Jul 01 11:10:15.770940 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3049/6196] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:15 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1127 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:16.787452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:16.788066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:16.796604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:16.797508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:16.798477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:16.799118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:17.333863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:17.342935 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33683b5f-80da-410e-8094-b971545fdba8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.558675 Jul 01 11:10:17.354954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3148/6197] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:16 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:17.536976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-334623b7-a5de-4363-99ee-93c7f729116c req-43a6ebca-c9e4-462e-9758-7744b5580b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9700398e-2e8f-4073-b5b4-bad8caf23a38", "tag": "665e6fb3-8415-4c28-852b-b06fc6b08573"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:17.555559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-334623b7-a5de-4363-99ee-93c7f729116c req-43a6ebca-c9e4-462e-9758-7744b5580b06 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:17.556841 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-334623b7-a5de-4363-99ee-93c7f729116c req-43a6ebca-c9e4-462e-9758-7744b5580b06 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:17.571725 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-334623b7-a5de-4363-99ee-93c7f729116c req-43a6ebca-c9e4-462e-9758-7744b5580b06 service nova] Creating event network-changed:665e6fb3-8415-4c28-852b-b06fc6b08573 for instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 on n-h2-master-1 Jul 01 11:10:17.577874 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-334623b7-a5de-4363-99ee-93c7f729116c req-43a6ebca-c9e4-462e-9758-7744b5580b06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043910 Jul 01 11:10:17.578500 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3050/6198] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:10:18.360884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:18.362130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:18.369333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:18.370102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:18.371066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:18.371671 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:18.537321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:18.545598 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-710f9fbd-4ad8-4e77-a23c-c82262a1e96e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.189596 Jul 01 11:10:18.546251 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3149/6199] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:18 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:19.563322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:19.564090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:19.571496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:19.572004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:19.572861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:19.573394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:19.711251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:19.719143 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f21a712-9646-438e-95f5-77092886e41c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.160388 Jul 01 11:10:19.719859 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3051/6200] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:19 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:20.736823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:20.737470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:20.744403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:20.744854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:20.745644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:20.746071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:20.903990 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:20.915707 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac35459c-40b7-4d55-87f0-e41f16a8d4fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.182720 Jul 01 11:10:20.916513 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3150/6201] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:20 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:21.933408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:21.934159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:21.941736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:21.942289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:21.943115 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:21.943763 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:22.088695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:22.096844 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-479d8c88-c518-48c9-909f-9fb93a52d382 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.167943 Jul 01 11:10:22.097464 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3052/6202] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:21 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:23.114434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:23.115043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:23.126692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:23.127141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:23.127931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:23.128414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:23.243062 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:23.266792 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:23.303621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:23.315571 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ce8c110-0279-4484-8a3c-51135b64e9be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.205114 Jul 01 11:10:23.316149 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3151/6203] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:23 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:24.332285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:24.332914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:24.336343 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:24.343303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:24.343303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:24.343303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:24.343303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:24.771018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:24.779466 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1cb3be7-e6e6-44b4-879b-632d7f8f8eeb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.450926 Jul 01 11:10:24.780043 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3053/6204] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:24 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:10:25.523290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-510f639e-74d7-4f1f-9235-c9ccb84cf73f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:25.524989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-510f639e-74d7-4f1f-9235-c9ccb84cf73f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:25.536342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-510f639e-74d7-4f1f-9235-c9ccb84cf73f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:25.537018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-510f639e-74d7-4f1f-9235-c9ccb84cf73f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:25.537839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-510f639e-74d7-4f1f-9235-c9ccb84cf73f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:25.538273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-510f639e-74d7-4f1f-9235-c9ccb84cf73f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:25.602438 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-510f639e-74d7-4f1f-9235-c9ccb84cf73f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478/action" status: 200 len: 24553 microversion: 2.1 time: 0.083431 Jul 01 11:10:25.604224 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3152/6205] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:10:25 2022] POST /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478/action => generated 24553 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:10:25.795690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:25.796254 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:25.803414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:25.803874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:25.805442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:25.806413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:25.947944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:25.956054 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a66ff599-3365-4d5d-8ed6-e0746bc9b465 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.164405 Jul 01 11:10:25.956621 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3054/6206] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:25 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:26.972610 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:26.973354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:26.981665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:26.982123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:26.982937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:26.983333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:27.133558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:27.142692 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b721ab3-0a3b-4227-b0aa-ab711cbc0914 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.174418 Jul 01 11:10:27.143344 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3153/6207] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:26 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:28.161299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:28.161945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:28.171318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:28.171850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:28.172634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:28.173072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:28.313284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:28.321826 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae851db5-c101-419b-b803-806649f819fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.164659 Jul 01 11:10:28.322397 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3055/6208] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:28 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:29.339331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:29.339950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:29.350533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:29.351039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:29.353011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:29.353693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:29.493174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:29.505218 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-21e5fd25-4688-4cf2-b740-706588bdf88e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.170333 Jul 01 11:10:29.505799 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3154/6209] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:29 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:30.522049 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:30.522695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:30.531742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:30.532196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:30.532971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:30.533450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:30.683512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:30.691515 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f8afa80-6dea-43de-8878-c70c8f3554f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.173387 Jul 01 11:10:30.692084 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3056/6210] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:30 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:31.710896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:31.711646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:31.719047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:31.719583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:31.720436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:31.720940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:31.864237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:31.872087 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0515654-e1f5-49d9-ad87-0ef3373df205 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.165413 Jul 01 11:10:31.882186 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3155/6211] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:31 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:32.890773 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:32.891328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:32.900598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:32.901098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:32.901935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:32.902375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:33.040844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:33.049642 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cae8d99c-03ba-4289-994e-64ed981784a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.162821 Jul 01 11:10:33.050221 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3057/6212] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:32 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:34.068580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:34.068580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:34.077188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:34.078003 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:34.078614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:34.079145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:34.225861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:34.233606 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31f1ba8c-c085-4349-879b-c24200005559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.170490 Jul 01 11:10:34.234177 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3156/6213] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:34 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:35.256023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:35.256624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:35.266449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:35.266895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:35.267663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:35.268097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:35.412434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:35.420528 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ec3a0bf6-4ca8-4e25-8865-5b9dcc9debee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.168517 Jul 01 11:10:35.421217 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3058/6214] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:35 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:36.438629 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:36.439464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:36.447906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:36.450273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:36.450273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:36.450273 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:36.641252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:36.648697 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d17f20e4-8334-4300-a3e5-a36f9e7b6346 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.214245 Jul 01 11:10:36.650208 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3157/6215] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:36 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:37.665438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:37.666071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:37.677694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:37.678345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:37.679708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:37.681349 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:37.860730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:37.870437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5be49571-4f4a-4c31-b78f-b2bf28befab9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.208958 Jul 01 11:10:37.871027 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3059/6216] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:37 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:38.888170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:38.888831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:38.895894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:38.896341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:38.897179 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:38.897633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:39.094929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:39.103166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-609e8ee1-3d76-43a1-a00d-49c4b3c59d19 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.219187 Jul 01 11:10:39.103739 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3158/6217] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:38 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:40.120227 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:40.120898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:40.128119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:40.128572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:40.129388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:40.129828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:40.262464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:40.270065 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c3ec2c19-1ef5-4c3c-9ab4-f77990efde99 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.154191 Jul 01 11:10:40.273509 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3060/6218] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:40 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:41.291924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:41.291924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:41.303096 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:41.305802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:41.306827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:41.307268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:41.508348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:41.520817 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b7be7abd-3619-4d9c-b77f-ae5437837f2e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.237749 Jul 01 11:10:41.533689 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3159/6219] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:41 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:42.539107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:42.540012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:42.547810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:42.548471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:42.549395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:42.550101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:42.655460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7afc6619-7090-4b9e-b162-7db4a55e9b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'create', calling method: .version_select at 0x7f6f91e70160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1673076260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiMfMJZIgFz2Bo5aO8o6ZXg4jSx9tx10lFuIKSuOoG7S30Z3Z9q//KIReXYqIXk2KbKrP7iwSIfeajQA17GhwRekYA9eHDf0RRvuE9+WeSmJFLWPeSq2DS5zIJwtJIPlw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:42.684925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7afc6619-7090-4b9e-b162-7db4a55e9b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:10:42.701326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7afc6619-7090-4b9e-b162-7db4a55e9b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for user f2bf9076469441cb8e8a8dca825f1833 and project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:10:42.759740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:42.767868 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5a0ded05-a492-4db4-baea-c549500f1bcf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.232941 Jul 01 11:10:42.768458 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3061/6220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:42 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:42.810313 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7afc6619-7090-4b9e-b162-7db4a55e9b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.158755 Jul 01 11:10:42.810929 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3160/6221] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:10:42 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:10:43.785665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:43.786843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:43.796182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:43.796812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:43.797796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:43.799285 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:43.999739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:44.010356 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0bd04f1c-2054-4de9-8280-0eb6cd120ff4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.227466 Jul 01 11:10:44.012683 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3062/6222] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:43 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:45.030345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:45.031865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:45.034311 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:45.041254 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:45.041744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:45.042523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:45.042959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:45.047690 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=79 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:45.211689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:45.234222 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3762ab64-7f8c-4f39-87b8-626fca7c5b93 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.197814 Jul 01 11:10:45.234222 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3161/6223] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:45 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:45.776562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1903758531", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "3508cfc5-39d8-4f27-b0c4-934fa2f5de01"}], "key_name": "tempest-TestNetworkBasicOps-1673076260", "security_groups": [{"name": "tempest-secgroup-smoke-556226903"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:45.803326 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=33 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:45.942967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] validate_networks() for [('3508cfc5-39d8-4f27-b0c4-934fa2f5de01', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:10:46.243373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:46.243989 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:46.257541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:46.266007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:46.272555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:46.272555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:46.517409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:46.526122 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f0e49df-b300-4fe8-922d-25ce425ac8f7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1169 microversion: 2.1 time: 0.288782 Jul 01 11:10:46.527421 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3162/6224] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:46 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1169 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:46.536047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:10:46.536677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:10:46.537627 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:10:46.538349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:10:46.538991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:10:46.551943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:46.552811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:46.553298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:46.553772 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:46.563044 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=81 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:46.573869 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:10:46.579584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for user f2bf9076469441cb8e8a8dca825f1833 and project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:10:46.602866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:10:46.607151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:10:46.760514 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-97b0df9d-e563-4088-8d40-b2b445cfad5e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.993404 Jul 01 11:10:46.761179 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3063/6225] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:10:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:10:46.771422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6ce585e3-1ca4-4731-b4da-91d518d4a20c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:46.771976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6ce585e3-1ca4-4731-b4da-91d518d4a20c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:47.133954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6ce585e3-1ca4-4731-b4da-91d518d4a20c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:47.140271 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6ce585e3-1ca4-4731-b4da-91d518d4a20c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1249 microversion: 2.1 time: 0.372823 Jul 01 11:10:47.140844 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3163/6226] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:46 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1249 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:47.552904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:47.553504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:47.561274 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:47.561848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:47.562892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:47.563335 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:47.698574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:47.706231 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5d795a74-36f2-40fc-849b-f4fb8184f2aa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1215 microversion: 2.1 time: 0.158552 Jul 01 11:10:47.706785 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3064/6227] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:47 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:48.158220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:48.159034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:48.167399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:48.167853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:48.169131 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:48.169604 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:48.234761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:48.242678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-616835d2-a6b2-4dcb-a51e-e736532ea99b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1245 microversion: 2.1 time: 0.088382 Jul 01 11:10:48.243305 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3164/6228] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:48 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:48.723241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:48.724000 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:48.731576 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:48.732125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:48.733016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:48.733546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:48.872935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:48.880496 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c2af1d6-4322-463a-80ff-2c3bc049d0f6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.161275 Jul 01 11:10:48.881758 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3065/6229] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:48 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:49.261502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:49.262125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:49.269110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:49.269837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:49.270808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:49.271422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:49.345327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:49.352918 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50adb6e6-caab-497d-87f6-2b8eb5e044c2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1319 microversion: 2.1 time: 0.095924 Jul 01 11:10:49.353533 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3165/6230] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:49 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1319 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:49.897698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:49.898291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:49.905174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:49.905913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:49.906686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:49.907311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:50.082155 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:50.091862 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0031c0b1-644a-4c07-ac52-6a563012e9ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.197962 Jul 01 11:10:50.092456 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3066/6231] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:49 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:50.372611 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:50.373722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:50.380580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:50.381113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:50.382216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:50.382733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:50.552083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:50.560656 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68cd19d3-4ce6-4239-8380-87fd17783d25 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1374 microversion: 2.1 time: 0.194440 Jul 01 11:10:50.561257 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3166/6232] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:50 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:50.882987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-80cc6d1e-4082-4b3a-af98-b8611e82d2af req-a52e19eb-32b9-4cf7-b701-1a4d2eda258a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafeea8b-3f5c-446e-83c5-4e61845afa21", "tag": "7d6ff12c-8b32-43a2-908b-deeaeaa6c65a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:50.892190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-80cc6d1e-4082-4b3a-af98-b8611e82d2af req-a52e19eb-32b9-4cf7-b701-1a4d2eda258a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:50.892692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-80cc6d1e-4082-4b3a-af98-b8611e82d2af req-a52e19eb-32b9-4cf7-b701-1a4d2eda258a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:50.907453 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-80cc6d1e-4082-4b3a-af98-b8611e82d2af req-a52e19eb-32b9-4cf7-b701-1a4d2eda258a service nova] Creating event network-changed:7d6ff12c-8b32-43a2-908b-deeaeaa6c65a for instance cafeea8b-3f5c-446e-83c5-4e61845afa21 on n-h1-master-1 Jul 01 11:10:50.913737 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-80cc6d1e-4082-4b3a-af98-b8611e82d2af req-a52e19eb-32b9-4cf7-b701-1a4d2eda258a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034257 Jul 01 11:10:50.914351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3067/6233] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:10:51.109406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:51.110115 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:51.116954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:51.117471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:51.118244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:51.118676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:51.348948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:51.357208 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ed24b72-53e5-4207-bad4-59d8ab49dd7d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.252170 Jul 01 11:10:51.357803 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3167/6234] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:51 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:51.580404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:51.581166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:51.588327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:51.588832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:51.589641 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:51.590109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:51.848375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:51.856954 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8b5b0edc-80e6-47d0-aea8-7d99063d0066 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1374 microversion: 2.1 time: 0.280796 Jul 01 11:10:51.857660 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3068/6235] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:51 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1374 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:52.374365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:52.374909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:52.382450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:52.382899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:52.383682 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:52.384122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:52.525707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:52.534000 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c907dde-75f3-4461-bf8d-7bbad6369542 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.163618 Jul 01 11:10:52.534572 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3168/6236] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:52 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:52.874752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:52.875359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:52.882378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:52.882824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:52.883589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:52.884026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:53.015887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:53.024061 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-085ce7fb-e038-4c89-854d-af4a66f4858b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1374 microversion: 2.1 time: 0.153169 Jul 01 11:10:53.024641 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3069/6237] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:52 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:10:53.551340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:53.551956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:53.559591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:53.560086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:53.560811 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:53.561285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:53.697589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:53.705152 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d71bd254-44a0-4133-8558-cd6cbde3dcd0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.157710 Jul 01 11:10:53.705744 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3169/6238] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:53 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:54.040006 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:54.040650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:54.047745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:54.048193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:54.048959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:54.049419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:54.183713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:54.191638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4f86519-fec5-444c-897f-7b9e65affb94 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1374 microversion: 2.1 time: 0.155569 Jul 01 11:10:54.192202 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3070/6239] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:54 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:54.722627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:54.723591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:54.730613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:54.731165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:54.732016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:54.732520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:54.870941 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:54.878742 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a6fda64-3037-4147-b2b5-35524dbaadee tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.160089 Jul 01 11:10:54.879404 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3170/6240] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:54 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:55.209393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:55.210048 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:55.216991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:55.217945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:55.218243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:55.218789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:55.367716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:55.375483 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5814f1ab-4c6e-49c5-b69d-42c7afe0e9a1 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1374 microversion: 2.1 time: 0.170045 Jul 01 11:10:55.383962 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3071/6241] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:55 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:55.895907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:55.896544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:55.903628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:55.904084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:55.904857 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:55.905336 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:56.036128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:56.045180 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-921d7f97-db60-4f24-8585-8fff76c8404a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.153136 Jul 01 11:10:56.045895 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3171/6242] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:55 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:10:56.393909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:56.395236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:56.404789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:56.405525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:56.406686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:56.407304 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:56.557433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:56.564630 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:56.568127 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5aa4f3d7-b3b1-498d-a048-aadbd3ffbecd tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1374 microversion: 2.1 time: 0.178546 Jul 01 11:10:56.569203 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3072/6243] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:56 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:56.579137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-592407c9-bc8f-49b3-aa73-47acd385aa5d req-fd5b25e5-8d75-4523-89a3-b27844827a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafeea8b-3f5c-446e-83c5-4e61845afa21", "name": "network-vif-plugged", "status": "completed", "tag": "7d6ff12c-8b32-43a2-908b-deeaeaa6c65a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:56.588714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-592407c9-bc8f-49b3-aa73-47acd385aa5d req-fd5b25e5-8d75-4523-89a3-b27844827a8f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:56.589293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-592407c9-bc8f-49b3-aa73-47acd385aa5d req-fd5b25e5-8d75-4523-89a3-b27844827a8f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:56.601173 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-592407c9-bc8f-49b3-aa73-47acd385aa5d req-fd5b25e5-8d75-4523-89a3-b27844827a8f service nova] Creating event network-vif-plugged:7d6ff12c-8b32-43a2-908b-deeaeaa6c65a for instance cafeea8b-3f5c-446e-83c5-4e61845afa21 on n-h1-master-1 Jul 01 11:10:56.606650 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-592407c9-bc8f-49b3-aa73-47acd385aa5d req-fd5b25e5-8d75-4523-89a3-b27844827a8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Jul 01 11:10:56.607531 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3172/6244] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:10:57.063194 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:57.063842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:57.066090 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:57.071954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:57.072407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:57.073192 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:57.073661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:57.206951 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:57.214446 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-626b2a13-da58-4a63-b279-1584d0979317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.155536 Jul 01 11:10:57.215009 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3073/6245] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:57 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:57.582936 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:10:57.587723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:57.588419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:57.594524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:57.594965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:57.595718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:57.596146 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:57.730206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:57.737589 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1937a4aa-3a12-4a8a-b40d-6c56d4dd96bf tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1374 microversion: 2.1 time: 0.156585 Jul 01 11:10:57.738152 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3173/6246] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:57 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:58.231343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:58.235012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:58.239071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:58.239524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:58.240292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:58.240727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:58.382748 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:58.390992 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-53dc415e-a9a8-419e-98f2-f8314d99650e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.163976 Jul 01 11:10:58.391569 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3074/6247] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:58 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:58.621690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-346abe46-3ee6-480a-9d13-7664bfa92944 req-78553420-4de7-473d-8ceb-d6c16c30e55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9700398e-2e8f-4073-b5b4-bad8caf23a38", "name": "network-vif-plugged", "status": "completed", "tag": "665e6fb3-8415-4c28-852b-b06fc6b08573"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:10:58.630819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-346abe46-3ee6-480a-9d13-7664bfa92944 req-78553420-4de7-473d-8ceb-d6c16c30e55b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:58.631268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-346abe46-3ee6-480a-9d13-7664bfa92944 req-78553420-4de7-473d-8ceb-d6c16c30e55b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:58.643530 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-346abe46-3ee6-480a-9d13-7664bfa92944 req-78553420-4de7-473d-8ceb-d6c16c30e55b service nova] Creating event network-vif-plugged:665e6fb3-8415-4c28-852b-b06fc6b08573 for instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 on n-h2-master-1 Jul 01 11:10:58.648823 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-346abe46-3ee6-480a-9d13-7664bfa92944 req-78553420-4de7-473d-8ceb-d6c16c30e55b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031474 Jul 01 11:10:58.649475 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3174/6248] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:10:58.754300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:58.755218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:58.761347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:58.761806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:58.762590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:58.763098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:58.909532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:58.917731 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71a21abc-d45d-4026-8ac2-b0e77d3a6202 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1546 microversion: 2.1 time: 0.167404 Jul 01 11:10:58.918311 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3075/6249] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:58 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:58.934578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:58.935655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:58.942492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:58.943081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:58.943962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:58.944665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:59.083575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:59.092066 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-321861e6-d895-43ca-ae1a-f0de94ffbf7b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1546 microversion: 2.1 time: 0.162144 Jul 01 11:10:59.092631 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3175/6250] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:58 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:10:59.409129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:10:59.409769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:10:59.416942 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:59.417423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:59.418234 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:10:59.418670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:10:59.550478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:10:59.558801 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-771da8bd-1cb6-4c6b-8c6e-46d79297f600 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1203 microversion: 2.1 time: 0.154317 Jul 01 11:10:59.559461 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3076/6251] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:10:59 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:00.576523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:00.577176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:00.584272 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:00.584723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:00.585533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:00.586012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:00.869810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:00.877579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea9402f4-a94b-4383-bea7-1ff1078b9d50 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1390 microversion: 2.1 time: 0.305025 Jul 01 11:11:00.878431 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3176/6252] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:00 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1390 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:00.895457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:00.896678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:00.904187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:00.904633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:00.905421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:00.905854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:01.115620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:01.124359 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fa40da90-bee4-47d8-966d-4bf6bdcdce1d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1390 microversion: 2.1 time: 0.232737 Jul 01 11:11:01.125081 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3077/6253] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:00 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:11:01.140596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:01.141227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:01.147238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:01.147679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:01.148874 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:01.149348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:01.377881 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:01.386590 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-369cbc80-60d9-4ed5-8042-493d92dbf726 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1390 microversion: 2.1 time: 0.249698 Jul 01 11:11:01.387652 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3177/6254] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:01 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1390 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:01.466485 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:01.466996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:01.473251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:01.473944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:01.474842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:01.475283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:01.500619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:11:01.831638 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4af3e1b-60ff-4561-80bb-eaacfb805f4a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 204 len: 0 microversion: 2.1 time: 0.368680 Jul 01 11:11:01.832242 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3078/6255] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:11:01 2022] DELETE /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:11:01.840855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:01.842116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:01.851437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:01.854782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:01.854782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:01.854782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:02.090306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:02.098610 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cfc851bb-c44e-4339-9e97-61449294cb43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1396 microversion: 2.1 time: 0.262195 Jul 01 11:11:02.099717 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3178/6256] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:01 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1396 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:11:03.118598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:03.120722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:03.129604 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:03.130610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:03.131476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:03.132478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:03.148653 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:03.377076 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:03.387657 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-620beccc-1240-4175-a556-862da716d632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1396 microversion: 2.1 time: 0.273536 Jul 01 11:11:03.388681 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3079/6257] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:03 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1396 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:04.408355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:04.408355 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:04.421288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:04.421808 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:04.422882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:04.423508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:04.474934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f9283b7c-dde0-4f29-a7bc-997dcbd773d7 req-d3723465-2a28-4a87-b911-43481087b817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9700398e-2e8f-4073-b5b4-bad8caf23a38", "name": "network-vif-deleted", "tag": "665e6fb3-8415-4c28-852b-b06fc6b08573"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:04.485832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f9283b7c-dde0-4f29-a7bc-997dcbd773d7 req-d3723465-2a28-4a87-b911-43481087b817 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:04.486558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f9283b7c-dde0-4f29-a7bc-997dcbd773d7 req-d3723465-2a28-4a87-b911-43481087b817 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:04.498563 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f9283b7c-dde0-4f29-a7bc-997dcbd773d7 req-d3723465-2a28-4a87-b911-43481087b817 service nova] Creating event network-vif-deleted:665e6fb3-8415-4c28-852b-b06fc6b08573 for instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 on n-h2-master-1 Jul 01 11:11:04.504260 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f9283b7c-dde0-4f29-a7bc-997dcbd773d7 req-d3723465-2a28-4a87-b911-43481087b817 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Jul 01 11:11:04.505592 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3080/6258] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:04.546978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:04.564137 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8318def6-94ea-408e-b0b0-72e9170b6b47 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1354 microversion: 2.1 time: 0.157738 Jul 01 11:11:04.569868 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3179/6259] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:04 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:11:05.584025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:05.585121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:05.592666 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:05.596212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:05.596212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:05.596212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:05.671712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:05.681843 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-30fdd1a4-44cd-4d6d-871e-0110649d30b6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1188 microversion: 2.1 time: 0.103183 Jul 01 11:11:05.682630 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3081/6260] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:05 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:11:06.700361 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:06.700965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:06.709061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:06.709761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:06.710607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:06.711871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:06.716408 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:06.781993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:06.790655 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa0886c9-4616-4e94-8332-654d93f6d3d8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1188 microversion: 2.1 time: 0.095188 Jul 01 11:11:06.791450 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3180/6261] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:06 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:07.808370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:07.809612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:07.816857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:07.821236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:07.821236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:07.821236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:07.882256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:07.891023 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf46daa0-607c-44dd-be13-53b0e1e5b8ff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1188 microversion: 2.1 time: 0.086978 Jul 01 11:11:07.892004 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3082/6262] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:07 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:08.908592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:08.909117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:08.916542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:08.916996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:08.917796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:08.918232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:08.981424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:08.989234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fa956289-d888-4a3c-8ab5-fcd17a73b2b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1188 microversion: 2.1 time: 0.084516 Jul 01 11:11:08.989831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3181/6263] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:08 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:10.006411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:10.007136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:10.015797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:10.016346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:10.019032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:10.019491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:10.051101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:10.051468 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:10.051932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lazy-loading 'fault' on Instance uuid 9700398e-2e8f-4073-b5b4-bad8caf23a38 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:11:10.100151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:10.108433 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82a5f91a-7a66-4acc-9da6-5b9b7edcbcb6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 200 len: 1193 microversion: 2.1 time: 0.106189 Jul 01 11:11:10.109053 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3083/6264] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:10 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 1193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:11:11.125449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:11.126063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:11.138367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:11.138820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:11.139607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:11.140045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:11.155060 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 HTTP/1.1 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '9700398e-2e8f-4073-b5b4-bad8caf23a38'} Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:11.156794 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:11.162242 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:11.162242 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:11.162242 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:11.162242 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:11:11.162242 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:11:11.162242 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:11.162242 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:11.163667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:11:11.164527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6bf38303-b445-451a-9556-e8fec2e0cc29 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 404 len: 111 microversion: 2.1 time: 0.043095 Jul 01 11:11:11.165090 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3182/6265] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:11 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:11:13.307245 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:13.307988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:13.315179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:13.315745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:13.316646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:13.317193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:13.332104 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 HTTP/1.1 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '9700398e-2e8f-4073-b5b4-bad8caf23a38'} Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:11:13.334120 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bb56ca7-2bd4-4a2f-a520-f92f15f04cd4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 404 len: 111 microversion: 2.1 time: 0.032765 Jul 01 11:11:13.340695 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3084/6266] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:11:13 2022] DELETE /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:11:13.349870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:13.350703 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 9700398e-2e8f-4073-b5b4-bad8caf23a38] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:13.357542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:13.358064 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:13.358905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:13.359421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:13.373305 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 HTTP/1.1 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '9700398e-2e8f-4073-b5b4-bad8caf23a38'} Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:13.374954 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 9700398e-2e8f-4073-b5b4-bad8caf23a38 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43389908-c2d2-482f-ba16-e33dd515bea1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38" status: 404 len: 111 microversion: 2.1 time: 0.032437 Jul 01 11:11:13.386756 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3183/6267] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:13 2022] GET /compute/v2.1/servers/9700398e-2e8f-4073-b5b4-bad8caf23a38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 11:11:24.230024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:24.232533 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:24.244431 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:24.245459 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=27 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:24.249969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:24.250561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:24.252035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:24.254521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:24.309067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:11:24.700992 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-40bc4b3f-4681-4801-87f7-0d13f238852c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 204 len: 0 microversion: 2.1 time: 0.477714 Jul 01 11:11:24.706953 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3085/6268] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:11:24 2022] DELETE /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:11:24.715201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:24.716500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:24.723837 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=47 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:24.726064 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=15 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:24.744091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:24.744955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:24.748624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:24.748624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:25.229683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:25.242703 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-47718015-aa76-49a5-b7f0-6accd015d470 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1552 microversion: 2.1 time: 0.535303 Jul 01 11:11:25.243521 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3184/6269] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:24 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1552 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:26.261605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:26.263279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:26.279482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:26.279979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:26.280815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:26.281343 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:26.669437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:26.679990 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5b113e05-3d3f-4703-bd3a-87bde4627719 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1552 microversion: 2.1 time: 0.423004 Jul 01 11:11:26.682726 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3086/6270] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:26 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1552 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:27.039928 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-38da927a-1100-4f60-9495-ffd1a2be7433 req-9263280d-df87-4550-9cad-d04430ffaf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafeea8b-3f5c-446e-83c5-4e61845afa21", "name": "network-vif-deleted", "tag": "7d6ff12c-8b32-43a2-908b-deeaeaa6c65a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:27.050748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-38da927a-1100-4f60-9495-ffd1a2be7433 req-9263280d-df87-4550-9cad-d04430ffaf0f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:27.051597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-38da927a-1100-4f60-9495-ffd1a2be7433 req-9263280d-df87-4550-9cad-d04430ffaf0f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:27.068037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-38da927a-1100-4f60-9495-ffd1a2be7433 req-9263280d-df87-4550-9cad-d04430ffaf0f service nova] Creating event network-vif-deleted:7d6ff12c-8b32-43a2-908b-deeaeaa6c65a for instance cafeea8b-3f5c-446e-83c5-4e61845afa21 on n-h1-master-1 Jul 01 11:11:27.074243 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-38da927a-1100-4f60-9495-ffd1a2be7433 req-9263280d-df87-4550-9cad-d04430ffaf0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038900 Jul 01 11:11:27.075126 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3185/6271] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:27.698374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:27.699661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:27.709169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:27.709727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:27.711211 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:27.711717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:27.748919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:27.749504 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:27.750023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lazy-loading 'fault' on Instance uuid cafeea8b-3f5c-446e-83c5-4e61845afa21 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:11:27.842101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:27.857869 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb0e6f0b-90c3-4f5a-a77f-cdd8dcf4d294 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 200 len: 1339 microversion: 2.1 time: 0.163625 Jul 01 11:11:27.858710 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3087/6272] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:27 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:28.890391 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:28.892718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: cafeea8b-3f5c-446e-83c5-4e61845afa21] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:28.902258 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:28.903814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:28.904673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:28.905490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:28.924493 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] HTTP exception thrown: Instance cafeea8b-3f5c-446e-83c5-4e61845afa21 could not be found. Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Request method failure captured: Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 HTTP/1.1 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtXsAQ1Io9g-fujlQ1kBzAqPJKZ3HLqw2SnDrWpTH2oCzAi-xXdjPeNt3DNCuC7JRzcy0Bahuymy2ssNxb31vP_q43OZyfz5OmHCXZg76rDwq-m-BoebARkP_8zPq0tbIOfDnoluk-ANffD9TVNQTpsdSwlHHaMZzGbFzNDaZudjdUw Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 175cf3cee50e4dc7b3b9b0f169ea2093 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkBasicOps-712821535 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_175cf3cee50e4dc7b3b9b0f169ea2093", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkBasicOps-712821535 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 175cf3cee50e4dc7b3b9b0f169ea2093 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkBasicOps-712821535 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkBasicOps-712821535-project Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f2bf9076469441cb8e8a8dca825f1833 Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkBasicOps-712821535-project Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: exception: Instance cafeea8b-3f5c-446e-83c5-4e61845afa21 could not be found. Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'cafeea8b-3f5c-446e-83c5-4e61845afa21'} Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafeea8b-3f5c-446e-83c5-4e61845afa21 could not be found. Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafeea8b-3f5c-446e-83c5-4e61845afa21 could not be found. Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:28.926415 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:28.933706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:28.933706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:28.933706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:28.933706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:11:28.933706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:11:28.933706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafeea8b-3f5c-446e-83c5-4e61845afa21 could not be found. Jul 01 11:11:28.933706 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:28.942771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Returning 404 to user: Instance cafeea8b-3f5c-446e-83c5-4e61845afa21 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:11:28.944221 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-859e769b-d9a0-49b2-84be-3c269e5715a0 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21" status: 404 len: 111 microversion: 2.1 time: 0.059234 Jul 01 11:11:28.946418 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3186/6273] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:28 2022] GET /compute/v2.1/servers/cafeea8b-3f5c-446e-83c5-4e61845afa21 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:11:29.272588 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6f63f22a-fc1e-4705-9363-f0e848ce0629 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '.version_select at 0x7f6f9094aee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:29.362205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6f63f22a-fc1e-4705-9363-f0e848ce0629 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1673076260" status: 202 len: 0 microversion: 2.1 time: 0.101658 Jul 01 11:11:29.363405 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3088/6274] 10.222.0.23 () {58 vars in 1256 bytes} [Fri Jul 1 11:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1673076260 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:11:33.004799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:33.006701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:33.027063 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:33.035635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2c44e560-62b9-41ee-beb2-d1e8ee7c9ee4 req-a632655f-1894-4684-b6e3-1c2219e95739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c0a130-c1db-4864-82f5-889b449a0478", "tag": "6429b232-2710-4969-895d-7c289ded26ce"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:33.042032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:33.043321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:33.046674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:33.062861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2c44e560-62b9-41ee-beb2-d1e8ee7c9ee4 req-a632655f-1894-4684-b6e3-1c2219e95739 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:33.065661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2c44e560-62b9-41ee-beb2-d1e8ee7c9ee4 req-a632655f-1894-4684-b6e3-1c2219e95739 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:33.091812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:11:33.111212 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2c44e560-62b9-41ee-beb2-d1e8ee7c9ee4 req-a632655f-1894-4684-b6e3-1c2219e95739 service nova] Creating event network-changed:6429b232-2710-4969-895d-7c289ded26ce for instance 19c0a130-c1db-4864-82f5-889b449a0478 on n-h2-master-1 Jul 01 11:11:33.120788 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2c44e560-62b9-41ee-beb2-d1e8ee7c9ee4 req-a632655f-1894-4684-b6e3-1c2219e95739 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090053 Jul 01 11:11:33.125945 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3089/6275] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:33.542381 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c07a1f1-cdb0-48cd-8639-99e9984068aa tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 204 len: 0 microversion: 2.1 time: 0.542740 Jul 01 11:11:33.543048 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3187/6276] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:11:32 2022] DELETE /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:11:33.556101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:33.557080 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:33.572340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:33.574442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:33.576815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:33.577489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:34.113477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:34.136223 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99b5db28-6078-4986-b66e-47d628861f1a tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1672 microversion: 2.1 time: 0.586140 Jul 01 11:11:34.146646 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3090/6277] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:33 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1672 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:11:35.164704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:35.167532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:35.183829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:35.188086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:35.190293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:35.192845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:35.604219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:35.634064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8296faca-7a5a-4915-a76a-33ff8767377d tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1672 microversion: 2.1 time: 0.482411 Jul 01 11:11:35.639154 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3188/6278] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:35 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1672 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:35.873372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-47b16a4e-7ab0-416b-aebe-6b88af60c3e2 req-e3b28651-faeb-4fe2-a3fa-dc526b3340a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c0a130-c1db-4864-82f5-889b449a0478", "name": "network-vif-deleted", "tag": "6429b232-2710-4969-895d-7c289ded26ce"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:35.884369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-47b16a4e-7ab0-416b-aebe-6b88af60c3e2 req-e3b28651-faeb-4fe2-a3fa-dc526b3340a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:35.884906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-47b16a4e-7ab0-416b-aebe-6b88af60c3e2 req-e3b28651-faeb-4fe2-a3fa-dc526b3340a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:35.899620 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-47b16a4e-7ab0-416b-aebe-6b88af60c3e2 req-e3b28651-faeb-4fe2-a3fa-dc526b3340a4 service nova] Creating event network-vif-deleted:6429b232-2710-4969-895d-7c289ded26ce for instance 19c0a130-c1db-4864-82f5-889b449a0478 on n-h2-master-1 Jul 01 11:11:35.905631 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-47b16a4e-7ab0-416b-aebe-6b88af60c3e2 req-e3b28651-faeb-4fe2-a3fa-dc526b3340a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036275 Jul 01 11:11:35.909526 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3091/6279] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:11:36.655638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:36.656262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:36.667685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:36.668504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:36.670194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:36.671009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:36.745333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:36.754925 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-acc8cbbc-b975-4f7f-bfd2-b259537bed48 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1485 microversion: 2.1 time: 0.107113 Jul 01 11:11:36.766048 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3189/6280] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:36 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1485 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:36.861500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee5b5163-eddf-4a46-a9eb-8b2f9d42ee8d tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1941493680", "availability_zone": "foo_zone"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:36.885208 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:36.885208 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:11:36.886282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.aggregate [None req-ee5b5163-eddf-4a46-a9eb-8b2f9d42ee8d tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Generated uuid 233be97a-bb45-40cd-b840-1723fc75a415 for aggregate {{(pid=119765) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 01 11:11:37.096142 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee5b5163-eddf-4a46-a9eb-8b2f9d42ee8d tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.386888 Jul 01 11:11:37.098270 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3092/6281] 10.222.0.23 () {60 vars in 1163 bytes} [Fri Jul 1 11:11:36 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:37.107675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af93793f-cbea-4365-a21f-5c97624986df tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:37.113736 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:37.113736 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:11:37.246901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af93793f-cbea-4365-a21f-5c97624986df tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.143404 Jul 01 11:11:37.254633 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3190/6282] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 11:11:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:37.261537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bcf91166-6075-401b-9fef-cf6e8875a63a tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:37.262946 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:37.262946 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:11:37.264724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcf91166-6075-401b-9fef-cf6e8875a63a tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:37.265922 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcf91166-6075-401b-9fef-cf6e8875a63a tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:37.266730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcf91166-6075-401b-9fef-cf6e8875a63a tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:37.267169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bcf91166-6075-401b-9fef-cf6e8875a63a tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:37.301486 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bcf91166-6075-401b-9fef-cf6e8875a63a tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046244 Jul 01 11:11:37.302110 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3093/6283] 10.222.0.23 () {58 vars in 1175 bytes} [Fri Jul 1 11:11:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:37.312451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c25d2f8-d8bd-4721-9e3c-6663b00f2706 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:37.313488 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:37.313488 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:11:37.322146 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c25d2f8-d8bd-4721-9e3c-6663b00f2706 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013226 Jul 01 11:11:37.322936 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3191/6284] 10.222.0.23 () {58 vars in 1142 bytes} [Fri Jul 1 11:11:37 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:37.334446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81323545-d355-49fc-a4eb-cf020a9fa3ff tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:37.337428 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:37.337428 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:11:37.346405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81323545-d355-49fc-a4eb-cf020a9fa3ff tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:37.347138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81323545-d355-49fc-a4eb-cf020a9fa3ff tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:37.716180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81323545-d355-49fc-a4eb-cf020a9fa3ff tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.385398 Jul 01 11:11:37.716900 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3094/6285] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 11:11:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:37.727732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-40a32d7f-5e3f-445a-a7d3-921b35ee7b1e tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:37.728901 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:37.728901 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:11:37.738441 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-40a32d7f-5e3f-445a-a7d3-921b35ee7b1e tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.015153 Jul 01 11:11:37.739035 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3192/6286] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 11:11:37 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:11:37.760693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c8abc1f6-615d-42d6-8a73-73c01169e615 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1230808265", "availability_zone": "foo_zone"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:37.774616 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:37.775691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:37.786836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:37.792553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:37.792553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:37.792553 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:37.847223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:37.847223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:37.847458 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:37.847458 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:11:37.847685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lazy-loading 'fault' on Instance uuid 19c0a130-c1db-4864-82f5-889b449a0478 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:11:37.943049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:37.952056 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d5b860ea-3e28-45bc-9d6f-d4a2187fd44b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 200 len: 1342 microversion: 2.1 time: 0.182713 Jul 01 11:11:37.952641 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3193/6287] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:37 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 1342 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:38.026530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c8abc1f6-615d-42d6-8a73-73c01169e615 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.280005 Jul 01 11:11:38.031183 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3095/6288] 10.222.0.23 () {60 vars in 1172 bytes} [Fri Jul 1 11:11:37 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:11:38.041633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-718dc633-0809-41b9-be36-e0be2dbe1f7d tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:38.042815 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:38.042815 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:11:38.149863 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-718dc633-0809-41b9-be36-e0be2dbe1f7d tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.112219 Jul 01 11:11:38.150913 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3194/6289] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 11:11:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:11:38.161486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d4b9dff-bc85-4b6f-bf65-dbe5d25d5fbc tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:38.162219 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:38.162219 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:11:38.172600 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d4b9dff-bc85-4b6f-bf65-dbe5d25d5fbc tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.014855 Jul 01 11:11:38.173465 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3096/6290] 10.222.0.23 () {58 vars in 1151 bytes} [Fri Jul 1 11:11:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:11:38.184285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1deff3d-5dc9-48d0-9d5d-6d9468be01f6 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:38.187735 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:38.187735 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:11:38.201832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1deff3d-5dc9-48d0-9d5d-6d9468be01f6 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:38.202437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1deff3d-5dc9-48d0-9d5d-6d9468be01f6 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:38.572368 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1deff3d-5dc9-48d0-9d5d-6d9468be01f6 tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.392370 Jul 01 11:11:38.573921 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3195/6291] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Jul 1 11:11:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:11:38.584797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9aa8e062-8145-48ce-b87c-0798a1a881fc tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:38.590093 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:11:38.590093 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:11:38.684795 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9aa8e062-8145-48ce-b87c-0798a1a881fc tempest-TestAggregatesBasicOps-555001384 tempest-TestAggregatesBasicOps-555001384-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.104998 Jul 01 11:11:38.686038 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3097/6292] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 11:11:38 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 01 11:11:38.978868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:38.979506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: 19c0a130-c1db-4864-82f5-889b449a0478] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:38.996967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:39.015752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:39.015752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:39.015752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:39.021530 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] HTTP exception thrown: Instance 19c0a130-c1db-4864-82f5-889b449a0478 could not be found. Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Request method failure captured: Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 HTTP/1.1 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtXsAQ1Io9g-fujlQ1kBzAqPJKZ3HLqw2SnDrWpTH2oCzAi-xXdjPeNt3DNCuC7JRzcy0Bahuymy2ssNxb31vP_q43OZyfz5OmHCXZg76rDwq-m-BoebARkP_8zPq0tbIOfDnoluk-ANffD9TVNQTpsdSwlHHaMZzGbFzNDaZudjdUw Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 175cf3cee50e4dc7b3b9b0f169ea2093 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkBasicOps-712821535 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_175cf3cee50e4dc7b3b9b0f169ea2093", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkBasicOps-712821535 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 175cf3cee50e4dc7b3b9b0f169ea2093 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkBasicOps-712821535 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkBasicOps-712821535-project Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f2bf9076469441cb8e8a8dca825f1833 Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkBasicOps-712821535-project Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 19c0a130-c1db-4864-82f5-889b449a0478 could not be found. Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '19c0a130-c1db-4864-82f5-889b449a0478'} Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c0a130-c1db-4864-82f5-889b449a0478 could not be found. Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c0a130-c1db-4864-82f5-889b449a0478 could not be found. Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:11:39.024630 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c0a130-c1db-4864-82f5-889b449a0478 could not be found. Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Returning 404 to user: Instance 19c0a130-c1db-4864-82f5-889b449a0478 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:11:39.030141 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e21007af-bfc0-4932-8f28-d09a105b5e2e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478" status: 404 len: 111 microversion: 2.1 time: 0.062280 Jul 01 11:11:39.034016 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3196/6293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:38 2022] GET /compute/v2.1/servers/19c0a130-c1db-4864-82f5-889b449a0478 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:11:39.345777 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4b1d5d9f-2755-422e-969e-095c607d2e3f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '.version_select at 0x7f6f9061e8b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:39.460491 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4b1d5d9f-2755-422e-969e-095c607d2e3f tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-311532750" status: 202 len: 0 microversion: 2.1 time: 0.119753 Jul 01 11:11:39.461357 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3098/6294] 10.222.0.23 () {58 vars in 1253 bytes} [Fri Jul 1 11:11:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-311532750 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:11:51.986044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50037888-ffb0-46a7-952f-6f8758e43e92 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'create', calling method: .version_select at 0x7f6f91109dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2094273045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODQHYDMAihMZM19VnIVQ1kOJAtC3kxiV5o2mgy5M0TShDfnZCo2OIE1hLKOsw6hpmJUQoZcQrvQXTs8bckI9RqbsokoNwAsasq2Oq2LaxcKWqGE7BDW2x81LmdczeOibg=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:51.996238 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:51.997074 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:52.029097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-50037888-ffb0-46a7-952f-6f8758e43e92 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:11:52.039848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-50037888-ffb0-46a7-952f-6f8758e43e92 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for user f2bf9076469441cb8e8a8dca825f1833 and project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:11:52.267274 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50037888-ffb0-46a7-952f-6f8758e43e92 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.291071 Jul 01 11:11:52.273904 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3197/6295] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:11:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:11:55.372144 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:55.373031 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:55.373658 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:11:55.377628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1846925111", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "58179560-4f49-4df9-9c28-6bb37492b512"}], "key_name": "tempest-TestNetworkBasicOps-2094273045", "security_groups": [{"name": "tempest-secgroup-smoke-105205373"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:55.490423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] validate_networks() for [('58179560-4f49-4df9-9c28-6bb37492b512', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:11:55.491424 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-375606239", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "597000ae-8c64-43ab-bc05-5e22b35be242", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fc85cd4f-4041-4340-a016-821f51d0f621"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:11:55.552612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] validate_networks() for [('fc85cd4f-4041-4340-a016-821f51d0f621', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:11:56.086781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:11:56.086781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:11:56.086781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:11:56.087088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:11:56.087313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:11:56.096555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:56.097002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:56.097840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:56.098276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:56.122858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:11:56.128321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:11:56.183001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:11:56.183001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:11:56.183001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:11:56.183001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:11:56.183001 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:11:56.188455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:11:56.190583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='597000ae-8c64-43ab-bc05-5e22b35be242',volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:11:56.191345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:56.191795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:56.192731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:56.193221 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:56.212948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:11:56.218347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Getting quotas for user f2bf9076469441cb8e8a8dca825f1833 and project 175cf3cee50e4dc7b3b9b0f169ea2093. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:11:56.231159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:11:56.233761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:11:56.366644 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61e1d08f-3f38-483c-abe8-5eebff2f8240 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.995619 Jul 01 11:11:56.367284 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3099/6296] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:11:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:11:56.377824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-979974c1-b573-47f0-891a-7c27d7448f8b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:56.378534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-979974c1-b573-47f0-891a-7c27d7448f8b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:56.438903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-979974c1-b573-47f0-891a-7c27d7448f8b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:56.447802 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-979974c1-b573-47f0-891a-7c27d7448f8b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1249 microversion: 2.1 time: 0.074706 Jul 01 11:11:56.448369 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3100/6297] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:56 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:11:56.652016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc7d8298-1ccc-49b2-b7e3-c6684b504295 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166220 Jul 01 11:11:56.652676 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3198/6298] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 11:11:56.663565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f9a7f6f-3179-4267-a6dc-be480463281d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:56.667853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f9a7f6f-3179-4267-a6dc-be480463281d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:56.720028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f9a7f6f-3179-4267-a6dc-be480463281d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:56.728055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f9a7f6f-3179-4267-a6dc-be480463281d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1070 microversion: 2.1 time: 0.069075 Jul 01 11:11:56.729981 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3101/6299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:56 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1070 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:57.464429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:57.465054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:57.471290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:57.471744 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:57.472518 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:57.472955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:57.537050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:57.544514 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-313823e5-a52a-46e3-9d72-502565df18f6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1253 microversion: 2.1 time: 0.084054 Jul 01 11:11:57.545077 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3199/6300] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:57 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:57.751296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:57.752103 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:57.759954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:57.760403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:57.761199 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:57.761685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:57.823161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:57.830995 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cce9a758-39b1-4bd7-954e-df88747a68cd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1120 microversion: 2.1 time: 0.083608 Jul 01 11:11:57.831575 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3102/6301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:57 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1120 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:58.561359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:58.562007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:58.569514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:58.570299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:58.571116 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:58.571556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:58.649484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:58.657057 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be9eb83d-f10d-45cf-843f-580d997ae9e6 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1309 microversion: 2.1 time: 0.099680 Jul 01 11:11:58.657663 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3200/6302] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:58 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:58.849729 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:58.850917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:58.858206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:58.858664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:58.859665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:58.860104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:58.951209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:58.963345 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58ecb657-b38b-49cb-91fc-8becd6538705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1176 microversion: 2.1 time: 0.117387 Jul 01 11:11:58.974042 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3103/6303] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:58 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1176 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:59.677336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:59.677981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:59.684686 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:59.685139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:59.685950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:59.686382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:59.935057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:11:59.948070 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e3deae9b-ecaf-42ee-8813-42b85a68644e tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.274440 Jul 01 11:11:59.957674 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3201/6304] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:59 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:11:59.983292 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:11:59.984545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:11:59.995417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:59.997363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:11:59.999565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:11:59.999565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:00.318232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:00.326920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba09eae3-4cac-423e-9fac-037a59e49e17 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1228 microversion: 2.1 time: 0.348831 Jul 01 11:12:00.327674 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3104/6305] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:11:59 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1228 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:00.891050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-101c2439-241d-488e-a8cd-219a0fa90435 req-1aeb5b77-e10d-417e-8410-ac9a7dbb7dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b42836a8-bcef-4590-aac0-cbf3155c66bf", "tag": "55bfb581-d95a-48a2-8d62-bfe988b0d2ca"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:00.906395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-101c2439-241d-488e-a8cd-219a0fa90435 req-1aeb5b77-e10d-417e-8410-ac9a7dbb7dcb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:00.907083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-101c2439-241d-488e-a8cd-219a0fa90435 req-1aeb5b77-e10d-417e-8410-ac9a7dbb7dcb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:00.928451 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-101c2439-241d-488e-a8cd-219a0fa90435 req-1aeb5b77-e10d-417e-8410-ac9a7dbb7dcb service nova] Creating event network-changed:55bfb581-d95a-48a2-8d62-bfe988b0d2ca for instance b42836a8-bcef-4590-aac0-cbf3155c66bf on n-h2-master-1 Jul 01 11:12:00.934979 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-101c2439-241d-488e-a8cd-219a0fa90435 req-1aeb5b77-e10d-417e-8410-ac9a7dbb7dcb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054162 Jul 01 11:12:00.937999 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3202/6306] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:12:00.954070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-12717abe-b93f-4f43-9413-2a7bd7df076f req-5114f86b-825d-4166-adf0-26eb760f7361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9f6d75-5e3d-488c-a40c-ca20d385c171", "tag": "2abecba2-7e98-4979-b039-fe51f84c477f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:00.969287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:00.970818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-12717abe-b93f-4f43-9413-2a7bd7df076f req-5114f86b-825d-4166-adf0-26eb760f7361 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:00.971493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-12717abe-b93f-4f43-9413-2a7bd7df076f req-5114f86b-825d-4166-adf0-26eb760f7361 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:00.972474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:00.990646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:00.991460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:00.992460 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:00.993110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:00.997441 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-12717abe-b93f-4f43-9413-2a7bd7df076f req-5114f86b-825d-4166-adf0-26eb760f7361 service nova] Creating event network-changed:2abecba2-7e98-4979-b039-fe51f84c477f for instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 on n-h2-master-1 Jul 01 11:12:01.012391 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-12717abe-b93f-4f43-9413-2a7bd7df076f req-5114f86b-825d-4166-adf0-26eb760f7361 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062084 Jul 01 11:12:01.013414 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3105/6307] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:12:01.226285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:01.239213 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6310eee2-a857-4991-a6d0-0900b836e613 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.273158 Jul 01 11:12:01.239213 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3203/6308] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:00 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:12:01.345553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:01.346279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:01.359061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:01.359518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:01.360444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:01.360878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:01.560673 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:01.571300 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3110e0d6-063d-451b-9e1b-dde416d75856 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1228 microversion: 2.1 time: 0.230767 Jul 01 11:12:01.573187 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3106/6309] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:01 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:02.216211 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:02.216734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:02.226662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.227393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:02.228405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.229062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:02.257551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:02.258698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:02.272888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.273629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:02.274594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.279116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:12:02.287006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:02.582694 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:02.582694 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b608f66a-67a0-4cbe-8f52-c2a431aee144 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.203398 Jul 01 11:12:02.582694 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3107/6310] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:02 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:02.588867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:02.589608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:02.597176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.598123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:02.599135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.600395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:02.758838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:02.767313 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc4c5763-b249-44e5-8ac9-376ec5b78390 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1228 microversion: 2.1 time: 0.182986 Jul 01 11:12:02.768370 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3108/6311] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:02 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:12:02.879177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6eb0da4d-527d-4ee7-97c5-e60e697240d9 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 204 len: 0 microversion: 2.1 time: 0.864802 Jul 01 11:12:02.881268 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3204/6312] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:12:02 2022] DELETE /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:12:02.888832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:02.889487 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:02.895596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.896049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:02.896844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:02.897323 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:03.035355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:03.043934 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dac56531-e32d-46b2-a808-93dc91037121 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1732 microversion: 2.1 time: 0.158850 Jul 01 11:12:03.046978 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3109/6313] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:02 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:03.587357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:03.588158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:03.595544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:03.595987 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:03.596748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:03.597212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:03.740397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:03.747811 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e596876d-a1f3-4aef-94a3-f5b65a0fe566 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.165723 Jul 01 11:12:03.748377 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3205/6314] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:03 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:03.784946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:03.785666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:03.793506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:03.794125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:03.795046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:03.795605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:03.928590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:03.936088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c00d2fc8-a4f0-45f6-aa5a-7a5a54843ec9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1228 microversion: 2.1 time: 0.155123 Jul 01 11:12:03.936655 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3110/6315] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:03 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:04.061899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:04.062436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:04.069755 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:04.070235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:04.071048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:04.071528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:04.218444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:04.227018 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04df1ef6-47c0-4c15-b8db-687e0ccdf00e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1732 microversion: 2.1 time: 0.169066 Jul 01 11:12:04.231402 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3206/6316] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:04 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:04.764410 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:04.765033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:04.771188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:04.772152 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:04.772925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:04.773389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:04.919415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:04.926934 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c070250c-db5d-4307-8c56-306e9bba5b95 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.166426 Jul 01 11:12:04.927560 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3111/6317] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:04 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:04.953593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:04.954203 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:04.961718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:04.962164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:04.962930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:04.963368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:05.120885 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:05.128946 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d972935-a108-4740-86ee-316dadfca498 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1228 microversion: 2.1 time: 0.179181 Jul 01 11:12:05.129728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3207/6318] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:04 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1228 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:05.249097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:05.249861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:05.269699 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:05.270372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:05.271339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:05.272417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:05.321227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f2e24c3d-248e-43ac-ac5b-ac5f5997017d req-d879160d-738d-4d1f-9cb5-4720cde9ae68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa987f2-aaa9-4683-878e-ae9a18726743", "name": "network-vif-deleted", "tag": "eea5cf7b-7166-4f05-b853-274e12dde180"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:05.343718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f2e24c3d-248e-43ac-ac5b-ac5f5997017d req-d879160d-738d-4d1f-9cb5-4720cde9ae68 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:05.344173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f2e24c3d-248e-43ac-ac5b-ac5f5997017d req-d879160d-738d-4d1f-9cb5-4720cde9ae68 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:05.353085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:05.360269 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f2e24c3d-248e-43ac-ac5b-ac5f5997017d req-d879160d-738d-4d1f-9cb5-4720cde9ae68 service nova] Creating event network-vif-deleted:eea5cf7b-7166-4f05-b853-274e12dde180 for instance 7aa987f2-aaa9-4683-878e-ae9a18726743 on n-h1-master-1 Jul 01 11:12:05.373707 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8531d664-42c6-4114-91b2-a5767e14eabd tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1664 microversion: 2.1 time: 0.123147 Jul 01 11:12:05.373707 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3112/6319] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:05 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1664 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:05.381974 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f2e24c3d-248e-43ac-ac5b-ac5f5997017d req-d879160d-738d-4d1f-9cb5-4720cde9ae68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066626 Jul 01 11:12:05.383079 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3208/6320] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:12:05.943870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:05.944475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:05.951435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:05.951884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:05.952654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:05.953563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:06.101730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:06.111957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03a9c89c-512e-4636-b46e-62578c77b19b tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.171874 Jul 01 11:12:06.112600 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3113/6321] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:05 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:06.144377 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:06.145262 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:06.149921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:06.150627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:06.158189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:06.158644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:06.159424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:06.159859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:06.310091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:06.319751 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-59f5ce8d-fb70-49cb-9bc4-b6f10d2d7c6f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.177080 Jul 01 11:12:06.320915 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3209/6322] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:06 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:06.382130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:06.382661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:06.384732 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:06.389928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:06.390372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:06.391136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:06.391564 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:06.433259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:06.433670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:06.434121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lazy-loading 'fault' on Instance uuid 7aa987f2-aaa9-4683-878e-ae9a18726743 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:12:06.485172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b71f050e4349368c371d815d637649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc8c6d3ac9b4615a54d8c99d19f999c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:06.492939 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-09713154-d412-41b1-be7b-94e4d678112e tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 200 len: 1387 microversion: 2.1 time: 0.114883 Jul 01 11:12:06.493664 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3114/6323] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:06 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 1387 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:07.129390 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:07.130255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:07.136809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:07.137396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:07.138167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:07.138605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:07.272538 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:07.280067 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5cac56f-ec60-4b69-8873-0a064ee873b5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.154936 Jul 01 11:12:07.280637 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3210/6324] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:07 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:07.336601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:07.337250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:07.339456 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:07.345334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:07.345786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:07.346544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:07.346976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:07.480415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:07.488035 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c2a56f3-c2b0-4172-94a1-f534c3e59d84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.155320 Jul 01 11:12:07.488607 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3115/6325] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:07 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:07.512164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:07.512786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:07.519213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:07.519683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:07.520471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:07.520901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:07.534600 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] HTTP exception thrown: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Request method failure captured: Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 HTTP/1.1 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtVMS5JcrnHZV3a26BRzq941Qev0Pk7bgQMteENf0GZsvDaaBr4JekHfhEB8AkPaocRQ2obr5J95RvYqR0fUSIpCa7im9SPWb4cNUi8y0SkltaJDajzPZI3WwPSxRjb8YhtNtrjyoNqN7k3GMyxo-oF_uESUv6Jas3mrkrcJ5NwLZ64 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: bcc8c6d3ac9b4615a54d8c99d19f999c Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestServerBasicOps-719078721 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc8c6d3ac9b4615a54d8c99d19f999c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestServerBasicOps-719078721 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: bcc8c6d3ac9b4615a54d8c99d19f999c Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestServerBasicOps-719078721 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestServerBasicOps-719078721-project Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f3b71f050e4349368c371d815d637649 Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestServerBasicOps-719078721-project Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '7aa987f2-aaa9-4683-878e-ae9a18726743'} Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:07.536215 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Returning 404 to user: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b18a05fd-1422-4d93-a79f-43fa508cd45d tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 404 len: 111 microversion: 2.1 time: 0.029309 Jul 01 11:12:07.542135 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3211/6326] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:07 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:12:08.297415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:08.298046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:08.304693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.305157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.305946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.306382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.340814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:08.341957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:08.348605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.352072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.352072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.352072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.364039 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] HTTP exception thrown: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Request method failure captured: Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 HTTP/1.1 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtVMS5JcrnHZV3a26BRzq941Qev0Pk7bgQMteENf0GZsvDaaBr4JekHfhEB8AkPaocRQ2obr5J95RvYqR0fUSIpCa7im9SPWb4cNUi8y0SkltaJDajzPZI3WwPSxRjb8YhtNtrjyoNqN7k3GMyxo-oF_uESUv6Jas3mrkrcJ5NwLZ64 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: bcc8c6d3ac9b4615a54d8c99d19f999c Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestServerBasicOps-719078721 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc8c6d3ac9b4615a54d8c99d19f999c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestServerBasicOps-719078721 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: bcc8c6d3ac9b4615a54d8c99d19f999c Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestServerBasicOps-719078721 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestServerBasicOps-719078721-project Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f3b71f050e4349368c371d815d637649 Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestServerBasicOps-719078721-project Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '7aa987f2-aaa9-4683-878e-ae9a18726743'} Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:12:08.366142 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Returning 404 to user: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-319334fc-ea55-4874-a9b4-66234e7a6c48 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 404 len: 111 microversion: 2.1 time: 0.030956 Jul 01 11:12:08.373029 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3212/6327] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:12:08 2022] DELETE /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:12:08.375836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:08.376443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] [instance: 7aa987f2-aaa9-4683-878e-ae9a18726743] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:08.382970 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.386031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.386031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.386031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.398729 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] HTTP exception thrown: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Request method failure captured: Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 HTTP/1.1 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtVMS5JcrnHZV3a26BRzq941Qev0Pk7bgQMteENf0GZsvDaaBr4JekHfhEB8AkPaocRQ2obr5J95RvYqR0fUSIpCa7im9SPWb4cNUi8y0SkltaJDajzPZI3WwPSxRjb8YhtNtrjyoNqN7k3GMyxo-oF_uESUv6Jas3mrkrcJ5NwLZ64 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: bcc8c6d3ac9b4615a54d8c99d19f999c Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestServerBasicOps-719078721 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc8c6d3ac9b4615a54d8c99d19f999c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc8c6d3ac9b4615a54d8c99d19f999c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestServerBasicOps-719078721 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: bcc8c6d3ac9b4615a54d8c99d19f999c Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestServerBasicOps-719078721 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestServerBasicOps-719078721-project Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f3b71f050e4349368c371d815d637649 Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestServerBasicOps-719078721-project Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '7aa987f2-aaa9-4683-878e-ae9a18726743'} Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:08.400271 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Returning 404 to user: Instance 7aa987f2-aaa9-4683-878e-ae9a18726743 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-658b5ccd-1193-4426-a19c-4408f1bb5b88 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743" status: 404 len: 111 microversion: 2.1 time: 0.029477 Jul 01 11:12:08.404976 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3213/6328] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:08 2022] GET /compute/v2.1/servers/7aa987f2-aaa9-4683-878e-ae9a18726743 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:12:08.445196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:08.453688 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b73dcb92-fb2e-409a-9125-57dbf38051a5 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.160164 Jul 01 11:12:08.457233 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3116/6329] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:08 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:08.505793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:08.505793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:08.512846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.513339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.514114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.514557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.641024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41ad1701-04fc-4e77-b4e9-8365451aed17 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] Calling method '.version_select at 0x7f6f9089c5e0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:08.658105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:08.667353 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5c5de0f3-2f48-413b-a21d-235841d9dc67 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.166142 Jul 01 11:12:08.667934 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3214/6330] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:08 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:08.704942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b35631f3-9fd9-48d6-b0e2-4592d59d7142 req-d2fdd0b0-1bc1-4574-bc14-478986d4ebef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9f6d75-5e3d-488c-a40c-ca20d385c171", "name": "network-vif-plugged", "status": "completed", "tag": "2abecba2-7e98-4979-b039-fe51f84c477f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:08.718762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b35631f3-9fd9-48d6-b0e2-4592d59d7142 req-d2fdd0b0-1bc1-4574-bc14-478986d4ebef service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:08.718762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b35631f3-9fd9-48d6-b0e2-4592d59d7142 req-d2fdd0b0-1bc1-4574-bc14-478986d4ebef service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:08.726117 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b35631f3-9fd9-48d6-b0e2-4592d59d7142 req-d2fdd0b0-1bc1-4574-bc14-478986d4ebef service nova] Creating event network-vif-plugged:2abecba2-7e98-4979-b039-fe51f84c477f for instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 on n-h2-master-1 Jul 01 11:12:08.731403 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b35631f3-9fd9-48d6-b0e2-4592d59d7142 req-d2fdd0b0-1bc1-4574-bc14-478986d4ebef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030365 Jul 01 11:12:08.732000 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3215/6331] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:12:08.750894 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-41ad1701-04fc-4e77-b4e9-8365451aed17 tempest-TestServerBasicOps-719078721 tempest-TestServerBasicOps-719078721-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-482532548" status: 202 len: 0 microversion: 2.1 time: 0.108333 Jul 01 11:12:08.750894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3117/6332] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 11:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-482532548 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 11:12:09.471779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:09.472477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:09.480096 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:09.480543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:09.481372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:09.481887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:09.684968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:09.685659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:09.695841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:09.696046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:09.696495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:09.697303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:09.697743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:09.707426 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9354f312-4aa8-4989-96b8-01f0cefec934 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1374 microversion: 2.1 time: 0.240026 Jul 01 11:12:09.708104 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3216/6333] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:09 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:09.906350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:09.913920 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8bf4554-4958-4686-b0de-614007822da1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.233915 Jul 01 11:12:09.914661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3118/6334] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:09 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:12:10.725718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:10.726621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:10.734391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:10.734948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:10.735825 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:10.736299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:10.755543 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:10.931213 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:10.932666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:10.940538 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:10.941375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:10.942488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:10.942993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:10.962394 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=100 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:10.967942 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:10.978917 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-78ae23b5-6e05-44cd-8175-71cc0be50323 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1547 microversion: 2.1 time: 0.257100 Jul 01 11:12:10.980372 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3217/6335] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:10 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1547 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:10.996087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:10.996087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:11.003278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:11.003731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:11.004506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:11.005138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:11.233742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:11.242107 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-006bd72b-3aeb-410d-91b6-4f1467e7443a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.315027 Jul 01 11:12:11.242878 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3119/6336] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:10 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:12:11.300018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:11.308335 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6a0f2ed2-adc5-49d1-b292-3f60e4651278 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1547 microversion: 2.1 time: 0.316878 Jul 01 11:12:11.308920 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3218/6337] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:10 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1547 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:12:12.258878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:12.260146 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:12.272903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:12.273711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:12.279755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:12.281095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:12.436094 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:12.445768 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-535a5680-7364-419f-82fe-c78a74b58c03 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.191272 Jul 01 11:12:12.446359 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3120/6338] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:12 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:13.462494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:13.463131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:13.470344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:13.480315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:13.480315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:13.480315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:14.001381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9f4fb843-018a-424b-8227-1450a7208653 req-4c487297-fcd6-494b-bbf3-d81144e5f5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9f6d75-5e3d-488c-a40c-ca20d385c171", "tag": "2abecba2-7e98-4979-b039-fe51f84c477f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:14.001930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:14.020634 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fce4ef59-f0dc-4e2d-ae7c-ad8fed55b6d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.551608 Jul 01 11:12:14.020634 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3219/6339] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:13 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:14.020943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9f4fb843-018a-424b-8227-1450a7208653 req-4c487297-fcd6-494b-bbf3-d81144e5f5ce service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:14.020943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9f4fb843-018a-424b-8227-1450a7208653 req-4c487297-fcd6-494b-bbf3-d81144e5f5ce service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:14.025970 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9f4fb843-018a-424b-8227-1450a7208653 req-4c487297-fcd6-494b-bbf3-d81144e5f5ce service nova] Creating event network-changed:2abecba2-7e98-4979-b039-fe51f84c477f for instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 on n-h2-master-1 Jul 01 11:12:14.031634 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9f4fb843-018a-424b-8227-1450a7208653 req-4c487297-fcd6-494b-bbf3-d81144e5f5ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033886 Jul 01 11:12:14.035710 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3121/6340] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:12:14.761534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3643988c-2099-4fa8-bec3-a7d672954b14 req-f1254c80-2152-4280-a0bc-0ed7a4a089a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42836a8-bcef-4590-aac0-cbf3155c66bf", "name": "network-vif-plugged", "status": "completed", "tag": "55bfb581-d95a-48a2-8d62-bfe988b0d2ca"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:14.771751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3643988c-2099-4fa8-bec3-a7d672954b14 req-f1254c80-2152-4280-a0bc-0ed7a4a089a2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:14.773646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3643988c-2099-4fa8-bec3-a7d672954b14 req-f1254c80-2152-4280-a0bc-0ed7a4a089a2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:14.783573 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3643988c-2099-4fa8-bec3-a7d672954b14 req-f1254c80-2152-4280-a0bc-0ed7a4a089a2 service nova] Creating event network-vif-plugged:55bfb581-d95a-48a2-8d62-bfe988b0d2ca for instance b42836a8-bcef-4590-aac0-cbf3155c66bf on n-h2-master-1 Jul 01 11:12:14.789830 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3643988c-2099-4fa8-bec3-a7d672954b14 req-f1254c80-2152-4280-a0bc-0ed7a4a089a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034977 Jul 01 11:12:14.790551 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3220/6341] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:12:15.030289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:15.030995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:15.040203 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:15.041188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:15.043309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:15.043702 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:15.317402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:15.325714 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74128c4e-743a-49dc-b8e7-621f4f7cb2dd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1216 microversion: 2.1 time: 0.300048 Jul 01 11:12:15.326399 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3122/6342] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:15 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1216 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:16.345052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:16.350930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:16.353583 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:16.354180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:16.354881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:16.355382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:16.500317 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:16.506983 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-173df846-1d11-4f14-a50d-fe3f36e9f0be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1403 microversion: 2.1 time: 0.167239 Jul 01 11:12:16.507567 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3221/6343] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:16 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1403 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:16.529261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:16.529261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:16.531168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:16.531626 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:16.532405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:16.532850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:16.741996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:16.752885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58f5cb63-e62a-4678-b336-1a13328c4f4e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1403 microversion: 2.1 time: 0.232687 Jul 01 11:12:16.753077 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3123/6344] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:16 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1403 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:16.769084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-838921436"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:16.770294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:16.776894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:16.778033 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:16.779247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:16.779967 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:16.876839 n-d-master-1 devstack@n-api.service[119764]: INFO nova.compute.api [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Attempting to quiesce instance before volume snapshot. Jul 01 11:12:16.947345 n-d-master-1 devstack@n-api.service[119764]: INFO nova.compute.api [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 01 11:12:17.151364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Creating snapshot from volume 597000ae-8c64-43ab-bc05-5e22b35be242. {{(pid=119764) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 01 11:12:18.841919 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3c7ec6c2-5395-47cc-83fd-e7a649a98ed0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf/action" status: 202 len: 0 microversion: 2.1 time: 2.076645 Jul 01 11:12:18.842787 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3222/6345] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:12:16 2022] POST /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf/action => generated 0 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 11:12:20.052105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1647948407", "imageRef": "eafab537-a53c-480c-8a07-ec7b099e2418", "flavorRef": "452", "networks": [{"uuid": "fc85cd4f-4041-4340-a016-821f51d0f621"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:20.109507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] validate_networks() for [('fc85cd4f-4041-4340-a016-821f51d0f621', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:12:20.480433 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:12:20.480854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:12:20.481359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:12:20.486277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:12:20.486277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:12:20.492193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:20.492638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:20.493463 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:20.493892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:20.510842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:12:20.516018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:12:20.528635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:12:20.531128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='411d378e-a27d-4d5a-9b97-8de451ad7de7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:12:20.677679 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5383562b-6e1e-4412-a0c5-a303cd4416be tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629694 Jul 01 11:12:20.678329 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3124/6346] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:12:20.689683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-08e8e4ca-6a9b-4792-b376-fb411e46d90a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:20.690397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-08e8e4ca-6a9b-4792-b376-fb411e46d90a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:20.746395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-08e8e4ca-6a9b-4792-b376-fb411e46d90a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:20.753246 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-08e8e4ca-6a9b-4792-b376-fb411e46d90a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1230 microversion: 2.1 time: 0.068805 Jul 01 11:12:20.753821 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3223/6347] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:20 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1230 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:21.771602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:21.772362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:21.778549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:21.778997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:21.779760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:21.780226 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:21.843753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:21.852384 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1d06f41c-9e9e-44c8-b3e2-982cf3da347c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1234 microversion: 2.1 time: 0.085523 Jul 01 11:12:21.853219 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3125/6348] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:21 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1234 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:22.868539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:22.869191 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:22.877175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:22.877654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:22.878449 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:22.878900 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:22.946733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:22.956834 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cec250a1-2ffc-4d2d-b6fa-9e99109ede11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1300 microversion: 2.1 time: 0.092080 Jul 01 11:12:22.961299 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3224/6349] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:22 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:23.975628 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:23.976834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:23.984047 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:23.984711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:23.985525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:23.985955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:24.151542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:24.160636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1cc636c4-ba06-477e-aad2-6dc1b8bfb761 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.189609 Jul 01 11:12:24.161591 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3126/6350] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:23 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:24.344190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1f7482fb-6023-46aa-91a8-5ec545757270 req-b4b219f8-d21b-4dff-92f4-a9083d11c575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4460e792-e627-4a2b-b331-fdc3e2a61f49", "tag": "fbde870d-37f5-4439-b679-343bc24cf781"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:24.356362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1f7482fb-6023-46aa-91a8-5ec545757270 req-b4b219f8-d21b-4dff-92f4-a9083d11c575 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:24.356928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1f7482fb-6023-46aa-91a8-5ec545757270 req-b4b219f8-d21b-4dff-92f4-a9083d11c575 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:24.373365 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1f7482fb-6023-46aa-91a8-5ec545757270 req-b4b219f8-d21b-4dff-92f4-a9083d11c575 service nova] Creating event network-changed:fbde870d-37f5-4439-b679-343bc24cf781 for instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 on n-h1-master-1 Jul 01 11:12:24.378947 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1f7482fb-6023-46aa-91a8-5ec545757270 req-b4b219f8-d21b-4dff-92f4-a9083d11c575 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041241 Jul 01 11:12:24.379688 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3225/6351] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:12:25.178510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:25.179149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:25.186541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:25.187309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:25.188372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:25.188814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:25.330090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:25.338111 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a10dd532-5e0a-46db-ae69-f878f026219b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.164311 Jul 01 11:12:25.338685 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3127/6352] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:25 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:26.356765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:26.357508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:26.359486 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:26.365139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:26.365622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:26.366401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:26.366849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:26.507310 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:26.515386 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6be1b83-81b6-437c-8301-edde13ba30b9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.163737 Jul 01 11:12:26.516878 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3226/6353] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:26 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:27.532881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:27.533621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:27.537048 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:27.542114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:27.542608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:27.543370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:27.543805 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:27.690220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:27.699714 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c81ee65-42d9-4e10-aa1b-bb1bd2e4a3b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.170696 Jul 01 11:12:27.700345 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3128/6354] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:27 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:28.719567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:28.720192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:28.727665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:28.728129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:28.728921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:28.729380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:28.874621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:28.882822 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6ce2a7c-1042-4d65-a8a3-28c6aae51689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.168849 Jul 01 11:12:28.883395 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3227/6355] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:28 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:29.902112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:29.902736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:29.909765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:29.910232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:29.910973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:29.911929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:30.050364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:30.058594 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4b66eeac-62ff-4451-b8e3-023216fa4192 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.160383 Jul 01 11:12:30.059408 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3129/6356] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:29 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:31.076085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:31.076714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:31.079452 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:31.084656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:31.085122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:31.085947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:31.086380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:31.227584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:31.235566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6af838f5-810c-401e-b632-11cad358d1b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.163422 Jul 01 11:12:31.236133 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3228/6357] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:31 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:32.254732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:32.255854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:32.257733 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:32.258497 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:32.264171 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:32.264660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:32.265438 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:32.265871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:32.416276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:32.424438 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a8cb1665-89c2-4875-9001-bd36dd1c897b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.174147 Jul 01 11:12:32.425094 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3130/6358] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:32 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:33.443346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:33.444015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:33.451301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:33.452507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:33.453342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:33.453791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:33.603961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:33.611606 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bfc2e084-3005-4e4d-9490-daff622ec976 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.173120 Jul 01 11:12:33.613010 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3229/6359] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:33 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:34.631602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:34.632297 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:34.638528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:34.638978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:34.639755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:34.640204 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:34.783100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:34.791972 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b1055ed3-ee7b-44d5-8fe8-12ef8e9d66c1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.165478 Jul 01 11:12:34.792795 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3131/6360] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:34 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:35.809860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:35.810490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:35.819376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:35.819839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:35.820618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:35.821069 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:35.966087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:35.974333 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4889d3ab-28fd-4ad6-8120-9a53f46d4505 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.168355 Jul 01 11:12:35.974924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3230/6361] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:35 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:36.373766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8494c736-fbee-454a-ac80-e1fe5d5e4b47 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:36.374654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8494c736-fbee-454a-ac80-e1fe5d5e4b47 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:36.381737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8494c736-fbee-454a-ac80-e1fe5d5e4b47 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:36.382190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8494c736-fbee-454a-ac80-e1fe5d5e4b47 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:36.382948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8494c736-fbee-454a-ac80-e1fe5d5e4b47 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:36.383434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8494c736-fbee-454a-ac80-e1fe5d5e4b47 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:36.442495 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8494c736-fbee-454a-ac80-e1fe5d5e4b47 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171/action" status: 200 len: 24570 microversion: 2.1 time: 0.072627 Jul 01 11:12:36.443241 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3132/6362] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:12:36 2022] POST /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:12:36.995272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:36.995904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:37.003902 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:37.004711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:37.005985 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:37.006660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:37.149013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:37.158546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b814b8c5-1593-4e74-9829-887786d32bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.167708 Jul 01 11:12:37.159118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3231/6363] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:36 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:38.177165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:38.177960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:38.185882 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:38.186369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:38.187143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:38.187585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:38.332210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:38.339706 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aae3004c-c209-473b-8b2b-408644d0ca34 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.166973 Jul 01 11:12:38.340266 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3133/6364] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:38 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:39.357503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:39.358126 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:39.365403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:39.365863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:39.366636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:39.367081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:39.514047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:39.521951 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-edf3a06c-e6be-4c3d-8ff7-4ea1ffbb7927 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.168476 Jul 01 11:12:39.522909 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3232/6365] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:39 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:40.540102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:40.540766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:40.547645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:40.548094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:40.548852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:40.549334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:40.688323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:40.696757 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9755f4de-d13a-4ce6-97e8-d9429fdd47ae tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.160854 Jul 01 11:12:40.697409 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3134/6366] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:40 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:41.714807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:41.715435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:41.722914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:41.723370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:41.727775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:41.727775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:41.729404 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:41.863173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:41.871054 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5d036e0-720b-43d7-b7e9-998d79bffbe2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.161553 Jul 01 11:12:41.879032 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3233/6367] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:41 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:42.889800 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:42.890372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:42.899359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:42.899813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:42.900580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:42.901016 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:42.903796 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=83 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:43.055818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:43.064141 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73f782f1-a1ef-4077-91cc-0920f3a574ec tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.178272 Jul 01 11:12:43.066392 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3135/6368] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:42 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:44.082849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:44.083481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:44.091805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:44.092386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:44.093287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:44.093840 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:44.224580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:44.232083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79812b82-a0b6-49e9-b18b-36b9fe96383b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.153305 Jul 01 11:12:44.232649 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3234/6369] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:44 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:45.249038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:45.249696 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:45.256753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:45.257233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:45.258008 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:45.258442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:45.389334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:45.396787 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9689106-a233-4b2a-bec2-c349c3fb897a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.152187 Jul 01 11:12:45.397398 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3136/6370] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:45 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:46.413740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:46.414364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:46.422053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:46.422515 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:46.423300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:46.423761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:46.564627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:46.572555 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8a814dab-9840-4562-92f0-e3d197471aaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.162703 Jul 01 11:12:46.573131 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3235/6371] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:46 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:47.446691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3eb63861-b644-42dc-ae30-491ca7e48d09 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:47.447629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3eb63861-b644-42dc-ae30-491ca7e48d09 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:47.454174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3eb63861-b644-42dc-ae30-491ca7e48d09 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:47.454622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3eb63861-b644-42dc-ae30-491ca7e48d09 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:47.455382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3eb63861-b644-42dc-ae30-491ca7e48d09 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:47.455814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3eb63861-b644-42dc-ae30-491ca7e48d09 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:47.512457 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3eb63861-b644-42dc-ae30-491ca7e48d09 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "POST /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171/action" status: 200 len: 32645 microversion: 2.1 time: 0.069679 Jul 01 11:12:47.513404 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3137/6372] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:12:47 2022] POST /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171/action => generated 32645 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:12:47.589440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:47.590659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:47.597721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:47.603628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:47.603628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:47.603628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:47.734529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:47.742151 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-147712ca-0ddb-422f-bb7e-e4a05fd19734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.156570 Jul 01 11:12:47.742728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3236/6373] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:47 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:48.760054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:48.760879 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:48.768534 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:48.768904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:48.769966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:48.770389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:48.996149 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:49.004896 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73a84797-b8e2-4843-a536-2afe7a079035 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.249095 Jul 01 11:12:49.006554 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3138/6374] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:48 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:49.053565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:49.054120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:49.061562 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:49.063764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:49.063764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:49.064019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:49.064379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3c2eca01-55d1-409e-a624-6483e77c5d21 req-3e435c46-38b4-4699-94c6-28298c169057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9f6d75-5e3d-488c-a40c-ca20d385c171", "tag": "2abecba2-7e98-4979-b039-fe51f84c477f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:49.073177 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3c2eca01-55d1-409e-a624-6483e77c5d21 req-3e435c46-38b4-4699-94c6-28298c169057 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:49.073614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3c2eca01-55d1-409e-a624-6483e77c5d21 req-3e435c46-38b4-4699-94c6-28298c169057 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:49.085990 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3c2eca01-55d1-409e-a624-6483e77c5d21 req-3e435c46-38b4-4699-94c6-28298c169057 service nova] Creating event network-changed:2abecba2-7e98-4979-b039-fe51f84c477f for instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 on n-h2-master-1 Jul 01 11:12:49.092364 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3c2eca01-55d1-409e-a624-6483e77c5d21 req-3e435c46-38b4-4699-94c6-28298c169057 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Jul 01 11:12:49.093032 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:12:49.093855 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3139/6375] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:12:49.584048 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e0fc4fd-1df5-4db2-9137-e840a470dcf2 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 204 len: 0 microversion: 2.1 time: 0.534176 Jul 01 11:12:49.585097 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3237/6376] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:12:49 2022] DELETE /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:12:49.595483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:49.596195 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:49.602779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:49.603229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:49.604198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:49.604863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:49.750257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:49.758480 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-37c7873c-77c1-444e-a911-8446ee31534c tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1671 microversion: 2.1 time: 0.169043 Jul 01 11:12:49.759077 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3140/6377] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:49 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:50.023318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:50.024164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:50.031547 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:50.032198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:50.033067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:50.033648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:50.181851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:50.190134 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5b299ab-ff03-4f93-ab21-1754b944a990 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.171263 Jul 01 11:12:50.190704 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3238/6378] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:50 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:50.775877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:50.776514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:50.783345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:50.789380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:50.789380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:50.789380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:50.926500 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:50.934658 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d13fef0-cf49-46eb-91ba-081748c04d51 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1553 microversion: 2.1 time: 0.162727 Jul 01 11:12:50.935456 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3141/6379] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:50 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:51.207968 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:51.208591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:51.217012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:51.217527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:51.218308 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:51.218750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:51.371442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:51.379084 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a94e6c58-6db7-42f0-8811-bad6f26a78b7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.175182 Jul 01 11:12:51.379660 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3239/6380] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:51 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:51.553440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-929063ad-657c-43c6-8c55-1f8fc0a4215d req-f108e39d-e30f-4925-95c2-2c827535d259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9f6d75-5e3d-488c-a40c-ca20d385c171", "name": "network-vif-deleted", "tag": "2abecba2-7e98-4979-b039-fe51f84c477f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:12:51.561890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-929063ad-657c-43c6-8c55-1f8fc0a4215d req-f108e39d-e30f-4925-95c2-2c827535d259 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:51.562387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-929063ad-657c-43c6-8c55-1f8fc0a4215d req-f108e39d-e30f-4925-95c2-2c827535d259 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:51.574485 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-929063ad-657c-43c6-8c55-1f8fc0a4215d req-f108e39d-e30f-4925-95c2-2c827535d259 service nova] Creating event network-vif-deleted:2abecba2-7e98-4979-b039-fe51f84c477f for instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 on n-h2-master-1 Jul 01 11:12:51.579608 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-929063ad-657c-43c6-8c55-1f8fc0a4215d req-f108e39d-e30f-4925-95c2-2c827535d259 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029934 Jul 01 11:12:51.580974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3142/6381] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:12:51.953438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:51.960385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:51.960614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:51.961078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:51.961958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:51.962401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:51.997969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:51.998428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:51.998888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lazy-loading 'fault' on Instance uuid ac9f6d75-5e3d-488c-a40c-ca20d385c171 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:12:52.040011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2bf9076469441cb8e8a8dca825f1833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175cf3cee50e4dc7b3b9b0f169ea2093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:52.048312 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0294f37e-6de1-43e4-abbc-edcae44db517 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 200 len: 1339 microversion: 2.1 time: 0.099666 Jul 01 11:12:52.048825 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3240/6382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:51 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:52.397878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:52.398504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:52.406297 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:52.406746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:52.407507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:52.407941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:52.539072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:52.546804 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d80c8c08-ca53-44e4-a13f-33f0327a6b43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.153225 Jul 01 11:12:52.547404 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3143/6383] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:52 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:12:53.066920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:53.067613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] [instance: ac9f6d75-5e3d-488c-a40c-ca20d385c171] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:53.074668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:53.075123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:53.075890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:53.076330 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:53.090467 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] HTTP exception thrown: Instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 could not be found. Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Request method failure captured: Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 HTTP/1.1 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtXsAQ1Io9g-fujlQ1kBzAqPJKZ3HLqw2SnDrWpTH2oCzAi-xXdjPeNt3DNCuC7JRzcy0Bahuymy2ssNxb31vP_q43OZyfz5OmHCXZg76rDwq-m-BoebARkP_8zPq0tbIOfDnoluk-ANffD9TVNQTpsdSwlHHaMZzGbFzNDaZudjdUw Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 175cf3cee50e4dc7b3b9b0f169ea2093 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkBasicOps-712821535 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_175cf3cee50e4dc7b3b9b0f169ea2093", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/175cf3cee50e4dc7b3b9b0f169ea2093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkBasicOps-712821535 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 175cf3cee50e4dc7b3b9b0f169ea2093 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkBasicOps-712821535 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkBasicOps-712821535-project Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: f2bf9076469441cb8e8a8dca825f1833 Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkBasicOps-712821535-project Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: exception: Instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 could not be found. Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'ac9f6d75-5e3d-488c-a40c-ca20d385c171'} Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 could not be found. Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 could not be found. Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:12:53.092109 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 could not be found. Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Returning 404 to user: Instance ac9f6d75-5e3d-488c-a40c-ca20d385c171 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01112e7c-9874-4de2-8226-f4946abbba08 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171" status: 404 len: 111 microversion: 2.1 time: 0.031358 Jul 01 11:12:53.098052 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3241/6384] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:53 2022] GET /compute/v2.1/servers/ac9f6d75-5e3d-488c-a40c-ca20d385c171 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:12:53.330332 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5db0415e-aeac-481d-8324-f2d9d22b4fe7 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] Calling method '.version_select at 0x7f6f9127bee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:53.425168 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5db0415e-aeac-481d-8324-f2d9d22b4fe7 tempest-TestNetworkBasicOps-712821535 tempest-TestNetworkBasicOps-712821535-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2094273045" status: 202 len: 0 microversion: 2.1 time: 0.098724 Jul 01 11:12:53.425909 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3144/6385] 10.222.0.23 () {58 vars in 1256 bytes} [Fri Jul 1 11:12:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2094273045 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:12:53.564302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:53.564933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:53.571546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:53.571955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:53.572756 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:53.573255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:53.712145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:53.720443 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ed35f38d-8a56-4f8c-8619-71e1cd42ce1a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.160323 Jul 01 11:12:53.723858 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3242/6386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:53 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:54.738483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:54.739804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:54.748164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:54.748710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:54.749647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:54.750138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:54.934544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:54.942846 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6dbaba76-ba77-4762-a023-b2c6dd893317 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.208837 Jul 01 11:12:54.943557 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3145/6387] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:54 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:55.960717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:55.962033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:55.970955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:55.971656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:55.972774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:55.974354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:56.180353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:56.190367 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a509f695-fcd2-439f-be91-4307d28e2235 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.233955 Jul 01 11:12:56.200097 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3243/6388] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:55 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:57.209284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:57.210915 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:57.225332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:57.240255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:57.240255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:57.240255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:57.374706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:57.383297 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74cb4cb9-bd8e-4f53-be96-ff93b57fd574 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.179312 Jul 01 11:12:57.384006 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3146/6389] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:57 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:58.401385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:58.402813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:58.405955 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:58.411325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:58.411789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:58.412802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:58.413347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:58.553679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:58.561824 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-813bf0ce-74c4-41bf-b94b-a96087ace632 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.164766 Jul 01 11:12:58.562386 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3244/6390] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:58 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:12:59.579365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:12:59.579963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:12:59.583544 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:12:59.588549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:59.589073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:59.589870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:12:59.590809 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:12:59.744844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:12:59.753583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1859bfe2-7d9a-42c6-9a98-986ec9ac262a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.178703 Jul 01 11:12:59.754241 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3147/6391] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:12:59 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:00.771657 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:00.772491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:00.780657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:00.781225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:00.782078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:00.782630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:00.924977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:00.933942 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c814c0e-46fd-42b3-b48d-4ba86b135bcd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.166942 Jul 01 11:13:00.934660 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3245/6392] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:00 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:01.953375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:01.954752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:01.964435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:01.965077 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:01.966169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:01.966979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:02.174443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:02.186177 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea052743-904f-40b8-937c-e823764ca16e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1342 microversion: 2.1 time: 0.237839 Jul 01 11:13:02.196114 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3148/6393] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:01 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1342 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:03.204647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:03.205313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:03.213236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:03.217202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:03.217202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:03.217202 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:03.529371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:03.539729 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0cb4c98e-0879-4ff1-ba7c-d4ff1d0c5534 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1388 microversion: 2.1 time: 0.338968 Jul 01 11:13:03.551117 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3246/6394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:03 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1388 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:04.558835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:04.560132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:04.567701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:04.568144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:04.569188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:04.569783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:04.806311 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:04.814258 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-708292f6-4427-406b-aa20-14bd1e8506c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.259321 Jul 01 11:13:04.814771 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3149/6395] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:04 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:05.832797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:05.835650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:05.843405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:05.849356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:05.849356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:05.849356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:06.090159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:06.110953 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-858aa193-a573-473d-9a0f-fa9dd0e4ab84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.280991 Jul 01 11:13:06.110953 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3247/6396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:05 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:07.127559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:07.128309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:07.136277 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:07.136811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:07.137688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:07.138194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:07.282725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:07.290660 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3302ab7-df04-4395-982d-2d4634561b26 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.167593 Jul 01 11:13:07.291448 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3150/6397] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:07 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:08.307921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:08.308584 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:08.315814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:08.316285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:08.317086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:08.317590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:08.332684 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:08.476004 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:08.484846 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d241502a-4477-4cb0-98df-2364e1e89d35 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.180892 Jul 01 11:13:08.486604 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3248/6398] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:08 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:09.504031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:09.504668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:09.513852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:09.516232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:09.517324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:09.518002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:09.734093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:09.734093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14ee109c-0995-4e5c-be8f-3f965f3504e7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.223278 Jul 01 11:13:09.734093 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3151/6399] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:09 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:10.740666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:10.744358 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:10.749928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:10.750572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:10.751485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:10.752087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:10.931912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:10.941187 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9568d49c-d388-491a-9d73-d87fdb9e4d66 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.204838 Jul 01 11:13:10.944228 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3249/6400] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:10 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:11.964810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:11.965575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:11.978037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:11.978776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:11.980628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:11.981452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:12.516234 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:12.527160 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-172f1be4-2569-4fd8-b970-bbdf759be105 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.565770 Jul 01 11:13:12.528248 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3152/6401] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:11 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:13.170566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-de0506f4-ecce-44b5-ae7c-d65d1072825f req-e0455e9c-404a-479b-8f52-79e6bdaed715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4460e792-e627-4a2b-b331-fdc3e2a61f49", "name": "network-vif-plugged", "status": "completed", "tag": "fbde870d-37f5-4439-b679-343bc24cf781"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:13.186155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-de0506f4-ecce-44b5-ae7c-d65d1072825f req-e0455e9c-404a-479b-8f52-79e6bdaed715 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:13.186613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-de0506f4-ecce-44b5-ae7c-d65d1072825f req-e0455e9c-404a-479b-8f52-79e6bdaed715 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:13.208282 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-de0506f4-ecce-44b5-ae7c-d65d1072825f req-e0455e9c-404a-479b-8f52-79e6bdaed715 service nova] Creating event network-vif-plugged:fbde870d-37f5-4439-b679-343bc24cf781 for instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 on n-h1-master-1 Jul 01 11:13:13.210921 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-de0506f4-ecce-44b5-ae7c-d65d1072825f req-e0455e9c-404a-479b-8f52-79e6bdaed715 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043772 Jul 01 11:13:13.211546 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3250/6402] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:13.544848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:13.545598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:13.563861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:13.564903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:13.566419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:13.567033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:13.573066 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=92 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:13.781248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:13.789415 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d0a98624-b13e-4da2-a852-5c12b97b4721 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1376 microversion: 2.1 time: 0.249196 Jul 01 11:13:13.789999 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3153/6403] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:13 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1376 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:14.145732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f0e71918-b38c-4ac9-bec6-2f38d47d3595 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:14.146576 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:13:14.146576 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:13:14.147724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0e71918-b38c-4ac9-bec6-2f38d47d3595 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:14.148198 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0e71918-b38c-4ac9-bec6-2f38d47d3595 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:14.149027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0e71918-b38c-4ac9-bec6-2f38d47d3595 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:14.149508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f0e71918-b38c-4ac9-bec6-2f38d47d3595 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:14.173265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f0e71918-b38c-4ac9-bec6-2f38d47d3595 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.151531 Jul 01 11:13:14.173894 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3251/6404] 10.222.0.23 () {58 vars in 1184 bytes} [Fri Jul 1 11:13:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:14.287052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-837434245", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "621bcd20-b40f-410d-ab58-31cc6d823146"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:14.355417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] validate_networks() for [('621bcd20-b40f-410d-ab58-31cc6d823146', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:13:14.759179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:13:14.759794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:13:14.760067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:13:14.760629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:13:14.761043 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:13:14.770126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:14.770579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:14.771442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:14.771848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:14.789484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Getting quotas for project 5e951b9694ee46258bb72509a66e9dba. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:13:14.795597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Getting quotas for user dfbc13f2e67e48708d2797715213dd07 and project 5e951b9694ee46258bb72509a66e9dba. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:13:14.808476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:14.809273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:13:14.809487 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:14.811576 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:13:14.817299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:14.818450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:14.819491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:14.820023 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:14.915916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-354d0a5f-5101-4eb3-841e-d5ff0043b773 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632719 Jul 01 11:13:14.922133 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3154/6405] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:13:14.928052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39462eb4-45a6-4f55-9b41-3889a06a02ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:14.928892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39462eb4-45a6-4f55-9b41-3889a06a02ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:15.004018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:15.012826 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c9c1ca72-d1df-4b74-b180-ed5b1d8af303 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1564 microversion: 2.1 time: 0.209460 Jul 01 11:13:15.013607 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39462eb4-45a6-4f55-9b41-3889a06a02ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1328 microversion: 2.1 time: 0.089520 Jul 01 11:13:15.018014 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3155/6406] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:14 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:15.023132 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3252/6407] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:14 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1564 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:15.031790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:15.032419 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:15.039222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:15.039687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:15.040475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:15.040925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:15.181167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:15.190291 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba3dc577-56e4-4924-96d4-3ae5a3aa3bfb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1564 microversion: 2.1 time: 0.163367 Jul 01 11:13:15.190925 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3156/6408] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:15 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:15.266308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:15.273374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:15.273374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:15.274057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:15.274385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:15.274838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:15.301139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:13:15.684244 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a30d31b-d60d-4d51-a0d6-02eefbde03bc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 204 len: 0 microversion: 2.1 time: 0.420223 Jul 01 11:13:15.687330 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3253/6409] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:13:15 2022] DELETE /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:13:15.695524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:15.696357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:15.703727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:15.704176 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:15.704952 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:15.705410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:15.910611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:15.921020 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-327eb38d-72d7-4e6b-8433-8b97d58d18e2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1570 microversion: 2.1 time: 0.231154 Jul 01 11:13:15.922080 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3157/6410] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:15 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:16.035347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c47b57ca-88c5-43b7-9175-77c4196faf8f tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:16.036251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c47b57ca-88c5-43b7-9175-77c4196faf8f tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:16.101578 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c47b57ca-88c5-43b7-9175-77c4196faf8f tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1328 microversion: 2.1 time: 0.070359 Jul 01 11:13:16.102188 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3254/6411] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:16 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1328 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:16.940503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:16.941672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:16.949897 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:16.950350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:16.951124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:16.951991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:17.102624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:17.111443 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-816d357b-d0f2-4e2e-8de0-a1654c0201fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1570 microversion: 2.1 time: 0.175489 Jul 01 11:13:17.112889 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3158/6412] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:16 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:17.118709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eac821f5-942e-44d2-a8e0-9c7f92fc7422 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:17.119345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eac821f5-942e-44d2-a8e0-9c7f92fc7422 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:17.127608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eac821f5-942e-44d2-a8e0-9c7f92fc7422 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:17.128365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eac821f5-942e-44d2-a8e0-9c7f92fc7422 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:17.129197 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eac821f5-942e-44d2-a8e0-9c7f92fc7422 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:17.129653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eac821f5-942e-44d2-a8e0-9c7f92fc7422 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:17.207178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eac821f5-942e-44d2-a8e0-9c7f92fc7422 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1415 microversion: 2.1 time: 0.092204 Jul 01 11:13:17.207758 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3255/6413] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:17 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1415 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:17.917523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5cafd311-4c27-44e8-bd43-313e192baee4 req-40ec5690-5dc1-4e3b-a95b-9ed8f82440a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4460e792-e627-4a2b-b331-fdc3e2a61f49", "name": "network-vif-deleted", "tag": "fbde870d-37f5-4439-b679-343bc24cf781"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:17.938571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5cafd311-4c27-44e8-bd43-313e192baee4 req-40ec5690-5dc1-4e3b-a95b-9ed8f82440a9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:17.942571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5cafd311-4c27-44e8-bd43-313e192baee4 req-40ec5690-5dc1-4e3b-a95b-9ed8f82440a9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:17.970116 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5cafd311-4c27-44e8-bd43-313e192baee4 req-40ec5690-5dc1-4e3b-a95b-9ed8f82440a9 service nova] Creating event network-vif-deleted:fbde870d-37f5-4439-b679-343bc24cf781 for instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 on n-h1-master-1 Jul 01 11:13:17.976260 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5cafd311-4c27-44e8-bd43-313e192baee4 req-40ec5690-5dc1-4e3b-a95b-9ed8f82440a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068391 Jul 01 11:13:17.977930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3159/6414] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:18.128445 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:18.130079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:18.137694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:18.138082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:18.138862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:18.139526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:18.226533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:18.227055 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-29d17860-888f-47fc-8240-cf709624a2a1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:18.227977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29d17860-888f-47fc-8240-cf709624a2a1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:18.237002 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29d17860-888f-47fc-8240-cf709624a2a1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:18.237492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29d17860-888f-47fc-8240-cf709624a2a1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:18.238175 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9422d384-c691-4c3f-b13d-c861e2e5d734 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1528 microversion: 2.1 time: 0.113950 Jul 01 11:13:18.238319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29d17860-888f-47fc-8240-cf709624a2a1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:18.238705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29d17860-888f-47fc-8240-cf709624a2a1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:18.239238 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3256/6415] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:18 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1528 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:18.318868 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-29d17860-888f-47fc-8240-cf709624a2a1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1421 microversion: 2.1 time: 0.096188 Jul 01 11:13:18.319536 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3160/6416] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:18 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:19.256673 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:19.262895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:19.270311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:19.271328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:19.272786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:19.273490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:19.336805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de868393-f55d-47e6-86a2-19898c572e4e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:19.344421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de868393-f55d-47e6-86a2-19898c572e4e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:19.345048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:19.350869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de868393-f55d-47e6-86a2-19898c572e4e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:19.351570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de868393-f55d-47e6-86a2-19898c572e4e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:19.352093 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5480a791-7f32-46aa-a8dd-48c54ce2e60f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1361 microversion: 2.1 time: 0.100549 Jul 01 11:13:19.352512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de868393-f55d-47e6-86a2-19898c572e4e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:19.352847 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3257/6417] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:19 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1361 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:19.353378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de868393-f55d-47e6-86a2-19898c572e4e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:19.536124 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de868393-f55d-47e6-86a2-19898c572e4e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1463 microversion: 2.1 time: 0.203685 Jul 01 11:13:19.540035 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3161/6418] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:19 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1463 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:13:19.997272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1f437c70-4e48-4c1c-a9b0-ca4ec0de4d60 req-577ebafb-868a-4f3c-a6f5-7ec77f10d2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3791894-bffd-496c-8e57-73e623efa0e9", "tag": "7e0de721-cf0b-4301-82a6-88cce8a9f7ef"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:20.012728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1f437c70-4e48-4c1c-a9b0-ca4ec0de4d60 req-577ebafb-868a-4f3c-a6f5-7ec77f10d2bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:20.013386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1f437c70-4e48-4c1c-a9b0-ca4ec0de4d60 req-577ebafb-868a-4f3c-a6f5-7ec77f10d2bf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:20.027110 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1f437c70-4e48-4c1c-a9b0-ca4ec0de4d60 req-577ebafb-868a-4f3c-a6f5-7ec77f10d2bf service nova] Creating event network-changed:7e0de721-cf0b-4301-82a6-88cce8a9f7ef for instance c3791894-bffd-496c-8e57-73e623efa0e9 on n-h2-master-1 Jul 01 11:13:20.032301 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1f437c70-4e48-4c1c-a9b0-ca4ec0de4d60 req-577ebafb-868a-4f3c-a6f5-7ec77f10d2bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038864 Jul 01 11:13:20.033028 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3258/6419] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:20.371511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:20.372131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:20.379462 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:20.379924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:20.380701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:20.381152 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:20.445180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:20.453962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8858332a-a217-4ff6-ab91-e42d2b008ab3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1361 microversion: 2.1 time: 0.087049 Jul 01 11:13:20.455030 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3162/6420] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:20 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:20.554140 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc964538-e060-4e96-8bc7-3b5cd9c2dbf7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:20.554878 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc964538-e060-4e96-8bc7-3b5cd9c2dbf7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:20.563174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc964538-e060-4e96-8bc7-3b5cd9c2dbf7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:20.563841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc964538-e060-4e96-8bc7-3b5cd9c2dbf7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:20.564640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc964538-e060-4e96-8bc7-3b5cd9c2dbf7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:20.565090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc964538-e060-4e96-8bc7-3b5cd9c2dbf7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:20.702313 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc964538-e060-4e96-8bc7-3b5cd9c2dbf7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1463 microversion: 2.1 time: 0.152139 Jul 01 11:13:20.702914 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3259/6421] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:20 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:21.478963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:21.479633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:21.489426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:21.489873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:21.490657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:21.491668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:21.567804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:21.576980 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0cdf010d-978e-4c5a-a012-5a1bef72f941 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1361 microversion: 2.1 time: 0.110020 Jul 01 11:13:21.577719 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3163/6422] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:21 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1361 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:21.719853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f77c0d9e-0335-4fa0-aa1c-c81192baecb5 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:21.720478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f77c0d9e-0335-4fa0-aa1c-c81192baecb5 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:21.727716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f77c0d9e-0335-4fa0-aa1c-c81192baecb5 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:21.728185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f77c0d9e-0335-4fa0-aa1c-c81192baecb5 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:21.728982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f77c0d9e-0335-4fa0-aa1c-c81192baecb5 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:21.729458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f77c0d9e-0335-4fa0-aa1c-c81192baecb5 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:21.858699 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f77c0d9e-0335-4fa0-aa1c-c81192baecb5 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1463 microversion: 2.1 time: 0.143087 Jul 01 11:13:21.859338 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3260/6423] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:21 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:22.594406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:22.595051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:22.602163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:22.602655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:22.603403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:22.603837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:22.669944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:22.675189 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c19c9532-2db3-40ec-ba38-f0914b50ec59 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 200 len: 1361 microversion: 2.1 time: 0.084665 Jul 01 11:13:22.675762 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3164/6424] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:22 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 1361 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:22.876114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4292ea7b-3d03-4b21-8e81-a386c9862192 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:22.876796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4292ea7b-3d03-4b21-8e81-a386c9862192 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:22.883979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4292ea7b-3d03-4b21-8e81-a386c9862192 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:22.884496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4292ea7b-3d03-4b21-8e81-a386c9862192 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:22.885705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4292ea7b-3d03-4b21-8e81-a386c9862192 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:22.886478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4292ea7b-3d03-4b21-8e81-a386c9862192 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:23.035570 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4292ea7b-3d03-4b21-8e81-a386c9862192 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1463 microversion: 2.1 time: 0.162103 Jul 01 11:13:23.036185 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3261/6425] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:22 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:23.692555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:23.693415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:23.700789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:23.701259 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:23.702096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:23.703483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:23.717748 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 HTTP/1.1 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '4460e792-e627-4a2b-b331-fdc3e2a61f49'} Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:23.719486 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb04ea06-7fb0-4973-894f-b6da53f3dedd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 404 len: 111 microversion: 2.1 time: 0.033025 Jul 01 11:13:23.725603 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3165/6426] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:23 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:13:24.053113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9f61e83-e441-4436-a789-c29e124f54d8 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:24.053755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9f61e83-e441-4436-a789-c29e124f54d8 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:24.061719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9f61e83-e441-4436-a789-c29e124f54d8 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:24.062317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9f61e83-e441-4436-a789-c29e124f54d8 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:24.063383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9f61e83-e441-4436-a789-c29e124f54d8 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:24.063827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9f61e83-e441-4436-a789-c29e124f54d8 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:24.157478 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:24.203535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9f61e83-e441-4436-a789-c29e124f54d8 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1463 microversion: 2.1 time: 0.153966 Jul 01 11:13:24.204132 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3262/6427] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:24 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:25.120601 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-fe7a081b-3529-46a2-a2e3-eca5abb85fee req-d4fe79be-add0-408c-bee1-6ca665e884a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3791894-bffd-496c-8e57-73e623efa0e9", "name": "network-vif-plugged", "status": "completed", "tag": "7e0de721-cf0b-4301-82a6-88cce8a9f7ef"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:25.127058 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:25.127826 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:25.137947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fe7a081b-3529-46a2-a2e3-eca5abb85fee req-d4fe79be-add0-408c-bee1-6ca665e884a0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:25.144389 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fe7a081b-3529-46a2-a2e3-eca5abb85fee req-d4fe79be-add0-408c-bee1-6ca665e884a0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:25.149308 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-fe7a081b-3529-46a2-a2e3-eca5abb85fee req-d4fe79be-add0-408c-bee1-6ca665e884a0 service nova] Creating event network-vif-plugged:7e0de721-cf0b-4301-82a6-88cce8a9f7ef for instance c3791894-bffd-496c-8e57-73e623efa0e9 on n-h2-master-1 Jul 01 11:13:25.155127 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-fe7a081b-3529-46a2-a2e3-eca5abb85fee req-d4fe79be-add0-408c-bee1-6ca665e884a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039100 Jul 01 11:13:25.155798 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3166/6428] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:13:25.221620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1a8f9afb-7a89-40ba-bdf9-f0869b4eee48 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:25.222339 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1a8f9afb-7a89-40ba-bdf9-f0869b4eee48 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:25.231832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8f9afb-7a89-40ba-bdf9-f0869b4eee48 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:25.233220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8f9afb-7a89-40ba-bdf9-f0869b4eee48 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:25.233670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8f9afb-7a89-40ba-bdf9-f0869b4eee48 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:25.234306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1a8f9afb-7a89-40ba-bdf9-f0869b4eee48 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:25.386734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1a8f9afb-7a89-40ba-bdf9-f0869b4eee48 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1463 microversion: 2.1 time: 0.169962 Jul 01 11:13:25.387314 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3263/6429] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:25 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:26.404286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8df3b0a-5b20-44c3-850a-df2bb3c24e34 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:26.405666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8df3b0a-5b20-44c3-850a-df2bb3c24e34 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:26.414792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8df3b0a-5b20-44c3-850a-df2bb3c24e34 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:26.415763 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8df3b0a-5b20-44c3-850a-df2bb3c24e34 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:26.416974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8df3b0a-5b20-44c3-850a-df2bb3c24e34 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:26.417482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8df3b0a-5b20-44c3-850a-df2bb3c24e34 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:26.572300 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8df3b0a-5b20-44c3-850a-df2bb3c24e34 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1463 microversion: 2.1 time: 0.172279 Jul 01 11:13:26.572915 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3167/6430] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:26 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1463 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:27.589778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-52e00e9c-5c49-4b54-92d9-46d80c3c2d91 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:27.590403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-52e00e9c-5c49-4b54-92d9-46d80c3c2d91 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:27.592407 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:27.598237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52e00e9c-5c49-4b54-92d9-46d80c3c2d91 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:27.598692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52e00e9c-5c49-4b54-92d9-46d80c3c2d91 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:27.599458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52e00e9c-5c49-4b54-92d9-46d80c3c2d91 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:27.599937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-52e00e9c-5c49-4b54-92d9-46d80c3c2d91 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:27.731306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-52e00e9c-5c49-4b54-92d9-46d80c3c2d91 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1647 microversion: 2.1 time: 0.145904 Jul 01 11:13:27.732011 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3264/6431] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:27 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1647 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:27.748917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0c0270d-19bd-4b1c-b588-89ab80fbd0fe tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:27.751053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f0c0270d-19bd-4b1c-b588-89ab80fbd0fe tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:27.756981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c0270d-19bd-4b1c-b588-89ab80fbd0fe tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:27.757477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c0270d-19bd-4b1c-b588-89ab80fbd0fe tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:27.758254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c0270d-19bd-4b1c-b588-89ab80fbd0fe tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:27.758683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f0c0270d-19bd-4b1c-b588-89ab80fbd0fe tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:27.894520 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0c0270d-19bd-4b1c-b588-89ab80fbd0fe tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1647 microversion: 2.1 time: 0.150135 Jul 01 11:13:27.895093 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3168/6432] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:27 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1647 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:27.910084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-672044ed-c2e8-4be1-af4f-aead700b36fb tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:27.910713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-672044ed-c2e8-4be1-af4f-aead700b36fb tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:27.916805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672044ed-c2e8-4be1-af4f-aead700b36fb tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:27.917338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672044ed-c2e8-4be1-af4f-aead700b36fb tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:27.918110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672044ed-c2e8-4be1-af4f-aead700b36fb tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:27.918579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672044ed-c2e8-4be1-af4f-aead700b36fb tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:28.044111 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-672044ed-c2e8-4be1-af4f-aead700b36fb tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1647 microversion: 2.1 time: 0.137614 Jul 01 11:13:28.047812 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3265/6433] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:27 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1647 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:28.098137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-119260058", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "621bcd20-b40f-410d-ab58-31cc6d823146"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:28.153408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] validate_networks() for [('621bcd20-b40f-410d-ab58-31cc6d823146', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:13:28.499902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:13:28.500400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:13:28.500881 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:13:28.501324 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:13:28.501740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:13:28.510902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:28.511348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:28.512210 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:28.512667 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:28.530187 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Getting quotas for project 5e951b9694ee46258bb72509a66e9dba. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:13:28.535405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Getting quotas for user dfbc13f2e67e48708d2797715213dd07 and project 5e951b9694ee46258bb72509a66e9dba. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:13:28.548134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:13:28.550477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:13:28.681955 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d52ca8cc-053f-45d1-a797-8265c1474199 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587392 Jul 01 11:13:28.682876 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3169/6434] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 11:13:28.692913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b409f37-9d46-451a-8998-892c08de5ca1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:28.693653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b409f37-9d46-451a-8998-892c08de5ca1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:28.753539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b409f37-9d46-451a-8998-892c08de5ca1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1328 microversion: 2.1 time: 0.064243 Jul 01 11:13:28.754118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3266/6435] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:28 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1328 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:13:29.098068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:29.098582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:29.104898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:29.105844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:29.106308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:29.106790 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:29.132850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:13:29.396870 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d27286b2-3ba9-4fae-a9f4-b4a1fa8539d0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 204 len: 0 microversion: 2.1 time: 0.303230 Jul 01 11:13:29.397517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3170/6436] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:13:29 2022] DELETE /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:13:29.405877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:29.406499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:29.413613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:29.414071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:29.414843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:29.415296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:29.429535 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:29.551663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:29.560024 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1a2f985-8d7e-4605-8b1f-e6ad1881c7a2 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1409 microversion: 2.1 time: 0.157951 Jul 01 11:13:29.560613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3267/6437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:29 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:29.771012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b9c57e54-28f0-45ab-8d48-52a1c5332dc1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:29.771765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b9c57e54-28f0-45ab-8d48-52a1c5332dc1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:29.773790 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:29.778716 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9c57e54-28f0-45ab-8d48-52a1c5332dc1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:29.779159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9c57e54-28f0-45ab-8d48-52a1c5332dc1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:29.779912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9c57e54-28f0-45ab-8d48-52a1c5332dc1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:29.780419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b9c57e54-28f0-45ab-8d48-52a1c5332dc1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:29.848873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b9c57e54-28f0-45ab-8d48-52a1c5332dc1 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1345 microversion: 2.1 time: 0.082039 Jul 01 11:13:29.849487 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3171/6438] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:29 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:30.578399 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:30.579035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:30.586677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:30.587146 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:30.590818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:30.590818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:30.724994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:30.732828 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ffe9d98-59b7-48da-a97e-2f2c54a532bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1409 microversion: 2.1 time: 0.158730 Jul 01 11:13:30.733441 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3268/6439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:30 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:30.865918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e3541457-0f41-49f0-b431-947f807a9ae0 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:30.866571 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e3541457-0f41-49f0-b431-947f807a9ae0 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:30.874640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3541457-0f41-49f0-b431-947f807a9ae0 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:30.875096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3541457-0f41-49f0-b431-947f807a9ae0 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:30.875879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3541457-0f41-49f0-b431-947f807a9ae0 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:30.876316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3541457-0f41-49f0-b431-947f807a9ae0 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:30.891710 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:30.950583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e3541457-0f41-49f0-b431-947f807a9ae0 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1421 microversion: 2.1 time: 0.088365 Jul 01 11:13:30.951169 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3172/6440] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:30 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:31.750931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:31.751765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:31.754678 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:31.761243 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:31.761819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:31.762813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:31.763279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:31.837834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:31.846466 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43c55be6-9a97-4888-9105-34151a47bfff tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1367 microversion: 2.1 time: 0.099426 Jul 01 11:13:31.847070 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3269/6441] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:31 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:13:31.900646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2915eef9-dbe8-40a6-aa0a-2069141689f6 req-c4da20bb-30d9-41c3-ae51-5e139e5f6103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42836a8-bcef-4590-aac0-cbf3155c66bf", "name": "network-vif-deleted", "tag": "55bfb581-d95a-48a2-8d62-bfe988b0d2ca"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:31.910573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2915eef9-dbe8-40a6-aa0a-2069141689f6 req-c4da20bb-30d9-41c3-ae51-5e139e5f6103 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:31.911020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2915eef9-dbe8-40a6-aa0a-2069141689f6 req-c4da20bb-30d9-41c3-ae51-5e139e5f6103 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:31.925173 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2915eef9-dbe8-40a6-aa0a-2069141689f6 req-c4da20bb-30d9-41c3-ae51-5e139e5f6103 service nova] Creating event network-vif-deleted:55bfb581-d95a-48a2-8d62-bfe988b0d2ca for instance b42836a8-bcef-4590-aac0-cbf3155c66bf on n-h2-master-1 Jul 01 11:13:31.930154 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2915eef9-dbe8-40a6-aa0a-2069141689f6 req-c4da20bb-30d9-41c3-ae51-5e139e5f6103 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041042 Jul 01 11:13:31.930738 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3173/6442] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:31.969480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c6561d4-0947-4dc0-9632-c36af435ea9a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:31.970188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c6561d4-0947-4dc0-9632-c36af435ea9a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:31.976348 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c6561d4-0947-4dc0-9632-c36af435ea9a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:31.976803 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c6561d4-0947-4dc0-9632-c36af435ea9a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:31.977603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c6561d4-0947-4dc0-9632-c36af435ea9a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:31.978046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c6561d4-0947-4dc0-9632-c36af435ea9a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:32.132441 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c6561d4-0947-4dc0-9632-c36af435ea9a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1463 microversion: 2.1 time: 0.167431 Jul 01 11:13:32.147721 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3270/6443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:31 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:32.865004 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:32.865733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:32.873223 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:32.877397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:32.877397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:32.877397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:32.945793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:32.953981 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0207fcd4-74ad-49ab-bb02-5b3e9e5f3081 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1201 microversion: 2.1 time: 0.093710 Jul 01 11:13:32.954826 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3174/6444] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:32 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:33.149381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-14fa1237-50b0-41eb-8781-ea42e5d968b4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:33.149927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-14fa1237-50b0-41eb-8781-ea42e5d968b4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:33.157527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14fa1237-50b0-41eb-8781-ea42e5d968b4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:33.157988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14fa1237-50b0-41eb-8781-ea42e5d968b4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:33.158767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14fa1237-50b0-41eb-8781-ea42e5d968b4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:33.159215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-14fa1237-50b0-41eb-8781-ea42e5d968b4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:33.283430 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-14fa1237-50b0-41eb-8781-ea42e5d968b4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1463 microversion: 2.1 time: 0.137841 Jul 01 11:13:33.284008 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3271/6445] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:33 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:33.944738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-10142271-0461-4d6e-9cfd-cb4a99ceb2d3 req-135e8d4f-64f9-48dc-b9d7-9e3a3c945b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d6861d-5bf1-4113-a9e3-f6439edb3317", "tag": "99aa1354-7cd8-40d7-a4b9-f5516010f1cc"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:33.954706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-10142271-0461-4d6e-9cfd-cb4a99ceb2d3 req-135e8d4f-64f9-48dc-b9d7-9e3a3c945b59 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:33.955321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-10142271-0461-4d6e-9cfd-cb4a99ceb2d3 req-135e8d4f-64f9-48dc-b9d7-9e3a3c945b59 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:33.966513 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-10142271-0461-4d6e-9cfd-cb4a99ceb2d3 req-135e8d4f-64f9-48dc-b9d7-9e3a3c945b59 service nova] Creating event network-changed:99aa1354-7cd8-40d7-a4b9-f5516010f1cc for instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 on n-h1-master-1 Jul 01 11:13:33.971436 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-10142271-0461-4d6e-9cfd-cb4a99ceb2d3 req-135e8d4f-64f9-48dc-b9d7-9e3a3c945b59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030492 Jul 01 11:13:33.971595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:33.972237 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3175/6446] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:33.972375 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:33.978710 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:33.979173 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:33.979959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:33.980410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:34.046028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:34.050855 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa0bab5f-fc8b-40b3-8c26-a95e2b012b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1201 microversion: 2.1 time: 0.083326 Jul 01 11:13:34.051634 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3272/6447] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:33 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1201 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:13:34.301997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fc94ecc-a355-467d-8241-cbd1e102af1d tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:34.302712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fc94ecc-a355-467d-8241-cbd1e102af1d tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:34.309742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fc94ecc-a355-467d-8241-cbd1e102af1d tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:34.310205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fc94ecc-a355-467d-8241-cbd1e102af1d tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:34.310988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fc94ecc-a355-467d-8241-cbd1e102af1d tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:34.311429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fc94ecc-a355-467d-8241-cbd1e102af1d tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:34.451172 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fc94ecc-a355-467d-8241-cbd1e102af1d tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1463 microversion: 2.1 time: 0.153211 Jul 01 11:13:34.451801 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3176/6448] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:34 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:35.069852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:35.070532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:35.078543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:35.078876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:35.079666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:35.080366 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:35.147240 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:35.155775 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba2ed544-bf15-44a5-8f95-a170ec8a5044 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1201 microversion: 2.1 time: 0.089857 Jul 01 11:13:35.157183 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3273/6449] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:35 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:35.467963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eec08814-c09a-4c1b-9622-5bf89f309d0a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:35.468651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eec08814-c09a-4c1b-9622-5bf89f309d0a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:35.475921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec08814-c09a-4c1b-9622-5bf89f309d0a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:35.476372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec08814-c09a-4c1b-9622-5bf89f309d0a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:35.477168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec08814-c09a-4c1b-9622-5bf89f309d0a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:35.477603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec08814-c09a-4c1b-9622-5bf89f309d0a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:35.609200 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eec08814-c09a-4c1b-9622-5bf89f309d0a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1463 microversion: 2.1 time: 0.145028 Jul 01 11:13:35.613233 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3177/6450] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:35 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:36.172970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:36.173641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:36.181114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:36.182124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:36.182950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:36.183396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:36.251901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:36.260315 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a392eac-bf92-425d-a56b-c79fdbdeda69 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1201 microversion: 2.1 time: 0.090897 Jul 01 11:13:36.260930 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3274/6451] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:36 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:36.626201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-65d39095-b849-4564-983b-dcb0f3cdd333 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:36.626807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-65d39095-b849-4564-983b-dcb0f3cdd333 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:36.634646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d39095-b849-4564-983b-dcb0f3cdd333 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:36.635041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d39095-b849-4564-983b-dcb0f3cdd333 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:36.636400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d39095-b849-4564-983b-dcb0f3cdd333 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:36.637112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65d39095-b849-4564-983b-dcb0f3cdd333 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:36.773858 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-65d39095-b849-4564-983b-dcb0f3cdd333 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1463 microversion: 2.1 time: 0.151272 Jul 01 11:13:36.774440 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3178/6452] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:36 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:37.272563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-489d7364-639d-41e4-a608-7a25b4b69161 req-6634fdae-3c7e-4878-92b1-8ddc75d743ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d6861d-5bf1-4113-a9e3-f6439edb3317", "name": "network-vif-plugged", "status": "completed", "tag": "99aa1354-7cd8-40d7-a4b9-f5516010f1cc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:37.278649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:37.279344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:37.282858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-489d7364-639d-41e4-a608-7a25b4b69161 req-6634fdae-3c7e-4878-92b1-8ddc75d743ab service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:37.283317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-489d7364-639d-41e4-a608-7a25b4b69161 req-6634fdae-3c7e-4878-92b1-8ddc75d743ab service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:37.285994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:37.286834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:37.287669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:37.288187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:37.294934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-489d7364-639d-41e4-a608-7a25b4b69161 req-6634fdae-3c7e-4878-92b1-8ddc75d743ab service nova] Creating event network-vif-plugged:99aa1354-7cd8-40d7-a4b9-f5516010f1cc for instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 on n-h1-master-1 Jul 01 11:13:37.301820 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-489d7364-639d-41e4-a608-7a25b4b69161 req-6634fdae-3c7e-4878-92b1-8ddc75d743ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035551 Jul 01 11:13:37.302425 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3275/6453] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:37.326149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:37.326663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:37.327153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lazy-loading 'fault' on Instance uuid b42836a8-bcef-4590-aac0-cbf3155c66bf {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:13:37.379749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:13:37.387417 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6a72aa2-f533-41bc-908f-3583926f47f5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 200 len: 1160 microversion: 2.1 time: 0.113951 Jul 01 11:13:37.393185 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3179/6454] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:37 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 1160 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:13:37.792793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-74c76482-b5c5-4dfb-9ec3-535d14b34fc4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:37.793577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-74c76482-b5c5-4dfb-9ec3-535d14b34fc4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:37.799952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74c76482-b5c5-4dfb-9ec3-535d14b34fc4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:37.800415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74c76482-b5c5-4dfb-9ec3-535d14b34fc4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:37.801216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74c76482-b5c5-4dfb-9ec3-535d14b34fc4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:37.801669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-74c76482-b5c5-4dfb-9ec3-535d14b34fc4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:37.932260 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-74c76482-b5c5-4dfb-9ec3-535d14b34fc4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1463 microversion: 2.1 time: 0.144242 Jul 01 11:13:37.932913 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3276/6455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:37 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:38.404958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:38.405809 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:38.412729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:38.413213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:38.413982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:38.414417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:38.428995 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf HTTP/1.1 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: exception: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'b42836a8-bcef-4590-aac0-cbf3155c66bf'} Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:38.430687 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-174cdab7-bce1-4279-b609-e0fbd6f0ea45 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 404 len: 111 microversion: 2.1 time: 0.031661 Jul 01 11:13:38.437296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3180/6456] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:38 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:13:38.949984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7bf7bcc8-a4ed-46c0-8941-30357c443f5e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:38.950615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7bf7bcc8-a4ed-46c0-8941-30357c443f5e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:38.953331 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:38.958542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bf7bcc8-a4ed-46c0-8941-30357c443f5e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:38.959005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bf7bcc8-a4ed-46c0-8941-30357c443f5e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:38.959817 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bf7bcc8-a4ed-46c0-8941-30357c443f5e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:38.960261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7bf7bcc8-a4ed-46c0-8941-30357c443f5e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.087050 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7bf7bcc8-a4ed-46c0-8941-30357c443f5e tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1648 microversion: 2.1 time: 0.141537 Jul 01 11:13:39.091877 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3277/6457] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:38 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1648 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:39.104130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-223685ca-53de-4098-9113-836170b98a8c tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:39.106738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-223685ca-53de-4098-9113-836170b98a8c tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:39.106903 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:39.107814 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:39.112914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-223685ca-53de-4098-9113-836170b98a8c tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.113606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-223685ca-53de-4098-9113-836170b98a8c tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.114435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-223685ca-53de-4098-9113-836170b98a8c tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.114823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-223685ca-53de-4098-9113-836170b98a8c tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.245957 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-223685ca-53de-4098-9113-836170b98a8c tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1648 microversion: 2.1 time: 0.146599 Jul 01 11:13:39.246730 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3181/6458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:39 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1648 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:39.262394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4cb00cec-8b5f-4d19-82fb-33916ec18eaa tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:39.263024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4cb00cec-8b5f-4d19-82fb-33916ec18eaa tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:39.269304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb00cec-8b5f-4d19-82fb-33916ec18eaa tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.269765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb00cec-8b5f-4d19-82fb-33916ec18eaa tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.270551 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb00cec-8b5f-4d19-82fb-33916ec18eaa tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.271001 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cb00cec-8b5f-4d19-82fb-33916ec18eaa tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.404250 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4cb00cec-8b5f-4d19-82fb-33916ec18eaa tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1648 microversion: 2.1 time: 0.146243 Jul 01 11:13:39.404975 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3278/6459] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:39 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1648 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:39.421014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:39.421595 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:39.428388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.428873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.429661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.430095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.457521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:13:39.722445 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e37bdb18-6795-41ff-a735-d2b1e60a16ea tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 204 len: 0 microversion: 2.1 time: 0.304968 Jul 01 11:13:39.723346 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3182/6460] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:13:39 2022] DELETE /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:13:39.732012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f738e2ab-8b0d-4cd1-9987-6ca9158b2d3a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:39.732650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f738e2ab-8b0d-4cd1-9987-6ca9158b2d3a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:39.738873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f738e2ab-8b0d-4cd1-9987-6ca9158b2d3a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.739338 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f738e2ab-8b0d-4cd1-9987-6ca9158b2d3a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.740120 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f738e2ab-8b0d-4cd1-9987-6ca9158b2d3a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:39.740570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f738e2ab-8b0d-4cd1-9987-6ca9158b2d3a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:39.866619 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f738e2ab-8b0d-4cd1-9987-6ca9158b2d3a tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1654 microversion: 2.1 time: 0.138909 Jul 01 11:13:39.867196 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3279/6461] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:39 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1654 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:40.571060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:40.571657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:40.580068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:40.580517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:40.581314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:40.581750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:40.594784 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 HTTP/1.1 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '4460e792-e627-4a2b-b331-fdc3e2a61f49'} Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:40.596449 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2b87c23-5795-45c4-ba10-fcf2466f7c21 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 404 len: 111 microversion: 2.1 time: 0.031180 Jul 01 11:13:40.600979 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3183/6462] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:13:40 2022] DELETE /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:13:40.606426 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:40.607064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 4460e792-e627-4a2b-b331-fdc3e2a61f49] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:40.614085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:40.614549 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:40.615328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:40.615775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:40.630155 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 HTTP/1.1 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '4460e792-e627-4a2b-b331-fdc3e2a61f49'} Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:40.631823 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 4460e792-e627-4a2b-b331-fdc3e2a61f49 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b02aaab-35e1-4c80-aa75-1d2f1f178a43 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49" status: 404 len: 111 microversion: 2.1 time: 0.030751 Jul 01 11:13:40.637419 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3280/6463] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:40 2022] GET /compute/v2.1/servers/4460e792-e627-4a2b-b331-fdc3e2a61f49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:13:40.883329 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-047568b4-a83c-49d8-a2a1-85e051bcd719 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:40.883963 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-047568b4-a83c-49d8-a2a1-85e051bcd719 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:40.890657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-047568b4-a83c-49d8-a2a1-85e051bcd719 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:40.891114 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-047568b4-a83c-49d8-a2a1-85e051bcd719 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:40.891949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-047568b4-a83c-49d8-a2a1-85e051bcd719 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:40.892517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-047568b4-a83c-49d8-a2a1-85e051bcd719 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:41.035279 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-047568b4-a83c-49d8-a2a1-85e051bcd719 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1654 microversion: 2.1 time: 0.155804 Jul 01 11:13:41.035850 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3184/6464] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:40 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:41.542913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:41.545630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:41.552469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:41.552469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:41.553115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:41.553592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:41.569894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf HTTP/1.1 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: exception: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'b42836a8-bcef-4590-aac0-cbf3155c66bf'} Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:41.571500 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-046df58a-2420-4159-81f3-c0d332313bdb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 404 len: 111 microversion: 2.1 time: 0.035228 Jul 01 11:13:41.580685 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3281/6465] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:13:41 2022] DELETE /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 11:13:41.583026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:41.583654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b42836a8-bcef-4590-aac0-cbf3155c66bf] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:41.593936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:41.594894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:41.595172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:41.595606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:41.611729 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf HTTP/1.1 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: exception: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'b42836a8-bcef-4590-aac0-cbf3155c66bf'} Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:41.613352 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance b42836a8-bcef-4590-aac0-cbf3155c66bf could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2cac6b96-1ed2-479d-8d8a-790ba03fdaed tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf" status: 404 len: 111 microversion: 2.1 time: 0.036905 Jul 01 11:13:41.618455 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3185/6466] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:41 2022] GET /compute/v2.1/servers/b42836a8-bcef-4590-aac0-cbf3155c66bf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:13:41.637409 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-71118007-03b6-4ba4-97ab-710a0773ed72 req-e14073ec-6da4-4e87-9bff-3df703d4d917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d6861d-5bf1-4113-a9e3-f6439edb3317", "name": "network-vif-deleted", "tag": "99aa1354-7cd8-40d7-a4b9-f5516010f1cc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:41.651293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-71118007-03b6-4ba4-97ab-710a0773ed72 req-e14073ec-6da4-4e87-9bff-3df703d4d917 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:41.651754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-71118007-03b6-4ba4-97ab-710a0773ed72 req-e14073ec-6da4-4e87-9bff-3df703d4d917 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:41.665900 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-71118007-03b6-4ba4-97ab-710a0773ed72 req-e14073ec-6da4-4e87-9bff-3df703d4d917 service nova] Creating event network-vif-deleted:99aa1354-7cd8-40d7-a4b9-f5516010f1cc for instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 on n-h1-master-1 Jul 01 11:13:41.671459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-71118007-03b6-4ba4-97ab-710a0773ed72 req-e14073ec-6da4-4e87-9bff-3df703d4d917 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040396 Jul 01 11:13:41.672507 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3282/6467] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:41.731677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2f05ba2d-ba43-4372-9d31-53529a7da5d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: .version_select at 0x7f6f90a05940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-281466780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwPqTUa+FMB9YP6DUe2ivsIPdtJlO2bgB1gycW3eHrge6oXX5oCIBLlW2zk9MCaxMrgOtlFEnjrwy3YhtgABPt14LFjrkZluDENPbqemjjdAMhCTwCSPe21WjrR3wqoxA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:41.750710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2f05ba2d-ba43-4372-9d31-53529a7da5d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:13:41.756213 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2f05ba2d-ba43-4372-9d31-53529a7da5d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:13:41.852621 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2f05ba2d-ba43-4372-9d31-53529a7da5d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.125200 Jul 01 11:13:41.853122 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3186/6468] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:13:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:42.053530 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:42.054286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:42.061252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:42.063216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:42.063216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:42.063216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:42.094930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:42.095395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:42.095857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lazy-loading 'fault' on Instance uuid 26d6861d-5bf1-4113-a9e3-f6439edb3317 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:13:42.153644 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7865c604-4126-42c1-baec-7532605746ec tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 200 len: 1453 microversion: 2.1 time: 0.104250 Jul 01 11:13:42.154274 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3283/6469] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:42 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:43.172314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:43.173056 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: 26d6861d-5bf1-4113-a9e3-f6439edb3317] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:43.182687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:43.183133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:43.183909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:43.184378 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:43.198128 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] HTTP exception thrown: Instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 could not be found. Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Request method failure captured: Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 HTTP/1.1 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtbJkEqrcfH03EqlaPVjJNaXsBX221nNP8m8a98m3u6U0cgLGn4hTiclFeONA-y7qC_ZtN6Lrn03ePe_gdyMDaFye97SA4rpbtGuC_bgXD5o-1HTp9fCMvcb5atsZtLMiM5xUDdKHhX_VhQQM9_AE7dsdcK9iZ8kG07h5GY226PlyTc Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5e951b9694ee46258bb72509a66e9dba Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestServerMultinode-1870025224 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e951b9694ee46258bb72509a66e9dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e951b9694ee46258bb72509a66e9dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e951b9694ee46258bb72509a66e9dba", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e951b9694ee46258bb72509a66e9dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestServerMultinode-1870025224 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5e951b9694ee46258bb72509a66e9dba Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestServerMultinode-1870025224 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestServerMultinode-1870025224-project-admin Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: dfbc13f2e67e48708d2797715213dd07 Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestServerMultinode-1870025224-project-admin Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 could not be found. Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '26d6861d-5bf1-4113-a9e3-f6439edb3317'} Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 could not be found. Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 could not be found. Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:43.199810 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 could not be found. Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Returning 404 to user: Instance 26d6861d-5bf1-4113-a9e3-f6439edb3317 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d8eee4a-1ff7-4a49-9dcf-2e1e1d0dd0c3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317" status: 404 len: 111 microversion: 2.1 time: 0.033757 Jul 01 11:13:43.205328 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3187/6470] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:43 2022] GET /compute/v2.1/servers/26d6861d-5bf1-4113-a9e3-f6439edb3317 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:13:43.210030 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:43.210536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:43.217369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:43.220643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:43.220643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:43.220643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:43.245064 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:13:43.376083 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:13:43.550936 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-55514771-8990-4d5b-b801-0b076179f6f7 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 204 len: 0 microversion: 2.1 time: 0.344390 Jul 01 11:13:43.551584 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3284/6471] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:13:43 2022] DELETE /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:13:43.559589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46becb08-caaa-4647-a7e3-85669eac72b3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:43.560279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46becb08-caaa-4647-a7e3-85669eac72b3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:43.566788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46becb08-caaa-4647-a7e3-85669eac72b3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:43.567229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46becb08-caaa-4647-a7e3-85669eac72b3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:43.567982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46becb08-caaa-4647-a7e3-85669eac72b3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:43.568415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46becb08-caaa-4647-a7e3-85669eac72b3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:43.700985 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46becb08-caaa-4647-a7e3-85669eac72b3 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1653 microversion: 2.1 time: 0.144984 Jul 01 11:13:43.701597 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3188/6472] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:43 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1653 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:44.718304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1eb98b49-5408-4fef-9092-dd3daca608d4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:44.719034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1eb98b49-5408-4fef-9092-dd3daca608d4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:44.725981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb98b49-5408-4fef-9092-dd3daca608d4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:44.726443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb98b49-5408-4fef-9092-dd3daca608d4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:44.727221 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb98b49-5408-4fef-9092-dd3daca608d4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:44.727666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1eb98b49-5408-4fef-9092-dd3daca608d4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:44.854470 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1eb98b49-5408-4fef-9092-dd3daca608d4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1653 microversion: 2.1 time: 0.140139 Jul 01 11:13:44.855034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3285/6473] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:44 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1653 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:45.622871 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-4b3c0078-1de4-4843-ad06-c2fa0861e4ea req-546b9a8c-cf71-45ec-9342-4927bd4254e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3791894-bffd-496c-8e57-73e623efa0e9", "name": "network-vif-deleted", "tag": "7e0de721-cf0b-4301-82a6-88cce8a9f7ef"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:13:45.636559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4b3c0078-1de4-4843-ad06-c2fa0861e4ea req-546b9a8c-cf71-45ec-9342-4927bd4254e1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:45.637344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-4b3c0078-1de4-4843-ad06-c2fa0861e4ea req-546b9a8c-cf71-45ec-9342-4927bd4254e1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:45.651736 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-4b3c0078-1de4-4843-ad06-c2fa0861e4ea req-546b9a8c-cf71-45ec-9342-4927bd4254e1 service nova] Creating event network-vif-deleted:7e0de721-cf0b-4301-82a6-88cce8a9f7ef for instance c3791894-bffd-496c-8e57-73e623efa0e9 on n-h2-master-1 Jul 01 11:13:45.658478 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-4b3c0078-1de4-4843-ad06-c2fa0861e4ea req-546b9a8c-cf71-45ec-9342-4927bd4254e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038477 Jul 01 11:13:45.659019 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3189/6474] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:13:45.871987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ae9ff3e-e15b-4aaa-b747-8e815c752fa4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:45.873259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ae9ff3e-e15b-4aaa-b747-8e815c752fa4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:45.881636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff3e-e15b-4aaa-b747-8e815c752fa4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:45.883404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff3e-e15b-4aaa-b747-8e815c752fa4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:45.883404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff3e-e15b-4aaa-b747-8e815c752fa4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:45.883404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff3e-e15b-4aaa-b747-8e815c752fa4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:45.972448 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ae9ff3e-e15b-4aaa-b747-8e815c752fa4 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 200 len: 1448 microversion: 2.1 time: 0.104742 Jul 01 11:13:45.973021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3286/6475] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:45 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 1448 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:13:46.991436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:13:46.992578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] [instance: c3791894-bffd-496c-8e57-73e623efa0e9] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:13:46.999489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:46.999939 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:47.000712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:13:47.001291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:13:47.018431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] HTTP exception thrown: Instance c3791894-bffd-496c-8e57-73e623efa0e9 could not be found. Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Request method failure captured: Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 HTTP/1.1 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtbJkEqrcfH03EqlaPVjJNaXsBX221nNP8m8a98m3u6U0cgLGn4hTiclFeONA-y7qC_ZtN6Lrn03ePe_gdyMDaFye97SA4rpbtGuC_bgXD5o-1HTp9fCMvcb5atsZtLMiM5xUDdKHhX_VhQQM9_AE7dsdcK9iZ8kG07h5GY226PlyTc Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 5e951b9694ee46258bb72509a66e9dba Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestServerMultinode-1870025224 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e951b9694ee46258bb72509a66e9dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e951b9694ee46258bb72509a66e9dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e951b9694ee46258bb72509a66e9dba", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e951b9694ee46258bb72509a66e9dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestServerMultinode-1870025224 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 5e951b9694ee46258bb72509a66e9dba Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestServerMultinode-1870025224 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestServerMultinode-1870025224-project-admin Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: dfbc13f2e67e48708d2797715213dd07 Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestServerMultinode-1870025224-project-admin Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: exception: Instance c3791894-bffd-496c-8e57-73e623efa0e9 could not be found. Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'c3791894-bffd-496c-8e57-73e623efa0e9'} Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3791894-bffd-496c-8e57-73e623efa0e9 could not be found. Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3791894-bffd-496c-8e57-73e623efa0e9 could not be found. Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:13:47.020090 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3791894-bffd-496c-8e57-73e623efa0e9 could not be found. Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] Returning 404 to user: Instance c3791894-bffd-496c-8e57-73e623efa0e9 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-df24361a-e89a-43a1-be5b-964d2b0cfb71 tempest-TestServerMultinode-1870025224 tempest-TestServerMultinode-1870025224-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9" status: 404 len: 111 microversion: 2.1 time: 0.035613 Jul 01 11:13:47.026212 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3190/6476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:13:46 2022] GET /compute/v2.1/servers/c3791894-bffd-496c-8e57-73e623efa0e9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:14:06.294042 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:14:06.294589 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:14:11.709512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-890742213", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-281466780", "security_groups": [{"name": "tempest-secgroup-smoke-1511613704"}], "block_device_mapping_v2": [{"uuid": "b3cf0cde-e021-4a25-9b77-ecff4d02a994", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc85cd4f-4041-4340-a016-821f51d0f621"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:14:11.718834 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:11.719516 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:11.821698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] validate_networks() for [('fc85cd4f-4041-4340-a016-821f51d0f621', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:14:12.334150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:14:12.334614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:14:12.335096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:14:12.335511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:14:12.335956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:14:12.344865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:12.345359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:12.346218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:12.346662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:12.363620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:14:12.368780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:14:12.426319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:14:12.428458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3cf0cde-e021-4a25-9b77-ecff4d02a994',volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:14:12.808400 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a01caaa-3ce0-4cf8-a8b9-6a4663d9edac tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.102971 Jul 01 11:14:12.809347 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3287/6477] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:14:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:14:12.819538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6c59936-86bb-481e-80b1-4f2204903190 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:12.820154 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6c59936-86bb-481e-80b1-4f2204903190 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:12.823511 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:12.824298 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:12.824833 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:12.884698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6c59936-86bb-481e-80b1-4f2204903190 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:12.891926 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6c59936-86bb-481e-80b1-4f2204903190 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1093 microversion: 2.1 time: 0.076392 Jul 01 11:14:12.892489 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3191/6478] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:12 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:13.911625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:13.912332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:13.919310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:13.919768 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:13.921251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:13.921711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:13.984518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:13.992766 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a85d436b-2e2d-4093-bda9-667bb072d450 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1135 microversion: 2.1 time: 0.087127 Jul 01 11:14:13.993351 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3288/6479] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:13 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1135 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:15.011013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:15.011632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:15.026865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:15.028166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:15.028166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:15.028663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:15.098514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:15.106604 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21a4acaf-6613-458d-8ce3-f7ea592ba8f8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1209 microversion: 2.1 time: 0.099998 Jul 01 11:14:15.107519 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3192/6480] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:15 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:16.125709 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:16.127609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:16.144012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:16.146002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:16.147082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:16.148826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:16.308246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:16.316526 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b74f02e1-bd2c-4316-b73c-f58a55f58892 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1277 microversion: 2.1 time: 0.194633 Jul 01 11:14:16.318815 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3289/6481] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:16 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:16.343121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f135359d-27c0-45dc-ac57-f52b8d6261d3 req-1a378a01-5fc8-40f3-893f-9df1b447aae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e52cc9e-da8a-4ba2-9750-79355e64e5ce", "tag": "66a054f8-c124-4045-ad03-4ff4fb298023"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:14:16.355973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f135359d-27c0-45dc-ac57-f52b8d6261d3 req-1a378a01-5fc8-40f3-893f-9df1b447aae0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:16.356590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f135359d-27c0-45dc-ac57-f52b8d6261d3 req-1a378a01-5fc8-40f3-893f-9df1b447aae0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:16.378890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f135359d-27c0-45dc-ac57-f52b8d6261d3 req-1a378a01-5fc8-40f3-893f-9df1b447aae0 service nova] Creating event network-changed:66a054f8-c124-4045-ad03-4ff4fb298023 for instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce on n-h2-master-1 Jul 01 11:14:16.387012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f135359d-27c0-45dc-ac57-f52b8d6261d3 req-1a378a01-5fc8-40f3-893f-9df1b447aae0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052908 Jul 01 11:14:16.389955 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3193/6482] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:14:17.335381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:17.336049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:17.343838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:17.344300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:17.345122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:17.345594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:17.485845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:17.493381 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-204cb3e7-fca3-4c0e-86a7-2635d9ff2231 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1277 microversion: 2.1 time: 0.162061 Jul 01 11:14:17.493954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3290/6483] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:17 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:18.511021 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:18.511861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:18.519205 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:18.519651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:18.520705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:18.521172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:18.655623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:18.663199 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a00612f-67bc-4358-ab29-1fa22d7ab869 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1277 microversion: 2.1 time: 0.156593 Jul 01 11:14:18.663767 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3194/6484] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:18 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:19.680402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:19.681060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:19.688742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:19.689232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:19.690018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:19.690468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:19.829908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:19.838517 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-07efa1f3-13b2-4741-a117-0cd76b9e2ffe tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1277 microversion: 2.1 time: 0.161253 Jul 01 11:14:19.839094 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3291/6485] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:19 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:20.855423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:20.856005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:20.862947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:20.863391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:20.864144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:20.864573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:20.994070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:21.001606 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e3626026-8efd-4f29-84ab-400cec12b6bd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.150656 Jul 01 11:14:21.002170 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3195/6486] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:20 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:22.018404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:22.019298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:22.026434 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:22.026879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:22.027658 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:22.028107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:22.162974 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:22.171195 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f7c48e9-5b40-4096-8a00-96fcc1cb86a9 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.156641 Jul 01 11:14:22.171753 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3292/6487] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:22 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:23.188724 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:23.189297 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:23.192384 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:23.198036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:23.198482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:23.199279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:23.199709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:23.338536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:23.346150 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad327a4f-c1d1-48a4-840f-f6937531bd84 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.161798 Jul 01 11:14:23.346721 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3196/6488] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:23 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:24.363180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:24.363830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:24.365744 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:24.366419 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:14:24.372088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:24.382893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:24.382893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:24.382893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:24.503518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:24.511592 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f131065-59d0-4716-a691-096948ad101a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.152348 Jul 01 11:14:24.512156 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3293/6489] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:24 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:25.528883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:25.529609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:25.536512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:25.536969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:25.537776 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:25.538220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:25.689453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:25.696965 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f3f0fcc2-b643-442f-b18f-cb559697335a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.172520 Jul 01 11:14:25.697584 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3197/6490] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:25 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:26.713751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:26.714378 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:26.721350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:26.721814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:26.722587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:26.723041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:26.852239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:26.859790 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d19dcd2-2289-49ef-81bc-700d76caf682 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.150555 Jul 01 11:14:26.860349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3294/6491] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:26 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:27.878943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:27.879594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:27.886489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:27.886940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:27.887709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:27.888148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:28.022321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:28.030963 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a93e3f4-06d9-4f28-8520-0eb51b2fc1a1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.155914 Jul 01 11:14:28.031545 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3198/6492] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:27 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:29.048026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:29.048652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:29.055727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:29.056814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:29.057641 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:29.058093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:29.188416 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:29.196192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-72cf82fe-9af8-489a-8a93-b30557d46c74 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.152184 Jul 01 11:14:29.196793 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3295/6493] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:29 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:29.511000 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-448846a6-9ff1-4d43-af88-94bca1868694 req-59d629a8-9533-4704-9794-64c79d89ad09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e52cc9e-da8a-4ba2-9750-79355e64e5ce", "name": "network-vif-plugged", "status": "completed", "tag": "66a054f8-c124-4045-ad03-4ff4fb298023"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:14:29.521871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-448846a6-9ff1-4d43-af88-94bca1868694 req-59d629a8-9533-4704-9794-64c79d89ad09 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:29.522483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-448846a6-9ff1-4d43-af88-94bca1868694 req-59d629a8-9533-4704-9794-64c79d89ad09 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:29.534800 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-448846a6-9ff1-4d43-af88-94bca1868694 req-59d629a8-9533-4704-9794-64c79d89ad09 service nova] Creating event network-vif-plugged:66a054f8-c124-4045-ad03-4ff4fb298023 for instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce on n-h2-master-1 Jul 01 11:14:29.539937 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-448846a6-9ff1-4d43-af88-94bca1868694 req-59d629a8-9533-4704-9794-64c79d89ad09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169462 Jul 01 11:14:29.544733 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3199/6494] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:14:30.213583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:30.214200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:30.221266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:30.221723 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:30.222489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:30.222934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:30.354617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:30.362414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b230564-9cca-48b0-8de7-685a503b102b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1265 microversion: 2.1 time: 0.152680 Jul 01 11:14:30.362988 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3296/6495] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:30 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:31.380295 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:31.381003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:31.388864 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:31.389371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:31.390140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:31.390574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:31.526619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:31.534268 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0589edfa-7797-4749-9059-7d24416e6fa7 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1452 microversion: 2.1 time: 0.158253 Jul 01 11:14:31.534840 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3200/6496] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:31 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:31.550816 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:14:31.551446 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:14:31.558264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:31.558727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:31.559499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:31.559947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:31.690137 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:14:31.697859 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f42cef9-a264-4b09-8788-7eb2aab99ba0 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1452 microversion: 2.1 time: 0.150883 Jul 01 11:14:31.698447 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3297/6497] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:14:31 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:14:34.110114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f0941f4d-745b-42bd-9ed1-a1e2e131a29f req-7289a544-ac3a-4a77-82ca-e89aee7ccbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e52cc9e-da8a-4ba2-9750-79355e64e5ce", "tag": "66a054f8-c124-4045-ad03-4ff4fb298023"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:14:34.118772 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0941f4d-745b-42bd-9ed1-a1e2e131a29f req-7289a544-ac3a-4a77-82ca-e89aee7ccbe4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:14:34.119217 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0941f4d-745b-42bd-9ed1-a1e2e131a29f req-7289a544-ac3a-4a77-82ca-e89aee7ccbe4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:14:34.131318 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f0941f4d-745b-42bd-9ed1-a1e2e131a29f req-7289a544-ac3a-4a77-82ca-e89aee7ccbe4 service nova] Creating event network-changed:66a054f8-c124-4045-ad03-4ff4fb298023 for instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce on n-h2-master-1 Jul 01 11:14:34.136590 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f0941f4d-745b-42bd-9ed1-a1e2e131a29f req-7289a544-ac3a-4a77-82ca-e89aee7ccbe4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095836 Jul 01 11:14:34.137452 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3201/6498] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:15:47.058947 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:15:47.059745 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:16:00.650551 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:16:00.651021 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:16:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:17:00.432102 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:17:00.432799 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:00.433412 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=62 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:00.437863 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:00.440276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:00.444637 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:00.445094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:00.445907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:00.446350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:00.472232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:17:00.810112 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23c22871-6750-4d9f-8642-c99b73de3508 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 204 len: 0 microversion: 2.1 time: 0.380213 Jul 01 11:17:00.810700 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3298/6499] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:17:00 2022] DELETE /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:17:00.817537 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:17:00.818624 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:17:00.819530 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=24 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:00.820369 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=48 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:00.824848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:00.825579 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:00.832122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:00.832747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:00.833539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:00.833975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:01.097653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:01.105263 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-779437aa-ed3d-4db3-9e66-46e3df0557fb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1576 microversion: 2.1 time: 0.289836 Jul 01 11:17:01.105821 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3202/6500] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:00 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:02.123675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:02.124412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:02.135459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:02.137368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:02.137368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:02.137368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:02.143650 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39458. Jul 01 11:17:02.342866 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:02.350553 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-40fa4528-f3a0-4b8f-8c97-8fcb10d07188 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1576 microversion: 2.1 time: 0.231248 Jul 01 11:17:02.351118 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3299/6501] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:02 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:03.368084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:03.368736 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:03.378506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:03.378964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:03.379744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:03.380181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:03.397692 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39464. Jul 01 11:17:03.401509 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39466. Jul 01 11:17:03.450026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:03.457728 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e525d524-15fd-44d3-8421-c0cb9ed556e6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1508 microversion: 2.1 time: 0.093816 Jul 01 11:17:03.458289 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3203/6502] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:03 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1508 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:03.612775 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a75da1f6-1760-4606-806f-72214150762a req-111a8875-078d-4a6e-b70a-2178d8427269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e52cc9e-da8a-4ba2-9750-79355e64e5ce", "name": "network-vif-deleted", "tag": "66a054f8-c124-4045-ad03-4ff4fb298023"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:17:03.627796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a75da1f6-1760-4606-806f-72214150762a req-111a8875-078d-4a6e-b70a-2178d8427269 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:03.628584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a75da1f6-1760-4606-806f-72214150762a req-111a8875-078d-4a6e-b70a-2178d8427269 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:03.646120 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a75da1f6-1760-4606-806f-72214150762a req-111a8875-078d-4a6e-b70a-2178d8427269 service nova] Creating event network-vif-deleted:66a054f8-c124-4045-ad03-4ff4fb298023 for instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce on n-h2-master-1 Jul 01 11:17:03.651345 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a75da1f6-1760-4606-806f-72214150762a req-111a8875-078d-4a6e-b70a-2178d8427269 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112753 Jul 01 11:17:03.651954 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3300/6503] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:17:04.478991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:04.479824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:04.487314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:04.487773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:04.488539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:04.488966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:04.558578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:04.567531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6247b162-586a-4735-af36-3f7cf5407b5e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1224 microversion: 2.1 time: 0.092489 Jul 01 11:17:04.568132 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3204/6504] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:04 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:17:05.585544 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:05.586183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:05.592456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:05.592910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:05.593721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:05.594666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:05.663376 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:05.671156 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6268356a-db6f-46b6-a117-41dbfec60d6b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1224 microversion: 2.1 time: 0.090839 Jul 01 11:17:05.671815 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3301/6505] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:05 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:06.687817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:06.689345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:06.696157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:06.696602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:06.697382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:06.697813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:06.759102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:06.766840 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e30ba3e2-e88f-44c5-b8d9-db8efec9dfaf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1224 microversion: 2.1 time: 0.082886 Jul 01 11:17:06.767407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3205/6506] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:06 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:07.783812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:07.784438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:07.791235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:07.791692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:07.792478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:07.792923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:07.863879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:07.871395 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3acec186-28d1-4483-adc7-0602d955b435 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 200 len: 1224 microversion: 2.1 time: 0.091798 Jul 01 11:17:07.871953 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3302/6507] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:07 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:08.889052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:08.889650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:08.896557 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:08.896999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:08.897799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:08.898227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:08.911550 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce HTTP/1.1 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0e52cc9e-da8a-4ba2-9750-79355e64e5ce'} Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:17:08.913189 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-871ac400-e651-46ef-a269-d7f68a228f01 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 404 len: 111 microversion: 2.1 time: 0.029549 Jul 01 11:17:08.919028 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3206/6508] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:08 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:17:08.964189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-822669183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-281466780", "security_groups": [{"name": "tempest-secgroup-smoke-1511613704"}], "block_device_mapping_v2": [{"uuid": "b3cf0cde-e021-4a25-9b77-ecff4d02a994", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc85cd4f-4041-4340-a016-821f51d0f621"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:17:09.075753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] validate_networks() for [('fc85cd4f-4041-4340-a016-821f51d0f621', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:17:09.440079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:17:09.440532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:17:09.441010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:17:09.441448 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:17:09.441877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:17:09.450579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:09.451030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:09.451834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:09.452276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:09.468957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:17:09.474853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:17:09.531281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:17:09.534051 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3cf0cde-e021-4a25-9b77-ecff4d02a994',volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:17:09.923182 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [4e09ed61-704d-4108-a27f-92469a78dc98] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:17:10.930295 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [4e09ed61-704d-4108-a27f-92469a78dc98] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39502. Jul 01 11:17:10.934178 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d8bf0cd0-7e34-4bee-930d-551d00f6467f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.973975 Jul 01 11:17:10.934833 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3303/6509] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:17:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:17:10.945648 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-38b03ee4-e88c-4c1c-b4a0-1ac91f75c4a3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:10.946271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-38b03ee4-e88c-4c1c-b4a0-1ac91f75c4a3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:11.001539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-38b03ee4-e88c-4c1c-b4a0-1ac91f75c4a3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:11.009776 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-38b03ee4-e88c-4c1c-b4a0-1ac91f75c4a3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1093 microversion: 2.1 time: 0.067932 Jul 01 11:17:11.010543 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3207/6510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:10 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:12.028804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:12.029461 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:12.036312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:12.036775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:12.042400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:12.042400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:12.100585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:12.108302 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1f088ef3-a4f8-43a4-9480-cb969478a880 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1143 microversion: 2.1 time: 0.084682 Jul 01 11:17:12.108800 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3304/6511] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:12 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:13.126583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:13.127231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:13.135092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:13.135543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:13.136644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:13.137279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:13.208663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:13.216603 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fc696f65-8724-4115-bbbd-2aec831eba06 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1209 microversion: 2.1 time: 0.094534 Jul 01 11:17:13.217197 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3208/6512] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:13 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:14.234099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:14.235571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:14.242096 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:14.242820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:14.244213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:14.244213 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:14.397057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:14.409732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ecd3cdb4-6a4c-41ad-afa0-0fcba9b1b322 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1277 microversion: 2.1 time: 0.179289 Jul 01 11:17:14.410320 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3305/6513] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:14 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:14.708145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-080c1a06-c7b2-46de-b8b9-258b0a1eead4 req-26a031f6-239c-44af-90b0-a97d1731f0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ca3ecf-d229-4182-bb2c-72020fa5fba8", "tag": "333fd455-38f3-4f04-a1f1-bd2f535a7ca5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:17:14.720035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-080c1a06-c7b2-46de-b8b9-258b0a1eead4 req-26a031f6-239c-44af-90b0-a97d1731f0c5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:14.720484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-080c1a06-c7b2-46de-b8b9-258b0a1eead4 req-26a031f6-239c-44af-90b0-a97d1731f0c5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:14.732276 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-080c1a06-c7b2-46de-b8b9-258b0a1eead4 req-26a031f6-239c-44af-90b0-a97d1731f0c5 service nova] Creating event network-changed:333fd455-38f3-4f04-a1f1-bd2f535a7ca5 for instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 on n-h2-master-1 Jul 01 11:17:14.741023 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-080c1a06-c7b2-46de-b8b9-258b0a1eead4 req-26a031f6-239c-44af-90b0-a97d1731f0c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037840 Jul 01 11:17:14.741675 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3209/6514] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:17:15.428131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:15.428862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:15.436552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:15.437270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:15.439021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:15.439740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:15.578176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:15.586561 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3578079-0a4d-497f-8298-20e0a78ab065 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1277 microversion: 2.1 time: 0.162417 Jul 01 11:17:15.587130 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3306/6515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:15 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:16.605393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:16.606092 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:16.613219 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:16.613664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:16.614526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:16.614961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:16.749467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:16.757706 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-450ddcfe-647e-47a6-9082-69cb152841bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1277 microversion: 2.1 time: 0.157575 Jul 01 11:17:16.758277 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3210/6516] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:16 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:17.775301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:17.775920 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:17.783031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:17.783496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:17.784288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:17.784734 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:17.917892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:17.925837 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1750a982-95c2-4302-95f2-3a279c7b1705 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1277 microversion: 2.1 time: 0.154469 Jul 01 11:17:17.926421 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3307/6517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:17 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:18.943620 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:18.944178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:18.951287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:18.951730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:18.952495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:18.952925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:19.093365 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:19.100980 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c74743b-8258-4edf-a19e-6ca0897ca187 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.161385 Jul 01 11:17:19.103079 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3211/6518] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:18 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:17:20.117301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:20.117930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:20.120725 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:20.121477 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:20.126923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:20.130870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:20.130870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:20.130870 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:20.259088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:20.269931 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9dc2d56e-40a5-44c5-9dcb-98dc8a71576d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.155742 Jul 01 11:17:20.273744 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3308/6519] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:20 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:21.295316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:21.295863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:21.298702 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:21.304017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:21.306721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:21.306721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:21.306721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:21.441045 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:21.448940 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdcebf84-5366-47d6-b341-383b876a09b1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.157679 Jul 01 11:17:21.449545 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3212/6520] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:21 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:22.466532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:22.467149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:22.474122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:22.474590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:22.475395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:22.475847 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:22.607734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:22.615878 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f5f0268a-d6cf-4d18-8c6a-e4ec866323f3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.153234 Jul 01 11:17:22.616442 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3309/6521] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:22 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:23.632309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:23.632916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:23.640096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:23.641175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:23.641960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:23.642398 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:23.770559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:23.778107 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-10d4c11e-aa7d-4050-a2e7-eb300b8c74cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.150085 Jul 01 11:17:23.778670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3213/6522] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:23 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:24.795212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:24.795832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:24.803328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:24.803786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:24.804567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:24.805002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:24.937072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:24.944962 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09274871-8173-4e70-ae32-7db50f5e8c4d tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.153596 Jul 01 11:17:24.945555 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3310/6523] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:24 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:25.961950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:25.962559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:25.969586 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:25.970027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:25.970777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:25.971215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:26.100452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:26.108000 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef27c0bf-19c5-4e37-a3ec-6ce7c6797719 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.149979 Jul 01 11:17:26.108559 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3214/6524] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:25 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:26.302179 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:17:26.302655 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:17:27.126034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:27.126648 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:27.133534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:27.133988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:27.134752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:27.135192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:27.262345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:27.270501 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8425e8e6-6d2d-419d-ac6e-e09a37f178ea tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.148913 Jul 01 11:17:27.271061 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3311/6525] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:27 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:28.288981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:28.289573 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:28.296857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:28.297380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:28.298172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:28.298612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:28.437899 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:28.446544 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-991b4e8e-93cd-4aec-b067-9ed66f960830 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.161806 Jul 01 11:17:28.447127 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3215/6526] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:28 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:29.463929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:29.464646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:29.471512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:29.471971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:29.472754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:29.473235 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:29.602354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:29.610524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e6085307-1bb1-424d-be65-cbbceee1e8bf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.149897 Jul 01 11:17:29.611089 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3312/6527] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:29 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:30.355505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-71be1663-8ea7-4f63-a7db-bde106424f92 req-2047dbf1-27bf-4132-9572-f7e56b3a0452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ca3ecf-d229-4182-bb2c-72020fa5fba8", "name": "network-vif-plugged", "status": "completed", "tag": "333fd455-38f3-4f04-a1f1-bd2f535a7ca5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:17:30.364974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-71be1663-8ea7-4f63-a7db-bde106424f92 req-2047dbf1-27bf-4132-9572-f7e56b3a0452 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:30.365456 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-71be1663-8ea7-4f63-a7db-bde106424f92 req-2047dbf1-27bf-4132-9572-f7e56b3a0452 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:30.376757 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-71be1663-8ea7-4f63-a7db-bde106424f92 req-2047dbf1-27bf-4132-9572-f7e56b3a0452 service nova] Creating event network-vif-plugged:333fd455-38f3-4f04-a1f1-bd2f535a7ca5 for instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 on n-h2-master-1 Jul 01 11:17:30.381778 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-71be1663-8ea7-4f63-a7db-bde106424f92 req-2047dbf1-27bf-4132-9572-f7e56b3a0452 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030145 Jul 01 11:17:30.382364 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3216/6528] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:17:30.627270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:30.627922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:30.635080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:30.635542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:30.636321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:30.636773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:30.639475 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:30.774913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:30.782496 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1aebb22c-8242-41ad-ac95-3b0e22f9b802 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.159094 Jul 01 11:17:30.783054 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3313/6529] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:30 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:31.801569 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:31.802272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:31.804229 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=33 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:31.809282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:31.809727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:31.810493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:31.810950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:31.815319 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=73 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:31.944445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:31.952065 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-674bf035-c85c-4636-af74-952028f5b922 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1265 microversion: 2.1 time: 0.156447 Jul 01 11:17:31.952635 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3217/6530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:31 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:32.970031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:32.970674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:32.973018 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:17:32.977854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:32.978312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:32.979084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:32.979534 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:33.117672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:33.126524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95233791-663f-46a2-ad58-79c4f7ef7fc3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1453 microversion: 2.1 time: 0.160954 Jul 01 11:17:33.127375 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3314/6531] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:32 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:33.142698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:17:33.143313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:17:33.150695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:33.151144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:33.151905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:33.152337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:33.283655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:17:33.291205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-06b031aa-fe69-4b4a-9ad5-bdd86aafb83f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1453 microversion: 2.1 time: 0.152333 Jul 01 11:17:33.291795 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3218/6532] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:17:33 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:17:35.451552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ddefe975-164e-4706-860e-bbbd1c8e8bed req-619a8f1a-5242-40fe-a7a4-bf9d03b063d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ca3ecf-d229-4182-bb2c-72020fa5fba8", "tag": "333fd455-38f3-4f04-a1f1-bd2f535a7ca5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:17:35.461195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ddefe975-164e-4706-860e-bbbd1c8e8bed req-619a8f1a-5242-40fe-a7a4-bf9d03b063d2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:17:35.461651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ddefe975-164e-4706-860e-bbbd1c8e8bed req-619a8f1a-5242-40fe-a7a4-bf9d03b063d2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:17:35.472812 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ddefe975-164e-4706-860e-bbbd1c8e8bed req-619a8f1a-5242-40fe-a7a4-bf9d03b063d2 service nova] Creating event network-changed:333fd455-38f3-4f04-a1f1-bd2f535a7ca5 for instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 on n-h2-master-1 Jul 01 11:17:35.478234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ddefe975-164e-4706-860e-bbbd1c8e8bed req-619a8f1a-5242-40fe-a7a4-bf9d03b063d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030452 Jul 01 11:17:35.478844 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3315/6533] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:19:06.771432 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:19:06.772012 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:19:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:19:07.067878 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:19:07.068146 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:19:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:20:02.354282 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:20:02.355199 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=11 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:20:02.359650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-723048781", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-281466780", "security_groups": [{"name": "tempest-secgroup-smoke-1511613704"}], "block_device_mapping_v2": [{"uuid": "33af384e-617f-40b7-b578-0c05071bf898", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc85cd4f-4041-4340-a016-821f51d0f621"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:20:02.474739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] validate_networks() for [('fc85cd4f-4041-4340-a016-821f51d0f621', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:02.927827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:02.931860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:20:02.937807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Getting quotas for user 29ed38b7e27f41fb89edab0947241ff6 and project 561b9efdad3745418365806c411c9bf2. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:20:03.004683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:20:03.007403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33af384e-617f-40b7-b578-0c05071bf898',volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:20:03.477741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef903d41-5cb9-417e-825a-c42e4e683651 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.125582 Jul 01 11:20:03.478708 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3219/6534] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:20:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:20:03.487374 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:20:03.488237 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:20:03.488836 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:20:03.489614 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=13 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:20:03.494076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e1fe6076-eed2-40a0-b0fe-1f363ef9eabc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:03.496014 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e1fe6076-eed2-40a0-b0fe-1f363ef9eabc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:03.560103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e1fe6076-eed2-40a0-b0fe-1f363ef9eabc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:03.560103 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e1fe6076-eed2-40a0-b0fe-1f363ef9eabc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1093 microversion: 2.1 time: 0.071393 Jul 01 11:20:03.560103 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3316/6535] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:03 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:04.575515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:04.576723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:04.582964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:04.583408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:04.584168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:04.584601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:04.645996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:04.654106 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1da88885-211f-4657-a20d-1805fa831ee5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1143 microversion: 2.1 time: 0.083319 Jul 01 11:20:04.654708 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3220/6536] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:04 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:05.677848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:05.678562 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:05.694146 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39734. Jul 01 11:20:05.697852 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:05.698326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:05.699121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:05.699571 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:05.718269 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39732. Jul 01 11:20:05.767458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:05.775990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e08ed674-1ebd-4b6e-967d-0cb8d8e3126b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1199 microversion: 2.1 time: 0.102328 Jul 01 11:20:05.776772 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3317/6537] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:05 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1199 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:06.812617 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:06.813860 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:06.821777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:06.822253 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:06.823093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:06.823591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:06.986807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:06.992109 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0e3dd4f4-c21c-4b87-bf49-e42b0b1708cf tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1277 microversion: 2.1 time: 0.184810 Jul 01 11:20:06.992691 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3221/6538] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:06 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:07.430768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0ea6c5ba-c9ed-4a90-adac-6635dc4cb4df req-dee04bb2-bd40-4380-9967-b1f3a15d1504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e26fe7-9919-45d8-b3f1-bff2b0d68373", "tag": "1b10750d-0c4f-47dd-bcc9-cb55b8240dd7"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:20:07.447787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0ea6c5ba-c9ed-4a90-adac-6635dc4cb4df req-dee04bb2-bd40-4380-9967-b1f3a15d1504 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:07.448483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0ea6c5ba-c9ed-4a90-adac-6635dc4cb4df req-dee04bb2-bd40-4380-9967-b1f3a15d1504 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:07.462972 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0ea6c5ba-c9ed-4a90-adac-6635dc4cb4df req-dee04bb2-bd40-4380-9967-b1f3a15d1504 service nova] Creating event network-changed:1b10750d-0c4f-47dd-bcc9-cb55b8240dd7 for instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 on n-h1-master-1 Jul 01 11:20:07.470106 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0ea6c5ba-c9ed-4a90-adac-6635dc4cb4df req-dee04bb2-bd40-4380-9967-b1f3a15d1504 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044145 Jul 01 11:20:07.470800 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3318/6539] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:20:08.009660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:08.010309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:08.017938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:08.018397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:08.019175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:08.019613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:08.157121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:08.165812 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62e01125-fdbc-46f8-b940-8ed69ce9ab02 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1277 microversion: 2.1 time: 0.160111 Jul 01 11:20:08.166480 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3222/6540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:08 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:09.184333 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:09.185293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:09.192013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:09.192478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:09.193297 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:09.193753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:09.332400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:09.340403 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a846ea1-2252-483f-8b90-9a0d4a83c559 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1277 microversion: 2.1 time: 0.161137 Jul 01 11:20:09.341005 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3319/6541] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:09 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:10.358176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:10.358743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:10.365848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:10.366302 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:10.367071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:10.367504 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:10.506017 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:10.513785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c855cfbb-c937-441f-8ffa-701b78e45832 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1277 microversion: 2.1 time: 0.160231 Jul 01 11:20:10.514463 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3223/6542] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:10 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:11.530680 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:11.531220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:11.538195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:11.538603 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:11.539404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:11.539851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:11.680205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:11.688034 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9eeba524-09b4-44e1-9358-665cb09e89c8 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1277 microversion: 2.1 time: 0.161757 Jul 01 11:20:11.688597 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3320/6543] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:11 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:12.705227 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:12.705831 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:12.712766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:12.713237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:12.713987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:12.714414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:12.849273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:12.856885 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-854d04c0-e7ed-471d-bf76-0988135efcb5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.155449 Jul 01 11:20:12.857489 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3224/6544] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:12 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:13.873896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:13.874570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:13.877426 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:20:13.882373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:13.882833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:13.883640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:13.884114 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:14.023134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:14.031343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38018a72-d8dd-48c7-892d-4bcd79349689 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.161353 Jul 01 11:20:14.031919 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3321/6545] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:13 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:15.048507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:15.049118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:15.051087 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:20:15.051741 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:20:15.057455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:15.060729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:15.060729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:15.060729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:15.194818 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:15.202541 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-10a0d2f7-d31f-4bcc-87f3-3a0166acbe81 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.158596 Jul 01 11:20:15.203116 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3225/6546] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:15 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:16.219034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:16.219665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:16.226643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:16.227111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:16.227906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:16.228324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:16.366966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:16.375146 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-98bdf933-4731-44a2-a7bf-9dc0633c8b2a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.160049 Jul 01 11:20:16.375734 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3322/6547] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:16 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:17.392266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:17.392858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:17.399956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:17.400449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:17.401233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:17.401664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:17.537856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:17.546078 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c7060375-b0b5-44aa-a404-c2a8369c8030 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.158170 Jul 01 11:20:17.546629 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3226/6548] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:17 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:18.563730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:18.564609 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:18.571510 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:18.571997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:18.572762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:18.573225 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:18.703637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:18.711341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d74443af-c96a-4963-a52b-67783eb0f4c4 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.152318 Jul 01 11:20:18.711907 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3323/6549] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:18 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:19.728781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:19.729484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:19.736424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:19.736874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:19.737658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:19.738095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:19.868451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:19.876715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7cbf6334-6ab9-4d61-b405-136d68236ac1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.151917 Jul 01 11:20:19.877304 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3227/6550] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:19 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:20.894859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:20.895414 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:20.902303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:20.902756 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:20.903520 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:20.903959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:21.040776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:21.048451 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-84651dce-306c-4303-bd12-432753254a6e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.157535 Jul 01 11:20:21.049018 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3324/6551] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:20 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:22.065774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:22.066426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:22.073391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:22.073837 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:22.074585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:22.075017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:22.205921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:22.214594 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa9ba218-720a-4395-b047-12db2a3fc837 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.152957 Jul 01 11:20:22.215174 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3228/6552] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:22 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:23.232021 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:23.232770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:23.241418 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:23.241805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:23.242648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:23.243201 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:23.328177 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6b5d3899-42a3-4099-93e6-0713536d8fca req-9dfa6a5e-d66d-42c8-a5b5-6023d7aab2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e26fe7-9919-45d8-b3f1-bff2b0d68373", "name": "network-vif-plugged", "status": "completed", "tag": "1b10750d-0c4f-47dd-bcc9-cb55b8240dd7"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:20:23.337925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b5d3899-42a3-4099-93e6-0713536d8fca req-9dfa6a5e-d66d-42c8-a5b5-6023d7aab2a1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:23.338370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b5d3899-42a3-4099-93e6-0713536d8fca req-9dfa6a5e-d66d-42c8-a5b5-6023d7aab2a1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:23.353989 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6b5d3899-42a3-4099-93e6-0713536d8fca req-9dfa6a5e-d66d-42c8-a5b5-6023d7aab2a1 service nova] Creating event network-vif-plugged:1b10750d-0c4f-47dd-bcc9-cb55b8240dd7 for instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 on n-h1-master-1 Jul 01 11:20:23.360241 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6b5d3899-42a3-4099-93e6-0713536d8fca req-9dfa6a5e-d66d-42c8-a5b5-6023d7aab2a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111678 Jul 01 11:20:23.361133 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3229/6553] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:20:23.396065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:23.404169 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fd849170-28e2-4dcb-b690-7e19d7f23ec1 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.175820 Jul 01 11:20:23.409638 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3325/6554] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:23 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:24.423074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:24.423768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:24.430228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:24.430665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:24.431416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:24.431846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:24.563903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:24.571926 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1345bc56-670f-4820-a434-6bc69b983859 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1265 microversion: 2.1 time: 0.154558 Jul 01 11:20:24.572495 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3230/6555] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:24 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:25.589103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:25.589764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:25.596818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:25.597321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:25.598101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:25.598550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:25.733450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:25.740965 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ee0ca59-c658-452b-9007-25f736f9ce55 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1452 microversion: 2.1 time: 0.155802 Jul 01 11:20:25.741547 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3326/6556] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:25 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:25.757442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:20:25.758053 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:20:25.765705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:25.769286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:25.769286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:25.769286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:25.901955 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:20:25.909484 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bdb63068-5bd5-4809-9d3d-32c4e43df0cc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1452 microversion: 2.1 time: 0.155914 Jul 01 11:20:25.910067 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3231/6557] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:20:25 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:20:27.940069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1c5c0519-47de-486c-b541-7e8e7d13d21b req-b4b60e8d-9e15-4ef1-abb1-89e9d4858964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e26fe7-9919-45d8-b3f1-bff2b0d68373", "tag": "1b10750d-0c4f-47dd-bcc9-cb55b8240dd7"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:20:27.948413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1c5c0519-47de-486c-b541-7e8e7d13d21b req-b4b60e8d-9e15-4ef1-abb1-89e9d4858964 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:20:27.948968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1c5c0519-47de-486c-b541-7e8e7d13d21b req-b4b60e8d-9e15-4ef1-abb1-89e9d4858964 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:20:27.960022 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1c5c0519-47de-486c-b541-7e8e7d13d21b req-b4b60e8d-9e15-4ef1-abb1-89e9d4858964 service nova] Creating event network-changed:1b10750d-0c4f-47dd-bcc9-cb55b8240dd7 for instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 on n-h1-master-1 Jul 01 11:20:27.965365 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1c5c0519-47de-486c-b541-7e8e7d13d21b req-b4b60e8d-9e15-4ef1-abb1-89e9d4858964 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088314 Jul 01 11:20:27.966099 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3327/6558] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:20:46.310340 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:20:46.311311 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:22:26.451335 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:22:26.451919 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:22:26.779478 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:22:26.780021 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:22:27.076040 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:22:27.076239 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:22:31.185265 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:22:31.185265 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:22:31.185265 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:22:31.185265 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=70 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:22:31.186133 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 01 11:22:31.187464 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 01 11:22:31.188374 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=26 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:22:31.188924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:31.189589 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=58 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:22:31.189741 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:31.194170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a60c6158-1bb5-41e8-bd0d-ad26098a3116 req-b452ccc8-768a-48ea-8688-73f3c1614950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e26fe7-9919-45d8-b3f1-bff2b0d68373", "tag": "1b10750d-0c4f-47dd-bcc9-cb55b8240dd7"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:22:31.196046 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:31.196493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:31.197331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:31.197742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:31.204020 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a60c6158-1bb5-41e8-bd0d-ad26098a3116 req-b452ccc8-768a-48ea-8688-73f3c1614950 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:31.210123 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a60c6158-1bb5-41e8-bd0d-ad26098a3116 req-b452ccc8-768a-48ea-8688-73f3c1614950 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:31.215743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a60c6158-1bb5-41e8-bd0d-ad26098a3116 req-b452ccc8-768a-48ea-8688-73f3c1614950 service nova] Creating event network-changed:1b10750d-0c4f-47dd-bcc9-cb55b8240dd7 for instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 on n-h1-master-1 Jul 01 11:22:31.221804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a60c6158-1bb5-41e8-bd0d-ad26098a3116 req-b452ccc8-768a-48ea-8688-73f3c1614950 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038973 Jul 01 11:22:31.222761 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3328/6559] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:22:31.224685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:22:31.515051 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fbd6a03-c33a-4651-882f-277f30674306 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 204 len: 0 microversion: 2.1 time: 0.334538 Jul 01 11:22:31.519414 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3232/6560] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:22:31 2022] DELETE /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 11:22:31.525801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:31.526518 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:31.534350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:31.535131 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:31.536347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:31.536787 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:31.728382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:31.736427 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a7fca3d4-7e80-431c-a6e1-f17ee543499b tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1577 microversion: 2.1 time: 0.215467 Jul 01 11:22:31.737182 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3329/6561] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:31 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:32.756390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:32.757256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:32.764970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:32.766049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:32.766859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:32.767292 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:32.786329 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39870. Jul 01 11:22:32.789851 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39872. Jul 01 11:22:32.956426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:32.964202 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-079081c4-1e28-4f25-be84-8c2146fd31cb tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1577 microversion: 2.1 time: 0.211971 Jul 01 11:22:32.964777 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3233/6562] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:32 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:33.981964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:33.982592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:33.991428 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:33.991896 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:33.992699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:33.993170 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:34.014567 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39880. Jul 01 11:22:34.020622 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39878. Jul 01 11:22:34.066695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:34.074342 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4223bce7-75ab-44b7-a88b-3467e89a78fa tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1390 microversion: 2.1 time: 0.096234 Jul 01 11:22:34.079736 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3330/6563] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:33 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:34.092169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ac00461c-4d57-4330-9609-22c60db2c869 req-488ccc28-b647-46a1-a738-e884df2c7ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e26fe7-9919-45d8-b3f1-bff2b0d68373", "name": "network-vif-deleted", "tag": "1b10750d-0c4f-47dd-bcc9-cb55b8240dd7"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:22:34.100243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ac00461c-4d57-4330-9609-22c60db2c869 req-488ccc28-b647-46a1-a738-e884df2c7ca7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:34.102670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ac00461c-4d57-4330-9609-22c60db2c869 req-488ccc28-b647-46a1-a738-e884df2c7ca7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:34.113392 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ac00461c-4d57-4330-9609-22c60db2c869 req-488ccc28-b647-46a1-a738-e884df2c7ca7 service nova] Creating event network-vif-deleted:1b10750d-0c4f-47dd-bcc9-cb55b8240dd7 for instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 on n-h1-master-1 Jul 01 11:22:34.118649 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ac00461c-4d57-4330-9609-22c60db2c869 req-488ccc28-b647-46a1-a738-e884df2c7ca7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089442 Jul 01 11:22:34.119586 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3234/6564] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:22:35.091954 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:35.092577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:35.100118 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:35.100579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:35.101377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:35.101828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:35.164514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:35.172139 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8969e29a-0e62-4142-a96b-51017ef8089c tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1224 microversion: 2.1 time: 0.084271 Jul 01 11:22:35.173083 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3331/6565] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:35 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:36.190247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:36.190960 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:36.198411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:36.198867 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:36.199642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:36.200083 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:36.267059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:36.274853 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6662ff5a-69fc-4860-9f06-036eb21e860f tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1224 microversion: 2.1 time: 0.089847 Jul 01 11:22:36.275433 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3235/6566] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:36 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:37.291834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:37.292484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:37.299994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:37.300451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:37.301310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:37.301771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:37.363853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:37.371669 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-88f7aada-7660-48c5-abfd-6e76a2b75ad5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1224 microversion: 2.1 time: 0.083676 Jul 01 11:22:37.372249 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3332/6567] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:37 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:38.389393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:38.390522 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:38.398473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:38.403408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:38.403408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:38.403408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:38.462205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:38.469715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff168f8f-8e07-488b-bfff-cb2009257e31 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 200 len: 1224 microversion: 2.1 time: 0.084170 Jul 01 11:22:38.470450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3236/6568] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:38 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:39.487592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:39.488217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: d6e26fe7-9919-45d8-b3f1-bff2b0d68373] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:39.495180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:39.495642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:39.496417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:39.496868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:39.510037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 could not be found. Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 HTTP/1.1 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: exception: Instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 could not be found. Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd6e26fe7-9919-45d8-b3f1-bff2b0d68373'} Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 could not be found. Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 could not be found. Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:39.511679 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 could not be found. Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance d6e26fe7-9919-45d8-b3f1-bff2b0d68373 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3c136ecf-f5a4-4e7b-84b9-83e5bd892742 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373" status: 404 len: 111 microversion: 2.1 time: 0.030033 Jul 01 11:22:39.518045 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3333/6569] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:39 2022] GET /compute/v2.1/servers/d6e26fe7-9919-45d8-b3f1-bff2b0d68373 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:22:45.900122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:45.900645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:45.902172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c57cf423-828b-4255-9861-0e45b50d6e92 req-7a5447d1-0bb8-46d3-9787-1011964fc995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ca3ecf-d229-4182-bb2c-72020fa5fba8", "tag": "333fd455-38f3-4f04-a1f1-bd2f535a7ca5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:22:45.910835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:45.911145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c57cf423-828b-4255-9861-0e45b50d6e92 req-7a5447d1-0bb8-46d3-9787-1011964fc995 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:45.911835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c57cf423-828b-4255-9861-0e45b50d6e92 req-7a5447d1-0bb8-46d3-9787-1011964fc995 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:45.912536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:45.917896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:45.918421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:45.924017 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c57cf423-828b-4255-9861-0e45b50d6e92 req-7a5447d1-0bb8-46d3-9787-1011964fc995 service nova] Creating event network-changed:333fd455-38f3-4f04-a1f1-bd2f535a7ca5 for instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 on n-h2-master-1 Jul 01 11:22:45.930609 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c57cf423-828b-4255-9861-0e45b50d6e92 req-7a5447d1-0bb8-46d3-9787-1011964fc995 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032040 Jul 01 11:22:45.932426 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3334/6570] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:22:45.956954 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:22:46.277316 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9e240072-5871-43e0-9add-cb41833e9e13 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 204 len: 0 microversion: 2.1 time: 0.380815 Jul 01 11:22:46.277915 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3237/6571] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:22:45 2022] DELETE /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:22:46.287733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:46.291008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:46.300915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:46.301711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:46.302715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:46.303307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:46.449519 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:46.459674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2dfd7fee-42ac-4507-b01d-adab33d88de6 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1578 microversion: 2.1 time: 0.176144 Jul 01 11:22:46.460964 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3335/6572] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:46 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:47.479506 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:47.483128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:47.487946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:47.488397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:47.489361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:47.489800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:47.560701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:47.570032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-56f9503a-fcd9-4978-8524-49446230d9d5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1391 microversion: 2.1 time: 0.095740 Jul 01 11:22:47.570638 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3238/6573] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:47 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:47.946732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-43452752-bed6-4c43-9da4-dc6d32cdc939 req-42b1ca90-b842-4313-b570-5d42636653c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ca3ecf-d229-4182-bb2c-72020fa5fba8", "name": "network-vif-deleted", "tag": "333fd455-38f3-4f04-a1f1-bd2f535a7ca5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:22:47.958576 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-43452752-bed6-4c43-9da4-dc6d32cdc939 req-42b1ca90-b842-4313-b570-5d42636653c1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:47.959127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-43452752-bed6-4c43-9da4-dc6d32cdc939 req-42b1ca90-b842-4313-b570-5d42636653c1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:47.971580 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-43452752-bed6-4c43-9da4-dc6d32cdc939 req-42b1ca90-b842-4313-b570-5d42636653c1 service nova] Creating event network-vif-deleted:333fd455-38f3-4f04-a1f1-bd2f535a7ca5 for instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 on n-h2-master-1 Jul 01 11:22:47.977289 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-43452752-bed6-4c43-9da4-dc6d32cdc939 req-42b1ca90-b842-4313-b570-5d42636653c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034549 Jul 01 11:22:47.977964 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3336/6574] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:22:48.586835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:48.587486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:48.595247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:48.595693 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:48.596458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:48.596890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:48.659555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:48.667238 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ef904d7-84ac-4ff8-99cd-1f87892ddf9e tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1224 microversion: 2.1 time: 0.084323 Jul 01 11:22:48.667806 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3239/6575] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:48 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:49.685494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:49.686201 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:49.693246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:49.693707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:49.694493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:49.694943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:49.760412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:49.768848 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1bdc727-822e-451e-ac39-240a865f8ddd tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1224 microversion: 2.1 time: 0.088774 Jul 01 11:22:49.769463 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3337/6576] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:49 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:50.787320 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:50.788014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:50.795231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:50.795680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:50.796452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:50.797075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:50.859403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:50.867289 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62d41937-39b1-4f60-89d9-a25e4a6c95ce tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1224 microversion: 2.1 time: 0.083884 Jul 01 11:22:50.867883 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3240/6577] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:50 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:51.884110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:51.884772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:51.892115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:51.892321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:51.893040 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:51.893511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:51.957939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed38b7e27f41fb89edab0947241ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561b9efdad3745418365806c411c9bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:22:51.965595 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9278449-207b-44f2-8625-bfbd40283e11 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 200 len: 1224 microversion: 2.1 time: 0.085353 Jul 01 11:22:51.966167 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3338/6578] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:51 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:22:52.983064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:52.983664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: b3ca3ecf-d229-4182-bb2c-72020fa5fba8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:52.990823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:52.991281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:52.992053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:52.992489 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:53.006339 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 could not be found. Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 HTTP/1.1 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: exception: Instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 could not be found. Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'b3ca3ecf-d229-4182-bb2c-72020fa5fba8'} Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 could not be found. Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 could not be found. Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:53.008024 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 could not be found. Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance b3ca3ecf-d229-4182-bb2c-72020fa5fba8 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba2be35c-794a-405f-ae52-a3248e5125b3 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8" status: 404 len: 111 microversion: 2.1 time: 0.030312 Jul 01 11:22:53.013747 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3241/6579] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:52 2022] GET /compute/v2.1/servers/b3ca3ecf-d229-4182-bb2c-72020fa5fba8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:22:53.489066 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:53.489599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:53.496368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:53.496826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:53.497623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:53.498067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:53.510940 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce HTTP/1.1 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '0e52cc9e-da8a-4ba2-9750-79355e64e5ce'} Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:22:53.512503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f6b3508-2a8e-43f8-bd22-cbb04599bd9a tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 404 len: 111 microversion: 2.1 time: 0.029350 Jul 01 11:22:53.517879 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3339/6580] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:22:53 2022] DELETE /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:22:53.522708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:53.523322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] [instance: 0e52cc9e-da8a-4ba2-9750-79355e64e5ce] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:22:53.529470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:53.529922 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:53.530684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:22:53.531632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:22:53.545285 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] HTTP exception thrown: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Request method failure captured: Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce HTTP/1.1 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtW5ophVKAbbD-bA8-PBD2B35az8WhT6ObdCAkoevCUSXP17TzgOqCSRkFQyIqTS-NGSrBY7PPl-mWhV51RpTmMU1SIP6az4p2whEyqmIAoEr0spx-IM6-6GP8wZVA7MDttgi2zjKI4R_0efTXawQgfC3IZDWQQ9yM4H5ZZzEhIA9gw Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/561b9efdad3745418365806c411c9bf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_561b9efdad3745418365806c411c9bf2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/561b9efdad3745418365806c411c9bf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 561b9efdad3745418365806c411c9bf2 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestVolumeBootPattern-75906665 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 29ed38b7e27f41fb89edab0947241ff6 Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestVolumeBootPattern-75906665-project Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '0e52cc9e-da8a-4ba2-9750-79355e64e5ce'} Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:22:53.547440 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Returning 404 to user: Instance 0e52cc9e-da8a-4ba2-9750-79355e64e5ce could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae977ddf-7119-4368-ac3e-d8d14302e1dc tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce" status: 404 len: 111 microversion: 2.1 time: 0.030080 Jul 01 11:22:53.553281 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3242/6581] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:22:53 2022] GET /compute/v2.1/servers/0e52cc9e-da8a-4ba2-9750-79355e64e5ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:22:57.162304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c74f7a67-07c5-49fa-bbc3-32f361b851a5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] Calling method '.version_select at 0x7f6f90c6b790>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:22:57.239322 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c74f7a67-07c5-49fa-bbc3-32f361b851a5 tempest-TestVolumeBootPattern-75906665 tempest-TestVolumeBootPattern-75906665-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-281466780" status: 202 len: 0 microversion: 2.1 time: 0.080755 Jul 01 11:22:57.239898 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3340/6582] 10.222.0.23 () {58 vars in 1259 bytes} [Fri Jul 1 11:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-281466780 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:23:17.128884 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:17.129650 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:17.250883 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2112284606", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:17.303917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] validate_networks() for None {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:23:17.589410 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:23:17.589914 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:23:17.590330 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:23:17.590733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:23:17.591137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:23:17.600117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:17.600558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:17.601385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:17.601815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:17.618122 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Getting quotas for project ed11326da53544548448fbaec39d7fef. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:23:17.623375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Getting quotas for user 7374ec37f8c74d168bb445f10512044f and project ed11326da53544548448fbaec39d7fef. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:23:17.637024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:23:17.639346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:23:17.765180 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-078a2788-1112-4b1d-87a6-be034b852955 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642060 Jul 01 11:23:17.765820 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3243/6583] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:23:17.776311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d020d8b-7462-4a49-a680-e9ea5ac40a85 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:17.776931 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d020d8b-7462-4a49-a680-e9ea5ac40a85 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:17.779268 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=52 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:17.780023 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:17.832797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d020d8b-7462-4a49-a680-e9ea5ac40a85 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:17.840845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d020d8b-7462-4a49-a680-e9ea5ac40a85 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1222 microversion: 2.1 time: 0.067934 Jul 01 11:23:17.849673 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3341/6584] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:17 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:18.858553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fdf5deaa-00ad-4b29-9c9b-b16ce3534c75 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:18.859260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fdf5deaa-00ad-4b29-9c9b-b16ce3534c75 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:18.919559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fdf5deaa-00ad-4b29-9c9b-b16ce3534c75 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:18.926762 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fdf5deaa-00ad-4b29-9c9b-b16ce3534c75 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1222 microversion: 2.1 time: 0.073292 Jul 01 11:23:18.927737 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3244/6585] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:18 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:19.944351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:19.944939 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:19.952324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:19.952792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:19.953602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:19.954140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:20.020088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:20.027518 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a4ccc1b5-751c-45eb-8638-602f3090f0e1 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1274 microversion: 2.1 time: 0.087205 Jul 01 11:23:20.028076 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3342/6586] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:19 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:21.045477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:21.046088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:21.053634 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:21.054085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:21.054848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:21.055284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:21.197175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:21.205377 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9365b9ca-ee7e-46c5-8aea-4b99b55e45e3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1322 microversion: 2.1 time: 0.163853 Jul 01 11:23:21.205903 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3245/6587] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:21 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:22.104836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1263f414-5f2f-42ee-acca-cf1d5a701c17 req-6fbaa29e-d736-472c-8149-da9936450738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff196d5-66b9-4a27-8f66-fe1ffb8b8957", "tag": "6740b44e-fd7f-487f-ac14-cb7d5d62a042"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:22.115699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1263f414-5f2f-42ee-acca-cf1d5a701c17 req-6fbaa29e-d736-472c-8149-da9936450738 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:22.116223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1263f414-5f2f-42ee-acca-cf1d5a701c17 req-6fbaa29e-d736-472c-8149-da9936450738 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:22.135668 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1263f414-5f2f-42ee-acca-cf1d5a701c17 req-6fbaa29e-d736-472c-8149-da9936450738 service nova] Creating event network-changed:6740b44e-fd7f-487f-ac14-cb7d5d62a042 for instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 on n-h2-master-1 Jul 01 11:23:22.141394 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1263f414-5f2f-42ee-acca-cf1d5a701c17 req-6fbaa29e-d736-472c-8149-da9936450738 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041685 Jul 01 11:23:22.142102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3343/6588] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:22.223580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:22.224284 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:22.231783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:22.232235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:22.233100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:22.233605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:22.370558 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:22.378903 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67458b17-01d4-40a2-ac99-71591a6099f2 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1322 microversion: 2.1 time: 0.160299 Jul 01 11:23:22.379575 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3246/6589] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:22 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:23.396392 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:23.397099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:23.404181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:23.404646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:23.405447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:23.405894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:23.539607 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:23.547045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0e561b41-0101-400e-87c5-7cc6618cfb49 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1322 microversion: 2.1 time: 0.154927 Jul 01 11:23:23.547623 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3344/6590] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:23 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:24.563733 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:24.564342 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:24.571518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:24.571959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:24.572708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:24.573137 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:24.699718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:24.707615 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-98268695-cb88-4ea8-806f-27b32ef9ecbe tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1322 microversion: 2.1 time: 0.147818 Jul 01 11:23:24.708181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3247/6591] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:24 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:25.723725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:25.724350 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:25.731345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:25.731807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:25.732580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:25.733029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:26.191276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:26.199238 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3456ea72-6c19-4cb2-9ac9-915935c709d3 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1322 microversion: 2.1 time: 0.479437 Jul 01 11:23:26.199830 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3345/6592] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:25 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:27.216509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:27.217166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:27.224048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:27.224496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:27.225288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:27.225724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:27.353562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:27.360967 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2702022e-ead6-4e81-bb83-98eb62f038cf tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1322 microversion: 2.1 time: 0.148328 Jul 01 11:23:27.361566 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3248/6593] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:27 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:28.072047 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fd3c811a-b96b-473a-b0c7-f8086fbcf5b9 req-8436a2c1-0972-4f7c-bfab-438992dff46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff196d5-66b9-4a27-8f66-fe1ffb8b8957", "name": "network-vif-plugged", "status": "completed", "tag": "6740b44e-fd7f-487f-ac14-cb7d5d62a042"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:28.076570 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:28.082070 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fd3c811a-b96b-473a-b0c7-f8086fbcf5b9 req-8436a2c1-0972-4f7c-bfab-438992dff46c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:28.082552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fd3c811a-b96b-473a-b0c7-f8086fbcf5b9 req-8436a2c1-0972-4f7c-bfab-438992dff46c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:28.093924 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fd3c811a-b96b-473a-b0c7-f8086fbcf5b9 req-8436a2c1-0972-4f7c-bfab-438992dff46c service nova] Creating event network-vif-plugged:6740b44e-fd7f-487f-ac14-cb7d5d62a042 for instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 on n-h2-master-1 Jul 01 11:23:28.099458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fd3c811a-b96b-473a-b0c7-f8086fbcf5b9 req-8436a2c1-0972-4f7c-bfab-438992dff46c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Jul 01 11:23:28.100043 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3346/6594] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:28.378577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:28.379197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:28.381096 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:28.386871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:28.387319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:28.388119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:28.388554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:28.518771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:28.526363 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1c40115c-6aaf-46bc-8b5e-ee3e6b71ceb6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1322 microversion: 2.1 time: 0.152346 Jul 01 11:23:28.526938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3249/6595] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:28 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:29.544365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:29.545212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:29.552319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:29.552781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:29.553590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:29.554036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:29.684866 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:29.693236 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b01c6bb5-e9b9-40ca-9914-94c8982ada83 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1470 microversion: 2.1 time: 0.154250 Jul 01 11:23:29.693803 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3347/6596] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:29 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:23:29.712490 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:29.761782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-337744be-1879-404c-a54d-504e76502893 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Calling method '.version_select at 0x7f6f913b0550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:29.827351 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-337744be-1879-404c-a54d-504e76502893 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c4d7c2a888744ecebde7bb50e281b18f" status: 200 len: 371 microversion: 2.1 time: 0.119297 Jul 01 11:23:29.827913 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3250/6597] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 11:23:29 2022] GET /compute/v2.1/os-quota-sets/c4d7c2a888744ecebde7bb50e281b18f => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:29.838048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-69d40a13-9ee5-4f73-a8f3-07fa72ff7192 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1270141457", "id": 56634284, "os-flavor-access:is_public": "True"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:29.839624 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:23:29.839624 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:23:29.900587 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-69d40a13-9ee5-4f73-a8f3-07fa72ff7192 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.066045 Jul 01 11:23:29.901179 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3348/6598] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:23:29 2022] POST /compute/v2.1/flavors => generated 432 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:29.912484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "56634284"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:29.913559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:29.919690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:29.920139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:29.920938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:29.921401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.007638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '35d73295cc5749a98a9f0a710665752e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d7c2a888744ecebde7bb50e281b18f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:30.013843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1270141457 {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:23:30.020591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.021039 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.021861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.022303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.042715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Getting quotas for project ed11326da53544548448fbaec39d7fef. Resources: {'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:23:30.047772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Getting quotas for user 7374ec37f8c74d168bb445f10512044f and project ed11326da53544548448fbaec39d7fef. Resources: {'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:23:30.059535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.compute.api [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] ram quota exceeded for c4d7c2a888744ecebde7bb50e281b18f, tried to resize instance. Jul 01 11:23:30.060073 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Request method failure captured: Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957/action HTTP/1.1 Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 37 Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtkkDiWW13sSAt94llTb4EyKwsjHa0FqNFu-ZGuN4pxG6A38NIH2dyXSMgP4o03KMqBXkQn0fuO8OEQGuSJZdWzuHioBbBHaCxw6Zfm5WLOjo7yzxsf_R_ps6hjlH5ZyKB1qOYAtGJ0PVue0cNifE18TDe23FwEzPK1Gn2uFqpbJGPA Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: c4d7c2a888744ecebde7bb50e281b18f Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2490812 Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member,admin Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member,admin Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4d7c2a888744ecebde7bb50e281b18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4d7c2a888744ecebde7bb50e281b18f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4d7c2a888744ecebde7bb50e281b18f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4d7c2a888744ecebde7bb50e281b18f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2490812 Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: c4d7c2a888744ecebde7bb50e281b18f Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2490812 Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersAdminNegativeTestJSON-2490812-project-admin Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 35d73295cc5749a98a9f0a710665752e Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2490812-project-admin Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: {"resize": {"flavorRef": "56634284"}} Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'fff196d5-66b9-4a27-8f66-fe1ffb8b8957', 'body': {'resize': {'flavorRef': '56634284'}}} Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:23:30.062060 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1eb3ae9d-f5f0-4381-a4f0-8516f0ffc275 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957/action" status: 403 len: 118 microversion: 2.1 time: 0.154894 Jul 01 11:23:30.068018 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3251/6599] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:23:29 2022] POST /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957/action => generated 118 bytes in 156 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:23:30.072433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-82eff2cb-4ffd-42a4-83f1-f45528a87d3a tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:30.073222 n-d-master-1 devstack@n-api.service[119764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:23:30.073222 n-d-master-1 devstack@n-api.service[119764]: warnings.warn(msg) Jul 01 11:23:30.150834 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-82eff2cb-4ffd-42a4-83f1-f45528a87d3a tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/56634284" status: 202 len: 0 microversion: 2.1 time: 0.081849 Jul 01 11:23:30.151341 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3349/6600] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Jul 1 11:23:30 2022] DELETE /compute/v2.1/flavors/56634284 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:23:30.159754 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-645ee6e8-b757-4ac7-89aa-831322052bb1 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:30.178943 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-645ee6e8-b757-4ac7-89aa-831322052bb1 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023124 Jul 01 11:23:30.179509 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3252/6601] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 11:23:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:30.205464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b70bdeff-01c6-40e5-82be-b2a088f3d04b tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Calling method '.version_select at 0x7f6f90295040>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:30.279166 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b70bdeff-01c6-40e5-82be-b2a088f3d04b tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c4d7c2a888744ecebde7bb50e281b18f" status: 200 len: 371 microversion: 2.1 time: 0.078109 Jul 01 11:23:30.279725 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3350/6602] 10.222.0.23 () {58 vars in 1241 bytes} [Fri Jul 1 11:23:30 2022] GET /compute/v2.1/os-quota-sets/c4d7c2a888744ecebde7bb50e281b18f => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:30.289959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f824eb4e-1e71-4e04-bf03-5e7f430371ff tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1249076931", "id": 1285736870, "os-flavor-access:is_public": "True"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:30.291641 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:23:30.291641 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:23:30.402812 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f824eb4e-1e71-4e04-bf03-5e7f430371ff tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.116483 Jul 01 11:23:30.403321 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3253/6603] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:23:30 2022] POST /compute/v2.1/flavors => generated 437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:23:30.414943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1285736870"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:30.415922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:30.422008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.422455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.423270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.423714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '35d73295cc5749a98a9f0a710665752e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d7c2a888744ecebde7bb50e281b18f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1249076931 {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Getting quotas for project ed11326da53544548448fbaec39d7fef. Resources: {'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Getting quotas for user 7374ec37f8c74d168bb445f10512044f and project ed11326da53544548448fbaec39d7fef. Resources: {'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: INFO nova.compute.api [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] cores quota exceeded for c4d7c2a888744ecebde7bb50e281b18f, tried to resize instance. Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Request method failure captured: Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957/action HTTP/1.1 Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 39 Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtkkDiWW13sSAt94llTb4EyKwsjHa0FqNFu-ZGuN4pxG6A38NIH2dyXSMgP4o03KMqBXkQn0fuO8OEQGuSJZdWzuHioBbBHaCxw6Zfm5WLOjo7yzxsf_R_ps6hjlH5ZyKB1qOYAtGJ0PVue0cNifE18TDe23FwEzPK1Gn2uFqpbJGPA Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: c4d7c2a888744ecebde7bb50e281b18f Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2490812 Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member,admin Jul 01 11:23:30.688889 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member,admin Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4d7c2a888744ecebde7bb50e281b18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4d7c2a888744ecebde7bb50e281b18f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4d7c2a888744ecebde7bb50e281b18f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4d7c2a888744ecebde7bb50e281b18f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2490812 Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: c4d7c2a888744ecebde7bb50e281b18f Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2490812 Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersAdminNegativeTestJSON-2490812-project-admin Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 35d73295cc5749a98a9f0a710665752e Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2490812-project-admin Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: {"resize": {"flavorRef": "1285736870"}} Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'fff196d5-66b9-4a27-8f66-fe1ffb8b8957', 'body': {'resize': {'flavorRef': '1285736870'}}} Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 01 11:23:30.691692 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-21806467-371a-47f0-adc6-84f30f69d149 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957/action" status: 403 len: 113 microversion: 2.1 time: 0.210607 Jul 01 11:23:30.694566 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3351/6604] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:23:30 2022] POST /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957/action => generated 113 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:23:30.696489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c096aa46-769e-4f30-bc3e-a624847c36d7 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:30.696489 n-d-master-1 devstack@n-api.service[119765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 11:23:30.696489 n-d-master-1 devstack@n-api.service[119765]: warnings.warn(msg) Jul 01 11:23:30.803192 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c096aa46-769e-4f30-bc3e-a624847c36d7 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1285736870" status: 202 len: 0 microversion: 2.1 time: 0.176060 Jul 01 11:23:30.803867 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3254/6605] 10.222.0.23 () {58 vars in 1160 bytes} [Fri Jul 1 11:23:30 2022] DELETE /compute/v2.1/flavors/1285736870 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:23:30.812063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a42ff614-6a3c-42a5-9486-3892d27db3d2 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:30.836614 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a42ff614-6a3c-42a5-9486-3892d27db3d2 tempest-ServersAdminNegativeTestJSON-2490812 tempest-ServersAdminNegativeTestJSON-2490812-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028222 Jul 01 11:23:30.837222 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3352/6606] 10.222.0.23 () {58 vars in 1145 bytes} [Fri Jul 1 11:23:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:30.860626 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:30.861131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:30.868293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.868789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.869815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:30.870492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:30.896981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:23:31.145577 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-15e82dad-985f-423e-a145-367a529ed40e tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 204 len: 0 microversion: 2.1 time: 0.288599 Jul 01 11:23:31.146105 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3255/6607] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:23:30 2022] DELETE /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:23:31.154152 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:31.154779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:31.161913 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:31.162377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:31.163175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:31.163625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:31.292978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:31.300546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31ee57c4-9954-417f-947a-201c7df579e6 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1476 microversion: 2.1 time: 0.150269 Jul 01 11:23:31.301108 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3353/6608] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:31 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:32.319132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:32.319861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:32.326852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:32.327300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:32.328053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:32.328587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:32.464803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:32.473075 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bf831543-33f6-4090-8852-75aa5a1b8649 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1476 microversion: 2.1 time: 0.158511 Jul 01 11:23:32.473622 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3256/6609] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:32 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:33.036347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a012a5ee-babc-4da4-8a30-77fa8a6950d9 req-1f09a7dc-141c-4699-ae01-d259acaaadb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff196d5-66b9-4a27-8f66-fe1ffb8b8957", "name": "network-vif-deleted", "tag": "6740b44e-fd7f-487f-ac14-cb7d5d62a042"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:33.045901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a012a5ee-babc-4da4-8a30-77fa8a6950d9 req-1f09a7dc-141c-4699-ae01-d259acaaadb7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:33.046361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a012a5ee-babc-4da4-8a30-77fa8a6950d9 req-1f09a7dc-141c-4699-ae01-d259acaaadb7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:33.061486 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a012a5ee-babc-4da4-8a30-77fa8a6950d9 req-1f09a7dc-141c-4699-ae01-d259acaaadb7 service nova] Creating event network-vif-deleted:6740b44e-fd7f-487f-ac14-cb7d5d62a042 for instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 on n-h2-master-1 Jul 01 11:23:33.066930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a012a5ee-babc-4da4-8a30-77fa8a6950d9 req-1f09a7dc-141c-4699-ae01-d259acaaadb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 Jul 01 11:23:33.067528 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3354/6610] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:33.491255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:33.492221 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:33.498525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:33.498962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:33.499724 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:33.500159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:33.530088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:33.530524 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:33.530962 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lazy-loading 'fault' on Instance uuid fff196d5-66b9-4a27-8f66-fe1ffb8b8957 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:23:33.571348 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7374ec37f8c74d168bb445f10512044f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed11326da53544548448fbaec39d7fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:33.579300 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ccc1c514-3fce-4d17-8198-2d89a18d2a28 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 200 len: 1312 microversion: 2.1 time: 0.092263 Jul 01 11:23:33.579858 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3257/6611] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:33 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:34.599266 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:34.599977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] [instance: fff196d5-66b9-4a27-8f66-fe1ffb8b8957] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:34.606463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:34.606921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:34.607692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:34.608134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:34.621351 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] HTTP exception thrown: Instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 could not be found. Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Request method failure captured: Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 HTTP/1.1 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtkkm8LMYEUiEA_dlR1U6LFV0AuzLp6dmTq71z3BBMJ9S8zwaYCVg8ooyKFjn5I2c0iAZ2R2FifnmHCd_GJUeNfjJhPZq0QgCxWRphJbPVDq0yxilmvcYnkKlPQc7I4WOxoFVeGB8SJx6etEhRGoMXA53poaL0whJ7NNj8zQqNnNnH8 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: ed11326da53544548448fbaec39d7fef Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1424849394 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ed11326da53544548448fbaec39d7fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ed11326da53544548448fbaec39d7fef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ed11326da53544548448fbaec39d7fef", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ed11326da53544548448fbaec39d7fef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1424849394 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: ed11326da53544548448fbaec39d7fef Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1424849394 Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersAdminNegativeTestJSON-1424849394-project Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 7374ec37f8c74d168bb445f10512044f Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1424849394-project Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: exception: Instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 could not be found. Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'fff196d5-66b9-4a27-8f66-fe1ffb8b8957'} Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 could not be found. Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 could not be found. Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:34.622963 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 could not be found. Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] Returning 404 to user: Instance fff196d5-66b9-4a27-8f66-fe1ffb8b8957 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0b5f19ac-7037-4a2a-9431-bb762336e344 tempest-ServersAdminNegativeTestJSON-1424849394 tempest-ServersAdminNegativeTestJSON-1424849394-project] 10.222.0.23 "GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957" status: 404 len: 111 microversion: 2.1 time: 0.031767 Jul 01 11:23:34.626780 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3355/6612] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:34 2022] GET /compute/v2.1/servers/fff196d5-66b9-4a27-8f66-fe1ffb8b8957 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:23:42.612164 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:42.613445 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:42.757269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-45613781", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "541287f6-7bf1-4880-b2c3-3ec3a9ba1f38"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:42.811105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] validate_networks() for [('541287f6-7bf1-4880-b2c3-3ec3a9ba1f38', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:23:43.202738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:23:43.203169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:23:43.203641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:23:43.204660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:23:43.205068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:23:43.213958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:43.214402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:43.215186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:43.215617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:43.233599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Getting quotas for project dee3810d1b284fdda5b54e353425700b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:23:43.239389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Getting quotas for user ee1c63859b3b4923afe6c76a1bdfe7d8 and project dee3810d1b284fdda5b54e353425700b. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:23:43.252121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:23:43.254344 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:23:43.347594 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8aa95533-008d-42cc-ab2d-cfd0a192580e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741989 Jul 01 11:23:43.348268 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3258/6613] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:23:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:23:43.358535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f223041-d7a0-47c5-9ad5-c36128ba4677 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:43.359158 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f223041-d7a0-47c5-9ad5-c36128ba4677 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:43.363075 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:43.365014 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:43.519103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f223041-d7a0-47c5-9ad5-c36128ba4677 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:43.526385 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f223041-d7a0-47c5-9ad5-c36128ba4677 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1213 microversion: 2.1 time: 0.171820 Jul 01 11:23:43.532640 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3356/6614] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:43 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:23:44.545101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:44.545753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:44.558639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:44.558639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:44.558639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:44.558639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:44.673920 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:44.681626 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-356474a8-81e9-4996-b552-f03b7e97ee52 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1217 microversion: 2.1 time: 0.141458 Jul 01 11:23:44.682194 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3259/6615] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:44 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:45.698628 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:45.700072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:45.704852 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=51 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:45.717943 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:45.720563 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:45.723117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:45.723117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:45.796256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:45.805278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d21bc36d-88e3-4bd3-9562-e9790331eabf tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1283 microversion: 2.1 time: 0.110439 Jul 01 11:23:45.806064 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3357/6616] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:45 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:46.824440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:46.825654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:46.838128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:46.838577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:46.839388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:46.839847 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:47.076441 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:47.084636 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-464cea74-98fb-4d7a-9588-a7d4b15106c5 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1313 microversion: 2.1 time: 0.265051 Jul 01 11:23:47.085244 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3260/6617] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:46 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:47.729935 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3b904331-5884-4fea-a503-797780696f08 req-b5e7a9d0-d8b8-491c-a67f-c6cb4d69c86c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40ab352-1b42-4ae8-94e7-177d3096f041", "tag": "fafe250b-ca98-4ef6-83ae-033bf994436b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:47.745317 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3b904331-5884-4fea-a503-797780696f08 req-b5e7a9d0-d8b8-491c-a67f-c6cb4d69c86c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:47.745941 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3b904331-5884-4fea-a503-797780696f08 req-b5e7a9d0-d8b8-491c-a67f-c6cb4d69c86c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:47.758412 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3b904331-5884-4fea-a503-797780696f08 req-b5e7a9d0-d8b8-491c-a67f-c6cb4d69c86c service nova] Creating event network-changed:fafe250b-ca98-4ef6-83ae-033bf994436b for instance f40ab352-1b42-4ae8-94e7-177d3096f041 on n-h2-master-1 Jul 01 11:23:47.763362 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3b904331-5884-4fea-a503-797780696f08 req-b5e7a9d0-d8b8-491c-a67f-c6cb4d69c86c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037419 Jul 01 11:23:47.765269 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3358/6618] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:48.102165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:48.102697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:48.105416 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:48.110829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:48.111284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:48.112054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:48.112491 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:48.117869 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:48.248701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:48.256459 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b662d600-0faf-463f-8c13-da673895a2b1 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1313 microversion: 2.1 time: 0.158326 Jul 01 11:23:48.257108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3261/6619] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:48 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:49.274644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:49.275299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:49.281860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:49.282328 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:49.283107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:49.283560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:49.490899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:49.498456 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-70324841-8df8-467c-a133-74b2787bd437 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1313 microversion: 2.1 time: 0.229046 Jul 01 11:23:49.499025 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3359/6620] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:49 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:50.515886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:50.516554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:50.524910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:50.525501 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:50.526263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:50.526697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:50.659823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:50.667523 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-368ae77b-d995-486d-80b5-1fb27d0f577e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1313 microversion: 2.1 time: 0.155610 Jul 01 11:23:50.668093 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3262/6621] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:50 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:23:51.683683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:51.684312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:51.687106 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:51.692852 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:51.693360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:51.694138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:51.694591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:51.830803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:51.838278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eecda0c3-ac98-43cc-94c3-c58fa5daf104 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1313 microversion: 2.1 time: 0.158514 Jul 01 11:23:51.838844 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3360/6622] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:51 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:52.142027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-cdb57237-8608-48d0-be1c-7fa8c2b587b5 req-8d75de1b-d16a-4312-b851-b7b34851b2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40ab352-1b42-4ae8-94e7-177d3096f041", "name": "network-vif-plugged", "status": "completed", "tag": "fafe250b-ca98-4ef6-83ae-033bf994436b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:52.151033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cdb57237-8608-48d0-be1c-7fa8c2b587b5 req-8d75de1b-d16a-4312-b851-b7b34851b2f3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:52.151478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cdb57237-8608-48d0-be1c-7fa8c2b587b5 req-8d75de1b-d16a-4312-b851-b7b34851b2f3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:52.162746 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-cdb57237-8608-48d0-be1c-7fa8c2b587b5 req-8d75de1b-d16a-4312-b851-b7b34851b2f3 service nova] Creating event network-vif-plugged:fafe250b-ca98-4ef6-83ae-033bf994436b for instance f40ab352-1b42-4ae8-94e7-177d3096f041 on n-h2-master-1 Jul 01 11:23:52.167621 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-cdb57237-8608-48d0-be1c-7fa8c2b587b5 req-8d75de1b-d16a-4312-b851-b7b34851b2f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029368 Jul 01 11:23:52.168204 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3263/6623] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:23:52.854907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:52.855586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:52.862631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:52.863099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:52.863876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:52.864327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:52.995120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:53.003301 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c56e8d70-1a4b-42d1-9337-9c10aa3fe5db tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1313 microversion: 2.1 time: 0.152232 Jul 01 11:23:53.003869 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3361/6624] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:52 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:54.018411 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:54.019190 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:54.023345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:54.024046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:54.030275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:54.030751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:54.032153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:54.032605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:54.162290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:54.169833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc308a97-7e4a-4a9c-a032-0c5de4d87dd8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1500 microversion: 2.1 time: 0.153743 Jul 01 11:23:54.170405 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3264/6625] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:54 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:54.189005 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:23:54.190396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:54.192331 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:23:54.197991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:54.198456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:54.199236 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:54.199691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:54.230120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:54.236079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Old instance type m1.heat2, new instance type m1.heat {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:23:54.242212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:23:54.242646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:23:54.243127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:23:54.243545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:23:54.243964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:23:54.459228 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b60a1865-ab27-4823-a7b9-0388c6c85c3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "POST /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041/action" status: 202 len: 0 microversion: 2.1 time: 0.274565 Jul 01 11:23:54.459863 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3362/6626] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:23:54 2022] POST /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:23:54.468044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:54.468664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:54.475573 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:54.476026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:54.476799 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:54.477267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:54.606682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:54.614786 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-887a7b89-6623-4859-8680-cba54a869a3d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1509 microversion: 2.1 time: 0.150707 Jul 01 11:23:54.615349 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3265/6627] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:54 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:23:55.633080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:55.633760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:55.640253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:55.640761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:55.642196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:55.642635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:55.777718 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:55.785950 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-347fb96a-26be-43df-a722-a51f7c901b0d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1509 microversion: 2.1 time: 0.157705 Jul 01 11:23:55.786515 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3363/6628] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:55 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:23:56.805062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:56.806003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:56.812620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:56.813061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:56.813853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:56.814280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:56.952376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:56.960556 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-352fc3c6-ede2-404e-95f4-3561f15d3065 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1509 microversion: 2.1 time: 0.159375 Jul 01 11:23:56.961174 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3266/6629] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:56 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:57.977966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:57.978583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:57.986013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:57.986471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:57.987238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:57.987681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:58.114015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:58.121431 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d5200b5c-52ae-4d86-9583-f4192b6661eb tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.147346 Jul 01 11:23:58.121991 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3364/6630] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:57 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:23:59.138629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:23:59.139271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:23:59.146763 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:59.147211 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:59.147973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:23:59.148408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:23:59.280826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:23:59.289110 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35c45a31-290a-4ee6-830d-e4d4d3247e0c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.154349 Jul 01 11:23:59.289768 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3267/6631] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:23:59 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:00.306829 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:00.307454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:00.314522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:00.315230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:00.315999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:00.316442 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:00.444101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:00.451623 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1fa3ec0-6318-450c-b2eb-5a4fbdf44d28 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.148821 Jul 01 11:24:00.452183 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3365/6632] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:00 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:01.469012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:01.469681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:01.476552 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:01.476997 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:01.477785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:01.478215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:01.606180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:01.614292 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-67bcd6ec-ac04-4e9b-b6c9-05f997d9203e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.149231 Jul 01 11:24:01.614863 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3268/6633] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:01 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:02.633092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:02.633678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:02.641677 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:02.642144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:02.642979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:02.643493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:02.777740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:02.786006 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f37e06e-f75d-4246-bf28-d53ae64fa871 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.156856 Jul 01 11:24:02.786600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3366/6634] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:02 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:03.803271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:03.803878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:03.809971 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:03.810414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:03.811163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:03.811595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:03.938217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:03.945934 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7d79945d-ad2a-4041-83d2-11d9f705aa77 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.146900 Jul 01 11:24:03.946497 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3269/6635] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:03 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:04.963028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:04.963645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:04.969851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:04.970305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:04.971065 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:04.971505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:05.102475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:05.110933 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8d92d4f7-7272-4d47-bbed-c36a52aa8d99 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.151903 Jul 01 11:24:05.114960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3367/6636] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:04 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:24:06.128548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:06.129179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:06.136231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:06.137951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:06.137951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:06.137951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:06.267695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:06.275204 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a072f59-b8d8-44c2-9191-c9721dbf022c tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.151077 Jul 01 11:24:06.275782 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3270/6637] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:06 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:07.291905 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:07.292556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:07.299499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:07.299960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:07.300739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:07.301205 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:07.688971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:07.696865 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-633eba1d-53ca-4a94-b7d2-0f7d3b3ce599 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.408872 Jul 01 11:24:07.697461 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3368/6638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:07 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:08.714511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:08.715118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:08.722833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:08.723279 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:08.724030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:08.724458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:08.854141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:08.861571 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3476d841-dcd6-4245-809f-56309ca7d22a tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.150908 Jul 01 11:24:08.862135 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3271/6639] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:08 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:09.877999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:09.878622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:09.885506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:09.885977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:09.886754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:09.887199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:10.012336 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:10.019874 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-93bdd653-feb3-4913-a754-a637094e0c06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.145812 Jul 01 11:24:10.020435 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3369/6640] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:09 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:11.036658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:11.037308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:11.044179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:11.044625 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:11.045435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:11.045873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:11.184853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:11.193332 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bb06dd3a-0e90-48a5-9c06-5d4afef05d06 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.160542 Jul 01 11:24:11.193915 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3272/6641] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:11 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:12.210509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:12.211135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:12.218104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:12.218701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:12.219401 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:12.219851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:12.347306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:12.354854 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7e7ced0e-378c-43b5-9034-5af44b620061 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.148234 Jul 01 11:24:12.355423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3370/6642] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:12 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:13.371753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:13.372357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:13.379301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:13.379745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:13.380500 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:13.380930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:13.509535 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:13.518146 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9065c4e8-a077-46bb-8065-0c7599066e15 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.150223 Jul 01 11:24:13.518917 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3273/6643] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:13 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:14.535855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:14.536385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:14.543365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:14.543827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:14.544616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:14.545059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:14.676406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:14.683955 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a235095-2391-4556-bfa3-fc44bffd3b49 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.152624 Jul 01 11:24:14.684511 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3371/6644] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:14 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:15.701193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:15.701817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:15.708811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:15.709305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:15.710074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:15.710514 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:15.838427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:15.846496 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a63ff24b-9d2d-4f21-93d6-3784827461e8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.149219 Jul 01 11:24:15.847072 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3274/6645] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:15 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:16.864133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:16.864769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:16.871818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:16.874540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:16.874540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:16.874540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:17.004178 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:17.007929 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:17.012357 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-23bc1596-5601-43a1-940c-6a3ac68685ae tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.152823 Jul 01 11:24:17.017677 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3372/6646] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:16 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:18.029723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:18.030337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:18.037363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:18.037808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:18.038556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:18.038985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:18.167406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:18.175451 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-04e9a994-c003-4526-a644-823c888bfd0e tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.149599 Jul 01 11:24:18.176020 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3275/6647] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:18 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:19.192774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:19.193357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:19.200606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:19.201111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:19.203522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:19.203522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:19.337498 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:19.346256 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-960d5a2a-288b-4676-8efd-3cb0040451ab tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.158150 Jul 01 11:24:19.347121 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3373/6648] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:19 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:20.363537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:20.364184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:20.371119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:20.371570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:20.372333 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:20.372765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:20.500825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:20.508360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-854dd22e-dc43-4c3c-91d5-916d1f9dbf32 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.149343 Jul 01 11:24:20.508931 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3276/6649] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:20 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:21.525011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:21.525658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:21.533139 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:21.533630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:21.534398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:21.534846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:21.664012 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:21.671666 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c6bc391-fe4a-4df4-a0bb-3b78e9e6d8c6 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.150526 Jul 01 11:24:21.672250 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3374/6650] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:21 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:22.687944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:22.688559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:22.691573 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=32 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:22.696415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:22.696869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:22.697668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:22.698109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:22.702078 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=92 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:22.829179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:22.836645 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d35f75f7-585b-42d4-a9a6-ca872cf03e44 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.152685 Jul 01 11:24:22.837230 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3277/6651] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:22 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:23.854107 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:23.854760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:23.857496 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:23.862248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:23.862708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:23.863474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:23.863920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:23.990129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:23.997528 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-184707f7-9033-4492-a1ed-70779215f571 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.147360 Jul 01 11:24:23.998089 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3375/6652] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:23 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:25.014351 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:25.014959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:25.022014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:25.022456 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:25.023844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:25.023844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:25.163357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:25.171179 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cabd9afe-667d-44e8-bdff-1f63f404d3b9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1514 microversion: 2.1 time: 0.160773 Jul 01 11:24:25.172368 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3278/6653] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:25 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:25.956676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fcd3a1f5-daab-4560-8f7f-731bbfc1251f req-218180e2-a8be-405b-8a57-87a3cc7cd19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40ab352-1b42-4ae8-94e7-177d3096f041", "name": "network-vif-unplugged", "status": "completed", "tag": "fafe250b-ca98-4ef6-83ae-033bf994436b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:24:25.964842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fcd3a1f5-daab-4560-8f7f-731bbfc1251f req-218180e2-a8be-405b-8a57-87a3cc7cd19d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:25.965398 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fcd3a1f5-daab-4560-8f7f-731bbfc1251f req-218180e2-a8be-405b-8a57-87a3cc7cd19d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:25.977645 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fcd3a1f5-daab-4560-8f7f-731bbfc1251f req-218180e2-a8be-405b-8a57-87a3cc7cd19d service nova] Creating event network-vif-unplugged:fafe250b-ca98-4ef6-83ae-033bf994436b for instance f40ab352-1b42-4ae8-94e7-177d3096f041 on n-h1-master-1 Jul 01 11:24:25.983116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-fcd3a1f5-daab-4560-8f7f-731bbfc1251f req-218180e2-a8be-405b-8a57-87a3cc7cd19d service nova] Instance f40ab352-1b42-4ae8-94e7-177d3096f041 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:24:25.995036 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fcd3a1f5-daab-4560-8f7f-731bbfc1251f req-218180e2-a8be-405b-8a57-87a3cc7cd19d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095159 Jul 01 11:24:25.995697 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3376/6654] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:24:26.189066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:26.190015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:26.197215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:26.197663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:26.198423 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:26.198850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:26.352538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:26.362601 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6b6a2aba-ca9d-4846-ad52-e17d6a9509f8 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1513 microversion: 2.1 time: 0.177851 Jul 01 11:24:26.363488 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3279/6655] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:26 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:27.382744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:27.383403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:27.389697 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:27.399092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:27.399092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:27.399092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:27.523207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:27.530859 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d7885a8-f777-4637-9f8a-de336e648ce4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1511 microversion: 2.1 time: 0.153506 Jul 01 11:24:27.531574 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3377/6656] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:27 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:28.011003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a9b97575-c6a2-44db-93ad-844ef0829931 req-43958571-152d-4274-a871-9160cbf27293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40ab352-1b42-4ae8-94e7-177d3096f041", "tag": "fafe250b-ca98-4ef6-83ae-033bf994436b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:24:28.019924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a9b97575-c6a2-44db-93ad-844ef0829931 req-43958571-152d-4274-a871-9160cbf27293 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:28.020365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a9b97575-c6a2-44db-93ad-844ef0829931 req-43958571-152d-4274-a871-9160cbf27293 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:28.032196 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a9b97575-c6a2-44db-93ad-844ef0829931 req-43958571-152d-4274-a871-9160cbf27293 service nova] Creating event network-changed:fafe250b-ca98-4ef6-83ae-033bf994436b for instance f40ab352-1b42-4ae8-94e7-177d3096f041 on n-h1-master-1 Jul 01 11:24:28.037427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-a9b97575-c6a2-44db-93ad-844ef0829931 req-43958571-152d-4274-a871-9160cbf27293 service nova] Instance f40ab352-1b42-4ae8-94e7-177d3096f041 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:24:28.049520 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a9b97575-c6a2-44db-93ad-844ef0829931 req-43958571-152d-4274-a871-9160cbf27293 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042204 Jul 01 11:24:28.050108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3280/6657] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:24:28.548696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:28.549361 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:28.556773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:28.557283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:28.558078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:28.558705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:28.699493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:28.708248 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cfc67414-4478-4b31-ad77-306efb0be778 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1511 microversion: 2.1 time: 0.163334 Jul 01 11:24:28.714600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3378/6658] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:28 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:29.728183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:29.729543 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:29.739874 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:29.740326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:29.741094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:29.741560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:29.868015 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:29.875452 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc80d93a-345e-471c-93cb-b13743e4ebe4 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1508 microversion: 2.1 time: 0.153659 Jul 01 11:24:29.876031 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3281/6659] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:29 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:29.891732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:29.892242 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:29.899783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:29.900191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:29.900960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:29.901435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:29.928520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:24:30.034191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.compute.api [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Found an unconfirmed migration during delete, id: 16, status: finished Jul 01 11:24:32.327727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8166ec68-9577-491d-9ab7-388fc773c944 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 204 len: 0 microversion: 2.1 time: 2.439940 Jul 01 11:24:32.328377 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3379/6660] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:24:29 2022] DELETE /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 0 bytes in 2442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:24:32.336904 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:32.337615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:32.345071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:32.345549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:32.346312 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:32.346749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:32.478941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:32.487095 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-372fab95-eb70-4bb8-ab12-9f026d282a26 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1500 microversion: 2.1 time: 0.154235 Jul 01 11:24:32.487891 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3282/6661] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:32 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:32.598389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ff7a1b38-8f11-467e-afce-71d0370715cc req-9cef158f-4495-43a1-a238-432c0349e10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40ab352-1b42-4ae8-94e7-177d3096f041", "name": "network-vif-plugged", "status": "completed", "tag": "fafe250b-ca98-4ef6-83ae-033bf994436b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:24:32.610413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ff7a1b38-8f11-467e-afce-71d0370715cc req-9cef158f-4495-43a1-a238-432c0349e10f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:32.610875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ff7a1b38-8f11-467e-afce-71d0370715cc req-9cef158f-4495-43a1-a238-432c0349e10f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:32.621813 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ff7a1b38-8f11-467e-afce-71d0370715cc req-9cef158f-4495-43a1-a238-432c0349e10f service nova] Creating event network-vif-plugged:fafe250b-ca98-4ef6-83ae-033bf994436b for instance f40ab352-1b42-4ae8-94e7-177d3096f041 on n-h1-master-1 Jul 01 11:24:32.628094 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ff7a1b38-8f11-467e-afce-71d0370715cc req-9cef158f-4495-43a1-a238-432c0349e10f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087402 Jul 01 11:24:32.628718 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3380/6662] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:24:33.506440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:33.507064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:33.513401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:33.513860 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:33.514633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:33.515072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:33.642332 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:33.650290 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e273f82-befe-49f7-b651-30aed991fd1f tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1500 microversion: 2.1 time: 0.147825 Jul 01 11:24:33.650877 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3283/6663] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:33 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1500 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:24:34.211006 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d9a8252e-408e-4539-a7f7-f786759b85e8 req-54bc1bbd-e6b9-4c5f-8a15-c28dc5eaf61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40ab352-1b42-4ae8-94e7-177d3096f041", "name": "network-vif-deleted", "tag": "fafe250b-ca98-4ef6-83ae-033bf994436b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:24:34.224322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d9a8252e-408e-4539-a7f7-f786759b85e8 req-54bc1bbd-e6b9-4c5f-8a15-c28dc5eaf61f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:34.225029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d9a8252e-408e-4539-a7f7-f786759b85e8 req-54bc1bbd-e6b9-4c5f-8a15-c28dc5eaf61f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:34.236657 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d9a8252e-408e-4539-a7f7-f786759b85e8 req-54bc1bbd-e6b9-4c5f-8a15-c28dc5eaf61f service nova] Creating event network-vif-deleted:fafe250b-ca98-4ef6-83ae-033bf994436b for instance f40ab352-1b42-4ae8-94e7-177d3096f041 on n-h1-master-1 Jul 01 11:24:34.242955 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d9a8252e-408e-4539-a7f7-f786759b85e8 req-54bc1bbd-e6b9-4c5f-8a15-c28dc5eaf61f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035763 Jul 01 11:24:34.242955 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3381/6664] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:24:34.666510 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:34.667233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:34.675284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:34.675740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:34.676517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:34.676951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:34.707664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:34.708112 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:34.708562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lazy-loading 'fault' on Instance uuid f40ab352-1b42-4ae8-94e7-177d3096f041 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:24:34.749906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c63859b3b4923afe6c76a1bdfe7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3810d1b284fdda5b54e353425700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:34.757684 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c6aa902-69de-4fb6-9fd1-1c9d01d1096d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 200 len: 1303 microversion: 2.1 time: 0.095051 Jul 01 11:24:34.758290 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3284/6665] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:34 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:35.776441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:35.777166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:35.783540 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:35.784005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:35.784781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:35.785259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:35.798943 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] HTTP exception thrown: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Request method failure captured: Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 HTTP/1.1 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtk-uxFAhNVMPnoKcLJqEDvHrLiXKHjtyroiVmvxfZCBs5ZhDDb09L-wZwNnfsoYXU3liVKl_uWFUgMpaUM6-xBdEWHL59W6vcIUF6w1Imt7pIM-Wp3MBVQHZrJXaUsfj7r4VRRaUNYOxtEQeMC1R7qUhjj9QacLOtxizCJad3iU38w Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: dee3810d1b284fdda5b54e353425700b Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dee3810d1b284fdda5b54e353425700b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: dee3810d1b284fdda5b54e353425700b Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-808917760-project Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: ee1c63859b3b4923afe6c76a1bdfe7d8 Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-808917760-project Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f40ab352-1b42-4ae8-94e7-177d3096f041'} Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:24:35.800564 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Returning 404 to user: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba7cc8e8-b9a0-4855-b2d2-9843856b1b5d tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 404 len: 111 microversion: 2.1 time: 0.030692 Jul 01 11:24:35.804678 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3382/6666] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:35 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:24:35.815682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:35.816175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:35.823172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:35.823616 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:35.824364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:35.824793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:35.837906 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] HTTP exception thrown: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Request method failure captured: Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 HTTP/1.1 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtk-uxFAhNVMPnoKcLJqEDvHrLiXKHjtyroiVmvxfZCBs5ZhDDb09L-wZwNnfsoYXU3liVKl_uWFUgMpaUM6-xBdEWHL59W6vcIUF6w1Imt7pIM-Wp3MBVQHZrJXaUsfj7r4VRRaUNYOxtEQeMC1R7qUhjj9QacLOtxizCJad3iU38w Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: dee3810d1b284fdda5b54e353425700b Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dee3810d1b284fdda5b54e353425700b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: dee3810d1b284fdda5b54e353425700b Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-DeleteServersTestJSON-808917760-project Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: ee1c63859b3b4923afe6c76a1bdfe7d8 Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-DeleteServersTestJSON-808917760-project Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: exception: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'f40ab352-1b42-4ae8-94e7-177d3096f041'} Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:24:35.839536 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Returning 404 to user: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e99e340e-349b-4f54-be3e-2e6abef78ae9 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 404 len: 111 microversion: 2.1 time: 0.029940 Jul 01 11:24:35.842752 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3285/6667] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:24:35 2022] DELETE /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:24:35.849502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:35.850127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] [instance: f40ab352-1b42-4ae8-94e7-177d3096f041] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:35.856888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:35.857380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:35.858157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:35.859120 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:35.872240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] HTTP exception thrown: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Request method failure captured: Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 HTTP/1.1 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtk-uxFAhNVMPnoKcLJqEDvHrLiXKHjtyroiVmvxfZCBs5ZhDDb09L-wZwNnfsoYXU3liVKl_uWFUgMpaUM6-xBdEWHL59W6vcIUF6w1Imt7pIM-Wp3MBVQHZrJXaUsfj7r4VRRaUNYOxtEQeMC1R7qUhjj9QacLOtxizCJad3iU38w Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: dee3810d1b284fdda5b54e353425700b Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dee3810d1b284fdda5b54e353425700b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dee3810d1b284fdda5b54e353425700b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: dee3810d1b284fdda5b54e353425700b Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-DeleteServersTestJSON-808917760 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-DeleteServersTestJSON-808917760-project Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: ee1c63859b3b4923afe6c76a1bdfe7d8 Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-DeleteServersTestJSON-808917760-project Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f40ab352-1b42-4ae8-94e7-177d3096f041'} Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:24:35.873813 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] Returning 404 to user: Instance f40ab352-1b42-4ae8-94e7-177d3096f041 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f87e5537-e8b5-4cd6-a4f0-94822e9acf67 tempest-DeleteServersTestJSON-808917760 tempest-DeleteServersTestJSON-808917760-project] 10.222.0.23 "GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041" status: 404 len: 111 microversion: 2.1 time: 0.030263 Jul 01 11:24:35.878837 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3383/6668] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:35 2022] GET /compute/v2.1/servers/f40ab352-1b42-4ae8-94e7-177d3096f041 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:24:46.591339 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=19 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:46.592789 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=49 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:46.777413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1319518121", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "32aae430-2b03-4ab7-aad1-8cef3ca4f3c8"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:24:46.852992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] validate_networks() for [('32aae430-2b03-4ab7-aad1-8cef3ca4f3c8', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:24:47.341088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:24:47.341555 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:24:47.342068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:24:47.342643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:24:47.343065 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:24:47.352921 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:47.353478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:47.354287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:47.354726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:47.371950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Getting quotas for project 782d296151f349bfb5c3bf2afa8e882e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:24:47.377261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Getting quotas for user 75191c7df2c146219f929565e1e0c733 and project 782d296151f349bfb5c3bf2afa8e882e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:24:47.389764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:24:47.392111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:24:47.511833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a32abede-8f6a-4ae3-95f5-59d68640fd92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927001 Jul 01 11:24:47.512669 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3286/6669] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:24:47.523159 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e51f2d1b-e07d-48d8-8804-b766275cc761 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:47.523779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e51f2d1b-e07d-48d8-8804-b766275cc761 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:47.528375 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:47.529432 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:47.590859 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e51f2d1b-e07d-48d8-8804-b766275cc761 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:47.601288 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e51f2d1b-e07d-48d8-8804-b766275cc761 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1218 microversion: 2.1 time: 0.082494 Jul 01 11:24:47.602084 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3384/6670] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:47 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:48.619843 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:48.620453 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:48.627451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:48.628145 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:48.629078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:48.629538 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:48.705998 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:48.713962 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5e875463-e828-4814-bfbd-e0a51f0d02c5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1222 microversion: 2.1 time: 0.098858 Jul 01 11:24:48.714545 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3287/6671] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:48 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:49.731501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:49.732138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:49.741577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:49.741968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:49.742753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:49.743426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:49.810337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:49.820150 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60396abf-c947-416d-aec8-fb31d3f19860 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1278 microversion: 2.1 time: 0.092938 Jul 01 11:24:49.820973 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3385/6672] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:49 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:50.838997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:50.839802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:50.847522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:50.847994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:50.848955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:50.849605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:50.987776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:50.995783 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c6b53c9c-21c4-4d53-9f18-58bbd1a65756 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.160856 Jul 01 11:24:50.996392 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3288/6673] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:50 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:51.724088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a19e429a-e61d-4a19-a1bd-a1eea6b5905f req-8eaff67f-e7bb-464b-8ff9-8f635aae1e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f39681-aa15-4247-bdfe-bdc7b1bdcc50", "tag": "d3b53bf6-fc56-4e75-acae-841c9eb2b387"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:24:51.735016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a19e429a-e61d-4a19-a1bd-a1eea6b5905f req-8eaff67f-e7bb-464b-8ff9-8f635aae1e57 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:51.735631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a19e429a-e61d-4a19-a1bd-a1eea6b5905f req-8eaff67f-e7bb-464b-8ff9-8f635aae1e57 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:51.747584 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a19e429a-e61d-4a19-a1bd-a1eea6b5905f req-8eaff67f-e7bb-464b-8ff9-8f635aae1e57 service nova] Creating event network-changed:d3b53bf6-fc56-4e75-acae-841c9eb2b387 for instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 on n-h1-master-1 Jul 01 11:24:51.753279 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a19e429a-e61d-4a19-a1bd-a1eea6b5905f req-8eaff67f-e7bb-464b-8ff9-8f635aae1e57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038377 Jul 01 11:24:51.753943 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3386/6674] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:24:52.014349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:52.014886 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:52.022327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:52.022778 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:52.023547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:52.023981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:52.158647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:52.166115 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8bebadd-52e0-4d9a-a459-fbdc16ab9915 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.155952 Jul 01 11:24:52.166702 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3289/6675] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:52 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:53.184766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:53.185503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:53.192610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:53.193070 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:53.193859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:53.194304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:53.324507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:53.332005 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a972b1be-ab84-4c3b-9967-fdedf49c1559 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.152306 Jul 01 11:24:53.332572 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3387/6676] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:53 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:54.348550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:54.349216 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:54.356212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:54.356660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:54.357463 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:54.357898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:54.489402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:54.496884 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46a549ba-db5b-4f11-ae3b-915106de1687 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.152274 Jul 01 11:24:54.497485 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3290/6677] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:54 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:55.513960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:55.514586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:55.523731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:55.524195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:55.524976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:55.525469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:55.654362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:55.662705 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d96c8f8a-634a-4212-8732-6d60fd156c09 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.152660 Jul 01 11:24:55.663269 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3388/6678] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:55 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:56.679866 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:56.680517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:56.690492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:56.690938 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:56.691711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:56.692149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:56.832493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:56.840459 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3a467046-99b4-48ba-9f1d-24110f28bc87 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.164518 Jul 01 11:24:56.842568 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3291/6679] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:56 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:57.857371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:57.857907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:57.860802 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:57.865665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:57.866121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:57.866893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:57.867334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:57.997509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:58.005599 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2381b2a1-9d9f-4c6a-9930-a8303348d26a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.152226 Jul 01 11:24:58.006219 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3389/6680] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:57 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:24:58.608388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2ec5ca42-c35a-4e7d-9e2f-815fe54737c2 req-a5e7efd7-7dfe-4d3c-8b6e-d678972fad74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f39681-aa15-4247-bdfe-bdc7b1bdcc50", "name": "network-vif-plugged", "status": "completed", "tag": "d3b53bf6-fc56-4e75-acae-841c9eb2b387"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:24:58.612133 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:58.612897 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:24:58.619243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2ec5ca42-c35a-4e7d-9e2f-815fe54737c2 req-a5e7efd7-7dfe-4d3c-8b6e-d678972fad74 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:58.619692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2ec5ca42-c35a-4e7d-9e2f-815fe54737c2 req-a5e7efd7-7dfe-4d3c-8b6e-d678972fad74 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:58.631448 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2ec5ca42-c35a-4e7d-9e2f-815fe54737c2 req-a5e7efd7-7dfe-4d3c-8b6e-d678972fad74 service nova] Creating event network-vif-plugged:d3b53bf6-fc56-4e75-acae-841c9eb2b387 for instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 on n-h1-master-1 Jul 01 11:24:58.636504 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2ec5ca42-c35a-4e7d-9e2f-815fe54737c2 req-a5e7efd7-7dfe-4d3c-8b6e-d678972fad74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031876 Jul 01 11:24:58.637412 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3292/6681] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:24:59.022577 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:24:59.023752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:24:59.030924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:59.031933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:59.032760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:24:59.033246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:24:59.160891 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:24:59.168552 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dcce990c-42a9-4f8d-aeb8-cdf96634ea81 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1318 microversion: 2.1 time: 0.150092 Jul 01 11:24:59.169236 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3390/6682] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:24:59 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:00.186668 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:00.187376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:00.194404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.194857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.195623 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.196092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.335286 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:00.342939 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13a463e4-bfe6-4490-9d3e-1d231c68126f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1508 microversion: 2.1 time: 0.162127 Jul 01 11:25:00.344077 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3293/6683] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:00 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:00.360536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:00.361262 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:00.368318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.368783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.369591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.370044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.496512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:00.504343 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01e21cf2-b9b4-4cef-82ab-14b341212ce0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1508 microversion: 2.1 time: 0.148308 Jul 01 11:25:00.504921 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3391/6684] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:00 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:00.521058 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9ede2732-4f79-4da6-955a-98e240aaab58 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:00.522248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9ede2732-4f79-4da6-955a-98e240aaab58 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:00.528599 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ede2732-4f79-4da6-955a-98e240aaab58 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.529045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ede2732-4f79-4da6-955a-98e240aaab58 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.529872 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ede2732-4f79-4da6-955a-98e240aaab58 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.530302 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ede2732-4f79-4da6-955a-98e240aaab58 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.646035 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9ede2732-4f79-4da6-955a-98e240aaab58 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "PUT /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1080 microversion: 2.1 time: 0.128831 Jul 01 11:25:00.646713 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3294/6685] 10.222.0.23 () {60 vars in 1255 bytes} [Fri Jul 1 11:25:00 2022] PUT /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1080 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:00.661743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:00.662374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:00.668586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.669054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.669875 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.670333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.806564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:00.815532 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-64413c11-b5d7-45fd-a970-0097c3153c70 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1506 microversion: 2.1 time: 0.157630 Jul 01 11:25:00.816109 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3392/6686] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:00 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:00.831798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:00.832410 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:00.838794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.839182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.839942 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:00.840375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:00.972657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:00.980461 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b4e2b92c-02d5-412f-9e2b-0d5c2ba431a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1506 microversion: 2.1 time: 0.153066 Jul 01 11:25:00.981037 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3295/6687] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:00 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:00.996624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:00.997603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:01.004230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:01.004698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:01.005528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:01.005984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:01.035532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:01.041737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Old instance type m1.heat2, new instance type m1.heat {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:25:01.048299 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:25:01.048734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:25:01.049244 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:25:01.049662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:25:01.050080 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:25:01.228638 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-040d1f7d-89e7-453f-8ce7-36c4a1b73dde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "POST /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50/action" status: 202 len: 0 microversion: 2.1 time: 0.235929 Jul 01 11:25:01.229398 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3393/6688] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:25:00 2022] POST /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:25:01.238256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:01.239089 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:01.246353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:01.246845 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:01.247577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:01.248010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:01.383602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:01.391834 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-83ef31b2-4091-4af3-9662-b4d43847957e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1517 microversion: 2.1 time: 0.158272 Jul 01 11:25:01.392415 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3296/6689] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:01 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:02.409282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:02.409948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:02.419395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:02.419395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:02.419395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:02.419395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:02.550688 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:02.558982 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d966f03a-6e4d-4737-aa7a-6d574d5ae1ae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1517 microversion: 2.1 time: 0.153721 Jul 01 11:25:02.559554 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3394/6690] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:02 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:03.575945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:03.576559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:03.582917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:03.583369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:03.584129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:03.584561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:03.727309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:03.734959 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7b2e750a-0457-4351-86be-276cda604b67 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1517 microversion: 2.1 time: 0.162961 Jul 01 11:25:03.736070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3297/6691] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:03 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:25:04.752458 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:04.753077 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:04.759443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:04.759905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:04.760678 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:04.761129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:04.890464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:04.898632 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d39e4840-39a1-4c63-93b9-00d19e8aa966 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.150617 Jul 01 11:25:04.899148 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3395/6692] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:04 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:05.915710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:05.916283 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:05.923993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:05.924433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:05.925220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:05.925647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:06.057418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:06.065242 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de80d8c7-263e-4c5e-a91a-af38042b2241 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.153172 Jul 01 11:25:06.065809 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3298/6693] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:05 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:07.082415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:07.083046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:07.089978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:07.090438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:07.091216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:07.091668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:07.218736 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:07.227123 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0214be16-6a96-49a2-a68e-cb9eac7e12a5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.149119 Jul 01 11:25:07.227708 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3396/6694] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:07 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:08.243876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:08.244517 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:08.252070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:08.252505 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:08.253296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:08.253726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:08.382716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:08.390236 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e6ab9667-aa2f-42f8-b502-78298dd3d87e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.150233 Jul 01 11:25:08.390802 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3299/6695] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:08 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:09.406991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:09.408193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:09.415363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:09.415830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:09.416618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:09.417072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:09.547369 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:09.554905 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9e33d08-f23b-48bf-a6e9-8792c10307d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.151842 Jul 01 11:25:09.555472 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3397/6696] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:09 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:10.571840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:10.572452 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:10.580126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:10.580571 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:10.581390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:10.587691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:10.711609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:10.719003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e8f078c7-e6f7-4577-8f47-be4dc4939e9c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.151139 Jul 01 11:25:10.719565 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3300/6697] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:10 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:11.736663 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:11.737343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:11.744282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:11.744746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:11.745558 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:11.746013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:11.882079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:11.889650 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5a749d21-2fd3-4eba-89c5-908005c653ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.157310 Jul 01 11:25:11.890221 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3398/6698] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:11 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:12.906120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:12.906669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:12.913533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:12.913978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:12.914728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:12.915173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:13.042404 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:13.050482 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-233dfa81-e878-4f3d-8c31-4ad88f1cbfe2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.148283 Jul 01 11:25:13.051051 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3301/6699] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:12 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:14.068232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:14.068909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:14.075879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:14.076342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:14.077117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:14.077594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:14.208549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:14.216088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a5a7950-1e35-4436-bece-1bd016e9fe1c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.152648 Jul 01 11:25:14.216644 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3399/6700] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:14 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:15.233403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:15.234026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:15.241769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:15.242224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:15.242978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:15.243417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:15.370537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:15.378089 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b85fa3d0-378b-4436-98c4-b164794f384c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.148882 Jul 01 11:25:15.378652 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3302/6701] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:15 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:16.395551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:16.396202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:16.404280 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:16.404745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:16.405559 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:16.406010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:16.554121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:16.557557 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:16.561988 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-47c723c1-12c5-4c8d-8f29-528150800d50 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.170512 Jul 01 11:25:16.564745 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3400/6702] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:16 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:17.579805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:17.580413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:17.583225 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:17.587969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:17.588418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:17.589202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:17.589645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:17.592179 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:17.721544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:17.729014 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-226cb181-fd81-483b-84df-5d380f46cdda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.153742 Jul 01 11:25:17.729615 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3303/6703] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:17 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:18.746533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:18.747193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:18.755410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:18.755879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:18.756669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:18.757124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:18.886867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:18.895066 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b9b84525-95b4-461b-b74f-67d921f15f13 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.152519 Jul 01 11:25:18.895588 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3401/6704] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:18 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:19.912614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:19.913134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:19.920161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:19.920603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:19.921392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:19.921820 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:20.064549 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:20.072429 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e7132883-2c84-456f-9ea3-f9b44aece6af tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.163868 Jul 01 11:25:20.073035 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3304/6705] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:19 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:21.090013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:21.090655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:21.093443 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=43 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:21.098648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:21.099105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:21.099872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:21.100315 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:21.227808 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:21.235915 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3df86054-d06c-4b0e-ac53-ff21554b9b6b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.149204 Jul 01 11:25:21.236475 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3402/6706] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:21 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:22.252888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:22.253557 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:22.260381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:22.260830 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:22.261625 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:22.262057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:22.389045 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:22.396546 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dde88025-7c6d-44a2-88d6-249277601c42 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.148362 Jul 01 11:25:22.397117 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3305/6707] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:22 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:23.413415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:23.414034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:23.420905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:23.421392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:23.422164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:23.422628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:23.553985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:23.561495 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d0f9807-d0e4-4b35-8065-1b29a5bed637 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.152007 Jul 01 11:25:23.562071 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3403/6708] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:23 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:24.579266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:24.579796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:24.586731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:24.587174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:24.587925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:24.588356 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:24.718519 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:24.726100 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5064da1a-b140-4bbc-b6ba-cfde216fb6ba tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.150830 Jul 01 11:25:24.726918 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3306/6709] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:24 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:25.743529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:25.744181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:25.751626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:25.752090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:25.752879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:25.753356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:25.882722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:25.890541 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ae737acd-10b6-474b-81bc-27c42d3649bf tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.150923 Jul 01 11:25:25.891673 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3404/6710] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:25 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:26.907700 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:26.908246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:26.915059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:26.916153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:26.916247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:26.916672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:27.045077 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:27.053176 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a121c504-35a3-429b-9ac0-dcef858b3849 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.149501 Jul 01 11:25:27.053748 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3307/6711] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:26 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:28.070311 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:28.070981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:28.078111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:28.079256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:28.080053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:28.080509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:28.215791 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:28.223385 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec0c15c4-d493-4842-8ee9-6ba5bf626b8b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.157014 Jul 01 11:25:28.227263 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3405/6712] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:28 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:25:29.242564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:29.243081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:29.250168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:29.251147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:29.251906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:29.252358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:29.380949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:29.388382 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-742cacd0-169b-4601-bade-4d00d3164f5c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.149810 Jul 01 11:25:29.388946 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3308/6713] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:29 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:30.406010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:30.407274 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:30.414220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:30.414691 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:30.415471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:30.415923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:30.547400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:30.555074 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62f53eea-08b7-4bcd-bc57-68c62b4546b0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.153030 Jul 01 11:25:30.556606 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3406/6714] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:30 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:31.572042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:31.572658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:31.580452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:31.580908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:31.581717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:31.582158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:31.713117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:31.720704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b5b06c6a-0c15-4743-889d-3816c06063ab tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.152525 Jul 01 11:25:31.721302 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3309/6715] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:31 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:32.737752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:32.738404 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:32.745550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:32.746015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:32.746794 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:32.747241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:32.876506 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:32.884208 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac4d91b2-8ec5-4d11-86e7-32b1eb50b88a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.150439 Jul 01 11:25:32.885055 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3407/6716] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:32 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:25:33.901707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:33.929649 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:33.929649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:33.929649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:33.929649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:33.929649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:34.054720 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:34.062492 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d22d9603-a8bf-4a53-b4bb-4f928146b73f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.164696 Jul 01 11:25:34.063077 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3310/6717] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:33 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:35.080772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:35.081414 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:35.087828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:35.088286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:35.089059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:35.089651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:35.215871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:35.223615 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d18a2e7-5fa1-4cfd-99b3-9365747df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.147388 Jul 01 11:25:35.224185 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3408/6718] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:35 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:36.241072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:36.241742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:36.249291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:36.252481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:36.252481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:36.252481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:36.383897 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:36.387405 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-775516ef-bfda-40d2-a559-97d27aef06c8 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1522 microversion: 2.1 time: 0.150539 Jul 01 11:25:36.387973 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3311/6719] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:36 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:37.404309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:37.404933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:37.412611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:37.413076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:37.413898 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:37.414349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:37.547494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:37.555096 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9f30e3c-64c9-4623-89a1-8c0ccf57d935 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1521 microversion: 2.1 time: 0.154714 Jul 01 11:25:37.555674 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3409/6720] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:37 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:37.787331 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-acde9db3-4b0b-4f9e-a1bc-634e5950ffb1 req-3c25ba8a-145c-4cbf-adf6-ceb669676ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f39681-aa15-4247-bdfe-bdc7b1bdcc50", "name": "network-vif-unplugged", "status": "completed", "tag": "d3b53bf6-fc56-4e75-acae-841c9eb2b387"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:37.796327 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-acde9db3-4b0b-4f9e-a1bc-634e5950ffb1 req-3c25ba8a-145c-4cbf-adf6-ceb669676ee5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:37.796766 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-acde9db3-4b0b-4f9e-a1bc-634e5950ffb1 req-3c25ba8a-145c-4cbf-adf6-ceb669676ee5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:37.808873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-acde9db3-4b0b-4f9e-a1bc-634e5950ffb1 req-3c25ba8a-145c-4cbf-adf6-ceb669676ee5 service nova] Creating event network-vif-unplugged:d3b53bf6-fc56-4e75-acae-841c9eb2b387 for instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 on n-h2-master-1 Jul 01 11:25:37.815873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-acde9db3-4b0b-4f9e-a1bc-634e5950ffb1 req-3c25ba8a-145c-4cbf-adf6-ceb669676ee5 service nova] Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:25:37.825622 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-acde9db3-4b0b-4f9e-a1bc-634e5950ffb1 req-3c25ba8a-145c-4cbf-adf6-ceb669676ee5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041961 Jul 01 11:25:37.826226 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3312/6721] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:25:38.573075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:38.573730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:38.580634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:38.581099 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:38.581916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:38.582373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:38.715765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:38.723949 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f6ea436-4b08-4cf5-8516-0b95ecaa804a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1521 microversion: 2.1 time: 0.154788 Jul 01 11:25:38.724521 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3410/6722] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:38 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:39.742683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:39.743384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:39.749614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:39.750654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:39.751416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:39.751851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:39.840204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ed993c6d-508f-49d9-8295-001801296755 req-40efb59a-233f-40b2-abcc-ae281790ce94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f39681-aa15-4247-bdfe-bdc7b1bdcc50", "tag": "d3b53bf6-fc56-4e75-acae-841c9eb2b387"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:39.849747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ed993c6d-508f-49d9-8295-001801296755 req-40efb59a-233f-40b2-abcc-ae281790ce94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:39.850203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ed993c6d-508f-49d9-8295-001801296755 req-40efb59a-233f-40b2-abcc-ae281790ce94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:39.862566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ed993c6d-508f-49d9-8295-001801296755 req-40efb59a-233f-40b2-abcc-ae281790ce94 service nova] Creating event network-changed:d3b53bf6-fc56-4e75-acae-841c9eb2b387 for instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 on n-h2-master-1 Jul 01 11:25:39.868095 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-ed993c6d-508f-49d9-8295-001801296755 req-40efb59a-233f-40b2-abcc-ae281790ce94 service nova] Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:25:39.879577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ed993c6d-508f-49d9-8295-001801296755 req-40efb59a-233f-40b2-abcc-ae281790ce94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043017 Jul 01 11:25:39.880366 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3411/6723] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:25:39.887495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:39.895090 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa454016-8b70-4f60-8297-66abfa55278c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1519 microversion: 2.1 time: 0.157465 Jul 01 11:25:39.895671 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3313/6724] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:39 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:40.912732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:40.913474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:40.922966 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:40.925969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:40.925969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:40.925969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:41.053770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:41.061449 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-09756945-1a92-4c7a-97a7-84df1fa5aa88 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1516 microversion: 2.1 time: 0.153203 Jul 01 11:25:41.063379 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3412/6725] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:40 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:41.078933 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b788ce41-5ce2-41b8-bd63-726edf43c9b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:41.079450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b788ce41-5ce2-41b8-bd63-726edf43c9b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:41.086227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b788ce41-5ce2-41b8-bd63-726edf43c9b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:41.086671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b788ce41-5ce2-41b8-bd63-726edf43c9b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:41.087421 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b788ce41-5ce2-41b8-bd63-726edf43c9b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:41.087852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b788ce41-5ce2-41b8-bd63-726edf43c9b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:41.245237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b788ce41-5ce2-41b8-bd63-726edf43c9b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "POST /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50/action" status: 204 len: 0 microversion: 2.1 time: 0.170045 Jul 01 11:25:41.245908 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3314/6726] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:25:41 2022] POST /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50/action => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:25:41.255985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:41.256617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:41.262698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:41.263935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:41.264329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:41.264786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:41.402314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:41.410604 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5be2cc1-b330-4ea5-846e-c2cbb0f5734d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1516 microversion: 2.1 time: 0.160377 Jul 01 11:25:41.411173 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3413/6727] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:41 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:42.429480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:42.430185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:42.436353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:42.436797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:42.438307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:42.438734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:42.571199 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:42.579286 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0c4ac950-206d-40c7-a19f-86b73a9f01d2 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1516 microversion: 2.1 time: 0.154905 Jul 01 11:25:42.579889 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3315/6728] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:42 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:43.596702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:43.597357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:43.604319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:43.607356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:43.607356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:43.607356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:43.735817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:43.743361 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-299ad6a9-559e-4aa2-8904-a8e468f26c34 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1508 microversion: 2.1 time: 0.151131 Jul 01 11:25:43.743944 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3414/6729] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:43 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:43.759209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:43.759819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:43.766681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:43.767121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:43.767870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:43.768301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:43.898450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:43.905879 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e369f67-bc8e-49e0-a308-27aa5f1df6c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1508 microversion: 2.1 time: 0.150562 Jul 01 11:25:43.907104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3316/6730] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:43 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:43.925550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c40431d-dfe2-4bac-8bcd-5be27a032189 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'create', calling method: .version_select at 0x7f6f91213e50>, body: {"keypair": {"name": "tempest-keypair-70365061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG501YPV6w5hSjaTlvQRlDUHhmdDaz8KIKVl0YWDWKPHZeD5q52hVRKYlu8AJGsHkaG+91IOOKWsIXdH6MPn9YGgaKIR2CVM28WawfomV928TcqFVWpOkr2uU9jEuFhzw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:43.941906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0c40431d-dfe2-4bac-8bcd-5be27a032189 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Getting quotas for project 782d296151f349bfb5c3bf2afa8e882e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:25:43.946969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-0c40431d-dfe2-4bac-8bcd-5be27a032189 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Getting quotas for user 75191c7df2c146219f929565e1e0c733 and project 782d296151f349bfb5c3bf2afa8e882e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:25:44.050056 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c40431d-dfe2-4bac-8bcd-5be27a032189 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.128406 Jul 01 11:25:44.050653 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3415/6731] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:25:43 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:25:44.704082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-19e547ac-e8d9-4b33-a8e0-7eb087db0f9a req-3ef0f95a-c042-418b-b5b7-d1354bff05e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f39681-aa15-4247-bdfe-bdc7b1bdcc50", "name": "network-vif-plugged", "status": "completed", "tag": "d3b53bf6-fc56-4e75-acae-841c9eb2b387"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:44.712783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-19e547ac-e8d9-4b33-a8e0-7eb087db0f9a req-3ef0f95a-c042-418b-b5b7-d1354bff05e2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:44.713180 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-19e547ac-e8d9-4b33-a8e0-7eb087db0f9a req-3ef0f95a-c042-418b-b5b7-d1354bff05e2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:44.724442 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-19e547ac-e8d9-4b33-a8e0-7eb087db0f9a req-3ef0f95a-c042-418b-b5b7-d1354bff05e2 service nova] Creating event network-vif-plugged:d3b53bf6-fc56-4e75-acae-841c9eb2b387 for instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 on n-h2-master-1 Jul 01 11:25:44.730310 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-19e547ac-e8d9-4b33-a8e0-7eb087db0f9a req-3ef0f95a-c042-418b-b5b7-d1354bff05e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030572 Jul 01 11:25:44.733588 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3317/6732] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:25:46.566347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:46.566978 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:46.576442 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:46.576899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:46.577721 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:46.578238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:46.709778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:46.717641 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68e76f03-596e-4ae7-a739-2eb85975fbac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 200 len: 1508 microversion: 2.1 time: 0.156404 Jul 01 11:25:46.718237 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3416/6733] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:46 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:46.736074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:46.736665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:46.743111 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:46.743557 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:46.744328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:46.744765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:46.769577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:25:46.795967 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:47.034526 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4248346e-5087-4295-ad33-48fbd0836fae tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 204 len: 0 microversion: 2.1 time: 0.303757 Jul 01 11:25:47.035178 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3318/6734] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:25:46 2022] DELETE /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:25:47.083968 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:25:47.084229 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:25:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:25:47.232830 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-663844822", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "32aae430-2b03-4ab7-aad1-8cef3ca4f3c8"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:47.283396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] validate_networks() for [('32aae430-2b03-4ab7-aad1-8cef3ca4f3c8', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:25:47.725696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:25:47.726261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:25:47.726639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:25:47.727059 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:25:47.727485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:25:47.737138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:47.737628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:47.738442 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:47.738894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:47.758613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Getting quotas for project 782d296151f349bfb5c3bf2afa8e882e. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:25:47.763966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Getting quotas for user 75191c7df2c146219f929565e1e0c733 and project 782d296151f349bfb5c3bf2afa8e882e. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:25:47.776564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:25:47.778880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:25:47.903960 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3693163d-a2d3-4695-b1de-4a6196efecb4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674872 Jul 01 11:25:47.904756 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3417/6735] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:25:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:25:47.915450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae1825c4-9544-4a76-821c-ab0f6c2ee257 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:47.916158 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae1825c4-9544-4a76-821c-ab0f6c2ee257 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:47.922397 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:47.974546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ae1825c4-9544-4a76-821c-ab0f6c2ee257 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:47.984859 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae1825c4-9544-4a76-821c-ab0f6c2ee257 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1217 microversion: 2.1 time: 0.073267 Jul 01 11:25:47.985471 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3319/6736] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:47 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:48.959341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-cbe5cee5-efdb-472b-bc3d-4908e2dd221b req-40d320ce-fbf4-4940-b554-13c2d14df175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f39681-aa15-4247-bdfe-bdc7b1bdcc50", "name": "network-vif-deleted", "tag": "d3b53bf6-fc56-4e75-acae-841c9eb2b387"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:48.969884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cbe5cee5-efdb-472b-bc3d-4908e2dd221b req-40d320ce-fbf4-4940-b554-13c2d14df175 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:48.970345 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cbe5cee5-efdb-472b-bc3d-4908e2dd221b req-40d320ce-fbf4-4940-b554-13c2d14df175 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:48.973399 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=91 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:48.982452 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-cbe5cee5-efdb-472b-bc3d-4908e2dd221b req-40d320ce-fbf4-4940-b554-13c2d14df175 service nova] Creating event network-vif-deleted:d3b53bf6-fc56-4e75-acae-841c9eb2b387 for instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 on n-h2-master-1 Jul 01 11:25:48.987710 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-cbe5cee5-efdb-472b-bc3d-4908e2dd221b req-40d320ce-fbf4-4940-b554-13c2d14df175 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Jul 01 11:25:48.988324 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3418/6737] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:25:49.002532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:49.003150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:49.010810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:49.011260 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:49.012043 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:49.012622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:49.080562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:49.095299 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-69700182-3e09-4668-a5b4-cbd40bddcb2f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1221 microversion: 2.1 time: 0.094440 Jul 01 11:25:49.095299 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3320/6738] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:48 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:50.110907 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:50.111642 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:50.120089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:50.120089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:50.120275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:50.120790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:50.191400 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:50.198876 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aed4a043-252e-41ca-8ef9-cabbcf5cc1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1275 microversion: 2.1 time: 0.093421 Jul 01 11:25:50.199446 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3419/6739] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:50 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:51.220618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:51.221262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:51.231410 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:51.234618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:51.234618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:51.234618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:51.382585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:51.389003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-62d720b6-8cb3-4c0a-a221-05f6db40a00c tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.173238 Jul 01 11:25:51.389598 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3321/6740] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:51 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:51.454730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9827b91f-0132-469c-98a3-4a1548699305 req-373888c0-950a-4e8a-adc3-c12baa98e921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40c5c65-10cf-4354-8d3b-6193888f5ba4", "tag": "ef898038-1b62-4bf7-9ea5-8f75620b584d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:51.460236 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:51.464127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9827b91f-0132-469c-98a3-4a1548699305 req-373888c0-950a-4e8a-adc3-c12baa98e921 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:51.464586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9827b91f-0132-469c-98a3-4a1548699305 req-373888c0-950a-4e8a-adc3-c12baa98e921 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:51.480096 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9827b91f-0132-469c-98a3-4a1548699305 req-373888c0-950a-4e8a-adc3-c12baa98e921 service nova] Creating event network-changed:ef898038-1b62-4bf7-9ea5-8f75620b584d for instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 on n-h2-master-1 Jul 01 11:25:51.485624 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9827b91f-0132-469c-98a3-4a1548699305 req-373888c0-950a-4e8a-adc3-c12baa98e921 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035441 Jul 01 11:25:51.486326 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3420/6741] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:25:52.405840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:52.406376 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:52.413261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:52.413716 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:52.414480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:52.414915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:52.542792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:52.550959 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d63b788-0b26-489e-ba87-b623ac04c648 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.149166 Jul 01 11:25:52.551529 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3322/6742] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:52 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:53.569468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:53.570187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:53.577509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:53.578573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:53.579350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:53.579801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:53.714024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:53.722207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6189b277-b5a9-48a7-8d64-a956b6c1f636 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.157661 Jul 01 11:25:53.722775 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3421/6743] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:53 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:54.739532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:54.740166 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:54.747106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:54.747545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:54.748293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:54.748729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:54.877229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:54.884626 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6597b03-026c-4487-a68e-a5a5de9531ad tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.149042 Jul 01 11:25:54.885208 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3323/6744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:54 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:55.901552 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:55.902110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:55.909707 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:55.910177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:55.910964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:55.911417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:56.037621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:56.045028 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6e2c66fe-b91a-474e-9c87-1c1d28643858 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.147545 Jul 01 11:25:56.045691 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3422/6745] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:55 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:57.061863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:57.062511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:57.069911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:57.070308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:57.071075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:57.071521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:57.205206 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:57.212688 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14902170-84d1-4276-9674-2f45399f3647 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.154760 Jul 01 11:25:57.213290 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3324/6746] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:57 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:58.230234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:58.230861 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:58.233771 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:58.234571 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:58.239629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:58.240030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:58.240954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:58.241424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:58.378315 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:58.385922 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-825f5458-37aa-4fdc-ae20-b1dacb3196fa tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.159884 Jul 01 11:25:58.386512 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3423/6747] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:58 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:25:58.743556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-33f790b1-ac14-4497-83bc-b8b3c87d0908 req-5e7121a0-826c-4f1f-b3f6-4a3e85e7b4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40c5c65-10cf-4354-8d3b-6193888f5ba4", "name": "network-vif-plugged", "status": "completed", "tag": "ef898038-1b62-4bf7-9ea5-8f75620b584d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:25:58.747941 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:25:58.754533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-33f790b1-ac14-4497-83bc-b8b3c87d0908 req-5e7121a0-826c-4f1f-b3f6-4a3e85e7b4cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:58.754975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-33f790b1-ac14-4497-83bc-b8b3c87d0908 req-5e7121a0-826c-4f1f-b3f6-4a3e85e7b4cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:58.766268 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-33f790b1-ac14-4497-83bc-b8b3c87d0908 req-5e7121a0-826c-4f1f-b3f6-4a3e85e7b4cf service nova] Creating event network-vif-plugged:ef898038-1b62-4bf7-9ea5-8f75620b584d for instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 on n-h2-master-1 Jul 01 11:25:58.772102 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-33f790b1-ac14-4497-83bc-b8b3c87d0908 req-5e7121a0-826c-4f1f-b3f6-4a3e85e7b4cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032276 Jul 01 11:25:58.772681 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3325/6748] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:25:59.403189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:25:59.403801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:25:59.411246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:59.411717 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:59.412496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:25:59.412946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:25:59.543844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:25:59.552076 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4360bde3-2236-4839-ba46-525c6a290a95 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1317 microversion: 2.1 time: 0.152874 Jul 01 11:25:59.552652 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3424/6749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:25:59 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:00.571028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:00.571742 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:00.578886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:00.579337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:00.583269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:00.583269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:00.714477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:00.722698 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-682c3a79-3cb9-4146-b0f1-925b5ff027e3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1507 microversion: 2.1 time: 0.157460 Jul 01 11:26:00.723277 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3326/6750] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:00 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:00.738846 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:00.739500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:00.746513 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:00.746972 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:00.747741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:00.748188 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:00.879770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:00.887283 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b25d0fe5-dfd1-4b57-930a-efc30426a423 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1507 microversion: 2.1 time: 0.152365 Jul 01 11:26:00.887848 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3425/6751] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:00 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:00.903804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:00.904798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:00.910850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:00.911301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:00.912061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:00.912497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:00.940502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:00.946291 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Old instance type m1.heat2, new instance type m1.heat {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:26:00.953037 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:26:00.953486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:26:00.953957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:26:00.954362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:26:00.954768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:26:01.084166 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d934b04-4c2f-4098-99a9-5ced71825f3b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "POST /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4/action" status: 202 len: 0 microversion: 2.1 time: 0.184140 Jul 01 11:26:01.084689 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3327/6752] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:26:00 2022] POST /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:26:01.092811 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:01.093748 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:01.100143 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:01.100612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:01.101499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:01.101955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:01.229909 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:01.238084 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d193f205-e2c6-46ef-bec4-da611f93f085 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1514 microversion: 2.1 time: 0.149191 Jul 01 11:26:01.239135 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3426/6753] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:01 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:02.256977 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:02.257619 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:02.263857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:02.264305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:02.265087 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:02.265726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:02.404167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:02.412497 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd595b9f-b8e8-4c29-a473-d1cb48aebeec tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1514 microversion: 2.1 time: 0.160448 Jul 01 11:26:02.413068 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3328/6754] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:02 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:03.430667 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:03.431303 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:03.438542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:03.439686 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:03.440738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:03.441257 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:03.571341 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:03.579190 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a90556a-fd37-444b-a2f9-db66717c636e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1514 microversion: 2.1 time: 0.152384 Jul 01 11:26:03.579866 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3427/6755] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:03 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:04.596612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:04.597136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:04.603224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:04.603669 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:04.604428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:04.604859 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:04.734823 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:04.742394 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-71418b39-023d-4cfb-939a-14b3a49ea7b3 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.150147 Jul 01 11:26:04.742965 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3329/6756] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:04 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:05.760000 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:05.760636 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:05.767588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:05.768056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:05.768842 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:05.769333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:05.902655 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:05.912292 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-192af7b2-3259-43c0-8c6f-f9e64118f8f4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.156214 Jul 01 11:26:05.912864 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3428/6757] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:05 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:06.929948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:06.930522 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:06.937857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:06.938306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:06.939158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:06.939596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:07.074718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:07.083331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0ad67202-5e46-40fb-8350-7a3e58104d92 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.157075 Jul 01 11:26:07.083895 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3330/6758] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:06 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:08.100699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:08.101361 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:08.108319 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:08.108783 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:08.109584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:08.110038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:08.243382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:08.251014 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0c99510-671b-44df-933f-cf1cc9823449 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.154264 Jul 01 11:26:08.252145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3429/6759] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:08 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:09.268528 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:09.269084 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:09.276174 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:09.276466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:09.277250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:09.277727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:09.405970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:09.414098 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-367d9e79-f444-4931-9859-d898f24db0fc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.149674 Jul 01 11:26:09.414667 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3331/6760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:09 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:10.430915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:10.431535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:10.439322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:10.439777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:10.440801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:10.441275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:10.574729 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:10.582295 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db8aeaa6-2fdc-4f3a-a7f9-9c6b7f05d022 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.155290 Jul 01 11:26:10.582862 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3430/6761] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:10 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:11.599744 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:11.600362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:11.607390 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:11.607839 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:11.608604 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:11.609042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:11.738095 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:11.745621 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5288ec88-b850-4cc3-b401-aa0b1767bc66 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.150436 Jul 01 11:26:11.746199 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3332/6762] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:11 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:12.762480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:12.763103 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:12.770066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:12.770523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:12.771292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:12.771736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:12.902893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:12.910988 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-551c9215-c8e8-4d22-b01e-cf1da16fbc25 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.152374 Jul 01 11:26:12.911557 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3431/6763] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:12 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:13.928014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:13.928545 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:13.935506 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:13.935950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:13.936712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:13.937169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:14.065926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:14.073441 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b6b0c588-6a4a-42a6-b0f7-687df01894c4 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.149365 Jul 01 11:26:14.074011 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3333/6764] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:13 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:15.090977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:15.091597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:15.098998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:15.099458 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:15.100228 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:15.100679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:15.227356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:15.234998 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ca75a233-a66f-43b4-a3e7-2028042d2517 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.147957 Jul 01 11:26:15.236184 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3432/6765] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:15 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:16.253060 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:16.257609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:16.262258 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:16.262710 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:16.263476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:16.263912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:16.399667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:16.403263 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:16.407599 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb7dede5-4f99-49bd-a6ae-a2a391ef1846 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.159034 Jul 01 11:26:16.408162 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3334/6766] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:16 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:17.424676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:17.425328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:17.432223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:17.432686 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:17.433498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:17.433947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:17.561738 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:17.569648 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-18842632-9005-47ec-8a41-538dabd6feb9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.148942 Jul 01 11:26:17.570223 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3433/6767] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:17 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:18.586835 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:18.587377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:18.590103 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=38 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:18.595108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:18.599714 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:18.599714 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:18.599714 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:18.731118 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:18.739341 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99c0ccb1-25fb-4b39-bd61-f42cc78e27c0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.156824 Jul 01 11:26:18.739920 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3335/6768] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:18 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:19.756471 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:19.757100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:19.764143 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:19.764606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:19.765413 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:19.765869 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:19.896069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:19.904755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ee6d15e-3155-4674-9d98-a17e98fd8eda tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.152273 Jul 01 11:26:19.908431 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3434/6769] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:19 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:20.924158 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:20.924683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:20.931603 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:20.932060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:20.932828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:20.933294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:21.069377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:21.076873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0090fcaf-ec38-4368-b088-004e4c2ad19b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.156680 Jul 01 11:26:21.077485 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3336/6770] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:20 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:22.094088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:22.095319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:22.102286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:22.102738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:22.103505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:22.103950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:22.107870 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=94 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:22.235250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:22.242811 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f045230a-b4ce-4d47-9079-2e4dc609c8ac tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.152582 Jul 01 11:26:22.243596 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3435/6771] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:22 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:23.259633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:23.260346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:23.267958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:23.270050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:23.270050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:23.270050 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:23.398418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:23.405948 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8a0d85ea-82d6-4e17-bcb6-4b141fccb9e7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.150236 Jul 01 11:26:23.406511 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3337/6772] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:23 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:24.422873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:24.423502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:24.426283 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=32 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:24.431071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:24.431535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:24.432316 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:24.432772 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:24.566345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:24.573879 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-67b6c220-59b7-40e7-a196-3d53d0f41ce9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.154948 Jul 01 11:26:24.574450 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3436/6773] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:24 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:25.590658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:25.591268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:25.598712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:25.599155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:25.599912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:25.600345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:25.731185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:25.739371 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7629802d-4bc9-4795-af4e-8ea3b9c7c4c9 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.152610 Jul 01 11:26:25.739954 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3338/6774] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:25 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:26.756613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:26.757272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:26.764260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:26.764729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:26.765543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:26.766030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:26.907097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:26.915470 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d8df5337-42aa-4911-a037-864cec153e55 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.162750 Jul 01 11:26:26.917320 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3437/6775] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:26 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:27.933388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:27.933927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:27.941715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:27.942164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:27.942930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:27.943366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:28.074775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:28.083356 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9ce81dc7-2272-46e0-896d-fe7f9b02c473 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.153975 Jul 01 11:26:28.083931 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3339/6776] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:27 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:29.099898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:29.100517 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:29.107480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:29.107939 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:29.108715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:29.109172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:29.239421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:29.247217 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-83e93368-7ac8-404a-b00d-6c40ccb2e46a tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.151286 Jul 01 11:26:29.247795 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3438/6777] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:29 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:30.264367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:30.264984 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:30.272183 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:30.272637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:30.273426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:30.273869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:30.410132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:30.417810 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad4a1f44-44a5-42cf-9266-1e4d646ed936 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.157405 Jul 01 11:26:30.424590 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3340/6778] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:30 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:31.434206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:31.434889 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:31.443802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:31.444260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:31.445067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:31.445546 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:31.576239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:31.584740 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0061f7c9-2d13-4276-af41-73b399a81df7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1519 microversion: 2.1 time: 0.154398 Jul 01 11:26:31.585452 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3439/6779] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:31 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:32.185738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0e2f47d1-a2d1-4e97-8438-1fd63c23e247 req-c7c0852a-1d62-4472-a590-2544264aff2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40c5c65-10cf-4354-8d3b-6193888f5ba4", "name": "network-vif-unplugged", "status": "completed", "tag": "ef898038-1b62-4bf7-9ea5-8f75620b584d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:32.195172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0e2f47d1-a2d1-4e97-8438-1fd63c23e247 req-c7c0852a-1d62-4472-a590-2544264aff2d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:32.195613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0e2f47d1-a2d1-4e97-8438-1fd63c23e247 req-c7c0852a-1d62-4472-a590-2544264aff2d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:32.206953 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0e2f47d1-a2d1-4e97-8438-1fd63c23e247 req-c7c0852a-1d62-4472-a590-2544264aff2d service nova] Creating event network-vif-unplugged:ef898038-1b62-4bf7-9ea5-8f75620b584d for instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 on n-h1-master-1 Jul 01 11:26:32.212178 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-0e2f47d1-a2d1-4e97-8438-1fd63c23e247 req-c7c0852a-1d62-4472-a590-2544264aff2d service nova] Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:26:32.223243 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0e2f47d1-a2d1-4e97-8438-1fd63c23e247 req-c7c0852a-1d62-4472-a590-2544264aff2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041231 Jul 01 11:26:32.223827 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3341/6780] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:26:32.602402 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:32.603114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:32.610527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:32.611082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:32.612130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:32.612655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:32.762780 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:32.771305 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a28dedb8-fd17-4949-b7ff-cea4919f4f75 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1518 microversion: 2.1 time: 0.173233 Jul 01 11:26:32.772252 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3440/6781] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:32 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:33.790567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:33.791276 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:33.798291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:33.798749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:33.799512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:33.799950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:33.927830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:33.935406 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd90ec87-c749-4d2e-a3c9-7032d20ed0f0 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1516 microversion: 2.1 time: 0.150243 Jul 01 11:26:33.936898 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3342/6782] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:33 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:34.237641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6ada7d19-2e35-4273-919e-4f902ac4023e req-51361bf0-f35c-406a-a54c-6e62b1013c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40c5c65-10cf-4354-8d3b-6193888f5ba4", "tag": "ef898038-1b62-4bf7-9ea5-8f75620b584d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:34.245714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6ada7d19-2e35-4273-919e-4f902ac4023e req-51361bf0-f35c-406a-a54c-6e62b1013c2c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:34.246174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6ada7d19-2e35-4273-919e-4f902ac4023e req-51361bf0-f35c-406a-a54c-6e62b1013c2c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:34.258264 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6ada7d19-2e35-4273-919e-4f902ac4023e req-51361bf0-f35c-406a-a54c-6e62b1013c2c service nova] Creating event network-changed:ef898038-1b62-4bf7-9ea5-8f75620b584d for instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 on n-h1-master-1 Jul 01 11:26:34.268785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-6ada7d19-2e35-4273-919e-4f902ac4023e req-51361bf0-f35c-406a-a54c-6e62b1013c2c service nova] Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:26:34.281309 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6ada7d19-2e35-4273-919e-4f902ac4023e req-51361bf0-f35c-406a-a54c-6e62b1013c2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047596 Jul 01 11:26:34.282657 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3441/6783] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:26:34.953738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:34.954346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:34.962071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:34.962539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:34.963466 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:34.963899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:35.102483 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:35.110859 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-264d5809-4ad8-424e-b5d4-0cd61c974055 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1516 microversion: 2.1 time: 0.161078 Jul 01 11:26:35.111580 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3343/6784] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:34 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:36.129816 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:36.130536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:36.136850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:36.137353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:36.138138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:36.138588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:36.272228 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:36.279950 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-15a1a7d9-4da8-4d77-b533-23ede5c7d9f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1513 microversion: 2.1 time: 0.155866 Jul 01 11:26:36.280535 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3442/6785] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:36 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:26:36.296003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-613265dd-caed-4148-8133-f121153eda48 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:36.296541 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-613265dd-caed-4148-8133-f121153eda48 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:36.303430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-613265dd-caed-4148-8133-f121153eda48 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:36.303881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-613265dd-caed-4148-8133-f121153eda48 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:36.304649 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-613265dd-caed-4148-8133-f121153eda48 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:36.305113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-613265dd-caed-4148-8133-f121153eda48 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:36.473012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-613265dd-caed-4148-8133-f121153eda48 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "POST /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4/action" status: 204 len: 0 microversion: 2.1 time: 0.180681 Jul 01 11:26:36.473723 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3344/6786] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:26:36 2022] POST /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4/action => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:26:36.482884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:36.483788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:36.490532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:36.490995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:36.491774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:36.492218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:36.623502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:36.632047 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5e54028-30e5-4d73-ab9f-c7f9b5fd790f tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1513 microversion: 2.1 time: 0.153633 Jul 01 11:26:36.632633 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3443/6787] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:36 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:37.650583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:37.651730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:37.658044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:37.658495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:37.659263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:37.659703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:37.799542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:37.807164 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed11c6ae-a90e-4c8b-ac48-fc4f63762872 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1513 microversion: 2.1 time: 0.162106 Jul 01 11:26:37.811988 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3345/6788] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:37 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:38.827879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:38.829037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:38.836148 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:38.836612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:38.837420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:38.837873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:38.965585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:38.973055 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b86bf56e-0cc0-4556-95d1-f98e2823b24e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1505 microversion: 2.1 time: 0.149133 Jul 01 11:26:38.973657 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3444/6789] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:38 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:38.988926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:38.989629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:38.996481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.001350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.001350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.001350 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.136891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:39.145074 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-95d1e64e-0f15-41a5-99f3-c08870d103f7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1505 microversion: 2.1 time: 0.159735 Jul 01 11:26:39.145690 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3346/6790] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:38 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:39.161006 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:39.161670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:39.173400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.173400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.173400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.173400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.249201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9d32e927-a23f-46cb-8875-bb0920e601a5 req-377a8355-7b0c-4e79-84be-387dba2c3d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40c5c65-10cf-4354-8d3b-6193888f5ba4", "name": "network-vif-plugged", "status": "completed", "tag": "ef898038-1b62-4bf7-9ea5-8f75620b584d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:39.258564 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9d32e927-a23f-46cb-8875-bb0920e601a5 req-377a8355-7b0c-4e79-84be-387dba2c3d89 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.259663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9d32e927-a23f-46cb-8875-bb0920e601a5 req-377a8355-7b0c-4e79-84be-387dba2c3d89 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.270950 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9d32e927-a23f-46cb-8875-bb0920e601a5 req-377a8355-7b0c-4e79-84be-387dba2c3d89 service nova] Creating event network-vif-plugged:ef898038-1b62-4bf7-9ea5-8f75620b584d for instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 on n-h1-master-1 Jul 01 11:26:39.276048 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9d32e927-a23f-46cb-8875-bb0920e601a5 req-377a8355-7b0c-4e79-84be-387dba2c3d89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Jul 01 11:26:39.276964 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3347/6791] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:26:39.301749 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:39.309227 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-127be1cb-44e5-4c5f-a29f-bbd5f072efe7 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1505 microversion: 2.1 time: 0.152145 Jul 01 11:26:39.309836 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3445/6792] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:39 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:26:39.326386 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:39.326983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:39.334178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.334628 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.335386 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.335817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.361356 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:26:39.633935 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a4c6ce7e-b451-4667-b1ff-a0ba46fb9c0e tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 204 len: 0 microversion: 2.1 time: 0.311467 Jul 01 11:26:39.634557 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3348/6793] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:26:39 2022] DELETE /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:26:39.659007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:39.659526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:39.666889 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.667349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.668133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.668578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.694394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:26:39.824823 n-d-master-1 devstack@n-api.service[119764]: INFO nova.compute.api [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Instance is already in deleting state, ignoring this request Jul 01 11:26:39.825702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-48266c2a-692a-4b4c-9481-bd2d27f9b87b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 204 len: 0 microversion: 2.1 time: 0.171428 Jul 01 11:26:39.826266 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3446/6794] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:26:39 2022] DELETE /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:26:39.835287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:39.835980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:39.841951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.842453 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.843200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:39.843629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:39.969501 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:39.971774 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:39.977644 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d85372aa-055d-4b5f-bf94-ce1173a9a1cc tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1511 microversion: 2.1 time: 0.146558 Jul 01 11:26:39.978207 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3349/6795] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:39 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:40.994523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:40.995153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:41.002015 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:41.002483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:41.003264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:41.003712 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:41.139972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75191c7df2c146219f929565e1e0c733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d296151f349bfb5c3bf2afa8e882e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:41.148260 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-77b4d127-d046-4778-91d0-9faab0a5539b tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 200 len: 1511 microversion: 2.1 time: 0.157629 Jul 01 11:26:41.148841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3447/6796] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:40 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:41.571369 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b42d8c77-e002-44ba-8967-6a6abab15970 req-0fa85439-c23a-4fe0-b719-28a9ad6f9b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40c5c65-10cf-4354-8d3b-6193888f5ba4", "name": "network-vif-deleted", "tag": "ef898038-1b62-4bf7-9ea5-8f75620b584d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:41.581546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b42d8c77-e002-44ba-8967-6a6abab15970 req-0fa85439-c23a-4fe0-b719-28a9ad6f9b6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:41.581994 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b42d8c77-e002-44ba-8967-6a6abab15970 req-0fa85439-c23a-4fe0-b719-28a9ad6f9b6d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:41.593927 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b42d8c77-e002-44ba-8967-6a6abab15970 req-0fa85439-c23a-4fe0-b719-28a9ad6f9b6d service nova] Creating event network-vif-deleted:ef898038-1b62-4bf7-9ea5-8f75620b584d for instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 on n-h1-master-1 Jul 01 11:26:41.598867 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b42d8c77-e002-44ba-8967-6a6abab15970 req-0fa85439-c23a-4fe0-b719-28a9ad6f9b6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Jul 01 11:26:41.599477 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3350/6797] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:26:42.165855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:42.166423 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: d40c5c65-10cf-4354-8d3b-6193888f5ba4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:42.173984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:42.174449 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:42.175239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:42.175694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:42.189583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] HTTP exception thrown: Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 could not be found. Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Request method failure captured: Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 HTTP/1.1 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtl-WtsX1yaBLMoD8oVvojAur07vO_z9R4By9gv-XJLmHl_ly-Tb2Cog0QquS2MIb9CR0ggLzTIo2YxdyZTXbNiaqBCLfJ8s7J6O9M8_Al3qbLOz4Kl_ZWCiEEmdXWnO1LMV1DKehTs6ailLX-aTCcOHK80UfjZhBJVXG17-NjHS1RM Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 782d296151f349bfb5c3bf2afa8e882e Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_782d296151f349bfb5c3bf2afa8e882e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 782d296151f349bfb5c3bf2afa8e882e Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerDiskConfigTestJSON-35427769-project Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 75191c7df2c146219f929565e1e0c733 Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerDiskConfigTestJSON-35427769-project Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: exception: Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 could not be found. Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'd40c5c65-10cf-4354-8d3b-6193888f5ba4'} Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 could not be found. Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 could not be found. Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:26:42.191752 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 could not be found. Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Returning 404 to user: Instance d40c5c65-10cf-4354-8d3b-6193888f5ba4 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-748aea3f-917c-4be8-9d0e-d984fcf0fcde tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4" status: 404 len: 111 microversion: 2.1 time: 0.031108 Jul 01 11:26:42.197439 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3448/6798] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:42 2022] GET /compute/v2.1/servers/d40c5c65-10cf-4354-8d3b-6193888f5ba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:26:42.202691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5919ccf-3b47-4f96-a5c4-3de47bf6ca9d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '.version_select at 0x7f6f921e5550>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:42.303797 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5919ccf-3b47-4f96-a5c4-3de47bf6ca9d tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-70365061" status: 202 len: 0 microversion: 2.1 time: 0.105341 Jul 01 11:26:42.304397 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3351/6799] 10.222.0.23 () {58 vars in 1214 bytes} [Fri Jul 1 11:26:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-70365061 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:26:43.016598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:43.017113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:43.023349 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:43.023815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:43.024594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:43.025048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:43.041123 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] HTTP exception thrown: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Request method failure captured: Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 HTTP/1.1 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtl-WtsX1yaBLMoD8oVvojAur07vO_z9R4By9gv-XJLmHl_ly-Tb2Cog0QquS2MIb9CR0ggLzTIo2YxdyZTXbNiaqBCLfJ8s7J6O9M8_Al3qbLOz4Kl_ZWCiEEmdXWnO1LMV1DKehTs6ailLX-aTCcOHK80UfjZhBJVXG17-NjHS1RM Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 782d296151f349bfb5c3bf2afa8e882e Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_782d296151f349bfb5c3bf2afa8e882e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 782d296151f349bfb5c3bf2afa8e882e Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerDiskConfigTestJSON-35427769-project Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 75191c7df2c146219f929565e1e0c733 Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerDiskConfigTestJSON-35427769-project Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '76f39681-aa15-4247-bdfe-bdc7b1bdcc50'} Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:26:43.042690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Returning 404 to user: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8cf801be-71f0-4706-95d8-a007f22855b5 tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 404 len: 111 microversion: 2.1 time: 0.032085 Jul 01 11:26:43.046312 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3449/6800] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:26:43 2022] DELETE /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:26:43.053362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:43.054116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] [instance: 76f39681-aa15-4247-bdfe-bdc7b1bdcc50] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:43.060797 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:43.061258 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:43.062010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:43.062439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:43.079093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] HTTP exception thrown: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Request method failure captured: Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 HTTP/1.1 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtl-WtsX1yaBLMoD8oVvojAur07vO_z9R4By9gv-XJLmHl_ly-Tb2Cog0QquS2MIb9CR0ggLzTIo2YxdyZTXbNiaqBCLfJ8s7J6O9M8_Al3qbLOz4Kl_ZWCiEEmdXWnO1LMV1DKehTs6ailLX-aTCcOHK80UfjZhBJVXG17-NjHS1RM Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 782d296151f349bfb5c3bf2afa8e882e Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_782d296151f349bfb5c3bf2afa8e882e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/782d296151f349bfb5c3bf2afa8e882e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 782d296151f349bfb5c3bf2afa8e882e Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-35427769 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerDiskConfigTestJSON-35427769-project Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 75191c7df2c146219f929565e1e0c733 Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerDiskConfigTestJSON-35427769-project Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '76f39681-aa15-4247-bdfe-bdc7b1bdcc50'} Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:26:43.080704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] Returning 404 to user: Instance 76f39681-aa15-4247-bdfe-bdc7b1bdcc50 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ab8509f-de5f-4258-9da8-2a2c5dfc49bb tempest-ServerDiskConfigTestJSON-35427769 tempest-ServerDiskConfigTestJSON-35427769-project] 10.222.0.23 "GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50" status: 404 len: 111 microversion: 2.1 time: 0.033499 Jul 01 11:26:43.084704 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3352/6801] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:43 2022] GET /compute/v2.1/servers/76f39681-aa15-4247-bdfe-bdc7b1bdcc50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:26:53.595230 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=27 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:53.596302 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:53.704436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7452b0a0-3e56-4277-8332-2ca50d7a60eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'create', calling method: .version_select at 0x7f6f91e26a60>, body: {"keypair": {"name": "tempest-keypair-1626383828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUODKrjX19HLXrab6gpYJkwLI3U6NOHbuR0WVP/Zwzr8joD/Q86dOhS9hlzCIpc5vnohU5vdsCnxocGQCB5ZNYmpCOEtpb6RxeObm8XRaWAQ0aAQMJA+GIRLbh7PQJsiA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:53.718668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7452b0a0-3e56-4277-8332-2ca50d7a60eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for project 743a6280024b4d74a4f6a54a745fca09. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:26:53.723784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-7452b0a0-3e56-4277-8332-2ca50d7a60eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for user faf4b86f835a466b9129e4f71a84e9f1 and project 743a6280024b4d74a4f6a54a745fca09. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:26:53.834710 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7452b0a0-3e56-4277-8332-2ca50d7a60eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245414 Jul 01 11:26:53.835342 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3450/6802] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:26:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:26:55.997539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-992350541", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70890723-10ef-4ffd-bed0-feeacfb1ebc4"}], "security_groups": [{"name": "tempest-securitygroup--1145951281"}], "key_name": "tempest-keypair-1626383828", "user_data": "}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:26:56.006388 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:56.007321 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=5 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:26:56.158290 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] validate_networks() for [('70890723-10ef-4ffd-bed0-feeacfb1ebc4', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:26:56.565957 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:26:56.566377 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:26:56.566996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:26:56.568346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:26:56.568772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:26:56.578996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:56.579447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:56.580244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:56.580679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:56.602550 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:26:56.608370 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for user faf4b86f835a466b9129e4f71a84e9f1 and project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:26:56.626360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:26:56.628819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:26:56.766451 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2bc3f086-58dc-4aac-a055-e1484c2dd284 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.773531 Jul 01 11:26:56.766871 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3353/6803] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:26:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:26:56.776890 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c9c16430-64c3-41f1-9f39-158a1444f975 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:56.777557 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c9c16430-64c3-41f1-9f39-158a1444f975 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:56.841710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c9c16430-64c3-41f1-9f39-158a1444f975 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:56.850211 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c9c16430-64c3-41f1-9f39-158a1444f975 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1238 microversion: 2.1 time: 0.077075 Jul 01 11:26:56.852065 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3451/6804] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:56 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:26:57.868863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:57.869427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:57.875560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:57.876006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:57.876775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:57.877231 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:57.938750 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:57.946559 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0410c693-2d98-4045-bf1f-07670029aaa4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1242 microversion: 2.1 time: 0.082690 Jul 01 11:26:57.947123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3354/6805] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:57 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:26:58.963271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:26:58.963975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:26:58.971252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:58.971727 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:58.972519 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:26:58.972971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:26:59.036023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:26:59.043603 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d6598e18-fc68-4c56-bbca-39c70a13fa60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1308 microversion: 2.1 time: 0.084291 Jul 01 11:26:59.044162 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3452/6806] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:26:58 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:00.067524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:00.068870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:00.076475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:00.077537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:00.078399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:00.079068 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:00.230838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:00.239808 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d162cd1a-838e-4ca9-b0b3-e0e5d803a75a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.179037 Jul 01 11:27:00.240489 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3355/6807] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:00 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:00.673384 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-fbb03d1a-8f08-432a-879f-3725c8e5456f req-0fa0f92d-9a66-4c58-a8b6-f06161fd4864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a233b8-89d3-4fdf-b624-1bbc4797640f", "tag": "c76d6bae-4567-4db5-b44a-3da632b740b5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:27:00.684969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fbb03d1a-8f08-432a-879f-3725c8e5456f req-0fa0f92d-9a66-4c58-a8b6-f06161fd4864 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:00.685731 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-fbb03d1a-8f08-432a-879f-3725c8e5456f req-0fa0f92d-9a66-4c58-a8b6-f06161fd4864 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:00.700060 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-fbb03d1a-8f08-432a-879f-3725c8e5456f req-0fa0f92d-9a66-4c58-a8b6-f06161fd4864 service nova] Creating event network-changed:c76d6bae-4567-4db5-b44a-3da632b740b5 for instance 01a233b8-89d3-4fdf-b624-1bbc4797640f on n-h1-master-1 Jul 01 11:27:00.705336 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-fbb03d1a-8f08-432a-879f-3725c8e5456f req-0fa0f92d-9a66-4c58-a8b6-f06161fd4864 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036054 Jul 01 11:27:00.706024 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3453/6808] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:27:01.257248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:01.257864 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:01.264725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:01.265169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:01.281308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:01.281308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:01.397905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:01.405545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d5a3d627-fdfe-4b37-8026-08ea003c22a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.152242 Jul 01 11:27:01.406119 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3356/6809] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:01 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:02.425313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:02.425999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:02.432494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:02.432956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:02.433788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:02.434231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:02.568141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:02.575669 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20bdc842-ca92-4233-b3cd-024ac20ce85b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.156360 Jul 01 11:27:02.576241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3454/6810] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:02 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:03.593132 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:03.593761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:03.600382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:03.600824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:03.601601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:03.602031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:03.729905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:03.737327 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8ba81f3d-1fce-4559-9e48-0059b22075fa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.148330 Jul 01 11:27:03.737895 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3357/6811] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:03 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:04.754670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:04.755305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:04.761702 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:04.762170 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:04.762950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:04.763404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:04.893295 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:04.900720 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c29ccf92-b428-4d58-9bf6-15393ff82355 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.150675 Jul 01 11:27:04.901325 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3455/6812] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:04 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:05.917491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:05.918096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:05.925553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:05.926007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:05.926753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:05.927178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:06.054943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:06.062584 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-375614e2-f76c-4041-a1bc-d6ecf8eb76ba tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.148943 Jul 01 11:27:06.063163 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3358/6813] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:05 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:07.080143 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:07.080771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:07.083596 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:27:07.089355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:07.089815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:07.090593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:07.091044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:07.231722 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:07.239337 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-963bcd39-4879-4b41-80da-5a06102be1e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.163698 Jul 01 11:27:07.239903 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3456/6814] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:07 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:07.383392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f865aebe-d727-4ca4-b2ec-e3e89d1532d6 req-a52c30fd-6b97-4440-a266-d847fcde8b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a233b8-89d3-4fdf-b624-1bbc4797640f", "name": "network-vif-plugged", "status": "completed", "tag": "c76d6bae-4567-4db5-b44a-3da632b740b5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:27:07.387975 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:27:07.388677 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:27:07.393954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f865aebe-d727-4ca4-b2ec-e3e89d1532d6 req-a52c30fd-6b97-4440-a266-d847fcde8b84 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:07.394392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f865aebe-d727-4ca4-b2ec-e3e89d1532d6 req-a52c30fd-6b97-4440-a266-d847fcde8b84 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:07.405100 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f865aebe-d727-4ca4-b2ec-e3e89d1532d6 req-a52c30fd-6b97-4440-a266-d847fcde8b84 service nova] Creating event network-vif-plugged:c76d6bae-4567-4db5-b44a-3da632b740b5 for instance 01a233b8-89d3-4fdf-b624-1bbc4797640f on n-h1-master-1 Jul 01 11:27:07.410960 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f865aebe-d727-4ca4-b2ec-e3e89d1532d6 req-a52c30fd-6b97-4440-a266-d847fcde8b84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Jul 01 11:27:07.411499 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3359/6815] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:27:08.256282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:08.256971 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:08.263981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:08.266410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:08.266410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:08.266410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:08.398711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:08.406197 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7fbce55d-8100-4541-80d8-321a9ac9caa1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1364 microversion: 2.1 time: 0.153840 Jul 01 11:27:08.406766 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3457/6816] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:08 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:09.427833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:09.428534 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:09.435851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:09.436297 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:09.437057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:09.437544 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:09.567734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:09.575208 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-39ba1f68-2b4e-43ad-8265-cd2c961d9d08 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1551 microversion: 2.1 time: 0.152589 Jul 01 11:27:09.575794 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3360/6817] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:09 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:09.591716 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1ab20a2-6938-488e-ae71-12bef654ed50 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:09.592219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b1ab20a2-6938-488e-ae71-12bef654ed50 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:09.599789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1ab20a2-6938-488e-ae71-12bef654ed50 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:09.600247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1ab20a2-6938-488e-ae71-12bef654ed50 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:09.601021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1ab20a2-6938-488e-ae71-12bef654ed50 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:09.601502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1ab20a2-6938-488e-ae71-12bef654ed50 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:09.680177 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b1ab20a2-6938-488e-ae71-12bef654ed50 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092265 Jul 01 11:27:09.680793 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3458/6818] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 11:27:09 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:27:10.828130 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-58e9b5f2-bc5b-4e1f-b5e1-531683a0307c req-935d3993-4722-4944-b120-fb1d94d8796d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a233b8-89d3-4fdf-b624-1bbc4797640f", "tag": "c76d6bae-4567-4db5-b44a-3da632b740b5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:27:10.836620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-58e9b5f2-bc5b-4e1f-b5e1-531683a0307c req-935d3993-4722-4944-b120-fb1d94d8796d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:10.837063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-58e9b5f2-bc5b-4e1f-b5e1-531683a0307c req-935d3993-4722-4944-b120-fb1d94d8796d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:10.848325 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-58e9b5f2-bc5b-4e1f-b5e1-531683a0307c req-935d3993-4722-4944-b120-fb1d94d8796d service nova] Creating event network-changed:c76d6bae-4567-4db5-b44a-3da632b740b5 for instance 01a233b8-89d3-4fdf-b624-1bbc4797640f on n-h1-master-1 Jul 01 11:27:10.853931 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-58e9b5f2-bc5b-4e1f-b5e1-531683a0307c req-935d3993-4722-4944-b120-fb1d94d8796d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115569 Jul 01 11:27:10.854897 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3361/6819] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:27:40.245246 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:27:40.246031 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=36 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:27:40.249960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:40.256194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:40.256648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.257113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.257934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.258384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.390967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:40.399424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9fd8218f-97a1-422a-b38c-4521d1fa108a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1669 microversion: 2.1 time: 0.156077 Jul 01 11:27:40.400029 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3459/6820] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:40 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:40.416391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:40.417098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:40.419426 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:27:40.420089 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=42 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:27:40.425202 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.425658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.426428 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.426869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.567106 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:40.574651 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68140539-2782-41ce-8a20-180e91fe030e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1669 microversion: 2.1 time: 0.162603 Jul 01 11:27:40.575211 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3362/6821] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:40 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:40.590578 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:40.591200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:40.597805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.598305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.599085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.599536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.728198 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:40.735736 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd54faf4-cd61-4750-af08-dcffe3f9829c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1669 microversion: 2.1 time: 0.149053 Jul 01 11:27:40.736952 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3460/6822] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:40 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:40.752190 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:27:40.760091 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:40.760091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.760091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.760371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:40.760746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:40.789391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:40.795174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:27:40.801525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:27:40.801943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:27:40.802409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:27:40.802811 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:27:40.803218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:27:41.019203 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c923f1cc-f477-49a6-86bd-6a47122bc9b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f/action" status: 202 len: 0 microversion: 2.1 time: 0.270739 Jul 01 11:27:41.020092 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3363/6823] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:27:40 2022] POST /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:27:41.033087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:41.034537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:41.040511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:41.040979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:41.041841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:41.042287 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:41.181494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:41.188997 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00a3eaf9-ece8-434e-8911-e42b32e47877 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1678 microversion: 2.1 time: 0.164217 Jul 01 11:27:41.190497 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3461/6824] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:41 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:27:42.207633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:42.208238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:42.214366 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:42.216144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:42.216144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:42.216144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:42.352709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:42.360221 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af424980-7e62-4cbc-a019-a94e361bc5f7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1678 microversion: 2.1 time: 0.157321 Jul 01 11:27:42.360784 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3364/6825] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:42 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:43.378532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:43.379184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:43.386311 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:43.387155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:43.387555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:43.388008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:43.521010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:43.530262 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1af743d-c887-44e0-a7e1-e345e6e397d0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1678 microversion: 2.1 time: 0.156110 Jul 01 11:27:43.531173 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3462/6826] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:43 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:44.547722 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:44.548334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:44.555685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:44.556128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:44.556888 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:44.557353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:44.692820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:44.700687 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-242f80ff-4709-4213-95eb-08d6fada89e6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.156818 Jul 01 11:27:44.701281 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3365/6827] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:44 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:45.718049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:45.718674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:45.726286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:45.726750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:45.727532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:45.727982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:45.862286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:45.869986 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e64d994-c121-4fa8-8823-328fb6a6a5f6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.155814 Jul 01 11:27:45.870569 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3463/6828] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:45 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:46.887003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:46.887638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:46.895105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:46.895484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:46.896263 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:46.896698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:47.030826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:47.038381 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bf93a87-4a23-4649-a33d-0c2b9004587b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.155407 Jul 01 11:27:47.038958 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3366/6829] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:46 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:48.055493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:48.056120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:48.062953 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:48.063416 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:48.064190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:48.065582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:48.197766 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:48.206348 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fad190f4-b033-4bd5-addb-368549b5c3be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.154762 Jul 01 11:27:48.206928 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3464/6830] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:48 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:49.224207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:49.225301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:49.231578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:49.232026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:49.232782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:49.233246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:49.362333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:49.370176 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3308b460-3742-4d58-965e-993af9de785b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.150444 Jul 01 11:27:49.370747 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3367/6831] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:49 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:50.387592 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:50.388216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:50.395883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:50.396341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:50.397112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:50.397584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:50.537810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:50.545322 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-abb367a6-d887-49fd-b8eb-e3393f8c67ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.162011 Jul 01 11:27:50.546279 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3465/6832] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:50 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:51.563139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:51.563757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:51.571954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:51.572406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:51.573208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:51.573652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:51.704999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:51.712567 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20846d25-7dc5-4ffd-9096-19db1ce6cb2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.153292 Jul 01 11:27:51.713165 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3368/6833] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:51 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:52.730334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:52.730966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:52.737992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:52.738464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:52.739255 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:52.739711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:52.866902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:52.874442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c6d5df54-acb7-4bd5-b141-c8a11421c9cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.148064 Jul 01 11:27:52.875020 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3466/6834] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:52 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:27:53.891651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:53.892266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:53.899235 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:53.899630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:53.900403 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:53.900838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:54.034135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:54.041602 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c4d85abc-f5d4-408b-b39c-f886fdf9ac21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.153879 Jul 01 11:27:54.042174 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3369/6835] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:53 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:55.059412 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:55.060033 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:55.067805 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:55.068268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:55.069039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:55.069509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:55.196671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:55.204265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-844187b8-b9fb-4178-bc78-37a40f4521b6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1683 microversion: 2.1 time: 0.148785 Jul 01 11:27:55.204843 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3467/6836] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:55 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:56.221525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:56.222220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:56.228836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:56.229317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:56.230101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:56.230531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:56.365100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:56.372692 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0038b8d5-89b2-469c-b187-496ff64be1bb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1682 microversion: 2.1 time: 0.155177 Jul 01 11:27:56.373303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3370/6837] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:56 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:56.803353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-0588dc53-4c12-4c71-afe4-c4854a628189 req-85c04cee-de45-43ca-a861-f8574516e029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a233b8-89d3-4fdf-b624-1bbc4797640f", "name": "network-vif-unplugged", "status": "completed", "tag": "c76d6bae-4567-4db5-b44a-3da632b740b5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:27:56.812429 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0588dc53-4c12-4c71-afe4-c4854a628189 req-85c04cee-de45-43ca-a861-f8574516e029 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:56.812996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-0588dc53-4c12-4c71-afe4-c4854a628189 req-85c04cee-de45-43ca-a861-f8574516e029 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:56.826156 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-0588dc53-4c12-4c71-afe4-c4854a628189 req-85c04cee-de45-43ca-a861-f8574516e029 service nova] Creating event network-vif-unplugged:c76d6bae-4567-4db5-b44a-3da632b740b5 for instance 01a233b8-89d3-4fdf-b624-1bbc4797640f on n-h2-master-1 Jul 01 11:27:56.831380 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-0588dc53-4c12-4c71-afe4-c4854a628189 req-85c04cee-de45-43ca-a861-f8574516e029 service nova] Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:27:56.842496 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-0588dc53-4c12-4c71-afe4-c4854a628189 req-85c04cee-de45-43ca-a861-f8574516e029 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043388 Jul 01 11:27:56.843107 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3468/6838] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:27:57.392713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:57.396018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:57.402480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:57.402870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:57.403640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:57.404510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:57.550167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:57.558617 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e06b959-c8ab-4878-9675-7fd7bae0aa34 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1682 microversion: 2.1 time: 0.171272 Jul 01 11:27:57.559610 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3371/6839] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:57 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:58.578585 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:58.579265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:58.585753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:58.586219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:58.586994 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:58.587447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:58.718072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:58.726278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d60afedd-5e02-4cf7-b923-64786c043eef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1680 microversion: 2.1 time: 0.152914 Jul 01 11:27:58.726840 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3469/6840] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:58 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:27:58.857172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3ac08003-c1f0-4a0d-928c-fe64d82d5385 req-1260de2c-2465-4000-a216-80bd99c95996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a233b8-89d3-4fdf-b624-1bbc4797640f", "tag": "c76d6bae-4567-4db5-b44a-3da632b740b5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:27:58.866726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ac08003-c1f0-4a0d-928c-fe64d82d5385 req-1260de2c-2465-4000-a216-80bd99c95996 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:58.867173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ac08003-c1f0-4a0d-928c-fe64d82d5385 req-1260de2c-2465-4000-a216-80bd99c95996 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:58.879251 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3ac08003-c1f0-4a0d-928c-fe64d82d5385 req-1260de2c-2465-4000-a216-80bd99c95996 service nova] Creating event network-changed:c76d6bae-4567-4db5-b44a-3da632b740b5 for instance 01a233b8-89d3-4fdf-b624-1bbc4797640f on n-h2-master-1 Jul 01 11:27:58.884508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-3ac08003-c1f0-4a0d-928c-fe64d82d5385 req-1260de2c-2465-4000-a216-80bd99c95996 service nova] Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:27:58.895462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3ac08003-c1f0-4a0d-928c-fe64d82d5385 req-1260de2c-2465-4000-a216-80bd99c95996 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041990 Jul 01 11:27:58.896061 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3372/6841] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:27:59.743467 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:27:59.744232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:27:59.751111 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:59.751576 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:59.752399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:27:59.752853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:27:59.887665 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:27:59.894844 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-11e4d8fd-6751-4523-bc62-d82b58b5d6be tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1680 microversion: 2.1 time: 0.155223 Jul 01 11:27:59.895423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3470/6842] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:27:59 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:00.913873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:00.914486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:00.920729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:00.921261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:00.922020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:00.922447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:01.056000 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:01.063554 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea3e7215-5725-4046-930a-bdde3f790daa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1677 microversion: 2.1 time: 0.155523 Jul 01 11:28:01.064132 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3373/6843] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:00 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:01.080210 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-81d8b8e7-0c47-41e6-92ab-3ea61244d135 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:28:01.081344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-81d8b8e7-0c47-41e6-92ab-3ea61244d135 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:01.088578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81d8b8e7-0c47-41e6-92ab-3ea61244d135 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:01.089051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81d8b8e7-0c47-41e6-92ab-3ea61244d135 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:01.090009 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81d8b8e7-0c47-41e6-92ab-3ea61244d135 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:01.090472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-81d8b8e7-0c47-41e6-92ab-3ea61244d135 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:01.266564 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-81d8b8e7-0c47-41e6-92ab-3ea61244d135 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f/action" status: 204 len: 0 microversion: 2.1 time: 0.189927 Jul 01 11:28:01.267233 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3471/6844] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:28:01 2022] POST /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f/action => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:28:01.275885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:01.276503 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:01.284399 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:01.284849 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:01.285674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:01.286076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:01.427621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:01.435214 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f61d3af5-dfb4-4b5a-9036-321f28b0443e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1677 microversion: 2.1 time: 0.163204 Jul 01 11:28:01.436172 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3374/6845] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:01 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:02.454531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:02.455774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:02.461993 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:02.462450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:02.463215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:02.463661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:02.594041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:02.602392 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3024a6e8-6ca0-4810-9dbc-3d70919fd22e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1677 microversion: 2.1 time: 0.152975 Jul 01 11:28:02.602966 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3472/6846] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:02 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:03.563682 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-dac20fd5-90fd-4f9b-8cdb-9cff6020e66b req-be1f4ddb-3311-4d3f-95da-50d4e575d86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a233b8-89d3-4fdf-b624-1bbc4797640f", "name": "network-vif-plugged", "status": "completed", "tag": "c76d6bae-4567-4db5-b44a-3da632b740b5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:28:03.573045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dac20fd5-90fd-4f9b-8cdb-9cff6020e66b req-be1f4ddb-3311-4d3f-95da-50d4e575d86d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:03.573509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dac20fd5-90fd-4f9b-8cdb-9cff6020e66b req-be1f4ddb-3311-4d3f-95da-50d4e575d86d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:03.584975 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-dac20fd5-90fd-4f9b-8cdb-9cff6020e66b req-be1f4ddb-3311-4d3f-95da-50d4e575d86d service nova] Creating event network-vif-plugged:c76d6bae-4567-4db5-b44a-3da632b740b5 for instance 01a233b8-89d3-4fdf-b624-1bbc4797640f on n-h2-master-1 Jul 01 11:28:03.590373 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-dac20fd5-90fd-4f9b-8cdb-9cff6020e66b req-be1f4ddb-3311-4d3f-95da-50d4e575d86d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030816 Jul 01 11:28:03.591531 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3375/6847] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:28:03.619922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:03.620551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:03.628264 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:03.628722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:03.629654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:03.630092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:03.759589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:03.767064 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7f1529a8-693b-4adf-8723-5dc5d6dcb38f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1669 microversion: 2.1 time: 0.151107 Jul 01 11:28:03.767637 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3473/6848] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:03 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:03.784220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:03.785038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:03.791311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:03.791761 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:03.792507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:03.792934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:03.923738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:03.931246 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ad5cb291-b6da-4f66-9cac-3659a95c86ea tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1669 microversion: 2.1 time: 0.151322 Jul 01 11:28:03.931814 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3376/6849] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:03 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:03.948113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:03.948731 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:03.954700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:03.955156 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:03.956543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:03.956989 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:04.083852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:04.087105 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:28:04.093718 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b11fefd0-a9c1-472f-a723-c28bc9869d48 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1669 microversion: 2.1 time: 0.149548 Jul 01 11:28:04.094311 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3474/6850] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:03 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:04.110073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:04.113334 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:04.117251 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:04.117698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:04.118442 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:04.118875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:04.143494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:28:04.156836 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:28:04.432420 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d8eaceb4-02b0-424c-9c97-0ee4cf9e43b0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 204 len: 0 microversion: 2.1 time: 0.326312 Jul 01 11:28:04.433014 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3377/6851] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:28:04 2022] DELETE /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:28:04.441938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:04.442598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:04.449124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:04.449628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:04.450409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:04.450859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:04.582058 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:04.589733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2593cc95-3d39-4d1d-a6d4-25483ab60bbb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1675 microversion: 2.1 time: 0.152288 Jul 01 11:28:04.590241 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3475/6852] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:04 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:05.608139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:05.608837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:05.615725 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:05.616167 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:05.616919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:05.617387 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:05.747264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:05.754779 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a1861a28-5ee2-42ce-b2fc-e54f0f79d43d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1675 microversion: 2.1 time: 0.151000 Jul 01 11:28:05.755348 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3378/6853] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:05 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:06.772192 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:06.772834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:06.779713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:06.780183 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:06.780980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:06.781459 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:06.854936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:06.863718 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ab5e0fb-dfcf-46c4-b32c-070dd2efff3d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 200 len: 1607 microversion: 2.1 time: 0.095533 Jul 01 11:28:06.865088 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3476/6854] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:06 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 1607 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:07.099734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-48b7ec3d-4f9f-4238-9bfc-b4942276cae1 req-7cfac850-f9f0-4d5d-96b4-a08c0d735b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a233b8-89d3-4fdf-b624-1bbc4797640f", "name": "network-vif-deleted", "tag": "c76d6bae-4567-4db5-b44a-3da632b740b5"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:28:07.108733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-48b7ec3d-4f9f-4238-9bfc-b4942276cae1 req-7cfac850-f9f0-4d5d-96b4-a08c0d735b3c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:07.109197 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-48b7ec3d-4f9f-4238-9bfc-b4942276cae1 req-7cfac850-f9f0-4d5d-96b4-a08c0d735b3c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:07.120085 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-48b7ec3d-4f9f-4238-9bfc-b4942276cae1 req-7cfac850-f9f0-4d5d-96b4-a08c0d735b3c service nova] Creating event network-vif-deleted:c76d6bae-4567-4db5-b44a-3da632b740b5 for instance 01a233b8-89d3-4fdf-b624-1bbc4797640f on n-h2-master-1 Jul 01 11:28:07.125139 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-48b7ec3d-4f9f-4238-9bfc-b4942276cae1 req-7cfac850-f9f0-4d5d-96b4-a08c0d735b3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029647 Jul 01 11:28:07.125781 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3379/6855] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:28:07.881434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:07.882936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:07.889589 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:07.890060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:07.890862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:07.891325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:07.905798 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f HTTP/1.1 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '01a233b8-89d3-4fdf-b624-1bbc4797640f'} Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:28:07.907525 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fb31002a-9296-4300-8da0-e69f96740b98 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 404 len: 111 microversion: 2.1 time: 0.032122 Jul 01 11:28:07.913220 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3477/6856] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:07 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:28:07.926261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:07.926976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:07.933775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:07.934297 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:07.935139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:07.935578 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:07.958331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f HTTP/1.1 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '01a233b8-89d3-4fdf-b624-1bbc4797640f'} Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:28:07.960002 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cef1eeb8-46f4-44e0-b6a5-c675b03302d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 404 len: 111 microversion: 2.1 time: 0.042575 Jul 01 11:28:07.963654 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3380/6857] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:07 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:28:08.010917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1049235663", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "70890723-10ef-4ffd-bed0-feeacfb1ebc4"}], "security_groups": [{"name": "tempest-securitygroup--1145951281"}], "key_name": "tempest-keypair-1626383828", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:28:08.123797 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] validate_networks() for [('70890723-10ef-4ffd-bed0-feeacfb1ebc4', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:28:08.489976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:28:08.495373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:28:08.495373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:28:08.495373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:28:08.495373 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:28:08.500784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:08.501362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:08.502189 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:08.502643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:08.519965 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:28:08.525245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for user faf4b86f835a466b9129e4f71a84e9f1 and project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:28:08.538187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:28:08.540512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:28:08.646746 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d4e55fbc-fd64-4a78-a841-28b0a47c29a4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639875 Jul 01 11:28:08.647402 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3478/6858] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:28:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:28:08.662848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f72271f2-f2e3-453e-b496-5a48bef699f2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:08.663923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f72271f2-f2e3-453e-b496-5a48bef699f2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:09.048256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f72271f2-f2e3-453e-b496-5a48bef699f2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:09.054475 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f72271f2-f2e3-453e-b496-5a48bef699f2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1239 microversion: 2.1 time: 0.397074 Jul 01 11:28:09.055047 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3381/6859] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:08 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1239 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:10.073403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:10.073956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:10.080869 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:10.081363 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:10.082145 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:10.082597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:10.145286 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:10.152764 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bdac99d7-f793-42b6-9804-c19a5151ff51 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1291 microversion: 2.1 time: 0.084338 Jul 01 11:28:10.153359 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3479/6860] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:10 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1291 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:11.170761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:11.171437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:11.174963 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:28:11.179836 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:11.180321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:11.181094 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:11.181563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:11.318495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:11.326533 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8490c02c-45ef-4f8c-981c-4d42f0af5cbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1365 microversion: 2.1 time: 0.159858 Jul 01 11:28:11.327168 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3382/6861] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:11 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:28:12.103046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-d3c6e181-ff4c-453a-820b-253ee7b8fe4d req-af88a581-1350-4024-9144-043e23a19c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644d2cd9-5e38-4e57-9503-dd39b4c73ed8", "tag": "97eaa89d-ad76-43b2-826f-72364311968f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:28:12.112033 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:28:12.116888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d3c6e181-ff4c-453a-820b-253ee7b8fe4d req-af88a581-1350-4024-9144-043e23a19c54 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:12.116888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-d3c6e181-ff4c-453a-820b-253ee7b8fe4d req-af88a581-1350-4024-9144-043e23a19c54 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:12.128540 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-d3c6e181-ff4c-453a-820b-253ee7b8fe4d req-af88a581-1350-4024-9144-043e23a19c54 service nova] Creating event network-changed:97eaa89d-ad76-43b2-826f-72364311968f for instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 on n-h2-master-1 Jul 01 11:28:12.134138 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-d3c6e181-ff4c-453a-820b-253ee7b8fe4d req-af88a581-1350-4024-9144-043e23a19c54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035069 Jul 01 11:28:12.135132 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3480/6862] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:28:12.344310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:12.345385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:12.352520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:12.356036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:12.356036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:12.356036 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:12.490035 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:12.497578 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f4acfa9-7853-423c-9074-3408d3fe1da5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1365 microversion: 2.1 time: 0.157373 Jul 01 11:28:12.498148 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3383/6863] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:12 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:13.515786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:13.516512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:13.524956 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:13.525451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:13.526241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:13.526698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:13.660660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:13.668287 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e9ea9720-5f27-4b46-9c3a-5d90023c707b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1365 microversion: 2.1 time: 0.156798 Jul 01 11:28:13.668859 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3481/6864] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:13 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:14.685898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:14.686548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:14.694824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:14.714006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:14.714006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:14.714006 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:14.829179 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:14.836522 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c18f2df-722e-4e36-8983-7b53ada145f1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1365 microversion: 2.1 time: 0.154696 Jul 01 11:28:14.837083 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3384/6865] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:14 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:15.855258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:15.855790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:15.862778 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:15.863233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:15.863997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:15.864449 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:15.991794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:15.999220 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eecc643a-3b8c-4e16-aa32-c7da25ae3801 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1365 microversion: 2.1 time: 0.149016 Jul 01 11:28:15.999789 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3482/6866] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:15 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:17.016873 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:17.017520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:17.024650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:17.025110 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:17.025955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:17.026414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:17.169301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:17.177505 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6f0e61d3-9270-43d3-9ca4-ad760de9ac56 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1365 microversion: 2.1 time: 0.164490 Jul 01 11:28:17.178081 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3385/6867] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:17 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:17.439490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6388f948-2ce3-493e-8b67-8f5cc609f95c req-a68b63ea-abe6-4ec6-a2bd-f9ab9cdd32e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d2cd9-5e38-4e57-9503-dd39b4c73ed8", "name": "network-vif-plugged", "status": "completed", "tag": "97eaa89d-ad76-43b2-826f-72364311968f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:28:17.449010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6388f948-2ce3-493e-8b67-8f5cc609f95c req-a68b63ea-abe6-4ec6-a2bd-f9ab9cdd32e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:17.449537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6388f948-2ce3-493e-8b67-8f5cc609f95c req-a68b63ea-abe6-4ec6-a2bd-f9ab9cdd32e4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:17.461011 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6388f948-2ce3-493e-8b67-8f5cc609f95c req-a68b63ea-abe6-4ec6-a2bd-f9ab9cdd32e4 service nova] Creating event network-vif-plugged:97eaa89d-ad76-43b2-826f-72364311968f for instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 on n-h2-master-1 Jul 01 11:28:17.466008 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6388f948-2ce3-493e-8b67-8f5cc609f95c req-a68b63ea-abe6-4ec6-a2bd-f9ab9cdd32e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030252 Jul 01 11:28:17.466589 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3483/6868] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:28:18.195614 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:18.196217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:18.203128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:18.203568 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:18.204318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:18.204748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:18.331756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:18.339094 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8ca3476-a779-4653-b530-1414e36576a6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1365 microversion: 2.1 time: 0.147325 Jul 01 11:28:18.339661 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3386/6869] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:18 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:19.354055 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:28:19.354834 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:28:19.358910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:19.359633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:19.365930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:19.366741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:19.367194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:19.367646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:19.497960 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:28:19.506187 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7d6fd27-a2f0-4a37-a2c2-6988db579cb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1552 microversion: 2.1 time: 0.154011 Jul 01 11:28:19.506790 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3484/6870] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:28:19 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:28:19.523197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7bb5e62e-6520-4486-bc8a-5f3bb2733599 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:28:19.523699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7bb5e62e-6520-4486-bc8a-5f3bb2733599 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:28:19.525594 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:28:19.531305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bb5e62e-6520-4486-bc8a-5f3bb2733599 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:19.531764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bb5e62e-6520-4486-bc8a-5f3bb2733599 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:19.532553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bb5e62e-6520-4486-bc8a-5f3bb2733599 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:19.532989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7bb5e62e-6520-4486-bc8a-5f3bb2733599 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:19.620325 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7bb5e62e-6520-4486-bc8a-5f3bb2733599 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100931 Jul 01 11:28:19.620942 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3387/6871] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 11:28:19 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:28:20.590637 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1b420401-85c9-4f7e-8daa-773e3aa34532 req-709d5666-71dc-43c8-9393-09526a075827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644d2cd9-5e38-4e57-9503-dd39b4c73ed8", "tag": "97eaa89d-ad76-43b2-826f-72364311968f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:28:20.600341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1b420401-85c9-4f7e-8daa-773e3aa34532 req-709d5666-71dc-43c8-9393-09526a075827 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:28:20.600740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1b420401-85c9-4f7e-8daa-773e3aa34532 req-709d5666-71dc-43c8-9393-09526a075827 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:28:20.612033 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1b420401-85c9-4f7e-8daa-773e3aa34532 req-709d5666-71dc-43c8-9393-09526a075827 service nova] Creating event network-changed:97eaa89d-ad76-43b2-826f-72364311968f for instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 on n-h2-master-1 Jul 01 11:28:20.617694 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1b420401-85c9-4f7e-8daa-773e3aa34532 req-709d5666-71dc-43c8-9393-09526a075827 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030804 Jul 01 11:28:20.618491 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3485/6872] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:29:01.566422 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=11 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:01.567228 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:01.571278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca843e62-2943-4c9f-8289-d856857de4c2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:01.577237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca843e62-2943-4c9f-8289-d856857de4c2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:01.577694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca843e62-2943-4c9f-8289-d856857de4c2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:01.600138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca843e62-2943-4c9f-8289-d856857de4c2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Going to try to stop instance {{(pid=119765) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 11:29:01.719583 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca843e62-2943-4c9f-8289-d856857de4c2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.155689 Jul 01 11:29:01.720199 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3388/6873] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:29:01 2022] POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:29:01.728669 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=11 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:01.729719 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=47 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:01.733723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:01.734436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:01.741261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:01.741719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:01.742492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:01.742973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:01.929036 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:01.936749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-407e40d9-7ca2-4152-b86a-23db3d70134c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.211270 Jul 01 11:29:01.937354 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3486/6874] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:01 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:02.956734 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:02.957657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:02.964101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:02.964539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:02.965330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:02.965764 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:03.141829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:03.150394 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a338f83e-18da-4f69-906d-1f74fb1c6702 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.199250 Jul 01 11:29:03.150972 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3389/6875] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:02 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:04.167212 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:04.167834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:04.174495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:04.174955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:04.175728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:04.176174 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:04.325379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:04.333109 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-58864502-e75e-4307-99ee-305c30f7ff1f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.170105 Jul 01 11:29:04.333772 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3487/6876] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:04 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:05.350236 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:05.350828 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:05.357990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:05.358441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:05.359206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:05.359637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:05.488651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:05.496210 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8dd6516-e353-4c96-8cd7-9e6ecabb8178 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.149899 Jul 01 11:29:05.496790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3390/6877] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:05 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:29:06.513205 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:06.513774 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:06.521284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:06.521753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:06.522538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:06.522992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:06.650683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:06.658242 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d393c011-02a6-45a9-ad58-1bc49ecb894b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.149001 Jul 01 11:29:06.659061 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3488/6878] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:06 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:07.094475 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:29:07.095056 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:29:07.675566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:07.676180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:07.683144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:07.683589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:07.684346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:07.684779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:07.815784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:07.823332 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a8cf640-c7d0-40c0-b083-d64b5b8788cc tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.152263 Jul 01 11:29:07.823898 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3391/6879] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:07 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:08.840915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:08.841564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:08.848505 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:08.848965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:08.849782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:08.850233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:08.988856 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:08.996354 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3e23449c-c45f-4bab-a948-1ee002ae0539 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.159438 Jul 01 11:29:08.997171 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3489/6880] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:08 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:10.013826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:10.014435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:10.021949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:10.022395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:10.023161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:10.023592 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:10.152484 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:10.160524 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c400e3ed-e23b-4c31-9712-dbc647dba8a7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.150595 Jul 01 11:29:10.161096 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3392/6881] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:10 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:11.178291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:11.178908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:11.185784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:11.186241 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:11.187014 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:11.187455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:11.315770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:11.323315 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1707966-396f-4930-91d8-4e8f828d62c4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.148944 Jul 01 11:29:11.323875 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3490/6882] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:11 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:12.339804 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:12.340412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:12.348042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:12.351637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:12.351637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:12.351637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:12.482113 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:12.489712 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-00cbd92d-c706-4267-81fd-4eed5ac1d8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.153790 Jul 01 11:29:12.490296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3393/6883] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:12 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:13.506849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:13.507490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:13.514566 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:13.515035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:13.515820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:13.516271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:13.653713 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:13.661733 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8cba5d06-6f73-472c-a281-291167d549ac tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.158831 Jul 01 11:29:13.662294 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3491/6884] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:13 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:14.678765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:14.679389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:14.686290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:14.686727 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:14.687479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:14.687905 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:14.816553 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:14.824012 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76b1e067-e12c-40e5-b33b-5562580aee93 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.149285 Jul 01 11:29:14.824583 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3394/6885] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:14 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:15.842121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:15.842744 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:15.849732 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:15.850192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:15.850959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:15.851404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:15.981509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:15.989527 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5600eb68-665a-44b6-a54e-70e55ea1fb7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.151307 Jul 01 11:29:15.990088 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3492/6886] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:15 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:17.006248 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:17.007068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:17.018999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:17.019795 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:17.021171 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:17.021757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:17.156205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:17.163732 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e18e276c-eb93-423f-afaf-b9cf6eebb6ab tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.161486 Jul 01 11:29:17.164303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3395/6887] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:17 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:18.180924 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:18.181581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:18.188440 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:18.188906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:18.189748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:18.190204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:18.332899 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:18.332899 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b6d70ec-d127-4dc7-8aec-8c8f3883777f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1657 microversion: 2.1 time: 0.155205 Jul 01 11:29:18.332899 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3493/6888] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:18 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:18.349420 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:18.351252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:18.358339 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:18.361262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:18.361262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:18.361262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:18.387298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:18.393691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Old instance type m1.heat2, new instance type m1.heat {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:29:18.399848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:29:18.400272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:29:18.400779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:29:18.401233 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:29:18.401657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:29:18.588978 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ade797ad-2625-43a7-b7d4-c1db6a66da80 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.244222 Jul 01 11:29:18.589633 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3396/6889] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:29:18 2022] POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:29:18.597699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:18.598323 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:18.604526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:18.604998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:18.605830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:18.606283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:18.749516 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:18.757609 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-24115cc3-a940-4568-aee4-f594b5961634 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.163737 Jul 01 11:29:18.758178 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3494/6890] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:18 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:19.776613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:19.777299 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:19.784175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:19.784618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:19.785407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:19.785838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:19.919489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:19.926988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96b7fe36-c65e-42da-b15d-17c392085fae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.155384 Jul 01 11:29:19.927554 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3397/6891] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:19 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:20.944204 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:20.944832 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:20.951767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:20.952231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:20.953013 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:20.953491 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:21.089075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:21.097341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-21b62d1c-d8fe-4e80-b97c-5c56d66c1df6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1680 microversion: 2.1 time: 0.157378 Jul 01 11:29:21.097911 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3495/6892] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:20 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:22.114875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:22.115520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:22.122433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:22.122886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:22.123652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:22.124089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:22.255894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:22.263498 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca19d9af-6bd2-44ee-8870-bc4b9865d697 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1685 microversion: 2.1 time: 0.153116 Jul 01 11:29:22.264066 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3398/6893] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:22 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:23.281070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:23.281758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:23.289313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:23.289786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:23.290579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:23.291037 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:23.422679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:23.431059 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-294abf10-73d7-47d1-94f7-a9c6ca0e734d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1685 microversion: 2.1 time: 0.153829 Jul 01 11:29:23.431802 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3496/6894] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:23 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:24.423821 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3efb53f8-3db0-4c15-8cbd-7bc5a9df00d7 req-b3e6561b-8d99-4a8a-8419-5a9e4e5488c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d2cd9-5e38-4e57-9503-dd39b4c73ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "97eaa89d-ad76-43b2-826f-72364311968f"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:24.433108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3efb53f8-3db0-4c15-8cbd-7bc5a9df00d7 req-b3e6561b-8d99-4a8a-8419-5a9e4e5488c4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:24.433605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3efb53f8-3db0-4c15-8cbd-7bc5a9df00d7 req-b3e6561b-8d99-4a8a-8419-5a9e4e5488c4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:24.447879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:24.451622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:24.451756 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3efb53f8-3db0-4c15-8cbd-7bc5a9df00d7 req-b3e6561b-8d99-4a8a-8419-5a9e4e5488c4 service nova] Creating event network-vif-unplugged:97eaa89d-ad76-43b2-826f-72364311968f for instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 on n-h1-master-1 Jul 01 11:29:24.455059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-3efb53f8-3db0-4c15-8cbd-7bc5a9df00d7 req-b3e6561b-8d99-4a8a-8419-5a9e4e5488c4 service nova] Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:29:24.455714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:24.456182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:24.456973 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:24.457448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:24.466145 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3efb53f8-3db0-4c15-8cbd-7bc5a9df00d7 req-b3e6561b-8d99-4a8a-8419-5a9e4e5488c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046463 Jul 01 11:29:24.466780 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3399/6895] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:29:24.609756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:24.627566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3ca5e9c7-b95b-4292-9c10-8ca41bd9cc0b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1684 microversion: 2.1 time: 0.183419 Jul 01 11:29:24.628859 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3497/6896] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:24 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:29:25.647280 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:25.647985 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:25.654894 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:25.655558 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:25.656490 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:25.656931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:25.787695 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:25.796185 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52b22253-c72a-4a0e-a362-35fc166c345f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1684 microversion: 2.1 time: 0.154706 Jul 01 11:29:25.796777 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3400/6897] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:25 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:26.533514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-89a7175e-ef07-4153-aee0-2796ee7a7cef req-9d8d6356-81e2-4c28-a686-1b82dd0de490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644d2cd9-5e38-4e57-9503-dd39b4c73ed8", "tag": "97eaa89d-ad76-43b2-826f-72364311968f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:26.541612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-89a7175e-ef07-4153-aee0-2796ee7a7cef req-9d8d6356-81e2-4c28-a686-1b82dd0de490 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:26.542076 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-89a7175e-ef07-4153-aee0-2796ee7a7cef req-9d8d6356-81e2-4c28-a686-1b82dd0de490 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:26.554056 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-89a7175e-ef07-4153-aee0-2796ee7a7cef req-9d8d6356-81e2-4c28-a686-1b82dd0de490 service nova] Creating event network-changed:97eaa89d-ad76-43b2-826f-72364311968f for instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 on n-h1-master-1 Jul 01 11:29:26.559383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-89a7175e-ef07-4153-aee0-2796ee7a7cef req-9d8d6356-81e2-4c28-a686-1b82dd0de490 service nova] Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:29:26.570984 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-89a7175e-ef07-4153-aee0-2796ee7a7cef req-9d8d6356-81e2-4c28-a686-1b82dd0de490 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094758 Jul 01 11:29:26.571552 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3498/6898] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:29:26.814851 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:26.815461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:26.822229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:26.822670 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:26.823426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:26.823852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:26.976289 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:26.984756 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a08201cc-27c5-41c5-a02a-d9bc9a4cecb2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1682 microversion: 2.1 time: 0.174268 Jul 01 11:29:26.985786 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3401/6899] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:26 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:28.004902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:28.005652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:28.011977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:28.012448 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:28.013267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:28.013730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:28.143254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:28.150774 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d000b72a-e59e-45db-9a63-e08bb19b49ae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1678 microversion: 2.1 time: 0.151716 Jul 01 11:29:28.151349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3499/6900] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:27 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:28.167162 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3e0b38a2-8514-430c-b0bc-2d81904f8fd4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:28.167776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3e0b38a2-8514-430c-b0bc-2d81904f8fd4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:28.175911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e0b38a2-8514-430c-b0bc-2d81904f8fd4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:28.176700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e0b38a2-8514-430c-b0bc-2d81904f8fd4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:28.178188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e0b38a2-8514-430c-b0bc-2d81904f8fd4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:28.178694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3e0b38a2-8514-430c-b0bc-2d81904f8fd4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:28.198509 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:28.368412 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3e0b38a2-8514-430c-b0bc-2d81904f8fd4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action" status: 204 len: 0 microversion: 2.1 time: 0.204905 Jul 01 11:29:28.369064 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3402/6901] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:29:28 2022] POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:29:28.377967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:28.382283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:28.388471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:28.388939 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:28.389754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:28.390204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:28.530735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:28.539666 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f8cb924-8cca-4c32-9b73-a03512d96719 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1678 microversion: 2.1 time: 0.166126 Jul 01 11:29:28.546112 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3500/6902] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:28 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:29.559508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:29.560229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:29.567655 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:29.568192 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:29.568951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:29.569407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:29.701099 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:29.708685 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c20941ca-e8bb-4090-83af-9da80135af96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1678 microversion: 2.1 time: 0.154202 Jul 01 11:29:29.709284 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3403/6903] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:29 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:30.087515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-36c3a5a6-258a-414a-9a3e-3a62d2eb9679 req-977c1712-c537-4a0c-8d27-727a2246b69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d2cd9-5e38-4e57-9503-dd39b4c73ed8", "name": "network-vif-plugged", "status": "completed", "tag": "97eaa89d-ad76-43b2-826f-72364311968f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:30.096750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-36c3a5a6-258a-414a-9a3e-3a62d2eb9679 req-977c1712-c537-4a0c-8d27-727a2246b69d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:30.097240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-36c3a5a6-258a-414a-9a3e-3a62d2eb9679 req-977c1712-c537-4a0c-8d27-727a2246b69d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:30.108288 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-36c3a5a6-258a-414a-9a3e-3a62d2eb9679 req-977c1712-c537-4a0c-8d27-727a2246b69d service nova] Creating event network-vif-plugged:97eaa89d-ad76-43b2-826f-72364311968f for instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 on n-h1-master-1 Jul 01 11:29:30.113851 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-36c3a5a6-258a-414a-9a3e-3a62d2eb9679 req-977c1712-c537-4a0c-8d27-727a2246b69d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030563 Jul 01 11:29:30.116350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3501/6904] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:29:30.726712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:30.727325 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:30.734161 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:30.734609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:30.735972 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:30.736418 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:30.861096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:30.868496 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f1a44262-c087-4648-a294-fb2e7a3d655e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1657 microversion: 2.1 time: 0.145698 Jul 01 11:29:30.869064 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3404/6905] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:30 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1657 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:30.885298 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:30.886026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:30.892237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:30.892722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:30.893575 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:30.893964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:31.027855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:31.036088 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b48c5f6-7f5c-46ec-b781-d2f8ca60147f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1657 microversion: 2.1 time: 0.154999 Jul 01 11:29:31.036660 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3502/6906] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:30 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:31.051989 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-381506c1-d570-4929-8683-4dd3e0351fef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:31.058125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-381506c1-d570-4929-8683-4dd3e0351fef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:31.058583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-381506c1-d570-4929-8683-4dd3e0351fef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:31.081423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-381506c1-d570-4929-8683-4dd3e0351fef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Going to try to start instance {{(pid=119765) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 11:29:31.228120 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-381506c1-d570-4929-8683-4dd3e0351fef tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.179826 Jul 01 11:29:31.228809 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3405/6907] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:29:31 2022] POST /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:29:31.237110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:31.237770 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:31.244342 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:31.244810 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:31.245663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:31.246084 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:31.264054 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=100 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:31.382218 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:31.390479 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d411ce86-7c0f-4232-b06f-9178cfd177ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1666 microversion: 2.1 time: 0.157070 Jul 01 11:29:31.391036 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3503/6908] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:31 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:32.409865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:32.410578 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:32.412501 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=41 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:32.417429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:32.417871 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:32.418691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:32.419185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:32.555117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:32.562725 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-46062b1d-aee8-4de0-afe7-1accefe8a888 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1666 microversion: 2.1 time: 0.158650 Jul 01 11:29:32.563285 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3406/6909] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:32 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:33.580429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:33.581057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:33.583831 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=37 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:33.588605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:33.589081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:33.589894 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:33.590353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:33.722627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:33.730339 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38a827c8-3aaa-4a8a-bb75-41ec6262b48c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1670 microversion: 2.1 time: 0.153813 Jul 01 11:29:33.730913 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3504/6910] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:33 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:29:33.747426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:33.747932 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:33.754233 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:33.754672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:33.755417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:33.755848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:33.779458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:29:33.984809 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-acb1d060-7185-4c6f-9846-c0d0ef411c21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 204 len: 0 microversion: 2.1 time: 0.240948 Jul 01 11:29:33.985440 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3407/6911] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:29:33 2022] DELETE /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:29:33.993651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:33.994283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:34.000766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:34.001274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:34.002075 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:34.002529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:34.145255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:34.152980 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-225cb630-b5ba-4eee-9e40-3203e20bb4a9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1676 microversion: 2.1 time: 0.163234 Jul 01 11:29:34.153585 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3505/6912] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:33 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:35.171412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:35.172123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:35.179821 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:35.180275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:35.181048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:35.181510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:35.312654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:35.320668 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-281bca0b-55df-4790-abcd-2435b7ef04b3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1676 microversion: 2.1 time: 0.153608 Jul 01 11:29:35.321272 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3408/6913] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:35 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:36.248278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-8feeb1a6-c0e5-4f1a-b618-8247c8820966 req-07919eee-9356-40c1-957a-b2a2696180e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d2cd9-5e38-4e57-9503-dd39b4c73ed8", "name": "network-vif-deleted", "tag": "97eaa89d-ad76-43b2-826f-72364311968f"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:36.258326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8feeb1a6-c0e5-4f1a-b618-8247c8820966 req-07919eee-9356-40c1-957a-b2a2696180e7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:36.258784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-8feeb1a6-c0e5-4f1a-b618-8247c8820966 req-07919eee-9356-40c1-957a-b2a2696180e7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:36.270232 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-8feeb1a6-c0e5-4f1a-b618-8247c8820966 req-07919eee-9356-40c1-957a-b2a2696180e7 service nova] Creating event network-vif-deleted:97eaa89d-ad76-43b2-826f-72364311968f for instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 on n-h1-master-1 Jul 01 11:29:36.275447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-8feeb1a6-c0e5-4f1a-b618-8247c8820966 req-07919eee-9356-40c1-957a-b2a2696180e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031373 Jul 01 11:29:36.276217 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3506/6914] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:29:36.338041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:36.339255 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:36.346476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:36.347005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:36.347786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:36.348218 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:36.414152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:36.421922 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cf182d26-b4d5-40ba-a1e7-e76ef93f512f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 200 len: 1608 microversion: 2.1 time: 0.087803 Jul 01 11:29:36.423048 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3409/6915] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:36 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 1608 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:37.442072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:37.442788 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:37.449104 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:37.449600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:37.450373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:37.450826 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:37.464627 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 HTTP/1.1 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '644d2cd9-5e38-4e57-9503-dd39b4c73ed8'} Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:29:37.466285 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ec30ace9-6409-4602-891d-2194e0bac706 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 404 len: 111 microversion: 2.1 time: 0.031593 Jul 01 11:29:37.470702 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3507/6916] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:37 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:29:37.485136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:37.485875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:37.492742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:37.493213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:37.493963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:37.494391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:37.507770 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 HTTP/1.1 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '644d2cd9-5e38-4e57-9503-dd39b4c73ed8'} Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:29:37.509416 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a2c31bb-1619-4bbf-ac97-5c14b1019f90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 404 len: 111 microversion: 2.1 time: 0.029563 Jul 01 11:29:37.513585 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3410/6917] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:37 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:29:37.557202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-695652722", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "70890723-10ef-4ffd-bed0-feeacfb1ebc4"}], "security_groups": [{"name": "tempest-securitygroup--1145951281"}], "key_name": "tempest-keypair-1626383828", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:37.661805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] validate_networks() for [('70890723-10ef-4ffd-bed0-feeacfb1ebc4', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:29:38.018309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:29:38.018747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:29:38.019227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:29:38.019644 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:29:38.020062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:29:38.028912 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:38.029409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:38.030216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:38.030661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:38.048401 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:29:38.053943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for user faf4b86f835a466b9129e4f71a84e9f1 and project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:29:38.066619 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:29:38.068873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:29:38.192442 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-39b96345-8690-4be2-8de7-73e48019fe9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639043 Jul 01 11:29:38.193020 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3508/6918] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:29:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:29:38.203042 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f0f3fc6e-4767-46d9-9f0e-85b08c14d282 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:38.203714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f0f3fc6e-4767-46d9-9f0e-85b08c14d282 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:38.263497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f0f3fc6e-4767-46d9-9f0e-85b08c14d282 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:38.270163 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f0f3fc6e-4767-46d9-9f0e-85b08c14d282 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1238 microversion: 2.1 time: 0.070987 Jul 01 11:29:38.271054 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3411/6919] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:38 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:39.288957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:39.289614 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:39.295884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:39.296359 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:39.297117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:39.297587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:39.360088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:39.368374 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c4251d50-f336-4668-9869-2c6155e7ad29 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1234 microversion: 2.1 time: 0.084022 Jul 01 11:29:39.368956 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3509/6920] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:39 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:40.394336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:40.395129 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:40.403123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:40.403566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:40.404326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:40.404758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:40.477165 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:40.485298 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-adc5b0a5-45bc-472e-b581-10c471615a33 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1296 microversion: 2.1 time: 0.095724 Jul 01 11:29:40.488450 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3412/6921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:40 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:41.503494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:41.504318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:41.511403 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:41.511866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:41.512657 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:41.513129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:41.643562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-8a9e1d31-6cd0-4196-b8c3-beaee7717d5d req-26cfc8de-fa1d-4a2e-9e8b-8e623b5286f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:41.664003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:41.664168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8a9e1d31-6cd0-4196-b8c3-beaee7717d5d req-26cfc8de-fa1d-4a2e-9e8b-8e623b5286f5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:41.664168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8a9e1d31-6cd0-4196-b8c3-beaee7717d5d req-26cfc8de-fa1d-4a2e-9e8b-8e623b5286f5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:41.668045 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4d24afc3-de74-41a9-963b-4b64dd819efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1364 microversion: 2.1 time: 0.168400 Jul 01 11:29:41.668959 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3510/6922] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:41 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:41.688521 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-8a9e1d31-6cd0-4196-b8c3-beaee7717d5d req-26cfc8de-fa1d-4a2e-9e8b-8e623b5286f5 service nova] Creating event network-changed:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h2-master-1 Jul 01 11:29:41.696210 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-8a9e1d31-6cd0-4196-b8c3-beaee7717d5d req-26cfc8de-fa1d-4a2e-9e8b-8e623b5286f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057368 Jul 01 11:29:41.696923 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3413/6923] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:29:42.685255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:42.685876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:42.693530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:42.693988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:42.694754 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:42.695194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:42.825572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:42.833641 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ad8b40d9-e6af-4774-95a2-0c94c34b2134 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1364 microversion: 2.1 time: 0.152449 Jul 01 11:29:42.834207 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3511/6924] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:42 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:43.852606 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:43.853246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:43.859806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:43.860255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:43.861049 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:43.861510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:43.988375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:43.996043 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8d5e7b67-4e26-431f-83eb-7df801cca4dd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1364 microversion: 2.1 time: 0.148486 Jul 01 11:29:43.996623 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3414/6925] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:43 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:45.013245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:45.013906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:45.021344 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:45.021816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:45.022601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:45.023059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:45.162184 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:45.169694 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9f5d6b9f-9b45-4216-a158-413962ced463 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1364 microversion: 2.1 time: 0.160383 Jul 01 11:29:45.170264 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3512/6926] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:45 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:46.188663 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:46.189355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:46.197363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:46.197974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:46.198657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:46.199097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:46.360559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:46.368873 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3f6bccdb-2691-410e-99c6-200e90114b05 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1364 microversion: 2.1 time: 0.184877 Jul 01 11:29:46.373514 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3415/6927] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:46 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:47.386509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:47.387135 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:47.394130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:47.398532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:47.398532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:47.398532 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:47.526260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:47.534589 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-295e9d85-e32b-4c9c-88cf-e9796d1a1885 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1364 microversion: 2.1 time: 0.152014 Jul 01 11:29:47.535512 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3513/6928] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:47 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:48.092624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f60dbd55-8b3f-4269-bfe3-23a007049ab9 req-713bd9de-8247-4015-8530-427fcb488a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "name": "network-vif-plugged", "status": "completed", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:48.096891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f60dbd55-8b3f-4269-bfe3-23a007049ab9 req-713bd9de-8247-4015-8530-427fcb488a12 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:48.097445 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f60dbd55-8b3f-4269-bfe3-23a007049ab9 req-713bd9de-8247-4015-8530-427fcb488a12 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:48.108452 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f60dbd55-8b3f-4269-bfe3-23a007049ab9 req-713bd9de-8247-4015-8530-427fcb488a12 service nova] Creating event network-vif-plugged:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h2-master-1 Jul 01 11:29:48.113519 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f60dbd55-8b3f-4269-bfe3-23a007049ab9 req-713bd9de-8247-4015-8530-427fcb488a12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088490 Jul 01 11:29:48.115459 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3416/6929] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:29:48.551632 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:48.552260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:48.554286 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:48.555006 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:48.561415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:48.561877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:48.562653 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:48.563097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:48.694697 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:48.702304 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-26061126-10b4-4db4-becd-e864f35dea14 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1364 microversion: 2.1 time: 0.154551 Jul 01 11:29:48.702895 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3514/6930] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:48 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:49.717074 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:29:49.722005 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:49.722701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:49.728825 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:49.729310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:49.730107 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:49.730542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:49.857770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:29:49.865785 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cd815187-f3cd-4a71-a56a-6ffdfb856b65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1550 microversion: 2.1 time: 0.149667 Jul 01 11:29:49.866349 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3417/6931] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:29:49 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:29:49.883120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c523244-ee66-4516-ad20-28ae6445a859 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:29:49.883658 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c523244-ee66-4516-ad20-28ae6445a859 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:29:49.890647 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c523244-ee66-4516-ad20-28ae6445a859 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:49.891074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c523244-ee66-4516-ad20-28ae6445a859 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:49.891862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c523244-ee66-4516-ad20-28ae6445a859 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:49.892318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c523244-ee66-4516-ad20-28ae6445a859 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:49.971528 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c523244-ee66-4516-ad20-28ae6445a859 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092204 Jul 01 11:29:49.972124 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3515/6932] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 11:29:49 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:29:51.228347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-32790a88-b411-4e70-ae1a-070658498528 req-48499142-2c1a-428e-96fa-de4ea25f6948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:29:51.238239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-32790a88-b411-4e70-ae1a-070658498528 req-48499142-2c1a-428e-96fa-de4ea25f6948 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:29:51.238676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-32790a88-b411-4e70-ae1a-070658498528 req-48499142-2c1a-428e-96fa-de4ea25f6948 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:29:51.250099 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-32790a88-b411-4e70-ae1a-070658498528 req-48499142-2c1a-428e-96fa-de4ea25f6948 service nova] Creating event network-changed:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h2-master-1 Jul 01 11:29:51.255787 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-32790a88-b411-4e70-ae1a-070658498528 req-48499142-2c1a-428e-96fa-de4ea25f6948 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031128 Jul 01 11:29:51.256474 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3418/6933] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:30:32.091445 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:30:32.092296 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=60 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:30:32.096896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:30:32.100687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:32.104032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:32.104495 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:32.105304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:32.105791 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:32.133851 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:32.139603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Old instance type m1.heat2, new instance type m1.heat {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:30:32.145730 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:30:32.146166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:30:32.146653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:30:32.147073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:30:32.147499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:30:32.336265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1e2fdffd-bf92-4acd-92f4-38fbf3fe5f31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc/action" status: 202 len: 0 microversion: 2.1 time: 0.246811 Jul 01 11:30:32.336877 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3516/6934] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:30:32 2022] POST /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:30:32.347440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:32.347440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:32.350243 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:30:32.350968 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:30:32.355993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:32.356443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:32.357236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:32.357672 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:32.494431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:32.501876 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a62108b-82c7-490c-811c-f5453dd11604 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1677 microversion: 2.1 time: 0.160556 Jul 01 11:30:32.502448 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3419/6935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:32 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:33.520911 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:33.521572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:33.528350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:33.528812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:33.529624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:33.530136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:33.669587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:33.677872 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-15b61fc0-70e0-4907-b36e-313b16b71031 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1677 microversion: 2.1 time: 0.162200 Jul 01 11:30:33.678470 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3517/6936] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:33 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:34.696844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:34.697494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:34.704890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:34.705360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:34.706123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:34.706556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:34.837007 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:34.844433 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-87c2d134-8e83-4630-b211-d3d27e897bd5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1677 microversion: 2.1 time: 0.152363 Jul 01 11:30:34.845042 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3420/6937] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:34 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:35.861725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:35.862418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:35.868696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:35.869172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:35.869996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:35.870419 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:35.996696 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:36.004757 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-684ba546-0b2a-4748-9f15-9650b995ca15 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.147163 Jul 01 11:30:36.005353 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3518/6938] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:35 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:37.021384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:37.022039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:37.028960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:37.029446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:37.030230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:37.030651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:37.162727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:37.170324 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc0541fd-1007-4dad-a4a9-63b2b03adeb9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.152867 Jul 01 11:30:37.170907 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3421/6939] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:37 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:38.187914 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:38.189035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:38.196193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:38.196651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:38.197446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:38.197890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:38.324176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:38.332471 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-766e83f2-f166-42d2-9121-a2c2a178129a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.148442 Jul 01 11:30:38.333050 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3519/6940] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:38 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:39.350182 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:39.350814 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:39.357686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:39.358136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:39.358896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:39.359326 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:39.490855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:39.498322 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-13bc4ed2-7788-4a49-85fc-428964e56117 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.152029 Jul 01 11:30:39.498895 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3422/6941] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:39 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:30:40.515180 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:40.515802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:40.522590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:40.523048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:40.523819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:40.524265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:40.659967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:40.667582 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7179cc40-f43c-44da-9400-69bb0b8d5917 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.156331 Jul 01 11:30:40.670598 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3520/6942] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:40 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:41.685815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:41.686429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:41.694313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:41.694765 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:41.695526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:41.695970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:41.826083 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:41.833462 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b10a7119-24cd-4495-a181-b1666662d0f4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.151494 Jul 01 11:30:41.834019 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3423/6943] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:41 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:42.849916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:42.850539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:42.857538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:42.857996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:42.858762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:42.859207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:42.989362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:42.996967 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1184f580-a231-4219-8cff-dfcebfcc03eb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.150887 Jul 01 11:30:42.997569 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3521/6944] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:42 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:44.015169 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:44.015786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:44.023523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:44.023974 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:44.024752 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:44.025212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:44.153548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:44.161214 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31027513-60ce-4895-8f57-6d4e4fbb4e97 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.149932 Jul 01 11:30:44.161791 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3424/6945] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:44 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:45.178254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:45.178860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:45.185780 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:45.186240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:45.187016 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:45.187467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:45.319948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:45.327540 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2005ab7a-e2e2-4b91-8981-1294b5b54fbe tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.153188 Jul 01 11:30:45.328115 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3522/6946] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:45 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:46.345640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:46.346318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:46.353301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:46.353753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:46.354546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:46.354988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:46.488709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:46.496447 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4c4e7161-96a3-499a-861f-967f650142ee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.155250 Jul 01 11:30:46.497023 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3425/6947] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:46 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:47.513824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:47.514464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:47.521928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:47.522393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:47.523191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:47.523640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:47.659116 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:47.668197 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a686accf-32ac-4386-9fbb-56a0bfa6c547 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1682 microversion: 2.1 time: 0.157629 Jul 01 11:30:47.669956 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3523/6948] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:47 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:48.223875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-90a5ca46-ab8f-4c04-9d50-ba4bc1341d96 req-4887a2dd-64a8-4dc9-bb59-dbcabbf34ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "name": "network-vif-unplugged", "status": "completed", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:30:48.232944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-90a5ca46-ab8f-4c04-9d50-ba4bc1341d96 req-4887a2dd-64a8-4dc9-bb59-dbcabbf34ddb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:48.235800 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-90a5ca46-ab8f-4c04-9d50-ba4bc1341d96 req-4887a2dd-64a8-4dc9-bb59-dbcabbf34ddb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:48.245221 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-90a5ca46-ab8f-4c04-9d50-ba4bc1341d96 req-4887a2dd-64a8-4dc9-bb59-dbcabbf34ddb service nova] Creating event network-vif-unplugged:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h1-master-1 Jul 01 11:30:48.250473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-90a5ca46-ab8f-4c04-9d50-ba4bc1341d96 req-4887a2dd-64a8-4dc9-bb59-dbcabbf34ddb service nova] Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:30:48.261240 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-90a5ca46-ab8f-4c04-9d50-ba4bc1341d96 req-4887a2dd-64a8-4dc9-bb59-dbcabbf34ddb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041631 Jul 01 11:30:48.261925 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3426/6949] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:30:48.686533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:48.687187 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:48.694916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:48.695369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:48.696182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:48.696621 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:48.854771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:48.864524 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7485f228-a179-45d1-960c-3c1f62ccbe90 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1681 microversion: 2.1 time: 0.181935 Jul 01 11:30:48.865121 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3524/6950] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:48 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:49.883559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:49.884173 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:49.890676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:49.891630 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:49.892384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:49.892813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:50.023653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:50.031053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4394812c-0935-4f3e-995b-cdf9e130bbe4 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1679 microversion: 2.1 time: 0.152620 Jul 01 11:30:50.031633 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3427/6951] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:49 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:50.275568 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-85977004-30a1-4abc-bc44-6ebbcfcc588d req-765473a0-406d-4cca-8b71-d7daf6a5ac14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:30:50.284457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-85977004-30a1-4abc-bc44-6ebbcfcc588d req-765473a0-406d-4cca-8b71-d7daf6a5ac14 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:50.284910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-85977004-30a1-4abc-bc44-6ebbcfcc588d req-765473a0-406d-4cca-8b71-d7daf6a5ac14 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:50.296814 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-85977004-30a1-4abc-bc44-6ebbcfcc588d req-765473a0-406d-4cca-8b71-d7daf6a5ac14 service nova] Creating event network-changed:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h1-master-1 Jul 01 11:30:50.302093 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-85977004-30a1-4abc-bc44-6ebbcfcc588d req-765473a0-406d-4cca-8b71-d7daf6a5ac14 service nova] Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:30:50.313647 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-85977004-30a1-4abc-bc44-6ebbcfcc588d req-765473a0-406d-4cca-8b71-d7daf6a5ac14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041480 Jul 01 11:30:50.320783 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3525/6952] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:30:51.048097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:51.048723 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:51.056105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:51.056893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:51.057885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:51.058517 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:51.201594 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:51.209356 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-41c3f2b9-a05e-40cd-82bd-044f4b3b4947 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1679 microversion: 2.1 time: 0.165079 Jul 01 11:30:51.209952 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3428/6953] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:51 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:52.228312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:52.229055 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:52.235402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.235865 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.236651 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.237100 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.368473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:52.377110 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd3a1032-71cb-4403-bbc6-6972b8a44177 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1676 microversion: 2.1 time: 0.154026 Jul 01 11:30:52.377724 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3526/6954] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:52 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:52.394360 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:30:52.394945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:52.401935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.402383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.403184 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.403652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.440468 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.441228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.444610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.444610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.463468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for project 743a6280024b4d74a4f6a54a745fca09. Resources: {'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:30:52.468767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for user faf4b86f835a466b9129e4f71a84e9f1 and project 743a6280024b4d74a4f6a54a745fca09. Resources: {'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:30:52.793503 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0d79b28b-9683-4c01-9fe9-3993c38d3305 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc/action" status: 202 len: 0 microversion: 2.1 time: 0.403709 Jul 01 11:30:52.794226 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3429/6955] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:30:52 2022] POST /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:30:52.803043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:52.803677 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:52.810352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.815207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.815207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:52.815207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:52.951991 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:52.960081 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-358d911e-a6b3-47dd-bb2f-91616ebc6e94 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1675 microversion: 2.1 time: 0.160925 Jul 01 11:30:52.960678 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3527/6956] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:52 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:53.979457 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:53.980152 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:53.987103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:53.987543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:53.988289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:53.988718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:54.124361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:54.132581 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-21a21349-b5fd-4487-8c4a-87d8a9fd18b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1675 microversion: 2.1 time: 0.158238 Jul 01 11:30:54.133154 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3430/6957] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:53 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:54.448277 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-914e611c-ca25-47ef-8489-e3bd2465baae req-f8a1d642-241e-4a56-8bb7-02455ffc6a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "name": "network-vif-plugged", "status": "completed", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:30:54.457172 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-914e611c-ca25-47ef-8489-e3bd2465baae req-f8a1d642-241e-4a56-8bb7-02455ffc6a11 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:54.457639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-914e611c-ca25-47ef-8489-e3bd2465baae req-f8a1d642-241e-4a56-8bb7-02455ffc6a11 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:54.469937 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-914e611c-ca25-47ef-8489-e3bd2465baae req-f8a1d642-241e-4a56-8bb7-02455ffc6a11 service nova] Creating event network-vif-plugged:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h1-master-1 Jul 01 11:30:54.475176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-914e611c-ca25-47ef-8489-e3bd2465baae req-f8a1d642-241e-4a56-8bb7-02455ffc6a11 service nova] Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:30:54.486384 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-914e611c-ca25-47ef-8489-e3bd2465baae req-f8a1d642-241e-4a56-8bb7-02455ffc6a11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041838 Jul 01 11:30:54.487275 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3528/6958] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:30:55.150110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:55.150749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:55.158273 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:55.158717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:55.159484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:55.159916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:55.291761 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:55.299277 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f90e7a6-5036-48fa-aded-11168c0a14a2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1675 microversion: 2.1 time: 0.153092 Jul 01 11:30:55.299881 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3431/6959] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:55 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:56.317711 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:56.318489 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:56.324880 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:56.325394 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:56.326157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:56.326601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:56.460672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f3d5d3d0-7ced-436d-8e41-5c72c368ace4 req-2c778fba-6bb4-41db-9c0c-699bb215cc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "name": "network-vif-unplugged", "status": "completed", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:30:56.461720 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:56.468265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f3d5d3d0-7ced-436d-8e41-5c72c368ace4 req-2c778fba-6bb4-41db-9c0c-699bb215cc0c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:56.468712 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f3d5d3d0-7ced-436d-8e41-5c72c368ace4 req-2c778fba-6bb4-41db-9c0c-699bb215cc0c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:56.470495 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-341c0b7b-c7b2-453c-a341-67ac3d06a6d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1675 microversion: 2.1 time: 0.158334 Jul 01 11:30:56.471411 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3529/6960] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:56 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:56.481594 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f3d5d3d0-7ced-436d-8e41-5c72c368ace4 req-2c778fba-6bb4-41db-9c0c-699bb215cc0c service nova] Creating event network-vif-unplugged:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h2-master-1 Jul 01 11:30:56.487010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-f3d5d3d0-7ced-436d-8e41-5c72c368ace4 req-2c778fba-6bb4-41db-9c0c-699bb215cc0c service nova] Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:30:56.497512 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f3d5d3d0-7ced-436d-8e41-5c72c368ace4 req-2c778fba-6bb4-41db-9c0c-699bb215cc0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042119 Jul 01 11:30:56.498166 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3432/6961] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:30:57.487945 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:57.488504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:57.495408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:57.495881 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:57.496669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:57.497127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:57.630316 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:57.637930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dc75a9e6-b884-4473-9c9e-d49dbf7dcfb1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1675 microversion: 2.1 time: 0.154617 Jul 01 11:30:57.638505 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3530/6962] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:57 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:58.512490 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6b3ba1ee-cff3-4a19-a841-18db451886f5 req-553aeea3-3b56-4f62-953f-b5a1824e8435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:30:58.521520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b3ba1ee-cff3-4a19-a841-18db451886f5 req-553aeea3-3b56-4f62-953f-b5a1824e8435 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:58.521963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6b3ba1ee-cff3-4a19-a841-18db451886f5 req-553aeea3-3b56-4f62-953f-b5a1824e8435 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:58.525866 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:30:58.533477 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6b3ba1ee-cff3-4a19-a841-18db451886f5 req-553aeea3-3b56-4f62-953f-b5a1824e8435 service nova] Creating event network-changed:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h2-master-1 Jul 01 11:30:58.540798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-6b3ba1ee-cff3-4a19-a841-18db451886f5 req-553aeea3-3b56-4f62-953f-b5a1824e8435 service nova] Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:30:58.549682 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6b3ba1ee-cff3-4a19-a841-18db451886f5 req-553aeea3-3b56-4f62-953f-b5a1824e8435 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042044 Jul 01 11:30:58.550627 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3433/6963] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:30:58.656540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:58.657705 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:58.666295 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:58.666751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:58.667543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:58.667991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:58.803669 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:58.807339 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:30:58.811793 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2540024a-d3c9-4524-96e8-6e98783b1711 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1675 microversion: 2.1 time: 0.160119 Jul 01 11:30:58.812372 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3531/6964] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:58 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:59.831413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:59.832114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:30:59.839808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:59.840254 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:59.841004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:30:59.841465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:30:59.971651 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:30:59.979444 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3b8ca360-d67c-4b63-bda6-4670f2c83123 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1668 microversion: 2.1 time: 0.152886 Jul 01 11:30:59.980014 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3434/6965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:59 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:30:59.995499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:30:59.996120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:00.004155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.004612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.005414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.005858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.138514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:00.146085 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-955921d9-9f83-4b8f-b6a1-c14396174023 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1668 microversion: 2.1 time: 0.154469 Jul 01 11:31:00.146661 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3532/6966] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:30:59 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:00.161798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:00.162401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:00.168306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.168745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.169518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.169950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.298345 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:00.306089 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d4fc0bfb-d74d-45b7-bd30-77ade6677735 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1668 microversion: 2.1 time: 0.148130 Jul 01 11:31:00.307088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3435/6967] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:00 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:00.322834 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:00.323337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:00.329556 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.332154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.332154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.332154 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.357260 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:31:00.648568 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f5dd024c-beca-4d29-871d-c3bbef5f5fe7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 204 len: 0 microversion: 2.1 time: 0.329259 Jul 01 11:31:00.649196 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3533/6968] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:31:00 2022] DELETE /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:31:00.661380 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:00.661993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:00.668447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.669189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.669955 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:00.670392 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:00.802266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:00.809902 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4ef3e7ef-9513-4b59-964d-a4a06300e641 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1674 microversion: 2.1 time: 0.152578 Jul 01 11:31:00.810699 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3436/6969] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:00 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:01.828228 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:01.828936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:01.839477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:01.839934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:01.840705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:01.841161 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:01.974813 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:01.982341 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-601d1c16-3972-4444-a05e-a62db74a70e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1674 microversion: 2.1 time: 0.158646 Jul 01 11:31:01.982910 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3534/6970] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:01 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:02.501018 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a8b9c88d-a2fb-4c27-9d9e-8358f198628a req-66815f07-e05c-40f4-85db-49abcd143f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "name": "network-vif-plugged", "status": "completed", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:31:02.506577 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:31:02.511751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a8b9c88d-a2fb-4c27-9d9e-8358f198628a req-66815f07-e05c-40f4-85db-49abcd143f13 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:02.512193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a8b9c88d-a2fb-4c27-9d9e-8358f198628a req-66815f07-e05c-40f4-85db-49abcd143f13 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:02.524312 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a8b9c88d-a2fb-4c27-9d9e-8358f198628a req-66815f07-e05c-40f4-85db-49abcd143f13 service nova] Creating event network-vif-plugged:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h2-master-1 Jul 01 11:31:02.529465 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a8b9c88d-a2fb-4c27-9d9e-8358f198628a req-66815f07-e05c-40f4-85db-49abcd143f13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032473 Jul 01 11:31:02.530090 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3437/6971] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:31:03.000772 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:03.002771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:03.007849 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:31:03.012219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:03.012837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:03.013713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:03.014162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:03.086043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:03.094115 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ed4ae1a5-ac4c-4795-9cf8-e4f3b3db8499 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1606 microversion: 2.1 time: 0.097823 Jul 01 11:31:03.094927 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3535/6972] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:02 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:03.243570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-c3cfb029-8da6-4397-8ec0-177271383ddc req-b57fe763-e445-4ebe-914d-1c065cbae0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb66bd2b-69a5-43f1-a20b-3eb5b42569fc", "name": "network-vif-deleted", "tag": "88f7a23b-1d87-41b3-85c1-05050b949f8d"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:31:03.253187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c3cfb029-8da6-4397-8ec0-177271383ddc req-b57fe763-e445-4ebe-914d-1c065cbae0ac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:03.256010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-c3cfb029-8da6-4397-8ec0-177271383ddc req-b57fe763-e445-4ebe-914d-1c065cbae0ac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:03.264899 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-c3cfb029-8da6-4397-8ec0-177271383ddc req-b57fe763-e445-4ebe-914d-1c065cbae0ac service nova] Creating event network-vif-deleted:88f7a23b-1d87-41b3-85c1-05050b949f8d for instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc on n-h2-master-1 Jul 01 11:31:03.270245 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-c3cfb029-8da6-4397-8ec0-177271383ddc req-b57fe763-e445-4ebe-914d-1c065cbae0ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031524 Jul 01 11:31:03.271563 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3438/6973] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:31:04.112269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:04.119253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:04.119253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:04.119713 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:04.120454 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:04.121055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:04.156952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:04.158157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:04.158761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lazy-loading 'fault' on Instance uuid bb66bd2b-69a5-43f1-a20b-3eb5b42569fc {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:31:04.202536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:04.211307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4a55ef7-f446-4dc5-ad86-2711ec13fc44 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 200 len: 1328 microversion: 2.1 time: 0.103174 Jul 01 11:31:04.212051 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3536/6974] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:04 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:05.230616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:05.231305 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:05.234160 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:31:05.239054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:05.239497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:05.240250 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:05.240679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:05.254953 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc HTTP/1.1 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: exception: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'bb66bd2b-69a5-43f1-a20b-3eb5b42569fc'} Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:31:05.256638 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e6690863-462d-42f0-bf59-87e894f09ee1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 404 len: 111 microversion: 2.1 time: 0.031734 Jul 01 11:31:05.261032 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3439/6975] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:05 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:31:05.276138 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:05.276762 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:05.283684 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:05.284144 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:05.284914 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:05.285388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:05.299164 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc HTTP/1.1 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: exception: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'bb66bd2b-69a5-43f1-a20b-3eb5b42569fc'} Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:31:05.300793 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a0706e2-7dca-47bc-aed3-8dead64e84b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 404 len: 111 microversion: 2.1 time: 0.030061 Jul 01 11:31:05.305034 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3537/6976] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:05 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:31:05.349616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-830660843", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "70890723-10ef-4ffd-bed0-feeacfb1ebc4"}], "security_groups": [{"name": "tempest-securitygroup--1145951281"}], "key_name": "tempest-keypair-1626383828", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:31:05.456531 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] validate_networks() for [('70890723-10ef-4ffd-bed0-feeacfb1ebc4', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:31:05.862889 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:31:05.863308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:31:05.863776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:31:05.864181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:31:05.864613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:31:05.873458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:05.873902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:05.874715 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:05.875151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:05.891127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:31:05.896390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for user faf4b86f835a466b9129e4f71a84e9f1 and project 743a6280024b4d74a4f6a54a745fca09. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:31:05.908877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:31:05.911161 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:31:06.019819 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68ef46f0-3708-4499-be81-df6481899a47 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674001 Jul 01 11:31:06.020470 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3440/6977] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:31:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:31:06.030754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be3d489a-1007-4d05-931e-2604c1188fc9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:06.036253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be3d489a-1007-4d05-931e-2604c1188fc9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:06.088479 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-be3d489a-1007-4d05-931e-2604c1188fc9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:06.096075 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be3d489a-1007-4d05-931e-2604c1188fc9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1238 microversion: 2.1 time: 0.068623 Jul 01 11:31:06.096648 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3538/6978] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:06 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:07.113476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:07.114088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:07.121950 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:07.122385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:07.123147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:07.123585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:07.186096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:07.194346 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8efc05f-f7ff-4f9b-8d85-91f396a34ca8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1234 microversion: 2.1 time: 0.084807 Jul 01 11:31:07.196109 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3441/6979] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:07 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:08.211910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:08.212443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:08.220581 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:08.221053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:08.222411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:08.222861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:08.284849 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:08.292534 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-42c60be1-a490-42d7-8ce1-77b566c928b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1296 microversion: 2.1 time: 0.084634 Jul 01 11:31:08.293108 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3539/6980] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:08 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:09.310580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:09.311197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:09.319318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:09.319674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:09.320455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:09.320889 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:09.459336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:09.466875 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c3755ed8-b892-44f8-bf2c-f6586a0a74f5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1364 microversion: 2.1 time: 0.161101 Jul 01 11:31:09.467452 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3442/6981] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:09 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:09.528952 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-594eabc4-9a24-41ad-aa7b-6773035de7f2 req-c59152c4-c518-409b-8074-0d368839dd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:31:09.538090 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-594eabc4-9a24-41ad-aa7b-6773035de7f2 req-c59152c4-c518-409b-8074-0d368839dd95 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:09.538561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-594eabc4-9a24-41ad-aa7b-6773035de7f2 req-c59152c4-c518-409b-8074-0d368839dd95 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:09.551748 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-594eabc4-9a24-41ad-aa7b-6773035de7f2 req-c59152c4-c518-409b-8074-0d368839dd95 service nova] Creating event network-changed:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h2-master-1 Jul 01 11:31:09.557694 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-594eabc4-9a24-41ad-aa7b-6773035de7f2 req-c59152c4-c518-409b-8074-0d368839dd95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034560 Jul 01 11:31:09.557694 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3540/6982] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:31:10.483781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:10.484432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:10.491469 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:10.491925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:10.492691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:10.493130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:10.624616 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:10.632853 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4113599f-cc12-4259-9c29-75538544f532 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1364 microversion: 2.1 time: 0.152936 Jul 01 11:31:10.633461 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3443/6983] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:10 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:11.651712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:11.652425 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:11.658752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:11.659720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:11.660489 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:11.660936 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:11.791153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:11.798900 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f3a63a3e-093e-4b2c-bcfb-3085ab2b99fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1364 microversion: 2.1 time: 0.152242 Jul 01 11:31:11.799484 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3541/6984] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:11 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:12.817753 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:12.818387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:12.825278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:12.825720 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:12.826477 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:12.826911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:12.957655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:12.965205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-737316c2-d733-48fd-b2f8-3542375df920 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1364 microversion: 2.1 time: 0.152188 Jul 01 11:31:12.965780 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3444/6985] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:12 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:13.982805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:13.983419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:13.990369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:13.990820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:13.991592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:13.992034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:14.123227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:14.131691 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b888d9c-ec39-495b-9010-bbe909a89537 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1364 microversion: 2.1 time: 0.152796 Jul 01 11:31:14.132541 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3542/6986] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:13 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:14.615458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-dfa8af93-8d7a-4da3-b0d6-4669644695a0 req-fc67a996-63ed-4f79-818b-05b6ea53ce3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "name": "network-vif-plugged", "status": "completed", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:31:14.625055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dfa8af93-8d7a-4da3-b0d6-4669644695a0 req-fc67a996-63ed-4f79-818b-05b6ea53ce3c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:14.625536 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-dfa8af93-8d7a-4da3-b0d6-4669644695a0 req-fc67a996-63ed-4f79-818b-05b6ea53ce3c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:14.637304 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-dfa8af93-8d7a-4da3-b0d6-4669644695a0 req-fc67a996-63ed-4f79-818b-05b6ea53ce3c service nova] Creating event network-vif-plugged:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h2-master-1 Jul 01 11:31:14.648213 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-dfa8af93-8d7a-4da3-b0d6-4669644695a0 req-fc67a996-63ed-4f79-818b-05b6ea53ce3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Jul 01 11:31:14.648213 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3445/6987] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:31:15.149565 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:15.150188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:15.157353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:15.157818 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:15.158588 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:15.159035 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:15.289801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:15.297338 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-342b6fa8-68c6-4936-af57-51d25f6c9494 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1364 microversion: 2.1 time: 0.151711 Jul 01 11:31:15.297901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3543/6988] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:15 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:16.312520 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:31:16.314794 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:31:16.319944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:16.320646 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:16.326878 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:16.327328 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:16.328091 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:16.328526 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:16.460785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:31:16.468155 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-daa17028-0b98-45ff-ac7d-acb22fd45aad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1550 microversion: 2.1 time: 0.157454 Jul 01 11:31:16.468718 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3446/6989] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:31:16 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:31:16.484768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c832a359-bdfe-4afc-b5c5-6d805745bf65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:31:16.485314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c832a359-bdfe-4afc-b5c5-6d805745bf65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:31:16.489344 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:31:16.493030 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c832a359-bdfe-4afc-b5c5-6d805745bf65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:16.493538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c832a359-bdfe-4afc-b5c5-6d805745bf65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:16.494326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c832a359-bdfe-4afc-b5c5-6d805745bf65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:16.494776 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c832a359-bdfe-4afc-b5c5-6d805745bf65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:16.571674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c832a359-bdfe-4afc-b5c5-6d805745bf65 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090699 Jul 01 11:31:16.572316 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3544/6990] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Jul 1 11:31:16 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:31:17.533258 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-f0090c69-a43a-48f0-a2ab-69606a4af6fd req-4b2ec6e1-b66d-44a2-bac0-c2238906ade2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:31:17.542865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0090c69-a43a-48f0-a2ab-69606a4af6fd req-4b2ec6e1-b66d-44a2-bac0-c2238906ade2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:31:17.543310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-f0090c69-a43a-48f0-a2ab-69606a4af6fd req-4b2ec6e1-b66d-44a2-bac0-c2238906ade2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:31:17.554498 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-f0090c69-a43a-48f0-a2ab-69606a4af6fd req-4b2ec6e1-b66d-44a2-bac0-c2238906ade2 service nova] Creating event network-changed:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h2-master-1 Jul 01 11:31:17.559274 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-f0090c69-a43a-48f0-a2ab-69606a4af6fd req-4b2ec6e1-b66d-44a2-bac0-c2238906ade2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029726 Jul 01 11:31:17.559870 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3447/6991] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:32:01.176516 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=23 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:01.177381 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:01.181351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:01.182007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:01.187957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:01.189087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:01.189249 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:01.189644 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:01.319166 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:01.326583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e55cf1b-d922-4933-83bc-1d1b938b4c22 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1668 microversion: 2.1 time: 0.152100 Jul 01 11:32:01.327163 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3545/6992] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:01 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:01.342264 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:01.343619 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=62 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:01.347934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78960727-0ea8-4a7c-85d5-9dda9a6cbc1e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c706864c-f78c-44b4-ae55-0cfa0bc19dc7"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:32:01.349101 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78960727-0ea8-4a7c-85d5-9dda9a6cbc1e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:01.355247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78960727-0ea8-4a7c-85d5-9dda9a6cbc1e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:01.355689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78960727-0ea8-4a7c-85d5-9dda9a6cbc1e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:01.356440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78960727-0ea8-4a7c-85d5-9dda9a6cbc1e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:01.356870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78960727-0ea8-4a7c-85d5-9dda9a6cbc1e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:02.026821 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78960727-0ea8-4a7c-85d5-9dda9a6cbc1e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687106 Jul 01 11:32:02.027439 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3448/6993] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 11:32:01 2022] POST /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:32:13.724473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:32:13.725509 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:13.728129 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:13.733277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:13.733747 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:13.734530 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:13.734978 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:13.762925 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:13.769374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Old instance type m1.heat2, new instance type m1.heat {{(pid=119764) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:32:13.776013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:32:13.776449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:32:13.776934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:32:13.777382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:32:13.777805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:32:13.968928 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f7f43c14-c693-4f87-b615-b4350431a13c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/action" status: 202 len: 0 microversion: 2.1 time: 0.248930 Jul 01 11:32:13.969596 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3546/6994] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:32:13 2022] POST /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:32:13.976071 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:13.976837 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:13.981066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:13.981643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:13.987794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:13.992220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:13.992220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:13.992220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:14.126630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:14.135220 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b45fa207-d87f-4a5d-a2c4-b9ed62fa46e3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1723 microversion: 2.1 time: 0.161210 Jul 01 11:32:14.135806 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3449/6995] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:13 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:15.155848 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:15.156452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:15.163347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:15.163807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:15.164592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:15.165046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:15.299354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:15.307710 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-19cb747d-93cc-404d-9f55-4e528e50708e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1723 microversion: 2.1 time: 0.157852 Jul 01 11:32:15.308319 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3547/6996] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:15 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:16.326406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:16.327312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:16.335269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:16.340619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:16.340619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:16.340619 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:16.469991 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:16.479052 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1986a797-cde3-4cc0-96ae-e80a5985a721 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1723 microversion: 2.1 time: 0.156906 Jul 01 11:32:16.479669 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3450/6997] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:16 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:17.496827 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:17.497476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:17.504944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:17.505426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:17.506196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:17.506642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:17.641860 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:17.650696 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c272f0e-5386-4f0d-8f17-e4d39a965986 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.157743 Jul 01 11:32:17.654814 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3548/6998] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:17 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:18.670256 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:18.670868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:18.678299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:18.678749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:18.679510 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:18.679945 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:18.807319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:18.815295 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-552b17d2-6600-4b38-a4cd-de63bafdfeee tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.148885 Jul 01 11:32:18.815807 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3451/6999] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:18 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:19.832639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:19.833276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:19.840150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:19.840602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:19.841390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:19.841835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:19.968913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:19.977464 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-68d26dee-2f3c-423c-a2de-b4e2105edd0a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.149167 Jul 01 11:32:19.978030 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3549/7000] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:19 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:20.995003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:20.995737 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:21.002269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:21.002759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:21.003520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:21.003948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:21.137303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:21.145799 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d375075-85ef-42fd-9f13-7031957e6542 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.154723 Jul 01 11:32:21.146372 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3452/7001] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:20 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:22.163071 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:22.163690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:22.170715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:22.171182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:22.171976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:22.172427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:22.298910 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:22.307090 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ecc755a0-0aa5-420f-a525-1075ee4a02d6 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.147941 Jul 01 11:32:22.307678 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3550/7002] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:22 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:23.324919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:23.325566 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:23.332522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:23.332968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:23.333758 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:23.334194 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:23.463585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:23.471538 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d1a2b94-e9de-4409-82bb-c279e122e6af tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.150506 Jul 01 11:32:23.472114 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3453/7003] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:23 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:24.488468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:24.489269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:24.496369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:24.496828 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:24.497624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:24.498068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:24.629871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:24.638059 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-79b86876-efaa-4d80-918c-62be0f8ef57a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.154108 Jul 01 11:32:24.638619 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3551/7004] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:24 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:25.655875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:25.656481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:25.664146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:25.664589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:25.665377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:25.665813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:25.796476 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:25.804682 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b83e7c60-d656-45b8-9215-e9e51a3be69b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.152778 Jul 01 11:32:25.805293 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3454/7005] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:25 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:26.331260 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:32:26.331260 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:32:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:32:26.822050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:26.822599 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:26.829601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:26.830067 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:26.830847 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:26.831296 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:26.967396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:26.975860 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e0aea63-4a65-4402-bdbe-8afe5c7bb707 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.157739 Jul 01 11:32:26.976502 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3552/7006] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:26 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:27.103079 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:32:27.103604 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:32:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:32:27.991892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:27.992507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:27.999432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:27.999879 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:28.000638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:28.001103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:28.131634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:28.139561 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aee98af0-02f9-4603-9dfa-f08603102d30 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.151499 Jul 01 11:32:28.140130 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3455/7007] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:27 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:29.157799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:29.158456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:29.165990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:29.166453 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:29.167229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:29.167679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:29.298874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:29.308674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a1dedac6-b609-4a42-a610-3238d8989710 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.154546 Jul 01 11:32:29.309485 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3553/7008] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:29 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:30.328197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:30.333442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:30.336395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:30.336842 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:30.337637 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:30.338105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:30.466740 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:30.474721 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-abe25b08-f502-4f1a-9194-e711322e9461 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.150381 Jul 01 11:32:30.475307 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3456/7009] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:30 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:31.492182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:31.492801 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:31.499694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:31.500155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:31.500923 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:31.501392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:31.952732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:31.960930 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-39071693-aa4f-43ed-87ca-2afae9469ad3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.473101 Jul 01 11:32:31.961548 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3554/7010] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:31 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:32.978786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:32.979398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:32.985865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:32.986314 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:32.987071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:32.988010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:33.113071 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:33.121021 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-230b763d-6106-4203-97e2-87a898618dad tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.146165 Jul 01 11:32:33.121611 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3457/7011] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:32 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:34.138365 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:34.138983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:34.145662 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:34.146119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:34.146890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:34.147334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:34.277686 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:34.285776 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-31c461b0-6fed-44e6-aed3-9112f2413d31 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.151563 Jul 01 11:32:34.286351 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3555/7012] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:34 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:35.302415 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:35.303019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:35.309863 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:35.310301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:35.311048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:35.311476 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:35.437747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:35.445979 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35f4d6fe-548a-48a0-8830-6e3356c05efa tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.147597 Jul 01 11:32:35.446543 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3458/7013] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:35 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:36.462395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:36.463017 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:36.470129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:36.470594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:36.471408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:36.472326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:36.599589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:36.607833 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5febdac-57d2-465b-b4c7-0555a15996a5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.149261 Jul 01 11:32:36.614367 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3556/7014] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:36 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:32:37.625820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:37.626358 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:37.634011 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:37.634478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:37.635224 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:37.635660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:37.768201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:37.776251 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b40898f7-95f4-46c3-b015-a3685f3144fd tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.154447 Jul 01 11:32:37.776820 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3459/7015] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:37 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:38.793725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:38.794347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:38.801435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:38.801897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:38.802663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:38.803108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:38.930768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:38.938801 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f75026b-4e93-4203-84ee-df12b99ecbc2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.148995 Jul 01 11:32:38.939363 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3557/7016] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:38 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:39.958430 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:39.959047 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:39.965978 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:39.966432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:39.967200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:39.967638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:40.100341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:40.108333 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-babd9c8f-e401-4ff6-9ac7-af5343fe15cf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.154620 Jul 01 11:32:40.108931 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3460/7017] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:39 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:41.125975 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:41.126597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:41.133645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:41.134045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:41.134812 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:41.135260 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:41.265439 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:41.274017 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-263f7526-92f0-453b-9b4f-625ab5873f43 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.151964 Jul 01 11:32:41.274587 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3558/7018] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:41 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:42.291193 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:42.291798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:42.298682 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:42.299119 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:42.300116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:42.300551 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:42.427325 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:42.435175 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-519db208-f34a-4534-9b3c-2b75ad6c3b7f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.147894 Jul 01 11:32:42.435738 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3461/7019] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:42 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:43.452643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:43.453305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:43.460906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:43.461408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:43.462190 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:43.462643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:43.595590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:43.603856 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2e2eede5-548b-41a2-8b5e-56ca41108c2c tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.155168 Jul 01 11:32:43.604423 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3559/7020] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:43 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:44.620924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:44.621556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:44.624247 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=27 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:44.629644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:44.630090 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:44.630852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:44.631320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:44.765783 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:44.774466 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c0931557-d943-40f4-b01e-3695c9cdaf79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.157602 Jul 01 11:32:44.775049 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3462/7021] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:44 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:45.791653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:45.792287 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:45.795079 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=33 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:45.800379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:45.800846 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:45.801675 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:45.802130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:45.804911 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:45.939094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:45.947594 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-154ab139-da1f-4196-9fbd-9a7e3a9c5698 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.159879 Jul 01 11:32:45.948152 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3560/7022] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:45 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:46.965431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:46.967034 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:46.973449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:46.973893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:46.974642 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:46.975071 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:46.977636 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=85 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:32:47.103730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:47.111626 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ee6e6667-62b8-47c6-aa40-887e50f2341e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.150111 Jul 01 11:32:47.112826 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3463/7023] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:46 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:48.129948 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:48.130572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:48.137665 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:48.138125 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:48.138912 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:48.139362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:48.272639 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:48.280919 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bce2de3b-da37-4817-a958-124824d5c733 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.155536 Jul 01 11:32:48.281538 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3561/7024] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:48 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:49.298025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:49.298635 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:49.305721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:49.306167 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:49.306920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:49.307353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:49.434010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:49.442738 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1ebf44c2-c3d2-4875-85a8-ed5f40bb1326 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.148552 Jul 01 11:32:49.443302 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3464/7025] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:49 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:50.460308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:50.461007 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:50.468219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:50.468796 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:50.469613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:50.470066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:50.604422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:50.609458 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f11d8df8-a439-4859-87be-be46cc973882 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.153550 Jul 01 11:32:50.610035 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3562/7026] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:50 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:51.627184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:51.628321 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:51.635281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:51.635719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:51.636470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:51.636897 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:51.773971 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:51.782201 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-57811906-69cd-4eba-bd51-f78d41070b9f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1728 microversion: 2.1 time: 0.158984 Jul 01 11:32:51.782782 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3465/7027] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:51 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:52.703898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b14cf469-bc79-40a1-8aa9-7b701eba66ce req-e5aae3d6-6b79-4740-95d5-1f818e61533e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "name": "network-vif-unplugged", "status": "completed", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:32:52.713521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b14cf469-bc79-40a1-8aa9-7b701eba66ce req-e5aae3d6-6b79-4740-95d5-1f818e61533e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:52.713962 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b14cf469-bc79-40a1-8aa9-7b701eba66ce req-e5aae3d6-6b79-4740-95d5-1f818e61533e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:52.726186 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b14cf469-bc79-40a1-8aa9-7b701eba66ce req-e5aae3d6-6b79-4740-95d5-1f818e61533e service nova] Creating event network-vif-unplugged:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h1-master-1 Jul 01 11:32:52.731386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-b14cf469-bc79-40a1-8aa9-7b701eba66ce req-e5aae3d6-6b79-4740-95d5-1f818e61533e service nova] Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:32:52.742421 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b14cf469-bc79-40a1-8aa9-7b701eba66ce req-e5aae3d6-6b79-4740-95d5-1f818e61533e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042391 Jul 01 11:32:52.743015 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3563/7028] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:32:52.799246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:52.800265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:52.813308 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:52.814159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:52.816020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:52.817317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:52.964279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:52.973387 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cd82eae0-5d41-4d55-81b3-1e154d2b649b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1727 microversion: 2.1 time: 0.178054 Jul 01 11:32:52.974173 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3466/7029] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:52 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:53.992826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:53.993573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:53.999784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:54.000246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:54.001056 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:54.001533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:54.137529 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:54.145685 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b1cc9bb1-4285-4d2e-beb3-62cd18a84ec0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1727 microversion: 2.1 time: 0.158036 Jul 01 11:32:54.146263 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3564/7030] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:53 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:54.756778 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-8ebdb11f-c472-4655-a69a-4e17a40d4651 req-ff665cca-9e5b-471d-9738-096fe4f9fb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:32:54.766052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8ebdb11f-c472-4655-a69a-4e17a40d4651 req-ff665cca-9e5b-471d-9738-096fe4f9fb46 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:54.766498 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-8ebdb11f-c472-4655-a69a-4e17a40d4651 req-ff665cca-9e5b-471d-9738-096fe4f9fb46 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:54.778392 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-8ebdb11f-c472-4655-a69a-4e17a40d4651 req-ff665cca-9e5b-471d-9738-096fe4f9fb46 service nova] Creating event network-changed:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h1-master-1 Jul 01 11:32:54.784383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-8ebdb11f-c472-4655-a69a-4e17a40d4651 req-ff665cca-9e5b-471d-9738-096fe4f9fb46 service nova] Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:32:54.794999 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-8ebdb11f-c472-4655-a69a-4e17a40d4651 req-ff665cca-9e5b-471d-9738-096fe4f9fb46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041898 Jul 01 11:32:54.795593 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3467/7031] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:32:55.163025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:55.163651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:55.171218 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:55.171685 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:55.172475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:55.172924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:55.316511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:55.325307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96089434-c5e9-4085-aef7-4026b772afae tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.166263 Jul 01 11:32:55.326106 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3565/7032] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:55 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:56.344786 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:56.345686 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:56.352774 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:56.353242 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:56.354001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:56.354433 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:56.488602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:56.496780 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6bc20784-f84f-4c70-90d0-9c6fe39ebc96 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.157103 Jul 01 11:32:56.497461 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3468/7033] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:56 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:57.514381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:57.515013 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:57.522017 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:57.522482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:57.523261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:57.523716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:57.673992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:57.682901 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-803c920e-8771-4d15-ad47-1b38399064ff tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.172427 Jul 01 11:32:57.683487 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3566/7034] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:57 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:32:58.699867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:58.700466 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:58.707567 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:58.708007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:58.708759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:58.709209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:58.840586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:32:58.849389 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-48b68502-36f4-43c4-83e3-9d2821b0b042 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.153359 Jul 01 11:32:58.849954 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3469/7035] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:58 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:32:59.866630 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:32:59.867250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:32:59.874356 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:59.874821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:32:59.875607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:32:59.876061 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:00.012417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:00.020756 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d1223ae6-b4c7-406d-ae06-127b19b466e9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.158154 Jul 01 11:33:00.021370 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3567/7036] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:32:59 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:01.038825 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:01.039444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:01.046484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:01.046944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:01.047703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:01.048142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:01.180222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:01.188374 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b23fdc9e-4e27-4b95-9539-9e2f9334c28d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.153766 Jul 01 11:33:01.188957 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3470/7037] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:01 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:02.206377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:02.206999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:02.213951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:02.214417 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:02.215196 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:02.215645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:02.346431 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:02.354459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c0f36495-403a-4051-a421-21fb93a2f531 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.152474 Jul 01 11:33:02.355026 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3568/7038] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:02 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:03.371784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:03.372401 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:03.379027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:03.379472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:03.380230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:03.380664 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:03.507023 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:03.515232 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1273ecd6-fba8-4a56-992b-50952aa0496d tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.147582 Jul 01 11:33:03.515807 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3471/7039] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:03 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:04.534285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:04.534903 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:04.541614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:04.542077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:04.542848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:04.543294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:04.673864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:04.682010 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5767d1e-19aa-40fe-9771-7a8c3d5fdc76 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.152187 Jul 01 11:33:04.682573 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3569/7040] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:04 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:05.699438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:05.702876 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:05.707426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:05.708306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:05.709060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:05.709515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:05.840428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:05.848818 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba92a783-a7c8-4cfe-978d-c89598d74a81 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.153383 Jul 01 11:33:05.849420 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3472/7041] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:05 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:06.865976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:06.866573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:06.873416 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:06.873980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:06.874843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:06.875301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:07.015460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:07.028402 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fba323fa-5058-4752-9656-99a7d6ff1f62 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1725 microversion: 2.1 time: 0.166851 Jul 01 11:33:07.028984 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3570/7042] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:06 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:08.045880 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:08.046546 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:08.053419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.053861 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.054610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.055041 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.185672 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:08.194331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ba969a31-2f6a-4d1a-b7c4-7b096323d244 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1722 microversion: 2.1 time: 0.152311 Jul 01 11:33:08.194894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3473/7043] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:08 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:08.211065 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:33:08.211638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:08.218456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.218916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.219690 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.220132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.256498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.256955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.257784 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.258229 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.277988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for project 743a6280024b4d74a4f6a54a745fca09. Resources: {'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:33:08.283100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Getting quotas for user faf4b86f835a466b9129e4f71a84e9f1 and project 743a6280024b4d74a4f6a54a745fca09. Resources: {'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:33:08.699998 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b1969a81-0c14-4baa-a8e2-281f21e89d79 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "POST /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/action" status: 202 len: 0 microversion: 2.1 time: 0.492553 Jul 01 11:33:08.700637 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3571/7044] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:33:08 2022] POST /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:33:08.709278 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:08.709902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:08.716100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.716555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.717368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:08.717810 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:08.848145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:08.856240 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e001cf89-5f97-459f-862c-9dce66ba8d3f tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.151382 Jul 01 11:33:08.866160 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3474/7045] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:08 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:09.078930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e79183f5-a0dd-4ef0-b190-3e8574875d3a req-65a06c57-46f4-453a-9db2-c644fa6537ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "name": "network-vif-plugged", "status": "completed", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:33:09.088415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e79183f5-a0dd-4ef0-b190-3e8574875d3a req-65a06c57-46f4-453a-9db2-c644fa6537ba service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:09.088872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e79183f5-a0dd-4ef0-b190-3e8574875d3a req-65a06c57-46f4-453a-9db2-c644fa6537ba service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:09.105061 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e79183f5-a0dd-4ef0-b190-3e8574875d3a req-65a06c57-46f4-453a-9db2-c644fa6537ba service nova] Creating event network-vif-plugged:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h1-master-1 Jul 01 11:33:09.105353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-e79183f5-a0dd-4ef0-b190-3e8574875d3a req-65a06c57-46f4-453a-9db2-c644fa6537ba service nova] Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:33:09.116721 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e79183f5-a0dd-4ef0-b190-3e8574875d3a req-65a06c57-46f4-453a-9db2-c644fa6537ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042050 Jul 01 11:33:09.117442 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3572/7046] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:33:09.872856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:09.873492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:09.880480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:09.880960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:09.881736 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:09.882165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:10.022970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:10.030892 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7659a9a2-fa12-463e-b5d3-c5b0706ac11e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.161837 Jul 01 11:33:10.031446 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3475/7047] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:09 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:11.051777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:11.052483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:11.062339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:11.062339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:11.062339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:11.062339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:11.200096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:11.208576 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0dcf20c-d9c3-479f-ab16-492298800c03 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.162763 Jul 01 11:33:11.209176 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3573/7048] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:11 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:12.225774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:12.226379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:12.233435 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:12.233881 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:12.234635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:12.235064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:12.366653 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:12.374733 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e52baf1b-7533-4482-8c3f-3bfc5ca1ea60 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.152898 Jul 01 11:33:12.375307 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3476/7049] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:12 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:13.391820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:13.392449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:13.400203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:13.400668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:13.401485 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:13.401946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:13.419194 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:13.542972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:13.552237 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0d8af58c-598e-4ca2-a59f-9e70676b37b8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.164127 Jul 01 11:33:13.552838 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3574/7050] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:13 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:14.570159 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:14.570689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:14.577638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:14.578087 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:14.578860 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:14.579302 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:14.683131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-602c1f73-ef65-47e0-a2b9-37db26f8a592 req-c537284b-6cb1-459c-ab4e-bff534aba1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "name": "network-vif-unplugged", "status": "completed", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:33:14.694081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-602c1f73-ef65-47e0-a2b9-37db26f8a592 req-c537284b-6cb1-459c-ab4e-bff534aba1cc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:14.696999 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-602c1f73-ef65-47e0-a2b9-37db26f8a592 req-c537284b-6cb1-459c-ab4e-bff534aba1cc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:14.707827 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-602c1f73-ef65-47e0-a2b9-37db26f8a592 req-c537284b-6cb1-459c-ab4e-bff534aba1cc service nova] Creating event network-vif-unplugged:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h2-master-1 Jul 01 11:33:14.713302 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-602c1f73-ef65-47e0-a2b9-37db26f8a592 req-c537284b-6cb1-459c-ab4e-bff534aba1cc service nova] Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:33:14.716096 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:14.725231 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-602c1f73-ef65-47e0-a2b9-37db26f8a592 req-c537284b-6cb1-459c-ab4e-bff534aba1cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046066 Jul 01 11:33:14.726511 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-121ec95e-7a6d-459c-8537-5ec5f31d93ec tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.160998 Jul 01 11:33:14.726856 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3575/7051] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:33:14.727088 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3477/7052] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:14 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:15.746617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:15.747337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:15.754675 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:15.755143 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:15.755937 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:15.756452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:15.904253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:15.912390 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5789c32b-1a7e-4ac1-a40b-3d02e37a034b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.171867 Jul 01 11:33:15.912953 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3576/7053] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:15 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:16.739406 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d4ef0404-755e-4e82-9b86-df8e25a09b40 req-ef9066ac-472f-4170-853f-54be0a4bc52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:33:16.743774 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=32 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:16.749060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d4ef0404-755e-4e82-9b86-df8e25a09b40 req-ef9066ac-472f-4170-853f-54be0a4bc52b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:16.752397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d4ef0404-755e-4e82-9b86-df8e25a09b40 req-ef9066ac-472f-4170-853f-54be0a4bc52b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:16.766297 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d4ef0404-755e-4e82-9b86-df8e25a09b40 req-ef9066ac-472f-4170-853f-54be0a4bc52b service nova] Creating event network-changed:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h2-master-1 Jul 01 11:33:16.774381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-d4ef0404-755e-4e82-9b86-df8e25a09b40 req-ef9066ac-472f-4170-853f-54be0a4bc52b service nova] Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:33:16.786360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d4ef0404-755e-4e82-9b86-df8e25a09b40 req-ef9066ac-472f-4170-853f-54be0a4bc52b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050601 Jul 01 11:33:16.787065 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3478/7054] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:33:16.930117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:16.930936 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:16.934244 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:16.941933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:16.942908 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:16.943719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:16.944325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:17.094094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:17.103285 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1096aef-fe03-47d1-9972-edffd694d1fb tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.177402 Jul 01 11:33:17.103879 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3577/7055] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:16 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:18.121257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:18.121965 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:18.128625 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:18.129069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:18.129856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:18.130294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:18.134323 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=92 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:18.261509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:18.270158 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7a4e02dc-ce7d-4113-831d-e2587baa41d5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.154042 Jul 01 11:33:18.270731 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3479/7056] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:18 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:19.287422 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:19.288060 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:19.290789 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:19.295777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:19.296234 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:19.297006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:19.297484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:19.432153 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:19.440497 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1646c5f-8b98-4b62-8aeb-d5d602eaf452 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.156914 Jul 01 11:33:19.441885 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3578/7057] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:19 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:20.459052 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:20.459799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:20.467038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:20.467488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:20.468278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:20.468726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:20.603572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:20.611917 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8699f213-d0a8-41b3-b4c4-b5a9b53766e7 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.157224 Jul 01 11:33:20.612622 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3480/7058] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:20 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:21.629809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:21.630432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:21.637785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:21.638244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:21.639019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:21.639465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:21.772432 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:21.780395 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0279c87-5db2-426a-80f9-fe7ac3ce44c9 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.154525 Jul 01 11:33:21.780960 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3579/7059] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:21 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:22.798393 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:22.799002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:22.806601 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:22.807048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:22.807804 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:22.808238 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:22.940660 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:22.948909 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-30970621-f361-47ef-bdbb-4826f1fce57e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.154425 Jul 01 11:33:22.949549 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3481/7060] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:22 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:23.966075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:23.966699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:23.974270 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:23.974733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:23.975514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:23.975963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:24.107309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:24.115872 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2c268ad3-b786-46bb-b866-df38f24c6f86 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.153796 Jul 01 11:33:24.116459 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3580/7061] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:23 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:25.132422 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:25.133031 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:25.139962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:25.140408 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:25.141179 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:25.141615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:25.276618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:25.284697 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-73fa8b00-8093-4365-a205-cdeb6d833486 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.156612 Jul 01 11:33:25.285300 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3482/7062] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:25 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:26.301938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:26.302567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:26.309602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:26.310068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:26.310858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:26.311309 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:26.442469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:26.450546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ace7082-593e-43b7-afda-a979ecccbc2a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.152558 Jul 01 11:33:26.451106 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3581/7063] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:26 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:27.468747 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:27.469371 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:27.476227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:27.476675 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:27.477462 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:27.477914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:27.610314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:27.618897 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f9c7b0f5-4b57-4203-8798-c352b9df0ef0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1721 microversion: 2.1 time: 0.154546 Jul 01 11:33:27.619564 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3483/7064] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:27 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:28.636128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:28.639809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:28.644108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:28.644463 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:28.645301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:28.645758 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:28.779691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:28.788174 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d8475358-b4ac-4d8d-aa3a-556acb3cf438 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1714 microversion: 2.1 time: 0.156013 Jul 01 11:33:28.794711 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3582/7065] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:28 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:28.804807 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:28.805489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:28.812483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:28.812936 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:28.813730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:28.814171 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:28.946781 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:28.954847 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c59c6c85-3b11-4619-9aee-75394bb2bf07 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1714 microversion: 2.1 time: 0.154508 Jul 01 11:33:28.955427 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3484/7066] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:28 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:28.971170 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:28.971802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:28.978391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:28.978859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:28.979645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:28.980101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:29.111810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:29.121507 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-50116f2e-7f37-4dfd-90b5-f8e2eaf099bf tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1714 microversion: 2.1 time: 0.154169 Jul 01 11:33:29.122091 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3583/7067] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:28 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:29.137922 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:29.140424 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:29.145085 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:29.145688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:29.146548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:29.147004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:29.171964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:33:29.455948 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-afe8ed21-75d2-4bfc-892d-27a844012678 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 204 len: 0 microversion: 2.1 time: 0.321586 Jul 01 11:33:29.456538 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3485/7068] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:33:29 2022] DELETE /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:33:29.465239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:29.465900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:29.472138 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:29.473252 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:29.474036 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:29.474481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:29.607912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:29.616115 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-750fda66-6814-477f-8b59-5025ba54194e tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1720 microversion: 2.1 time: 0.154795 Jul 01 11:33:29.617014 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3584/7069] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:29 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:30.634738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:30.635445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:30.642791 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:30.643457 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:30.643984 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:30.644413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:30.788426 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:30.796524 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f1a591d-7d8e-4714-8ad6-75ab3ddbc307 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1720 microversion: 2.1 time: 0.166081 Jul 01 11:33:30.797100 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3486/7070] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:30 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:31.180449 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b63723b2-dd3f-4793-8948-891cc1a3ca8f req-56899b58-0336-4511-9de7-936e435f2b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "name": "network-vif-plugged", "status": "completed", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:33:31.190233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b63723b2-dd3f-4793-8948-891cc1a3ca8f req-56899b58-0336-4511-9de7-936e435f2b69 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:31.190694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b63723b2-dd3f-4793-8948-891cc1a3ca8f req-56899b58-0336-4511-9de7-936e435f2b69 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:31.203259 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b63723b2-dd3f-4793-8948-891cc1a3ca8f req-56899b58-0336-4511-9de7-936e435f2b69 service nova] Creating event network-vif-plugged:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h2-master-1 Jul 01 11:33:31.208847 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b63723b2-dd3f-4793-8948-891cc1a3ca8f req-56899b58-0336-4511-9de7-936e435f2b69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033059 Jul 01 11:33:31.209549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3585/7071] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:33:31.813861 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:31.814473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:31.824687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:31.825299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:31.826121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:31.826528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:31.909136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:31.918776 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a7f80848-8fb6-4742-a0e7-3479d8e6d85a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1652 microversion: 2.1 time: 0.108853 Jul 01 11:33:31.921334 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3487/7072] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:31 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1652 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:32.371334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9c26b4b9-cf3f-425f-9f19-d206558243dc req-dd198690-af6b-48e4-ba0c-94ea846ba459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74", "name": "network-vif-deleted", "tag": "f0442673-a19c-46c8-a227-db3d10f62c83"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:33:32.377741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9c26b4b9-cf3f-425f-9f19-d206558243dc req-dd198690-af6b-48e4-ba0c-94ea846ba459 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:32.378199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9c26b4b9-cf3f-425f-9f19-d206558243dc req-dd198690-af6b-48e4-ba0c-94ea846ba459 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:32.389727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9c26b4b9-cf3f-425f-9f19-d206558243dc req-dd198690-af6b-48e4-ba0c-94ea846ba459 service nova] Creating event network-vif-deleted:f0442673-a19c-46c8-a227-db3d10f62c83 for instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 on n-h2-master-1 Jul 01 11:33:32.394672 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9c26b4b9-cf3f-425f-9f19-d206558243dc req-dd198690-af6b-48e4-ba0c-94ea846ba459 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030274 Jul 01 11:33:32.395790 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3586/7073] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:33:32.935920 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:32.936461 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:32.943902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:32.944441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:32.945335 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:32.945838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:33.015102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:33.026469 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14941b11-2050-4a3c-b8e5-29c36c822535 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1369 microversion: 2.1 time: 0.094466 Jul 01 11:33:33.027670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3488/7074] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:32 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:34.045589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:34.046297 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:34.052631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:34.053087 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:34.053911 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:34.054361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:34.120648 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:34.130101 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7b3baed5-5320-4b2d-80b7-d885d9329cc3 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1369 microversion: 2.1 time: 0.089868 Jul 01 11:33:34.130666 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3587/7075] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:34 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:35.146911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:35.147528 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:35.154511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:35.154967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:35.155737 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:35.156169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:35.218262 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:35.226453 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-afe06578-787d-40d2-b3a8-653066e4728a tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1369 microversion: 2.1 time: 0.083398 Jul 01 11:33:35.227029 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3489/7076] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:35 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:36.243523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:36.244144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:36.251240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:36.251699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:36.252484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:36.252926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:36.318540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:36.326829 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e28441de-c106-4b5b-9d46-f6d99b1c7942 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1369 microversion: 2.1 time: 0.087236 Jul 01 11:33:36.327486 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3588/7077] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:36 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:37.344136 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:37.344792 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:37.352541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:37.353035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:37.353976 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:37.355475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:37.386549 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:37.386992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:37.387432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lazy-loading 'fault' on Instance uuid 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:33:37.428246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf4b86f835a466b9129e4f71a84e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743a6280024b4d74a4f6a54a745fca09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:37.436458 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa06ab0e-ccd3-4371-97cd-2c619037c453 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 200 len: 1374 microversion: 2.1 time: 0.096166 Jul 01 11:33:37.436962 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3490/7078] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:37 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 1374 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:38.454513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:38.455139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:38.462584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:38.463044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:38.463819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:38.464268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:38.478132 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 HTTP/1.1 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74'} Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:38.479778 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c72b4e87-b221-4d23-a6e8-5046a1be94b5 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 404 len: 111 microversion: 2.1 time: 0.030694 Jul 01 11:33:38.483845 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3589/7079] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:38 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:38.536265 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:38.537215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:38.544151 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:38.544590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:38.545394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:38.545819 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:38.557921 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/os-volume_attachments HTTP/1.1 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74'} Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:38.559564 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6254c209-2159-4210-a7c9-635ea0ebdb6b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028615 Jul 01 11:33:38.564013 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3491/7080] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:33:38 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:41.995001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:41.995511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.002602 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.003071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.003907 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.004361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.017893 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 HTTP/1.1 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74'} Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.020370 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.024510 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e95e9473-70a7-42d2-96c4-f4b46ccbf8b2 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 404 len: 111 microversion: 2.1 time: 0.030697 Jul 01 11:33:42.025450 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3590/7081] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:33:41 2022] DELETE /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.030840 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.031448 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.039700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.040156 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.040937 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.041405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.055432 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 HTTP/1.1 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74'} Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.057007 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2cbcdc1e-7022-4675-bc25-6f15c545f7a0 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74" status: 404 len: 111 microversion: 2.1 time: 0.031508 Jul 01 11:33:42.061038 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3492/7082] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:42 2022] GET /compute/v2.1/servers/3f0e59d1-ec25-4ea2-b3c8-c06e1f33cc74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.067251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.067769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.073958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.074424 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.075209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.075660 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.089908 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc HTTP/1.1 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: exception: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'bb66bd2b-69a5-43f1-a20b-3eb5b42569fc'} Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.091482 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.095438 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2f3d8492-1254-47c8-a20e-1bf3cfb87881 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 404 len: 111 microversion: 2.1 time: 0.029847 Jul 01 11:33:42.096513 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3591/7083] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:33:42 2022] DELETE /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.102180 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.102785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: bb66bd2b-69a5-43f1-a20b-3eb5b42569fc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.108850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.109338 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.110093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.110523 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.123734 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc HTTP/1.1 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: exception: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'bb66bd2b-69a5-43f1-a20b-3eb5b42569fc'} Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.125267 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance bb66bd2b-69a5-43f1-a20b-3eb5b42569fc could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a01d8537-8070-4c83-81d4-b926e5447f3b tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc" status: 404 len: 111 microversion: 2.1 time: 0.028328 Jul 01 11:33:42.130097 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3493/7084] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:42 2022] GET /compute/v2.1/servers/bb66bd2b-69a5-43f1-a20b-3eb5b42569fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.135301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.135823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.142112 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.142582 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.143386 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.143844 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.158278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 HTTP/1.1 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '644d2cd9-5e38-4e57-9503-dd39b4c73ed8'} Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.160368 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be09d556-c80c-4a61-b92b-74635b411c92 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 404 len: 111 microversion: 2.1 time: 0.030586 Jul 01 11:33:42.164712 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3592/7085] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:33:42 2022] DELETE /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.170237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.170853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 644d2cd9-5e38-4e57-9503-dd39b4c73ed8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.177001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.177422 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.178188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.178622 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.192108 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 HTTP/1.1 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '644d2cd9-5e38-4e57-9503-dd39b4c73ed8'} Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.193652 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 644d2cd9-5e38-4e57-9503-dd39b4c73ed8 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.197819 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-751e00df-a75c-428b-8ad1-18aacde736d8 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8" status: 404 len: 111 microversion: 2.1 time: 0.028554 Jul 01 11:33:42.198776 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3494/7086] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:42 2022] GET /compute/v2.1/servers/644d2cd9-5e38-4e57-9503-dd39b4c73ed8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.203666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.204174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.210888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.211395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.212162 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.212605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.227409 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f HTTP/1.1 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '01a233b8-89d3-4fdf-b624-1bbc4797640f'} Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.228976 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ff81fc51-1128-4033-bc43-c2de6a700ed1 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 404 len: 111 microversion: 2.1 time: 0.030610 Jul 01 11:33:42.233001 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3593/7087] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:33:42 2022] DELETE /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.238918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.239523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] [instance: 01a233b8-89d3-4fdf-b624-1bbc4797640f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:42.245690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.246132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.246886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:42.247315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:42.261205 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] HTTP exception thrown: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Request method failure captured: Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f HTTP/1.1 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtn9-gGtY2vZRwwhOhs6mCMeH78ZMbyGKCGSYUB3BYQW1CaThEWXknnGuhaDFrhEJEs1nB04XRxHY0XF_rGMlopbh_QQpyHtr3Ji5LSMRgIhng775y481eS8ZEcQe3bFqRsx-GMZVdM3YBcTvNQUuM7r4VTrejWqbfoHGZ4E5LDq4W8 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_743a6280024b4d74a4f6a54a745fca09", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/743a6280024b4d74a4f6a54a745fca09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 743a6280024b4d74a4f6a54a745fca09 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServerActionsTestJSON-945628402 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: faf4b86f835a466b9129e4f71a84e9f1 Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServerActionsTestJSON-945628402-project Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '01a233b8-89d3-4fdf-b624-1bbc4797640f'} Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:33:42.262732 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Returning 404 to user: Instance 01a233b8-89d3-4fdf-b624-1bbc4797640f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:33:42.266878 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c80a5ff-b8b6-4284-82d8-7a9143a8e107 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f" status: 404 len: 111 microversion: 2.1 time: 0.029021 Jul 01 11:33:42.267841 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3495/7088] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:42 2022] GET /compute/v2.1/servers/01a233b8-89d3-4fdf-b624-1bbc4797640f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:33:42.273229 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f66c843-943b-40d5-81a6-b2f6c4dc5b21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] Calling method '.version_select at 0x7f6f97018430>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:42.383080 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f66c843-943b-40d5-81a6-b2f6c4dc5b21 tempest-ServerActionsTestJSON-945628402 tempest-ServerActionsTestJSON-945628402-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626383828" status: 202 len: 0 microversion: 2.1 time: 0.114199 Jul 01 11:33:42.383665 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3594/7089] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Jul 1 11:33:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626383828 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 11:33:53.650293 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:53.651064 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:53.790028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1625334106", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "929e9177-1a97-4dba-812d-3dd6a7da1425"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:33:53.843893 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] validate_networks() for [('929e9177-1a97-4dba-812d-3dd6a7da1425', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:33:54.225679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:33:54.226102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:33:54.226568 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:33:54.226997 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:33:54.227592 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:33:54.236909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:54.237402 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:54.238181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:54.238612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:54.255776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Getting quotas for project a5a17950d51a40069b5699f89a3c9151. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:33:54.261312 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Getting quotas for user 89d6f729a8ef4ee4b6a1a88f2bd91e9f and project a5a17950d51a40069b5699f89a3c9151. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:33:54.274309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:33:54.276565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:33:54.375368 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [f0f6be0e-63f8-48d1-9d33-c094ffe1af4b] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:33:55.385475 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [f0f6be0e-63f8-48d1-9d33-c094ffe1af4b] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41978. Jul 01 11:33:55.398052 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-596f7fd5-2bb5-4122-a0d8-a8551202e58e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.754056 Jul 01 11:33:55.403844 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3496/7090] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:33:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:33:55.407439 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=87 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:55.408680 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:33:55.414394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-652ce5e8-dedd-44b5-97e2-d3d434eb720c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:55.416464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-652ce5e8-dedd-44b5-97e2-d3d434eb720c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:55.477130 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-652ce5e8-dedd-44b5-97e2-d3d434eb720c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:55.484699 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-652ce5e8-dedd-44b5-97e2-d3d434eb720c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1217 microversion: 2.1 time: 0.079229 Jul 01 11:33:55.485530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3595/7091] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:55 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:56.502556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8eb74fb6-dbd4-4856-92bd-aaeeac352c7b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:56.503762 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8eb74fb6-dbd4-4856-92bd-aaeeac352c7b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:56.558014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8eb74fb6-dbd4-4856-92bd-aaeeac352c7b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:56.565045 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8eb74fb6-dbd4-4856-92bd-aaeeac352c7b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1217 microversion: 2.1 time: 0.067145 Jul 01 11:33:56.565949 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3497/7092] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:56 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:57.582854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5b753f13-fe0b-4e29-9bec-f02f4466ed4b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:57.583476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5b753f13-fe0b-4e29-9bec-f02f4466ed4b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:57.639862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5b753f13-fe0b-4e29-9bec-f02f4466ed4b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:57.646817 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5b753f13-fe0b-4e29-9bec-f02f4466ed4b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1217 microversion: 2.1 time: 0.068400 Jul 01 11:33:57.647671 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3596/7093] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:57 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:58.664509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4033863e-ab17-4c62-bc66-4d2b858cb260 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:58.665120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4033863e-ab17-4c62-bc66-4d2b858cb260 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:58.721537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4033863e-ab17-4c62-bc66-4d2b858cb260 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:58.729022 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4033863e-ab17-4c62-bc66-4d2b858cb260 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1217 microversion: 2.1 time: 0.068386 Jul 01 11:33:58.729636 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3498/7094] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:58 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:33:59.746357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:33:59.747044 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:33:59.755160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:59.755623 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:59.756408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:33:59.756864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:33:59.816635 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:33:59.824085 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac7c2bac-ad36-4309-8a90-3549eab09f87 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1221 microversion: 2.1 time: 0.081591 Jul 01 11:33:59.824600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3597/7095] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:33:59 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:00.840830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:00.841450 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:00.848912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:00.849404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:00.850207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:00.850645 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:00.911841 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:00.919239 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9f789dcf-4aba-49c0-8ccb-6f8f59bbd2ad tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1213 microversion: 2.1 time: 0.082479 Jul 01 11:34:00.919833 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3499/7096] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:00 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:01.937973 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:01.938594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:01.946314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:01.946774 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:01.947561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:01.948011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:02.074344 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:02.082905 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c7b56666-c126-4322-99d5-ac057b3c67af tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1275 microversion: 2.1 time: 0.148125 Jul 01 11:34:02.083379 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3598/7097] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:01 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:03.100888 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:03.101474 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:03.107827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:03.108331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:03.109058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:03.109530 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:03.138623 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-729af63e-f439-450e-8610-3dd7143628fa req-47682336-94ed-414f-a338-286306df1eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4804154b-42ab-49e8-9278-4f7c4fbbecba", "tag": "3e2b343a-a8e5-47d4-93ce-9fda7be4c151"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:03.155838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-729af63e-f439-450e-8610-3dd7143628fa req-47682336-94ed-414f-a338-286306df1eec service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:03.156304 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-729af63e-f439-450e-8610-3dd7143628fa req-47682336-94ed-414f-a338-286306df1eec service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:03.174140 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-729af63e-f439-450e-8610-3dd7143628fa req-47682336-94ed-414f-a338-286306df1eec service nova] Creating event network-changed:3e2b343a-a8e5-47d4-93ce-9fda7be4c151 for instance 4804154b-42ab-49e8-9278-4f7c4fbbecba on n-h2-master-1 Jul 01 11:34:03.179314 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-729af63e-f439-450e-8610-3dd7143628fa req-47682336-94ed-414f-a338-286306df1eec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044307 Jul 01 11:34:03.179917 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3599/7098] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:34:03.354925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:03.363872 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31227735-1a04-4f8a-9677-8f393ef05d1c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1317 microversion: 2.1 time: 0.267673 Jul 01 11:34:03.364567 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3500/7099] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:03 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:04.382687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:04.383328 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:04.389639 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:04.390102 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:04.390884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:04.391334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:04.521980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:04.529586 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1418feb0-2374-43f5-85ff-be09da942ee1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1317 microversion: 2.1 time: 0.152240 Jul 01 11:34:04.530171 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3600/7100] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:04 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:05.546958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:05.547572 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:05.550275 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:05.555717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:05.556162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:05.556919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:05.557382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:05.692903 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:05.700491 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca70fc75-1985-463c-b598-967251a1189a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1317 microversion: 2.1 time: 0.157474 Jul 01 11:34:05.701057 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3501/7101] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:05 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:06.716598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:06.717252 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:06.724538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:06.724998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:06.725860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:06.726310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:06.852964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:06.860622 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b8fc990-6876-4222-9da4-d77fed5ad01c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1317 microversion: 2.1 time: 0.147944 Jul 01 11:34:06.861348 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3601/7102] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:06 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:07.877878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:07.879852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:07.885944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:07.886397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:07.887159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:07.887640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:08.015020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:08.023161 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f390a8db-372c-492d-9fff-5ac8e1c8b23c tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1317 microversion: 2.1 time: 0.149161 Jul 01 11:34:08.023726 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3502/7103] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:07 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:09.040668 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:09.041331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:09.043480 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:09.049276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:09.049745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:09.050528 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:09.050983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:09.184202 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:09.193572 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f935775-ae80-4c86-bb04-bdef5c8fcf37 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1317 microversion: 2.1 time: 0.157575 Jul 01 11:34:09.194152 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3602/7104] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:09 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:09.420304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-fab883eb-551b-49e2-aaf9-960fd18f35d6 req-160e47ae-ed17-4488-823a-865078b33538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4804154b-42ab-49e8-9278-4f7c4fbbecba", "name": "network-vif-plugged", "status": "completed", "tag": "3e2b343a-a8e5-47d4-93ce-9fda7be4c151"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:09.423938 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:09.430554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fab883eb-551b-49e2-aaf9-960fd18f35d6 req-160e47ae-ed17-4488-823a-865078b33538 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:09.431004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-fab883eb-551b-49e2-aaf9-960fd18f35d6 req-160e47ae-ed17-4488-823a-865078b33538 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:09.442851 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-fab883eb-551b-49e2-aaf9-960fd18f35d6 req-160e47ae-ed17-4488-823a-865078b33538 service nova] Creating event network-vif-plugged:3e2b343a-a8e5-47d4-93ce-9fda7be4c151 for instance 4804154b-42ab-49e8-9278-4f7c4fbbecba on n-h2-master-1 Jul 01 11:34:09.447867 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-fab883eb-551b-49e2-aaf9-960fd18f35d6 req-160e47ae-ed17-4488-823a-865078b33538 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031274 Jul 01 11:34:09.448481 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3503/7105] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:34:10.210929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:10.211554 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:10.218438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:10.218893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:10.219663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:10.220132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:10.346069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:10.353583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1c95f029-f2cf-4e90-b43e-d6bce734ac2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1317 microversion: 2.1 time: 0.147151 Jul 01 11:34:10.354152 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3603/7106] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:10 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:11.369925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:11.370630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:11.378166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:11.378621 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:11.379407 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:11.379850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:11.511689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:11.519116 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-14a6b93b-7f52-407f-80c6-74c7c7930a29 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1507 microversion: 2.1 time: 0.153436 Jul 01 11:34:11.519694 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3504/7107] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:11 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:11.577537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1433858074", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "929e9177-1a97-4dba-812d-3dd6a7da1425"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:11.629893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] validate_networks() for [('929e9177-1a97-4dba-812d-3dd6a7da1425', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:34:12.036085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:34:12.036535 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:34:12.037028 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:34:12.037507 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:34:12.037972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:34:12.047238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:12.047706 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:12.048526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:12.048981 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:12.067504 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Getting quotas for project a5a17950d51a40069b5699f89a3c9151. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:34:12.072817 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Getting quotas for user 89d6f729a8ef4ee4b6a1a88f2bd91e9f and project a5a17950d51a40069b5699f89a3c9151. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:34:12.085710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:34:12.087998 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:34:12.182384 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-598197aa-048a-498d-a945-b8e10cd787d2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608713 Jul 01 11:34:12.183048 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3604/7108] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:34:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:34:12.193395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76aefbc9-e6e5-4c0f-91b5-6eff75ad596f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:12.194008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-76aefbc9-e6e5-4c0f-91b5-6eff75ad596f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:12.246491 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-76aefbc9-e6e5-4c0f-91b5-6eff75ad596f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:12.253272 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76aefbc9-e6e5-4c0f-91b5-6eff75ad596f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1217 microversion: 2.1 time: 0.064135 Jul 01 11:34:12.253850 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3505/7109] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:12 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:13.272206 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:13.273417 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:13.281209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:13.281673 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:13.282455 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:13.283049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:13.346278 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:13.354372 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-03d34793-f933-4cb1-9c29-69946a485c6e tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1213 microversion: 2.1 time: 0.087056 Jul 01 11:34:13.354969 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3605/7110] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:13 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:14.371863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:14.372621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:14.383541 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:14.384013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:14.384824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:14.385300 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:14.450100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:14.458267 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ea472c34-8aba-4380-8d84-47ff801b6c41 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1275 microversion: 2.1 time: 0.089768 Jul 01 11:34:14.458848 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3506/7111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:14 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:15.474634 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:15.475269 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:15.482587 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:15.483313 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:15.484801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:15.485289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:15.624641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:15.632968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6a3d00b-c61b-4ae9-9e32-abde5f1694cf tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1317 microversion: 2.1 time: 0.162310 Jul 01 11:34:15.633704 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3606/7112] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:15 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:15.704622 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-967921c2-e53c-423b-be07-5e936301aec8 req-ea96328e-dc1a-48c8-8d5c-d7ec3c634fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f", "tag": "166d5469-8e05-46e0-b735-f0a4779def9a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:15.714377 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-967921c2-e53c-423b-be07-5e936301aec8 req-ea96328e-dc1a-48c8-8d5c-d7ec3c634fbf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:15.714822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-967921c2-e53c-423b-be07-5e936301aec8 req-ea96328e-dc1a-48c8-8d5c-d7ec3c634fbf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:15.727193 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-967921c2-e53c-423b-be07-5e936301aec8 req-ea96328e-dc1a-48c8-8d5c-d7ec3c634fbf service nova] Creating event network-changed:166d5469-8e05-46e0-b735-f0a4779def9a for instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f on n-h1-master-1 Jul 01 11:34:15.732739 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-967921c2-e53c-423b-be07-5e936301aec8 req-ea96328e-dc1a-48c8-8d5c-d7ec3c634fbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031499 Jul 01 11:34:15.733912 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3507/7113] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:34:16.650613 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:16.651281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:16.658373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:16.658836 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:16.659613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:16.660059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:16.789550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:16.797051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-195617b5-cc0c-4538-8069-21ce277043be tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1317 microversion: 2.1 time: 0.150381 Jul 01 11:34:16.797644 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3607/7114] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:16 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:17.815657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:17.816597 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:17.823493 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:17.823940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:17.824696 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:17.825125 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:17.954701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:17.962217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9cc00da9-6f54-4bda-bdab-ee9f86d557c2 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1317 microversion: 2.1 time: 0.151673 Jul 01 11:34:17.962790 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3508/7115] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:17 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:18.979024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:18.979650 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:18.986813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:18.987271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:18.988049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:18.989115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:19.118783 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:19.126658 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f4d9327a-2011-4530-b032-35551b8c3745 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1317 microversion: 2.1 time: 0.151480 Jul 01 11:34:19.127235 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3608/7116] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:18 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:20.143437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:20.144039 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:20.151492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:20.151923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:20.152673 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:20.153104 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:20.281772 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:20.289215 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-abd85e31-af11-4491-b941-3965ed3de30a tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1317 microversion: 2.1 time: 0.149657 Jul 01 11:34:20.289778 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3509/7117] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:20 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:21.306347 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:21.306921 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:21.314122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:21.314600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:21.315390 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:21.315843 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:21.433842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-64f0db8e-0f4f-4b5c-845f-802b1a52a7c4 req-4206930c-4942-4920-9d54-38e17702494c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f", "name": "network-vif-plugged", "status": "completed", "tag": "166d5469-8e05-46e0-b735-f0a4779def9a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:21.445128 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-64f0db8e-0f4f-4b5c-845f-802b1a52a7c4 req-4206930c-4942-4920-9d54-38e17702494c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:21.445596 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-64f0db8e-0f4f-4b5c-845f-802b1a52a7c4 req-4206930c-4942-4920-9d54-38e17702494c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:21.461250 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-64f0db8e-0f4f-4b5c-845f-802b1a52a7c4 req-4206930c-4942-4920-9d54-38e17702494c service nova] Creating event network-vif-plugged:166d5469-8e05-46e0-b735-f0a4779def9a for instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f on n-h1-master-1 Jul 01 11:34:21.465054 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-64f0db8e-0f4f-4b5c-845f-802b1a52a7c4 req-4206930c-4942-4920-9d54-38e17702494c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035491 Jul 01 11:34:21.466092 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3510/7118] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:34:21.469622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:21.478116 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a9a07580-93fc-48d1-b4ce-d97653caf7a9 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1317 microversion: 2.1 time: 0.176044 Jul 01 11:34:21.486530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3609/7119] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:21 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:22.491438 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:22.496567 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:22.497302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:22.503691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:22.504187 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:22.505520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:22.505953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:22.646564 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:22.654169 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d6bfc5b-e57d-41d7-b461-5a2ae8d55e85 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1317 microversion: 2.1 time: 0.163648 Jul 01 11:34:22.654728 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3511/7120] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:22 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:23.670883 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:23.671515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:23.673439 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:23.674139 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:23.680293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:23.680761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:23.681585 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:23.682041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:23.814258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:23.822702 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5485f2e5-2508-48ec-a0d2-52c8467a56c0 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1506 microversion: 2.1 time: 0.155783 Jul 01 11:34:23.823277 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3610/7121] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:23 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:23.838429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:23.838929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:23.841612 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:23.846362 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:23.846835 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:23.847593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:23.848029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:23.851076 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=63 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:23.874978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:34:24.173719 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-518e2486-4751-4e91-ab98-d9f451eea0ac tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 204 len: 0 microversion: 2.1 time: 0.338759 Jul 01 11:34:24.174319 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3512/7122] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:34:23 2022] DELETE /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:34:24.183149 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:24.183820 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:24.189988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:24.194044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:24.194044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:24.194044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:24.322216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:24.329790 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f47a54b0-3b32-4250-bdb4-7bdf83e4c8c1 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1512 microversion: 2.1 time: 0.150523 Jul 01 11:34:24.330350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3611/7123] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:24 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:25.347700 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:25.348895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:25.355826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:25.356271 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:25.357027 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:25.357555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:25.488111 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:25.496531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ebdca758-b68b-4143-a999-797f9becb814 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1512 microversion: 2.1 time: 0.153001 Jul 01 11:34:25.497112 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3513/7124] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:25 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:26.175371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e17237dc-088f-4497-9e1b-3252ff87ee26 req-36e779e9-952d-4390-bf84-35fe86939c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f", "name": "network-vif-deleted", "tag": "166d5469-8e05-46e0-b735-f0a4779def9a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:26.183921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e17237dc-088f-4497-9e1b-3252ff87ee26 req-36e779e9-952d-4390-bf84-35fe86939c75 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:26.184487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e17237dc-088f-4497-9e1b-3252ff87ee26 req-36e779e9-952d-4390-bf84-35fe86939c75 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:26.188526 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=83 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:26.197158 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e17237dc-088f-4497-9e1b-3252ff87ee26 req-36e779e9-952d-4390-bf84-35fe86939c75 service nova] Creating event network-vif-deleted:166d5469-8e05-46e0-b735-f0a4779def9a for instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f on n-h1-master-1 Jul 01 11:34:26.203752 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e17237dc-088f-4497-9e1b-3252ff87ee26 req-36e779e9-952d-4390-bf84-35fe86939c75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097158 Jul 01 11:34:26.204457 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3612/7125] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:34:26.513895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:26.514511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:26.521364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:26.521833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:26.522595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:26.523029 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:26.553979 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:26.554437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:26.554862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lazy-loading 'fault' on Instance uuid 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:34:26.595978 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:26.603597 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9572dd86-bf77-4c91-b50f-a9a55f8d2e34 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 200 len: 1307 microversion: 2.1 time: 0.093556 Jul 01 11:34:26.604193 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3514/7126] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:26 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:27.630631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:27.631410 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:27.634325 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:34:27.639793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:27.640251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:27.641044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:27.641516 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:27.660820 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] HTTP exception thrown: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Request method failure captured: Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f HTTP/1.1 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtuhK7oTs4WSIQLF1Rgfr5OKrJDj6wagkIkk3g0C8kRSbmGGPe0Wx8mMeo7JH4qbFLZUhRdNBqASqM1yoOCaj_Qh4aMtMYji8vG-r_yXdCuyDFRV_pG0WidnjNIxU3epaKNFGf6swPxRkUJh3gZoT2wi8eGqFOptUV7fJv67KYwzFMo Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5a17950d51a40069b5699f89a3c9151", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 89d6f729a8ef4ee4b6a1a88f2bd91e9f Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f'} Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:27.663435 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Returning 404 to user: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-247ae6b7-a556-49e0-bc77-9f9adda2f019 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 404 len: 111 microversion: 2.1 time: 0.046341 Jul 01 11:34:27.667539 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3613/7127] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:27 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:34:27.675143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:27.680150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:27.683153 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:27.683608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:27.684380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:27.684817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:27.810994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:27.819186 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b96c5130-221e-4758-b905-a935ca326baa tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1507 microversion: 2.1 time: 0.148007 Jul 01 11:34:27.819789 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3515/7128] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:27 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:27.836792 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-258c37e3-fac0-4ed4-a74e-6923cb3c198f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:27.837809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-258c37e3-fac0-4ed4-a74e-6923cb3c198f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 62015f76-15af-4217-8a9a-07acef7575bd] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:27.843559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-258c37e3-fac0-4ed4-a74e-6923cb3c198f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] HTTP exception thrown: Instance 62015f76-15af-4217-8a9a-07acef7575bd could not be found. Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-258c37e3-fac0-4ed4-a74e-6923cb3c198f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Request method failure captured: Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/62015f76-15af-4217-8a9a-07acef7575bd/action HTTP/1.1 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 32 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtuhK7oTs4WSIQLF1Rgfr5OKrJDj6wagkIkk3g0C8kRSbmGGPe0Wx8mMeo7JH4qbFLZUhRdNBqASqM1yoOCaj_Qh4aMtMYji8vG-r_yXdCuyDFRV_pG0WidnjNIxU3epaKNFGf6swPxRkUJh3gZoT2wi8eGqFOptUV7fJv67KYwzFMo Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5a17950d51a40069b5699f89a3c9151", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 89d6f729a8ef4ee4b6a1a88f2bd91e9f Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: {"resize": {"flavorRef": "452"}} Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 62015f76-15af-4217-8a9a-07acef7575bd could not be found. Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '62015f76-15af-4217-8a9a-07acef7575bd', 'body': {'resize': {'flavorRef': '452'}}} Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62015f76-15af-4217-8a9a-07acef7575bd could not be found. Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:34:27.845193 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62015f76-15af-4217-8a9a-07acef7575bd could not be found. Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62015f76-15af-4217-8a9a-07acef7575bd could not be found. Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-258c37e3-fac0-4ed4-a74e-6923cb3c198f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Returning 404 to user: Instance 62015f76-15af-4217-8a9a-07acef7575bd could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-258c37e3-fac0-4ed4-a74e-6923cb3c198f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "POST /compute/v2.1/servers/62015f76-15af-4217-8a9a-07acef7575bd/action" status: 404 len: 111 microversion: 2.1 time: 0.014733 Jul 01 11:34:27.850040 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3614/7129] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:34:27 2022] POST /compute/v2.1/servers/62015f76-15af-4217-8a9a-07acef7575bd/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:34:27.855931 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:27.856544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:27.862632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:27.863080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:27.866589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:27.866589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:27.998413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:28.005910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aac422ed-7a4b-414f-8fb3-c5b47be02aae tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1507 microversion: 2.1 time: 0.153806 Jul 01 11:34:28.006478 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3516/7130] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:27 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:28.023353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:28.023976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.031044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.031512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.032291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.032764 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.159918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:28.168192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0c122599-5da6-4716-b2dc-677cbf28e882 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1507 microversion: 2.1 time: 0.149521 Jul 01 11:34:28.168766 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3615/7131] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:28 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:28.184340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "cbd3b838-0d2b-4865-ac16-dd0e4394d70d"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:28.185468 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.191751 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.192207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.193020 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.193443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.232028 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:28.237530 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] HTTP exception thrown: Flavor cbd3b838-0d2b-4865-ac16-dd0e4394d70d could not be found. Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Request method failure captured: Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: request: POST /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba/action HTTP/1.1 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 65 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtuhK7oTs4WSIQLF1Rgfr5OKrJDj6wagkIkk3g0C8kRSbmGGPe0Wx8mMeo7JH4qbFLZUhRdNBqASqM1yoOCaj_Qh4aMtMYji8vG-r_yXdCuyDFRV_pG0WidnjNIxU3epaKNFGf6swPxRkUJh3gZoT2wi8eGqFOptUV7fJv67KYwzFMo Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5a17950d51a40069b5699f89a3c9151", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 89d6f729a8ef4ee4b6a1a88f2bd91e9f Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: {"resize": {"flavorRef": "cbd3b838-0d2b-4865-ac16-dd0e4394d70d"}} Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: exception: Flavor cbd3b838-0d2b-4865-ac16-dd0e4394d70d could not be found. Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '4804154b-42ab-49e8-9278-4f7c4fbbecba', 'body': {'resize': {'flavorRef': 'cbd3b838-0d2b-4865-ac16-dd0e4394d70d'}}} Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 11:34:28.264243 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor cbd3b838-0d2b-4865-ac16-dd0e4394d70d could not be found. Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor cbd3b838-0d2b-4865-ac16-dd0e4394d70d could not be found. Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor cbd3b838-0d2b-4865-ac16-dd0e4394d70d could not be found. Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Returning 400 to user: Flavor cbd3b838-0d2b-4865-ac16-dd0e4394d70d could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7973cb36-3ddc-4ca4-8efd-d9e1c24721de tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "POST /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba/action" status: 400 len: 107 microversion: 2.1 time: 0.085375 Jul 01 11:34:28.268068 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3517/7132] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:34:28 2022] POST /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba/action => generated 107 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:34:28.274987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:28.275621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.282427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.282893 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.283708 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.284163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.414951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:28.422801 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-53c5053c-4a32-4026-8c6f-62ac36fa6bde tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1507 microversion: 2.1 time: 0.151685 Jul 01 11:34:28.423369 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3616/7133] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:28 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:34:28.439749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:28.440373 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.447560 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.448005 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.448823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.449324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.574936 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:28.582406 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-429a1fa3-d22e-4b09-a516-5bd86a1d80a3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1507 microversion: 2.1 time: 0.146572 Jul 01 11:34:28.583615 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3518/7134] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:28 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:28.599498 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036154ca-21b5-4f55-b22f-63694e5fc1c3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036154ca-21b5-4f55-b22f-63694e5fc1c3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Request method failure captured: Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: request: POST /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba/action HTTP/1.1 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 29 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtuhK7oTs4WSIQLF1Rgfr5OKrJDj6wagkIkk3g0C8kRSbmGGPe0Wx8mMeo7JH4qbFLZUhRdNBqASqM1yoOCaj_Qh4aMtMYji8vG-r_yXdCuyDFRV_pG0WidnjNIxU3epaKNFGf6swPxRkUJh3gZoT2wi8eGqFOptUV7fJv67KYwzFMo Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5a17950d51a40069b5699f89a3c9151", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 89d6f729a8ef4ee4b6a1a88f2bd91e9f Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: {"resize": {"flavorRef": ""}} Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '4804154b-42ab-49e8-9278-4f7c4fbbecba', 'body': {'resize': {'flavorRef': ''}}} Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise error Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi '' Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.602070 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-036154ca-21b5-4f55-b22f-63694e5fc1c3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-036154ca-21b5-4f55-b22f-63694e5fc1c3 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "POST /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba/action" status: 400 len: 113 microversion: 2.1 time: 0.008255 Jul 01 11:34:28.606173 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3617/7135] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:34:28 2022] POST /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 11:34:28.611374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:28.611981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.618391 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.621295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.621295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.621295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.752081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:28.760149 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3fa999be-e107-4905-b53b-d98ec200f5b8 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1507 microversion: 2.1 time: 0.152435 Jul 01 11:34:28.760718 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3519/7136] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:28 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:28.780570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:28.781113 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.788160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.788625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.789433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.789887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.803892 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] HTTP exception thrown: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Request method failure captured: Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f HTTP/1.1 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtuhK7oTs4WSIQLF1Rgfr5OKrJDj6wagkIkk3g0C8kRSbmGGPe0Wx8mMeo7JH4qbFLZUhRdNBqASqM1yoOCaj_Qh4aMtMYji8vG-r_yXdCuyDFRV_pG0WidnjNIxU3epaKNFGf6swPxRkUJh3gZoT2wi8eGqFOptUV7fJv67KYwzFMo Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5a17950d51a40069b5699f89a3c9151", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 89d6f729a8ef4ee4b6a1a88f2bd91e9f Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f'} Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:34:28.805488 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Returning 404 to user: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a93504f4-77d5-40f8-9187-943e56deb23b tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 404 len: 111 microversion: 2.1 time: 0.031105 Jul 01 11:34:28.809281 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3618/7137] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:34:28 2022] DELETE /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:34:28.816287 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:28.817820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.823823 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.824268 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.825022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.825492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.838858 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] HTTP exception thrown: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Request method failure captured: Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f HTTP/1.1 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtuhK7oTs4WSIQLF1Rgfr5OKrJDj6wagkIkk3g0C8kRSbmGGPe0Wx8mMeo7JH4qbFLZUhRdNBqASqM1yoOCaj_Qh4aMtMYji8vG-r_yXdCuyDFRV_pG0WidnjNIxU3epaKNFGf6swPxRkUJh3gZoT2wi8eGqFOptUV7fJv67KYwzFMo Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5a17950d51a40069b5699f89a3c9151", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 89d6f729a8ef4ee4b6a1a88f2bd91e9f Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f'} Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:28.840359 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Returning 404 to user: Instance 8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0f215621-4f00-45ff-a0f7-87e2aa372e2f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f" status: 404 len: 111 microversion: 2.1 time: 0.030290 Jul 01 11:34:28.844739 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3520/7138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:28 2022] GET /compute/v2.1/servers/8dc8d56b-b78f-4d52-ac79-34a1c1a99b6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:34:28.850146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:28.850653 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:28.856716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.857200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.857972 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:28.858421 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:28.884319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:34:29.163619 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea5678fe-d0cd-42f4-a4df-2fc9871c932f tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 204 len: 0 microversion: 2.1 time: 0.316964 Jul 01 11:34:29.164217 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3619/7139] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:34:28 2022] DELETE /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 11:34:29.172430 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:29.173070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:29.179546 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:29.183963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:29.183963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:29.183963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:29.315641 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:29.321171 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f57be891-4fbc-454a-ba94-8a0c9db8b557 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1513 microversion: 2.1 time: 0.152535 Jul 01 11:34:29.321738 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3521/7140] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:29 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:30.340019 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:30.340781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:30.348286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:30.348879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:30.349795 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:30.350238 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:30.486674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:30.494559 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9035bfde-a1a3-4fc5-9521-ebfdd9c39d24 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1513 microversion: 2.1 time: 0.159127 Jul 01 11:34:30.495129 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3620/7141] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:30 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:34:31.470927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-12728289-8b13-4145-a051-261b4cdadd3a req-93ffa2b8-785b-4e4e-88f8-813b2654cf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4804154b-42ab-49e8-9278-4f7c4fbbecba", "name": "network-vif-deleted", "tag": "3e2b343a-a8e5-47d4-93ce-9fda7be4c151"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:34:31.479941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-12728289-8b13-4145-a051-261b4cdadd3a req-93ffa2b8-785b-4e4e-88f8-813b2654cf78 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:31.480381 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-12728289-8b13-4145-a051-261b4cdadd3a req-93ffa2b8-785b-4e4e-88f8-813b2654cf78 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:31.492976 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-12728289-8b13-4145-a051-261b4cdadd3a req-93ffa2b8-785b-4e4e-88f8-813b2654cf78 service nova] Creating event network-vif-deleted:3e2b343a-a8e5-47d4-93ce-9fda7be4c151 for instance 4804154b-42ab-49e8-9278-4f7c4fbbecba on n-h2-master-1 Jul 01 11:34:31.498259 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-12728289-8b13-4145-a051-261b4cdadd3a req-93ffa2b8-785b-4e4e-88f8-813b2654cf78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095130 Jul 01 11:34:31.498870 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3522/7142] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:34:31.511814 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:31.512683 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:31.520219 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:31.520790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:31.521745 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:31.522310 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:31.591484 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d6f729a8ef4ee4b6a1a88f2bd91e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a17950d51a40069b5699f89a3c9151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:34:31.599627 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-21625e87-a012-44b4-affc-725301bde660 tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 200 len: 1471 microversion: 2.1 time: 0.092503 Jul 01 11:34:31.600192 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3621/7143] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:31 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 1471 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:34:32.618197 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:34:32.618972 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] [instance: 4804154b-42ab-49e8-9278-4f7c4fbbecba] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:34:32.626252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:32.626695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:32.627458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:34:32.627975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:34:32.642979 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] HTTP exception thrown: Instance 4804154b-42ab-49e8-9278-4f7c4fbbecba could not be found. Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Request method failure captured: Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba HTTP/1.1 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtuhK7oTs4WSIQLF1Rgfr5OKrJDj6wagkIkk3g0C8kRSbmGGPe0Wx8mMeo7JH4qbFLZUhRdNBqASqM1yoOCaj_Qh4aMtMYji8vG-r_yXdCuyDFRV_pG0WidnjNIxU3epaKNFGf6swPxRkUJh3gZoT2wi8eGqFOptUV7fJv67KYwzFMo Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5a17950d51a40069b5699f89a3c9151", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5a17950d51a40069b5699f89a3c9151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: a5a17950d51a40069b5699f89a3c9151 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1357182964 Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 89d6f729a8ef4ee4b6a1a88f2bd91e9f Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-ServersNegativeTestJSON-1357182964-project Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 4804154b-42ab-49e8-9278-4f7c4fbbecba could not be found. Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '4804154b-42ab-49e8-9278-4f7c4fbbecba'} Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4804154b-42ab-49e8-9278-4f7c4fbbecba could not be found. Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4804154b-42ab-49e8-9278-4f7c4fbbecba could not be found. Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:34:32.644623 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4804154b-42ab-49e8-9278-4f7c4fbbecba could not be found. Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] Returning 404 to user: Instance 4804154b-42ab-49e8-9278-4f7c4fbbecba could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d77bc78a-8a76-4d30-a3f9-99b105a90d4d tempest-ServersNegativeTestJSON-1357182964 tempest-ServersNegativeTestJSON-1357182964-project] 10.222.0.23 "GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba" status: 404 len: 111 microversion: 2.1 time: 0.033761 Jul 01 11:34:32.648882 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3523/7144] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:34:32 2022] GET /compute/v2.1/servers/4804154b-42ab-49e8-9278-4f7c4fbbecba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:35:17.345436 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:17.346210 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:17.515742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a8213d0-3840-4c5f-8f4c-4ac4d5d67812 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Action: 'create', calling method: .version_select at 0x7f6f9220e430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1370525090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcHlhO6Z9/6zUnqdfSOlxy1xTOWpV91YEF5tjezVFw7Q3uEFdnt8OJLQMQ7/Wo4KdofrMGgshJvSkSQctHwqUix09XWgVu5mnKbBDORRUI4uLSX6TzTDjHo0EqmFjIN6Q=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:17.531034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9a8213d0-3840-4c5f-8f4c-4ac4d5d67812 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for project fa65fc61d81042339854538f6ae1cc22. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:35:17.536985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-9a8213d0-3840-4c5f-8f4c-4ac4d5d67812 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for user aa607e2fe55d4e8389ab5c1aaa782155 and project fa65fc61d81042339854538f6ae1cc22. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:35:17.636855 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a8213d0-3840-4c5f-8f4c-4ac4d5d67812 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.296501 Jul 01 11:35:17.637393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3622/7145] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:35:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:17.685319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1732855595", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1370525090", "networks": [{"uuid": "120c5fc6-5682-4d55-a6ce-f6a04a0f9ac9"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:17.692931 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:17.693630 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:17.738680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] validate_networks() for [('120c5fc6-5682-4d55-a6ce-f6a04a0f9ac9', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:35:18.131964 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:35:18.132381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:35:18.133117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:35:18.133706 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:35:18.134307 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:35:18.145000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:18.145475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:18.146293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:18.146720 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:18.163996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for project fa65fc61d81042339854538f6ae1cc22. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:35:18.169217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for user aa607e2fe55d4e8389ab5c1aaa782155 and project fa65fc61d81042339854538f6ae1cc22. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:35:18.181246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:35:18.183445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:35:18.303082 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fad1e4b6-6c33-4fe4-bbc5-4e2d46806a24 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621639 Jul 01 11:35:18.303803 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3524/7146] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:35:18.313679 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fa5b533-d975-44c7-988a-4d937a7fbbc6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:18.314459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5fa5b533-d975-44c7-988a-4d937a7fbbc6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:18.370550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5fa5b533-d975-44c7-988a-4d937a7fbbc6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:18.380100 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5fa5b533-d975-44c7-988a-4d937a7fbbc6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1263 microversion: 2.1 time: 0.070277 Jul 01 11:35:18.380689 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3623/7147] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:18 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:35:19.398477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:19.399153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:19.405420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:19.408140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:19.408140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:19.408140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:19.468399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:19.475942 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-08294cd3-4625-4895-a6b7-a816ec9304be tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1267 microversion: 2.1 time: 0.082931 Jul 01 11:35:19.476845 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3525/7148] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:19 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:20.493436 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:20.494121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:20.501686 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:20.503142 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:20.503977 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:20.504437 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:20.584547 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:20.595153 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-98106834-8148-48b9-aef3-9ff582bb4148 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1315 microversion: 2.1 time: 0.104635 Jul 01 11:35:20.596504 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3624/7149] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:20 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1315 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:21.616064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:21.616848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:21.635953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:21.635953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:21.635953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:21.635953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:21.886273 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:21.896697 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-65dcece0-2e66-40f7-b05c-3af9dfd3ab01 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1363 microversion: 2.1 time: 0.285538 Jul 01 11:35:21.899044 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3526/7150] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:21 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:22.387476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-052ff840-e962-4d86-8085-526bb85ca579 req-07e0f12b-533c-4f83-8ade-6bcea765a93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222042a9-f802-4d10-b56f-6681921c7e71", "tag": "06622b8a-4ed2-4a0f-9b9c-d79bbbe9e932"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:22.397132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-052ff840-e962-4d86-8085-526bb85ca579 req-07e0f12b-533c-4f83-8ade-6bcea765a93b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:22.397627 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-052ff840-e962-4d86-8085-526bb85ca579 req-07e0f12b-533c-4f83-8ade-6bcea765a93b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:22.409298 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-052ff840-e962-4d86-8085-526bb85ca579 req-07e0f12b-533c-4f83-8ade-6bcea765a93b service nova] Creating event network-changed:06622b8a-4ed2-4a0f-9b9c-d79bbbe9e932 for instance 222042a9-f802-4d10-b56f-6681921c7e71 on n-h2-master-1 Jul 01 11:35:22.415498 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-052ff840-e962-4d86-8085-526bb85ca579 req-07e0f12b-533c-4f83-8ade-6bcea765a93b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Jul 01 11:35:22.416110 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3625/7151] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:22.914855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:22.915390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:22.922228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:22.922731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:22.923424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:22.923857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:23.130537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:23.138057 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-05dd6fec-b089-4012-912a-9ed1d2a9fa83 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1363 microversion: 2.1 time: 0.227174 Jul 01 11:35:23.138646 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3527/7152] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:22 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:24.155854 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:24.156747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:24.163127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:24.163596 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:24.164407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:24.164861 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:24.293520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:24.301301 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a4466d5d-79d9-4cbc-806b-fbc27471c22c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1363 microversion: 2.1 time: 0.150443 Jul 01 11:35:24.302093 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3626/7153] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:24 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:25.318945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:25.319554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:25.326482 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:25.326920 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:25.327677 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:25.328108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:25.457511 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:25.465306 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aab2f87f-4d23-4166-9329-23b290b8abef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1363 microversion: 2.1 time: 0.151097 Jul 01 11:35:25.465874 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3528/7154] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:25 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:26.482762 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:26.483413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:26.490800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:26.493595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:26.493595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:26.493595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:26.630306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:26.637910 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9de5a82d-5959-43d0-bacf-32b2556a8b62 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1363 microversion: 2.1 time: 0.159012 Jul 01 11:35:26.640399 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3627/7155] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:26 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:27.654911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:27.655515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:27.662385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:27.663190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:27.663722 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:27.664156 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:27.819943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:27.828167 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-50a875db-4ba0-4cf1-a999-f90e0ddea7d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1363 microversion: 2.1 time: 0.176986 Jul 01 11:35:27.830367 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3529/7156] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:27 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:27.834270 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f5ee5dcf-0d22-45db-a75a-9a8c97e8bb97 req-6f43f1ad-787a-4b45-ac2e-b7da2870466d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222042a9-f802-4d10-b56f-6681921c7e71", "name": "network-vif-plugged", "status": "completed", "tag": "06622b8a-4ed2-4a0f-9b9c-d79bbbe9e932"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:27.842461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f5ee5dcf-0d22-45db-a75a-9a8c97e8bb97 req-6f43f1ad-787a-4b45-ac2e-b7da2870466d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:27.842929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f5ee5dcf-0d22-45db-a75a-9a8c97e8bb97 req-6f43f1ad-787a-4b45-ac2e-b7da2870466d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:27.854513 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f5ee5dcf-0d22-45db-a75a-9a8c97e8bb97 req-6f43f1ad-787a-4b45-ac2e-b7da2870466d service nova] Creating event network-vif-plugged:06622b8a-4ed2-4a0f-9b9c-d79bbbe9e932 for instance 222042a9-f802-4d10-b56f-6681921c7e71 on n-h2-master-1 Jul 01 11:35:27.859453 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f5ee5dcf-0d22-45db-a75a-9a8c97e8bb97 req-6f43f1ad-787a-4b45-ac2e-b7da2870466d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095789 Jul 01 11:35:27.860054 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3628/7157] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:35:28.847261 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:28.848746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:28.850680 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:28.851364 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:28.856968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:28.857440 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:28.858189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:28.858615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:28.986645 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:28.994600 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4d984d1a-b0d7-4ede-aa44-4463f1315d9a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1363 microversion: 2.1 time: 0.151235 Jul 01 11:35:28.995160 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3530/7158] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:28 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:30.008702 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:30.013986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:30.014819 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:30.021002 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:30.021625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:30.022405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:30.022853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:30.560441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:30.568427 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8f27cde0-6ef9-486c-9b90-07b151e4e0c8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1555 microversion: 2.1 time: 0.560759 Jul 01 11:35:30.569003 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3629/7159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:30 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1555 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:30.585579 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:30.586333 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:30.598807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:30.598807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:30.598807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:30.598807 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:30.726680 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:30.737447 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b20d7c72-4861-4182-ad70-a9bb8e08808c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1555 microversion: 2.1 time: 0.156221 Jul 01 11:35:30.738043 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3531/7160] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:30 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:35:33.839371 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9615980c-782f-4eaa-8434-93c08fda34b5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a05d3b0-f0c7-48af-9572-7cea2262adc9"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:33.840470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9615980c-782f-4eaa-8434-93c08fda34b5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:33.847465 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9615980c-782f-4eaa-8434-93c08fda34b5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:33.847931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9615980c-782f-4eaa-8434-93c08fda34b5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:33.848716 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9615980c-782f-4eaa-8434-93c08fda34b5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:33.849194 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9615980c-782f-4eaa-8434-93c08fda34b5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:34.544327 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9615980c-782f-4eaa-8434-93c08fda34b5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "POST /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708679 Jul 01 11:35:34.588536 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3630/7161] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 11:35:33 2022] POST /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:46.277770 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:46.278968 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:46.281872 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:46.282554 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=44 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:46.287904 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:46.288359 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:46.289198 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:46.289668 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:46.371584 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lazy-loading 'services' on Instance uuid 222042a9-f802-4d10-b56f-6681921c7e71 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:35:46.573552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8078092e-99fd-4c73-8f64-43c04e8b06f8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments/5a05d3b0-f0c7-48af-9572-7cea2262adc9" status: 202 len: 0 microversion: 2.1 time: 0.300053 Jul 01 11:35:46.574427 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3532/7162] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:35:46 2022] DELETE /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments/5a05d3b0-f0c7-48af-9572-7cea2262adc9 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 11:35:46.581413 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:46.588434 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:35:46.588598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a29a1bfe-9014-495a-aacc-5ad9d8448a94 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:46.589929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a29a1bfe-9014-495a-aacc-5ad9d8448a94 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:46.596664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a1bfe-9014-495a-aacc-5ad9d8448a94 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:46.597892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a1bfe-9014-495a-aacc-5ad9d8448a94 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:46.598773 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a1bfe-9014-495a-aacc-5ad9d8448a94 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:46.599346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a29a1bfe-9014-495a-aacc-5ad9d8448a94 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:46.630907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a29a1bfe-9014-495a-aacc-5ad9d8448a94 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051788 Jul 01 11:35:46.631496 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3631/7163] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:35:46 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:47.114153 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:35:47.114373 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:35:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:35:47.643211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff444fd8-0e5b-4914-9de4-44b6b5fad452 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:47.644341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ff444fd8-0e5b-4914-9de4-44b6b5fad452 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:47.652767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff444fd8-0e5b-4914-9de4-44b6b5fad452 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:47.653239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff444fd8-0e5b-4914-9de4-44b6b5fad452 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:47.654075 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff444fd8-0e5b-4914-9de4-44b6b5fad452 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:47.654508 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff444fd8-0e5b-4914-9de4-44b6b5fad452 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:47.687948 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff444fd8-0e5b-4914-9de4-44b6b5fad452 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049497 Jul 01 11:35:47.688637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3533/7164] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:35:47 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:48.700561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af30f9b7-73c2-4306-a1c5-fbb586d03544 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:48.701647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af30f9b7-73c2-4306-a1c5-fbb586d03544 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:48.711025 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af30f9b7-73c2-4306-a1c5-fbb586d03544 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:48.711494 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af30f9b7-73c2-4306-a1c5-fbb586d03544 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:48.712292 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af30f9b7-73c2-4306-a1c5-fbb586d03544 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:48.712740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af30f9b7-73c2-4306-a1c5-fbb586d03544 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:48.745665 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af30f9b7-73c2-4306-a1c5-fbb586d03544 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049277 Jul 01 11:35:48.746315 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3632/7165] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:35:48 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:49.757703 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5f0e70b2-212d-4a89-8a79-59ac96c5acef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:49.758631 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5f0e70b2-212d-4a89-8a79-59ac96c5acef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:49.765753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f0e70b2-212d-4a89-8a79-59ac96c5acef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:49.766207 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f0e70b2-212d-4a89-8a79-59ac96c5acef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:49.767001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f0e70b2-212d-4a89-8a79-59ac96c5acef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:49.767436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5f0e70b2-212d-4a89-8a79-59ac96c5acef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:50.072725 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5f0e70b2-212d-4a89-8a79-59ac96c5acef tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.319028 Jul 01 11:35:50.073320 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3534/7166] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:35:49 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments => generated 197 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:51.085305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4fe4735f-f634-490a-9378-00e33ce45b38 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:51.086243 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4fe4735f-f634-490a-9378-00e33ce45b38 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:51.093471 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe4735f-f634-490a-9378-00e33ce45b38 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:51.093934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe4735f-f634-490a-9378-00e33ce45b38 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:51.094704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe4735f-f634-490a-9378-00e33ce45b38 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:51.095468 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4fe4735f-f634-490a-9378-00e33ce45b38 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:51.124258 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4fe4735f-f634-490a-9378-00e33ce45b38 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Jul 01 11:35:51.124811 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3633/7167] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:35:51 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:52.135793 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-571a7705-c162-4d4a-9638-2e951b13ea81 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:52.136710 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-571a7705-c162-4d4a-9638-2e951b13ea81 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:52.143475 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-571a7705-c162-4d4a-9638-2e951b13ea81 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:52.143913 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-571a7705-c162-4d4a-9638-2e951b13ea81 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:52.144698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-571a7705-c162-4d4a-9638-2e951b13ea81 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:52.145123 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-571a7705-c162-4d4a-9638-2e951b13ea81 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:52.173566 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-571a7705-c162-4d4a-9638-2e951b13ea81 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041732 Jul 01 11:35:52.174108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3535/7168] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:35:52 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 11:35:52.184515 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:52.185062 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:52.196593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:52.197053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:52.197868 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:52.198318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:52.272825 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] HTTP exception thrown: Instance 222042a9-f802-4d10-b56f-6681921c7e71 is not attached to volume 5a05d3b0-f0c7-48af-9572-7cea2262adc9 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Request method failure captured: Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments/5a05d3b0-f0c7-48af-9572-7cea2262adc9 HTTP/1.1 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtvuGHkhfTMyDF3kc4hLQaa0qKncXkpQJhvOfub67qie3KNP00Y3dioSuCXqfXOBC_w2QnHkzmfQMxR91qqh4WqxtH1VEHL6GyqBLE0NG7Ki-011lqN02olAPnK5k3TPwwhFOTSwZEke2kdkKbUbwVlWi1QqC08GnmLWutxwNtnbhyI Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa65fc61d81042339854538f6ae1cc22", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: aa607e2fe55d4e8389ab5c1aaa782155 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 222042a9-f802-4d10-b56f-6681921c7e71 is not attached to volume 5a05d3b0-f0c7-48af-9572-7cea2262adc9 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': '222042a9-f802-4d10-b56f-6681921c7e71', 'id': '5a05d3b0-f0c7-48af-9572-7cea2262adc9'} Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5a05d3b0-f0c7-48af-9572-7cea2262adc9. Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222042a9-f802-4d10-b56f-6681921c7e71 is not attached to volume 5a05d3b0-f0c7-48af-9572-7cea2262adc9 Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:35:52.285690 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:35:52.290014 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:35:52.290014 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:35:52.290014 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222042a9-f802-4d10-b56f-6681921c7e71 is not attached to volume 5a05d3b0-f0c7-48af-9572-7cea2262adc9 Jul 01 11:35:52.290014 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:52.290014 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Returning 404 to user: Instance 222042a9-f802-4d10-b56f-6681921c7e71 is not attached to volume 5a05d3b0-f0c7-48af-9572-7cea2262adc9 {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:35:52.290014 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c4d3d6a-8db0-441e-b9a3-c2c2e3d974bf tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments/5a05d3b0-f0c7-48af-9572-7cea2262adc9" status: 404 len: 154 microversion: 2.1 time: 0.106670 Jul 01 11:35:52.290014 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3634/7169] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:35:52 2022] DELETE /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71/os-volume_attachments/5a05d3b0-f0c7-48af-9572-7cea2262adc9 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:35:55.808418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:55.808993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:55.816280 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:55.817089 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:55.817949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:55.818458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:55.843803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:35:56.151151 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5fdb6f0b-a4fa-4c66-9629-96f7d9e7113f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 204 len: 0 microversion: 2.1 time: 0.346333 Jul 01 11:35:56.151838 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3536/7170] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:35:55 2022] DELETE /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:35:56.161134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:56.161912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:56.170793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:56.171267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:56.172059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:56.172503 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:56.311483 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:56.321278 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-672addc6-38f4-494e-83cc-fe195f4c49b8 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1561 microversion: 2.1 time: 0.164984 Jul 01 11:35:56.321879 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3635/7171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:56 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:35:57.340411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:57.341115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:57.348744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:57.349220 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:57.349989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:57.350425 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:57.478274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:57.485808 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8509fbcf-ba03-47de-b45b-d4921c8b5e0a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1561 microversion: 2.1 time: 0.149623 Jul 01 11:35:57.486360 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3537/7172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:57 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:35:58.372002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-af7a0123-aa15-44e1-aea3-c2e650641fa1 req-d167ddf6-7059-411c-87f4-609243a84ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222042a9-f802-4d10-b56f-6681921c7e71", "name": "network-vif-deleted", "tag": "06622b8a-4ed2-4a0f-9b9c-d79bbbe9e932"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:58.382008 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-af7a0123-aa15-44e1-aea3-c2e650641fa1 req-d167ddf6-7059-411c-87f4-609243a84ee9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:58.383567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-af7a0123-aa15-44e1-aea3-c2e650641fa1 req-d167ddf6-7059-411c-87f4-609243a84ee9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:58.393941 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-af7a0123-aa15-44e1-aea3-c2e650641fa1 req-d167ddf6-7059-411c-87f4-609243a84ee9 service nova] Creating event network-vif-deleted:06622b8a-4ed2-4a0f-9b9c-d79bbbe9e932 for instance 222042a9-f802-4d10-b56f-6681921c7e71 on n-h2-master-1 Jul 01 11:35:58.399011 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-af7a0123-aa15-44e1-aea3-c2e650641fa1 req-d167ddf6-7059-411c-87f4-609243a84ee9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030755 Jul 01 11:35:58.399599 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3636/7173] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:58.503862 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:58.504512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:58.511511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:58.511961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:58.512729 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:58.513182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:58.575768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:35:58.583374 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c3fb1f07-a28a-4acd-9857-f7c10397bc2f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 200 len: 1348 microversion: 2.1 time: 0.084322 Jul 01 11:35:58.583939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3538/7174] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:58 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:35:59.601314 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:59.602026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 222042a9-f802-4d10-b56f-6681921c7e71] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:35:59.608371 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:59.608833 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:59.609676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:35:59.610126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:35:59.623542 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] HTTP exception thrown: Instance 222042a9-f802-4d10-b56f-6681921c7e71 could not be found. Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Request method failure captured: Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 HTTP/1.1 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtvuGHkhfTMyDF3kc4hLQaa0qKncXkpQJhvOfub67qie3KNP00Y3dioSuCXqfXOBC_w2QnHkzmfQMxR91qqh4WqxtH1VEHL6GyqBLE0NG7Ki-011lqN02olAPnK5k3TPwwhFOTSwZEke2kdkKbUbwVlWi1QqC08GnmLWutxwNtnbhyI Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa65fc61d81042339854538f6ae1cc22", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: aa607e2fe55d4e8389ab5c1aaa782155 Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 222042a9-f802-4d10-b56f-6681921c7e71 could not be found. Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '222042a9-f802-4d10-b56f-6681921c7e71'} Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222042a9-f802-4d10-b56f-6681921c7e71 could not be found. Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222042a9-f802-4d10-b56f-6681921c7e71 could not be found. Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:35:59.628581 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222042a9-f802-4d10-b56f-6681921c7e71 could not be found. Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Returning 404 to user: Instance 222042a9-f802-4d10-b56f-6681921c7e71 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4b3d9185-ffa6-46f7-9b1e-14d84addf64b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71" status: 404 len: 111 microversion: 2.1 time: 0.030591 Jul 01 11:35:59.633072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3637/7175] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:35:59 2022] GET /compute/v2.1/servers/222042a9-f802-4d10-b56f-6681921c7e71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 11:35:59.638992 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1a4ea5e-6962-49c8-bb89-184036e84036 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '.version_select at 0x7f6f90699940>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:35:59.720933 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1a4ea5e-6962-49c8-bb89-184036e84036 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1370525090" status: 202 len: 0 microversion: 2.1 time: 0.085717 Jul 01 11:35:59.721547 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3539/7176] 10.222.0.23 () {58 vars in 1277 bytes} [Fri Jul 1 11:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1370525090 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:35:59.738678 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-41b485d9-1ff5-4c7c-81fd-7994e2cf3ced tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Action: 'create', calling method: .version_select at 0x7f6f91b5dd30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1002136760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgtY//OvESqAoKckEVVjlDP3JtSSZ9bDhhHJ+lIAneQVztwABVYTQmAYtFf3teFXhOips0gPcS2/9Kwhd0C5zE6C0lqVJTNC4nMVg+Je6JXfk/HFIPGhFQmxrZILHDTIA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:59.752624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-41b485d9-1ff5-4c7c-81fd-7994e2cf3ced tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for project fa65fc61d81042339854538f6ae1cc22. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:35:59.757981 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-41b485d9-1ff5-4c7c-81fd-7994e2cf3ced tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for user aa607e2fe55d4e8389ab5c1aaa782155 and project fa65fc61d81042339854538f6ae1cc22. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:35:59.837645 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-41b485d9-1ff5-4c7c-81fd-7994e2cf3ced tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.103467 Jul 01 11:35:59.838250 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3638/7177] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:35:59 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:35:59.884665 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2071024386", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1002136760", "networks": [{"uuid": "120c5fc6-5682-4d55-a6ce-f6a04a0f9ac9"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:35:59.940826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] validate_networks() for [('120c5fc6-5682-4d55-a6ce-f6a04a0f9ac9', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:36:00.302252 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:36:00.302670 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:36:00.303134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:36:00.303540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:36:00.303969 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:36:00.312738 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:00.313208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:00.313998 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:00.314427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:00.332657 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for project fa65fc61d81042339854538f6ae1cc22. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:36:00.338241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Getting quotas for user aa607e2fe55d4e8389ab5c1aaa782155 and project fa65fc61d81042339854538f6ae1cc22. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:36:00.350656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:36:00.352947 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:36:00.489725 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-386089e9-48dc-466c-993d-6aa449c27f78 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608798 Jul 01 11:36:00.490295 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3540/7178] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:35:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 11:36:00.500251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1aa2cc79-7d97-4441-afcb-572dd72876e2 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:00.500871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1aa2cc79-7d97-4441-afcb-572dd72876e2 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:00.563084 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1aa2cc79-7d97-4441-afcb-572dd72876e2 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:00.571208 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1aa2cc79-7d97-4441-afcb-572dd72876e2 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1263 microversion: 2.1 time: 0.075031 Jul 01 11:36:00.571768 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3639/7179] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:00 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:01.588745 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:01.589387 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:01.596298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:01.602424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:01.602424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:01.602424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:01.659455 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:01.667612 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7391d609-1a18-44ea-87ce-fd484bb6a6af tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1267 microversion: 2.1 time: 0.083666 Jul 01 11:36:01.668181 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3541/7180] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:01 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:02.685561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:02.686415 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:02.694007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:02.694809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:02.695779 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:02.696240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:02.780070 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:02.788153 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9e7df6b4-738e-49da-a1d3-8c6dd5a78a40 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1333 microversion: 2.1 time: 0.106775 Jul 01 11:36:02.788728 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3640/7181] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:02 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1333 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:03.805417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:03.806598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:03.813196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:03.814384 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:03.815368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:03.815808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:03.976383 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:03.983936 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d3e9009-aee3-450c-8e46-b86051198feb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1363 microversion: 2.1 time: 0.182618 Jul 01 11:36:03.984490 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3542/7182] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:03 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:04.080516 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6b26e335-1b1f-4f54-aa2e-46d28ccc56c5 req-c9332c7f-0b17-4af8-b164-7411263eeb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0093eef3-0974-4e1e-87dd-887395056b0a", "tag": "87fa28de-dd73-41a4-8328-db8584b0c2f5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:36:04.089607 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6b26e335-1b1f-4f54-aa2e-46d28ccc56c5 req-c9332c7f-0b17-4af8-b164-7411263eeb31 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:04.095121 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6b26e335-1b1f-4f54-aa2e-46d28ccc56c5 req-c9332c7f-0b17-4af8-b164-7411263eeb31 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:04.101924 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6b26e335-1b1f-4f54-aa2e-46d28ccc56c5 req-c9332c7f-0b17-4af8-b164-7411263eeb31 service nova] Creating event network-changed:87fa28de-dd73-41a4-8328-db8584b0c2f5 for instance 0093eef3-0974-4e1e-87dd-887395056b0a on n-h2-master-1 Jul 01 11:36:04.106866 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6b26e335-1b1f-4f54-aa2e-46d28ccc56c5 req-c9332c7f-0b17-4af8-b164-7411263eeb31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034237 Jul 01 11:36:04.107583 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3641/7183] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:05.000340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:05.000945 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:05.008370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:05.008813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:05.009595 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:05.010028 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:05.137666 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:05.145256 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2ef76e52-1892-4827-b417-5a170810c306 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1363 microversion: 2.1 time: 0.148802 Jul 01 11:36:05.145818 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3543/7184] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:04 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:06.163481 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:06.164194 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:06.170484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:06.170948 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:06.171719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:06.172168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:06.300145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:06.307743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-84e5176a-0f92-4b95-90a6-27203906a28e tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1363 microversion: 2.1 time: 0.150029 Jul 01 11:36:06.308317 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3642/7185] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:06 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:07.324565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:07.325229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:07.332665 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:07.333108 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:07.333887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:07.334316 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:07.466562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:07.474633 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5becf25f-d816-439c-ad38-524a898a06c9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1363 microversion: 2.1 time: 0.154012 Jul 01 11:36:07.475210 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3544/7186] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:07 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:08.492076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:08.492701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:08.499750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:08.500216 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:08.500992 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:08.501469 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:08.629096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:08.636689 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6e9d63eb-2e1d-48e1-8ce5-6726362691b9 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1363 microversion: 2.1 time: 0.148536 Jul 01 11:36:08.637282 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3643/7187] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:08 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:09.654408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:09.655051 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:09.662467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:09.662992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:09.663769 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:09.664208 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:09.796975 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:09.806095 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-90981382-34fc-4be2-8398-43ff878a2e13 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1363 microversion: 2.1 time: 0.155673 Jul 01 11:36:09.806675 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3545/7188] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:09 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:09.868767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3ac7f660-6151-444b-ba84-c80e53a27441 req-beee47de-c095-497a-b0b9-872947da13fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0093eef3-0974-4e1e-87dd-887395056b0a", "name": "network-vif-plugged", "status": "completed", "tag": "87fa28de-dd73-41a4-8328-db8584b0c2f5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:36:09.878466 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3ac7f660-6151-444b-ba84-c80e53a27441 req-beee47de-c095-497a-b0b9-872947da13fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:09.878926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3ac7f660-6151-444b-ba84-c80e53a27441 req-beee47de-c095-497a-b0b9-872947da13fb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:09.889907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3ac7f660-6151-444b-ba84-c80e53a27441 req-beee47de-c095-497a-b0b9-872947da13fb service nova] Creating event network-vif-plugged:87fa28de-dd73-41a4-8328-db8584b0c2f5 for instance 0093eef3-0974-4e1e-87dd-887395056b0a on n-h2-master-1 Jul 01 11:36:09.899312 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3ac7f660-6151-444b-ba84-c80e53a27441 req-beee47de-c095-497a-b0b9-872947da13fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029832 Jul 01 11:36:09.899312 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3644/7189] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:10.823444 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:10.824059 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:10.826113 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:36:10.826851 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:36:10.832638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:10.833138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:10.833941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:10.834376 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:10.963523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:10.971217 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-70a9d7e3-9dbb-4cdf-9865-2883cb32211b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1363 microversion: 2.1 time: 0.151669 Jul 01 11:36:10.971792 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3546/7190] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:10 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:36:11.986060 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:36:11.991781 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:11.992501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:11.998761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:11.999274 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:12.003333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:12.003333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:12.135687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:12.143151 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8ce93c88-2da6-4ccc-b42c-8c30339fd5f6 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1554 microversion: 2.1 time: 0.158099 Jul 01 11:36:12.143727 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3645/7191] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:11 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:12.159285 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:12.160396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:12.167215 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:12.167659 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:12.168413 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:12.168849 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:12.297097 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:12.300533 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:36:12.304950 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4bc95eed-9ec0-45ae-b3da-48f6d379ff5f tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1554 microversion: 2.1 time: 0.149584 Jul 01 11:36:12.305545 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3547/7192] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:12 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:15.269580 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b4d16a35-3250-4559-a604-5e00353d366c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11fa57e6-62e1-4ec9-9f2f-4bbacd56debb"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:36:15.270681 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b4d16a35-3250-4559-a604-5e00353d366c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:15.277629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4d16a35-3250-4559-a604-5e00353d366c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:15.278094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4d16a35-3250-4559-a604-5e00353d366c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:15.278873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4d16a35-3250-4559-a604-5e00353d366c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:15.279324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b4d16a35-3250-4559-a604-5e00353d366c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:16.006008 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b4d16a35-3250-4559-a604-5e00353d366c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "POST /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740217 Jul 01 11:36:16.006890 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3646/7193] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 11:36:15 2022] POST /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:27.721170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:27.721587 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:27.724824 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:36:27.729924 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:27.730361 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:27.731160 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:27.731593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:27.813346 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lazy-loading 'services' on Instance uuid 0093eef3-0974-4e1e-87dd-887395056b0a {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:36:28.009544 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ae7c792c-5036-44b7-8ef6-f6f7c0e4900c tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments/11fa57e6-62e1-4ec9-9f2f-4bbacd56debb" status: 202 len: 0 microversion: 2.1 time: 0.292375 Jul 01 11:36:28.010149 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3548/7194] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:36:27 2022] DELETE /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments/11fa57e6-62e1-4ec9-9f2f-4bbacd56debb => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:36:28.017021 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:36:28.017853 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:36:28.022625 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99e2ceb6-d418-4b25-b21f-a9dc28deb6d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:28.023643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99e2ceb6-d418-4b25-b21f-a9dc28deb6d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:28.029862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99e2ceb6-d418-4b25-b21f-a9dc28deb6d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:28.030320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99e2ceb6-d418-4b25-b21f-a9dc28deb6d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:28.031092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99e2ceb6-d418-4b25-b21f-a9dc28deb6d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:28.031537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99e2ceb6-d418-4b25-b21f-a9dc28deb6d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:28.062584 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99e2ceb6-d418-4b25-b21f-a9dc28deb6d0 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Jul 01 11:36:28.063151 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3647/7195] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:36:28 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:29.074875 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9a4cb062-ae4e-4e3d-876b-038ed65de9bb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:29.076603 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9a4cb062-ae4e-4e3d-876b-038ed65de9bb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:29.084547 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a4cb062-ae4e-4e3d-876b-038ed65de9bb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:29.085700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a4cb062-ae4e-4e3d-876b-038ed65de9bb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:29.086494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a4cb062-ae4e-4e3d-876b-038ed65de9bb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:29.086929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a4cb062-ae4e-4e3d-876b-038ed65de9bb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:29.120991 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9a4cb062-ae4e-4e3d-876b-038ed65de9bb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050368 Jul 01 11:36:29.124892 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3549/7196] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:36:29 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:30.133351 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9c144b8e-7721-42ed-9c1f-f86398500891 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:30.134327 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9c144b8e-7721-42ed-9c1f-f86398500891 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:30.142924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c144b8e-7721-42ed-9c1f-f86398500891 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:30.143395 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c144b8e-7721-42ed-9c1f-f86398500891 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:30.144230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c144b8e-7721-42ed-9c1f-f86398500891 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:30.144683 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9c144b8e-7721-42ed-9c1f-f86398500891 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:30.177877 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9c144b8e-7721-42ed-9c1f-f86398500891 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049313 Jul 01 11:36:30.178530 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3648/7197] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:36:30 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:31.189819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4274f35f-3882-486b-8e6a-0a97aa6aaf1d tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:31.190650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4274f35f-3882-486b-8e6a-0a97aa6aaf1d tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:31.197935 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4274f35f-3882-486b-8e6a-0a97aa6aaf1d tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:31.198388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4274f35f-3882-486b-8e6a-0a97aa6aaf1d tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:31.199157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4274f35f-3882-486b-8e6a-0a97aa6aaf1d tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:31.199593 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4274f35f-3882-486b-8e6a-0a97aa6aaf1d tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:31.229411 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4274f35f-3882-486b-8e6a-0a97aa6aaf1d tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Jul 01 11:36:31.229977 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3550/7198] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:36:31 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:32.240956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-51918369-b4b1-4e05-b167-29d28f44b230 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:32.241927 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-51918369-b4b1-4e05-b167-29d28f44b230 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:32.249407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51918369-b4b1-4e05-b167-29d28f44b230 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:32.249879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51918369-b4b1-4e05-b167-29d28f44b230 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:32.250661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51918369-b4b1-4e05-b167-29d28f44b230 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:32.251109 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-51918369-b4b1-4e05-b167-29d28f44b230 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:32.280892 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-51918369-b4b1-4e05-b167-29d28f44b230 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Jul 01 11:36:32.281493 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3649/7199] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:36:32 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:36:33.292917 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9226c6e3-304f-45b0-8ead-a66f471df96b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:33.293868 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9226c6e3-304f-45b0-8ead-a66f471df96b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:33.299901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9226c6e3-304f-45b0-8ead-a66f471df96b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:33.300346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9226c6e3-304f-45b0-8ead-a66f471df96b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:33.301096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9226c6e3-304f-45b0-8ead-a66f471df96b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:33.301553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9226c6e3-304f-45b0-8ead-a66f471df96b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:33.329178 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9226c6e3-304f-45b0-8ead-a66f471df96b tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041171 Jul 01 11:36:33.329755 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3551/7200] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:36:33 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 11:36:33.339950 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:33.340468 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:33.347414 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:33.347882 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:33.348663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:33.349119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:33.424377 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] HTTP exception thrown: Instance 0093eef3-0974-4e1e-87dd-887395056b0a is not attached to volume 11fa57e6-62e1-4ec9-9f2f-4bbacd56debb Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Request method failure captured: Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments/11fa57e6-62e1-4ec9-9f2f-4bbacd56debb HTTP/1.1 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtvuGHkhfTMyDF3kc4hLQaa0qKncXkpQJhvOfub67qie3KNP00Y3dioSuCXqfXOBC_w2QnHkzmfQMxR91qqh4WqxtH1VEHL6GyqBLE0NG7Ki-011lqN02olAPnK5k3TPwwhFOTSwZEke2kdkKbUbwVlWi1QqC08GnmLWutxwNtnbhyI Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa65fc61d81042339854538f6ae1cc22", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: aa607e2fe55d4e8389ab5c1aaa782155 Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 0093eef3-0974-4e1e-87dd-887395056b0a is not attached to volume 11fa57e6-62e1-4ec9-9f2f-4bbacd56debb Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': '0093eef3-0974-4e1e-87dd-887395056b0a', 'id': '11fa57e6-62e1-4ec9-9f2f-4bbacd56debb'} Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 11fa57e6-62e1-4ec9-9f2f-4bbacd56debb. Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0093eef3-0974-4e1e-87dd-887395056b0a is not attached to volume 11fa57e6-62e1-4ec9-9f2f-4bbacd56debb Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:36:33.426078 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:36:33.430434 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:36:33.430434 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:36:33.430434 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0093eef3-0974-4e1e-87dd-887395056b0a is not attached to volume 11fa57e6-62e1-4ec9-9f2f-4bbacd56debb Jul 01 11:36:33.430434 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:33.430434 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Returning 404 to user: Instance 0093eef3-0974-4e1e-87dd-887395056b0a is not attached to volume 11fa57e6-62e1-4ec9-9f2f-4bbacd56debb {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:36:33.430434 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-39d9bf80-de1b-4f58-a2af-1b18a9ec69cb tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments/11fa57e6-62e1-4ec9-9f2f-4bbacd56debb" status: 404 len: 154 microversion: 2.1 time: 0.091679 Jul 01 11:36:33.430434 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3650/7201] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:36:33 2022] DELETE /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a/os-volume_attachments/11fa57e6-62e1-4ec9-9f2f-4bbacd56debb => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:36:36.936495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:36.936983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:36.944584 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:36.945031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:36.945824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:36.946256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:36.972892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:36:37.245751 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-64394952-729b-45d5-aba6-eb331b361b04 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 204 len: 0 microversion: 2.1 time: 0.313646 Jul 01 11:36:37.246390 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3552/7202] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:36:36 2022] DELETE /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:36:37.260493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:37.261284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:37.267986 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:37.268439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:37.269248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:37.269693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:37.412707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:37.420867 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1577382-2a78-4664-b2c8-297e24d072f5 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1560 microversion: 2.1 time: 0.165014 Jul 01 11:36:37.421475 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3651/7203] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:37 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:38.438794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:38.439554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:38.446876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:38.451553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:38.451553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:38.451553 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:38.575966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:38.583512 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eec3542b-8cee-4a75-b5dc-cab9310e8022 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1560 microversion: 2.1 time: 0.148981 Jul 01 11:36:38.584122 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3553/7204] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:38 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:39.348349 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-bd807591-0a75-4525-ac1f-09d46eeebfcb req-ac3aa766-1232-4a3e-9437-8b21ce38a5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0093eef3-0974-4e1e-87dd-887395056b0a", "name": "network-vif-deleted", "tag": "87fa28de-dd73-41a4-8328-db8584b0c2f5"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:36:39.357484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-bd807591-0a75-4525-ac1f-09d46eeebfcb req-ac3aa766-1232-4a3e-9437-8b21ce38a5ac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:39.358294 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-bd807591-0a75-4525-ac1f-09d46eeebfcb req-ac3aa766-1232-4a3e-9437-8b21ce38a5ac service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:39.371770 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-bd807591-0a75-4525-ac1f-09d46eeebfcb req-ac3aa766-1232-4a3e-9437-8b21ce38a5ac service nova] Creating event network-vif-deleted:87fa28de-dd73-41a4-8328-db8584b0c2f5 for instance 0093eef3-0974-4e1e-87dd-887395056b0a on n-h2-master-1 Jul 01 11:36:39.376926 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-bd807591-0a75-4525-ac1f-09d46eeebfcb req-ac3aa766-1232-4a3e-9437-8b21ce38a5ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032765 Jul 01 11:36:39.377585 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3652/7205] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:36:39.601337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:39.601990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:39.611827 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:39.612375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:39.613190 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:39.613674 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:39.657550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:39.658074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:39.658598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lazy-loading 'fault' on Instance uuid 0093eef3-0974-4e1e-87dd-887395056b0a {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:36:39.703189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa607e2fe55d4e8389ab5c1aaa782155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa65fc61d81042339854538f6ae1cc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:36:39.712768 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-06fe5920-1427-4be7-a831-b8e9f1dafb82 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 200 len: 1353 microversion: 2.1 time: 0.115333 Jul 01 11:36:39.713542 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3554/7206] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:39 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 1353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:36:40.731290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:40.732003 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] [instance: 0093eef3-0974-4e1e-87dd-887395056b0a] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:36:40.739181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:40.739642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:40.740410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:36:40.741391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:36:40.754599 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] HTTP exception thrown: Instance 0093eef3-0974-4e1e-87dd-887395056b0a could not be found. Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Request method failure captured: Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a HTTP/1.1 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtvuGHkhfTMyDF3kc4hLQaa0qKncXkpQJhvOfub67qie3KNP00Y3dioSuCXqfXOBC_w2QnHkzmfQMxR91qqh4WqxtH1VEHL6GyqBLE0NG7Ki-011lqN02olAPnK5k3TPwwhFOTSwZEke2kdkKbUbwVlWi1QqC08GnmLWutxwNtnbhyI Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa65fc61d81042339854538f6ae1cc22", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa65fc61d81042339854538f6ae1cc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: fa65fc61d81042339854538f6ae1cc22 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-317989506 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: aa607e2fe55d4e8389ab5c1aaa782155 Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestEncryptedCinderVolumes-317989506-project Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 0093eef3-0974-4e1e-87dd-887395056b0a could not be found. Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '0093eef3-0974-4e1e-87dd-887395056b0a'} Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0093eef3-0974-4e1e-87dd-887395056b0a could not be found. Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0093eef3-0974-4e1e-87dd-887395056b0a could not be found. Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:36:40.756785 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0093eef3-0974-4e1e-87dd-887395056b0a could not be found. Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Returning 404 to user: Instance 0093eef3-0974-4e1e-87dd-887395056b0a could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38f29043-3861-4fc7-9642-2bcb7ca5c17a tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a" status: 404 len: 111 microversion: 2.1 time: 0.031292 Jul 01 11:36:40.763234 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3653/7207] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:36:40 2022] GET /compute/v2.1/servers/0093eef3-0974-4e1e-87dd-887395056b0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:36:40.769010 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dad9e75c-512a-4d27-8cd6-921fcacd5c71 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] Calling method '.version_select at 0x7f6f907eb430>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:36:40.854347 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dad9e75c-512a-4d27-8cd6-921fcacd5c71 tempest-TestEncryptedCinderVolumes-317989506 tempest-TestEncryptedCinderVolumes-317989506-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1002136760" status: 202 len: 0 microversion: 2.1 time: 0.089057 Jul 01 11:36:40.854938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3555/7208] 10.222.0.23 () {58 vars in 1277 bytes} [Fri Jul 1 11:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1002136760 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:37:12.930908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-25470d76-f33f-47bc-a97c-5ca1bf03cc35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'create', calling method: .version_select at 0x7f6f96fe1310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-118665239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHj+qEIfuS879/4FxBhZFiu6M0IgeSUBMShT4pHvHMha7E6sQg5Rt0zUvHeXP4NZdwLUQyepeEvHIxEHFCZqkqdwkuI0foprd1nZQeRtAO97/xrtQq67TPWZ/s/Xn/org=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:12.935088 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=14 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:12.935780 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:12.946523 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-25470d76-f33f-47bc-a97c-5ca1bf03cc35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for project 57c6e095b37444c69ee3aa71bd051270. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:37:12.951638 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-25470d76-f33f-47bc-a97c-5ca1bf03cc35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for user 12d77ce727d04d88b3593b123504535a and project 57c6e095b37444c69ee3aa71bd051270. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:37:13.025372 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-25470d76-f33f-47bc-a97c-5ca1bf03cc35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.098473 Jul 01 11:37:13.025942 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3654/7209] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:37:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:37:13.102014 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:13.102814 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:13.106803 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1529057082", "imageRef": "88190d01-edef-40c5-89a5-4bbf8383c2df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-118665239", "networks": [{"uuid": "54aa9c5f-dcdc-4b8a-8f91-1c34958ba209"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:13.155853 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] validate_networks() for [('54aa9c5f-dcdc-4b8a-8f91-1c34958ba209', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:37:13.628121 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:37:13.628544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:37:13.629210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:37:13.629637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:37:13.630077 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:37:13.639455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:13.642995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:13.642995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:13.642995 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:13.658398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for project 57c6e095b37444c69ee3aa71bd051270. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:37:13.664341 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for user 12d77ce727d04d88b3593b123504535a and project 57c6e095b37444c69ee3aa71bd051270. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:37:13.676394 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:37:13.678707 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88190d01-edef-40c5-89a5-4bbf8383c2df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:37:13.796010 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b790b958-b6a8-405d-a76d-ca24ac9e9c90 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695946 Jul 01 11:37:13.796657 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3556/7210] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:37:13.807168 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-575271bc-15d7-4641-af8d-5d162bd5b250 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:13.807790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-575271bc-15d7-4641-af8d-5d162bd5b250 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:13.862582 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-575271bc-15d7-4641-af8d-5d162bd5b250 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:13.869807 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-575271bc-15d7-4641-af8d-5d162bd5b250 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1258 microversion: 2.1 time: 0.066699 Jul 01 11:37:13.870401 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3655/7211] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:13 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:14.888100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-499ec208-04a9-4ab1-943a-bf106cf627d7 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:14.888716 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-499ec208-04a9-4ab1-943a-bf106cf627d7 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:14.945643 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-499ec208-04a9-4ab1-943a-bf106cf627d7 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:14.952360 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-499ec208-04a9-4ab1-943a-bf106cf627d7 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1258 microversion: 2.1 time: 0.069085 Jul 01 11:37:14.952924 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3557/7212] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:14 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:15.968898 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:15.969660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:15.978262 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:15.978719 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:15.979514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:15.979958 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:16.042710 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:16.050412 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-776e4c39-73de-4438-b016-c0040a104744 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1310 microversion: 2.1 time: 0.085405 Jul 01 11:37:16.050965 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3656/7213] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:15 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:17.078306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:17.078908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:17.091163 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:17.091747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:17.092640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:17.093086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:17.303702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:17.312028 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c21b2f78-9fb9-49ea-9184-28c3bbd46660 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.237558 Jul 01 11:37:17.328365 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3558/7214] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:17 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:18.335980 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:18.336603 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:18.343592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:18.344059 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:18.344838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:18.345411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:18.480450 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:18.489690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c943474f-9101-4cc8-9886-058d5f0216dd tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.157094 Jul 01 11:37:18.499255 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3657/7215] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:18 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:19.509213 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:19.510982 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:19.520276 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:19.521542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:19.522437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:19.523000 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:19.660492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:19.668635 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1ad65d82-a66b-4e54-b0f4-fc8ac1db3583 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.164851 Jul 01 11:37:19.669484 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3559/7216] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:19 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:20.686853 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:20.689456 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:20.697980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:20.698827 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:20.699852 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:20.700462 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:20.842264 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:20.850324 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-db70461a-a9f8-458f-b460-05693cdfaab4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.167869 Jul 01 11:37:20.853253 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3658/7217] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:20 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:21.867921 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:21.868654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:21.876032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:21.876478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:21.877283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:21.877719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:22.016447 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:22.024982 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2c1bb07c-b7d2-4b24-8d21-50a5cfe6391f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.161606 Jul 01 11:37:22.034404 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3560/7218] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:21 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:23.043145 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:23.043841 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:23.051832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:23.052290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:23.053261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:23.053715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:23.196957 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:23.204696 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f16d640-9d87-4f7e-9e05-bddb429e1f1c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.166218 Jul 01 11:37:23.205493 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3659/7219] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:23 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:24.221430 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:24.224586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:24.225045 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:24.229987 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:24.230485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:24.231255 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:24.231695 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:24.359479 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:24.367531 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5dce2920-2dc8-4fe4-b70b-3d4481f3a1d4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.150072 Jul 01 11:37:24.368109 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3561/7220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:24 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:25.384707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:25.386670 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:25.388697 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:25.394804 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:25.401374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:25.401374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:25.401374 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:25.573533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:25.584349 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-01075f42-12d4-4df6-bc55-85001d9496e4 req-dd910ce6-2dfd-490a-9a48-6cf3d38eddfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a582c-f4e5-4b97-83a7-1f377117d1ef", "tag": "7263fd6b-8c6f-4989-b0bf-c04171939c17"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:25.590357 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-41667289-4d8b-4621-b4b8-35ef1cb2ae07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.209372 Jul 01 11:37:25.603998 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3660/7221] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:25 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:25.607016 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:25.612144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-01075f42-12d4-4df6-bc55-85001d9496e4 req-dd910ce6-2dfd-490a-9a48-6cf3d38eddfe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:25.612590 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-01075f42-12d4-4df6-bc55-85001d9496e4 req-dd910ce6-2dfd-490a-9a48-6cf3d38eddfe service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:25.628832 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-01075f42-12d4-4df6-bc55-85001d9496e4 req-dd910ce6-2dfd-490a-9a48-6cf3d38eddfe service nova] Creating event network-changed:7263fd6b-8c6f-4989-b0bf-c04171939c17 for instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef on n-h2-master-1 Jul 01 11:37:25.634924 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-01075f42-12d4-4df6-bc55-85001d9496e4 req-dd910ce6-2dfd-490a-9a48-6cf3d38eddfe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056431 Jul 01 11:37:25.635914 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3562/7222] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:37:26.471618 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:37:26.472177 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:37:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:37:26.611248 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:26.611876 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:26.618871 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:26.619384 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:26.620166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:26.620617 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:26.751743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:26.759816 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9500e3fe-0bf9-49fb-b793-17f189e2256d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.152668 Jul 01 11:37:26.760393 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3661/7223] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:26 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:27.777475 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:27.778384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:27.784785 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:27.785270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:27.786583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:27.787026 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:27.924691 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:27.932703 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-85094b94-5675-4bbf-ba2f-548b6ab7d915 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.160772 Jul 01 11:37:27.933510 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3563/7224] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:27 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:28.949698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:28.950318 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:28.957175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:28.957631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:28.958960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:28.959407 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:29.093579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:29.101266 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d97385b2-a251-4528-9991-661dab9b4c08 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.155674 Jul 01 11:37:29.101831 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3662/7225] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:28 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:30.119019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:30.120231 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:30.128450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:30.128917 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:30.129721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:30.130168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:30.263269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:30.275076 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-78cdcc3a-3cf2-4c1b-8664-813619835ebe tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.156296 Jul 01 11:37:30.275076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3564/7226] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:30 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:31.287789 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:31.288413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:31.295492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:31.295955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:31.296733 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:31.297210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:31.429662 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:31.437072 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e931b2fd-34f0-4675-99e9-92f219e6c86a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.153185 Jul 01 11:37:31.437670 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3663/7227] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:31 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:32.222508 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-0fd070e3-8b35-4ce5-8e74-ab13e97ac5c1 req-28b57325-acaa-48d6-9beb-7a0750342d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0a582c-f4e5-4b97-83a7-1f377117d1ef", "name": "network-vif-plugged", "status": "completed", "tag": "7263fd6b-8c6f-4989-b0bf-c04171939c17"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:32.231635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0fd070e3-8b35-4ce5-8e74-ab13e97ac5c1 req-28b57325-acaa-48d6-9beb-7a0750342d8c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:32.232080 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-0fd070e3-8b35-4ce5-8e74-ab13e97ac5c1 req-28b57325-acaa-48d6-9beb-7a0750342d8c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:32.242961 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-0fd070e3-8b35-4ce5-8e74-ab13e97ac5c1 req-28b57325-acaa-48d6-9beb-7a0750342d8c service nova] Creating event network-vif-plugged:7263fd6b-8c6f-4989-b0bf-c04171939c17 for instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef on n-h2-master-1 Jul 01 11:37:32.248154 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-0fd070e3-8b35-4ce5-8e74-ab13e97ac5c1 req-28b57325-acaa-48d6-9beb-7a0750342d8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029542 Jul 01 11:37:32.248742 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3565/7228] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:37:32.453674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:32.454304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:32.461924 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:32.462410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:32.463177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:32.463632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:32.590943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:32.598529 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be68b416-badf-4cf4-b7ed-c8876bc2528b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.148802 Jul 01 11:37:32.599759 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3664/7229] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:32 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:33.617268 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:33.617974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:33.624479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:33.624934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:33.625745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:33.626217 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:33.761304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:33.768937 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b77badce-d602-4bcf-aef2-6666e741ee4f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1358 microversion: 2.1 time: 0.156777 Jul 01 11:37:33.769533 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3566/7230] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:33 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:34.785010 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:34.785685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:34.792103 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:34.792572 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:34.793391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:34.793841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:34.923533 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:34.931727 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-75185880-76cb-4569-9f75-31de5c262090 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1548 microversion: 2.1 time: 0.150735 Jul 01 11:37:34.932318 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3665/7231] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:34 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:34.948701 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:34.949367 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:34.956289 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:34.956755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:34.957543 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:34.957981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:35.091813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:35.100020 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc29a90b-3226-48c6-9ebf-d864d8f7f16c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1548 microversion: 2.1 time: 0.155196 Jul 01 11:37:35.100596 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3567/7232] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:34 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:35.116127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:35.119548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:35.120329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Searching by: {'deleted': False, 'project_id': '57c6e095b37444c69ee3aa71bd051270'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 11:37:35.125763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:35.126232 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:35.127049 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:35.127502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:35.151182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 11:37:35.178267 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-17aee85b-4fbc-4429-8f96-a7b62c0120f2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066513 Jul 01 11:37:35.178778 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3666/7233] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 11:37:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:37:35.189319 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:35.189967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:35.196256 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:35.196707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:35.197503 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:35.197941 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:35.327855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:35.336931 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a08c1e82-a555-4056-95e7-89f9d3c3fc0c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1548 microversion: 2.1 time: 0.151857 Jul 01 11:37:35.337562 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3568/7234] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:35 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:37:38.234985 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-61b9f06d-9e84-4502-972e-ea3d65a8e2cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5283b273-3d7d-46a9-9981-b89da0e74298"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:38.236075 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-61b9f06d-9e84-4502-972e-ea3d65a8e2cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:38.243085 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61b9f06d-9e84-4502-972e-ea3d65a8e2cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:38.243550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61b9f06d-9e84-4502-972e-ea3d65a8e2cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:38.244333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61b9f06d-9e84-4502-972e-ea3d65a8e2cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:38.244782 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-61b9f06d-9e84-4502-972e-ea3d65a8e2cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:38.893637 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-61b9f06d-9e84-4502-972e-ea3d65a8e2cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662232 Jul 01 11:37:38.894164 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3667/7235] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 11:37:38 2022] POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:37:53.198604 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:53.199217 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:53.202212 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:53.202879 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=60 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:53.208262 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:53.208705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:53.209513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:53.209947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:53.340167 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:53.348943 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-47af4f43-3fde-4584-abb2-1b8756e836ac tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1594 microversion: 2.1 time: 0.154108 Jul 01 11:37:53.349639 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3569/7236] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:53 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:37:55.239235 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-24e822a2-d14c-4f7f-89d7-ec018ee8d5a3 req-9e58de7d-b3bb-4c56-a439-4ec4eca0925a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a582c-f4e5-4b97-83a7-1f377117d1ef", "tag": "7263fd6b-8c6f-4989-b0bf-c04171939c17"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:55.247447 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:55.248727 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:55.249263 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:37:55.251492 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-24e822a2-d14c-4f7f-89d7-ec018ee8d5a3 req-9e58de7d-b3bb-4c56-a439-4ec4eca0925a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:55.251990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-24e822a2-d14c-4f7f-89d7-ec018ee8d5a3 req-9e58de7d-b3bb-4c56-a439-4ec4eca0925a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:55.264269 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-24e822a2-d14c-4f7f-89d7-ec018ee8d5a3 req-9e58de7d-b3bb-4c56-a439-4ec4eca0925a service nova] Creating event network-changed:7263fd6b-8c6f-4989-b0bf-c04171939c17 for instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef on n-h2-master-1 Jul 01 11:37:55.269747 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-24e822a2-d14c-4f7f-89d7-ec018ee8d5a3 req-9e58de7d-b3bb-4c56-a439-4ec4eca0925a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034954 Jul 01 11:37:55.270955 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3668/7237] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:37:57.758765 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-648629841"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:57.759310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:57.766368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:57.766818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:57.770427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:57.770427 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:57.893367 n-d-master-1 devstack@n-api.service[119765]: INFO nova.network.security_group_api [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Adding security group b8656197-8ab1-4bb5-a45e-70a50ae05611 to port 7263fd6b-8c6f-4989-b0bf-c04171939c17 Jul 01 11:37:58.290411 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-32765d9a-4b06-4d7a-b33d-d651c45b3d82 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.535475 Jul 01 11:37:58.295497 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3570/7238] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:37:57 2022] POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:37:58.303473 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:37:58.305946 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:37:58.309228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d89f4cb7-4ede-42c3-ae9b-2f72be2eff3e req-941bc2f5-a0ec-419a-8a18-cb91c246dd64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a582c-f4e5-4b97-83a7-1f377117d1ef", "tag": "7263fd6b-8c6f-4989-b0bf-c04171939c17"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:37:58.312877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:58.313749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:58.314816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:58.315483 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:58.337031 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d89f4cb7-4ede-42c3-ae9b-2f72be2eff3e req-941bc2f5-a0ec-419a-8a18-cb91c246dd64 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:37:58.337563 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d89f4cb7-4ede-42c3-ae9b-2f72be2eff3e req-941bc2f5-a0ec-419a-8a18-cb91c246dd64 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:37:58.352987 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d89f4cb7-4ede-42c3-ae9b-2f72be2eff3e req-941bc2f5-a0ec-419a-8a18-cb91c246dd64 service nova] Creating event network-changed:7263fd6b-8c6f-4989-b0bf-c04171939c17 for instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef on n-h2-master-1 Jul 01 11:37:58.363052 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d89f4cb7-4ede-42c3-ae9b-2f72be2eff3e req-941bc2f5-a0ec-419a-8a18-cb91c246dd64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062013 Jul 01 11:37:58.364952 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3571/7239] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:37:58.597183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:37:58.608012 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-471fcc47-cf6b-4852-bb28-013a8d95d4d9 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1757 microversion: 2.1 time: 0.311019 Jul 01 11:37:58.609206 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3669/7240] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:37:58 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1757 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:39:07.123771 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:39:07.124321 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:39:36.669962 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:39:36.670870 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:39:36.671464 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:39:36.672210 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:39:36.676467 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-947af7b2-167b-483f-a4db-8b44969838a8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:39:36.677525 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-947af7b2-167b-483f-a4db-8b44969838a8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:39:36.683617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-947af7b2-167b-483f-a4db-8b44969838a8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:36.687708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-947af7b2-167b-483f-a4db-8b44969838a8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:36.687708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-947af7b2-167b-483f-a4db-8b44969838a8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:36.687708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-947af7b2-167b-483f-a4db-8b44969838a8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:36.909585 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-947af7b2-167b-483f-a4db-8b44969838a8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.241934 Jul 01 11:39:36.910303 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3572/7241] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:39:36 2022] POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:39:36.916539 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:39:36.917316 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:39:36.918753 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:39:36.922800 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:39:36.923430 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:39:36.929921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:36.930378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:36.931223 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:36.931670 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:37.342842 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:39:37.351791 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a8a69b25-b19d-484d-bbf3-c23a6135e3be tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1759 microversion: 2.1 time: 0.437402 Jul 01 11:39:37.352407 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3670/7242] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:39:36 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1759 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:39:38.371802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:39:38.372537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:39:38.380896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:38.381512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:38.382309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:38.382754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:38.401578 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43120. Jul 01 11:39:38.402299 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43118. Jul 01 11:39:38.585767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:39:38.593899 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0a7c0a11-ebd9-4f08-96ed-a3c20a971779 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1764 microversion: 2.1 time: 0.228418 Jul 01 11:39:38.594463 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3573/7243] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:39:38 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1764 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:39:39.612403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:39:39.613015 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:39:39.623748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:39.624251 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:39.625072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:39:39.625550 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:39:39.631207 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43126. Jul 01 11:39:39.768717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:39:39.776795 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aa7bf986-5126-4a03-b0a0-50b2b9ee4e07 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1757 microversion: 2.1 time: 0.168361 Jul 01 11:39:39.777901 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3671/7244] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:39:39 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:40:46.480716 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:40:46.481419 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:40:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:40:53.476974 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:40:53.478713 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:40:53.482929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-648629841"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:40:53.483470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:40:53.489434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:53.490394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:53.490627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:53.491054 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:53.622325 n-d-master-1 devstack@n-api.service[119765]: INFO nova.network.security_group_api [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Removing security group b8656197-8ab1-4bb5-a45e-70a50ae05611 from port 7263fd6b-8c6f-4989-b0bf-c04171939c17 Jul 01 11:40:54.004533 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4de12a4c-ea7f-4d98-a14f-bc12ae6f2f3b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.529263 Jul 01 11:40:54.007469 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3574/7245] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:40:53 2022] POST /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:40:54.012244 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:40:54.013068 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:40:54.115154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-eb47b699-347f-4825-94e9-ba59b962ae45 req-5bef11c3-2dbb-4753-a310-750d9539dc8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a582c-f4e5-4b97-83a7-1f377117d1ef", "tag": "7263fd6b-8c6f-4989-b0bf-c04171939c17"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:40:54.131268 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-eb47b699-347f-4825-94e9-ba59b962ae45 req-5bef11c3-2dbb-4753-a310-750d9539dc8d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:54.131640 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-eb47b699-347f-4825-94e9-ba59b962ae45 req-5bef11c3-2dbb-4753-a310-750d9539dc8d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:54.143645 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-eb47b699-347f-4825-94e9-ba59b962ae45 req-5bef11c3-2dbb-4753-a310-750d9539dc8d service nova] Creating event network-changed:7263fd6b-8c6f-4989-b0bf-c04171939c17 for instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef on n-h2-master-1 Jul 01 11:40:54.147245 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [req-eb47b699-347f-4825-94e9-ba59b962ae45 req-5bef11c3-2dbb-4753-a310-750d9539dc8d service nova] [255d7d91-0140-4bb5-b8bd-31862c478a95] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:40:55.155312 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [req-eb47b699-347f-4825-94e9-ba59b962ae45 req-5bef11c3-2dbb-4753-a310-750d9539dc8d service nova] [255d7d91-0140-4bb5-b8bd-31862c478a95] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43158. Jul 01 11:40:55.163083 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-eb47b699-347f-4825-94e9-ba59b962ae45 req-5bef11c3-2dbb-4753-a310-750d9539dc8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.152736 Jul 01 11:40:55.164072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3672/7246] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:40:55.215739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:40:55.216464 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:40:55.222490 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:55.222940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:55.223717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:55.224150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:55.323833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lazy-loading 'services' on Instance uuid 7f0a582c-f4e5-4b97-83a7-1f377117d1ef {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:40:55.562120 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fb2facd2-bb83-4d68-ac84-2ec50e6b15ad tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments/5283b273-3d7d-46a9-9981-b89da0e74298" status: 202 len: 0 microversion: 2.1 time: 0.352549 Jul 01 11:40:55.562773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3575/7247] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:40:55 2022] DELETE /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments/5283b273-3d7d-46a9-9981-b89da0e74298 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:40:55.571877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-78505a76-f55a-4f49-8dd6-2adff2ca5cd2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:40:55.572916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-78505a76-f55a-4f49-8dd6-2adff2ca5cd2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:40:55.581636 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78505a76-f55a-4f49-8dd6-2adff2ca5cd2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:55.582760 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78505a76-f55a-4f49-8dd6-2adff2ca5cd2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:55.584210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78505a76-f55a-4f49-8dd6-2adff2ca5cd2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:55.585175 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-78505a76-f55a-4f49-8dd6-2adff2ca5cd2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:55.632594 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-78505a76-f55a-4f49-8dd6-2adff2ca5cd2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064899 Jul 01 11:40:55.633242 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3673/7248] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:40:55 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:40:56.647147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-460cbc6a-90bc-4e63-aa48-3a5a086b490d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:40:56.648306 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-460cbc6a-90bc-4e63-aa48-3a5a086b490d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:40:56.655471 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-460cbc6a-90bc-4e63-aa48-3a5a086b490d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:56.655991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-460cbc6a-90bc-4e63-aa48-3a5a086b490d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:56.656824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-460cbc6a-90bc-4e63-aa48-3a5a086b490d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:56.657320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-460cbc6a-90bc-4e63-aa48-3a5a086b490d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:56.685437 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-460cbc6a-90bc-4e63-aa48-3a5a086b490d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Jul 01 11:40:56.685991 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3576/7249] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:40:56 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:40:57.178631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4cc67a0c-daad-4618-bb63-e1a61aa7c28a req-22c35014-2984-41ac-8557-b25dc7178656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a582c-f4e5-4b97-83a7-1f377117d1ef", "tag": "7263fd6b-8c6f-4989-b0bf-c04171939c17"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:40:57.187935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4cc67a0c-daad-4618-bb63-e1a61aa7c28a req-22c35014-2984-41ac-8557-b25dc7178656 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:57.188380 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4cc67a0c-daad-4618-bb63-e1a61aa7c28a req-22c35014-2984-41ac-8557-b25dc7178656 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:57.203000 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4cc67a0c-daad-4618-bb63-e1a61aa7c28a req-22c35014-2984-41ac-8557-b25dc7178656 service nova] Creating event network-changed:7263fd6b-8c6f-4989-b0bf-c04171939c17 for instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef on n-h2-master-1 Jul 01 11:40:57.207960 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4cc67a0c-daad-4618-bb63-e1a61aa7c28a req-22c35014-2984-41ac-8557-b25dc7178656 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033032 Jul 01 11:40:57.208564 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3674/7250] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:40:57.696981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6ed4de28-f2fa-4f79-8ab3-a5e4699594e6 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:40:57.698912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6ed4de28-f2fa-4f79-8ab3-a5e4699594e6 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:40:57.707959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ed4de28-f2fa-4f79-8ab3-a5e4699594e6 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:57.709397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ed4de28-f2fa-4f79-8ab3-a5e4699594e6 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:57.709512 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ed4de28-f2fa-4f79-8ab3-a5e4699594e6 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:57.709940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6ed4de28-f2fa-4f79-8ab3-a5e4699594e6 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:57.744032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6ed4de28-f2fa-4f79-8ab3-a5e4699594e6 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051462 Jul 01 11:40:57.745086 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3577/7251] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:40:57 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:40:58.757395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cbc00bbc-9f1d-4dd7-9a00-e9c11247e912 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:40:58.758569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cbc00bbc-9f1d-4dd7-9a00-e9c11247e912 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:40:58.764879 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc00bbc-9f1d-4dd7-9a00-e9c11247e912 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:58.773261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc00bbc-9f1d-4dd7-9a00-e9c11247e912 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:58.773261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc00bbc-9f1d-4dd7-9a00-e9c11247e912 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:58.773261 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cbc00bbc-9f1d-4dd7-9a00-e9c11247e912 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:58.795855 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cbc00bbc-9f1d-4dd7-9a00-e9c11247e912 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Jul 01 11:40:58.796638 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3675/7252] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:40:58 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:40:59.807690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c9f56c25-ef17-4bd4-bd8b-2cc22b2c5f5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:40:59.808708 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c9f56c25-ef17-4bd4-bd8b-2cc22b2c5f5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:40:59.815683 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9f56c25-ef17-4bd4-bd8b-2cc22b2c5f5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:59.816136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9f56c25-ef17-4bd4-bd8b-2cc22b2c5f5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:59.816902 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9f56c25-ef17-4bd4-bd8b-2cc22b2c5f5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:40:59.817633 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c9f56c25-ef17-4bd4-bd8b-2cc22b2c5f5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:40:59.847502 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c9f56c25-ef17-4bd4-bd8b-2cc22b2c5f5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Jul 01 11:40:59.848068 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3578/7253] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:40:59 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:41:00.859074 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-95a66ec6-83dc-4927-9697-0d1b7edaa60d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:00.860020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-95a66ec6-83dc-4927-9697-0d1b7edaa60d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:00.866998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95a66ec6-83dc-4927-9697-0d1b7edaa60d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:00.867467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95a66ec6-83dc-4927-9697-0d1b7edaa60d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:00.868763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95a66ec6-83dc-4927-9697-0d1b7edaa60d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:00.869244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-95a66ec6-83dc-4927-9697-0d1b7edaa60d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:00.897600 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-95a66ec6-83dc-4927-9697-0d1b7edaa60d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042455 Jul 01 11:41:00.898072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3676/7254] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:41:00 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 11:41:00.908008 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:00.908495 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:00.915411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:00.915862 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:00.916635 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:00.917073 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:00.991088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] HTTP exception thrown: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef is not attached to volume 5283b273-3d7d-46a9-9981-b89da0e74298 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Request method failure captured: Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: request: DELETE /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments/5283b273-3d7d-46a9-9981-b89da0e74298 HTTP/1.1 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtxXIwGb-JIgFSZ38mXh31VuXZ0oMqKN1lDLD5VIvnwAdsS6q9qHnMda8-A-Ndll0r81oqAThlwCe7QzXNAuCM9y-LvF5TFSHXegPlXGhwMl1f9J3eiOQNZj_1qVh5YAyN11gyIFHryyGg9IA9AzUZm3Bk3j_FZi0tdm6ksaKRJTGgI Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57c6e095b37444c69ee3aa71bd051270", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 12d77ce727d04d88b3593b123504535a Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef is not attached to volume 5283b273-3d7d-46a9-9981-b89da0e74298 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: action_args: {'server_id': '7f0a582c-f4e5-4b97-83a7-1f377117d1ef', 'id': '5283b273-3d7d-46a9-9981-b89da0e74298'} Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5283b273-3d7d-46a9-9981-b89da0e74298. Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef is not attached to volume 5283b273-3d7d-46a9-9981-b89da0e74298 Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:41:00.993137 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:41:00.997902 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:41:00.997902 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:41:00.997902 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef is not attached to volume 5283b273-3d7d-46a9-9981-b89da0e74298 Jul 01 11:41:00.997902 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:00.997902 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Returning 404 to user: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef is not attached to volume 5283b273-3d7d-46a9-9981-b89da0e74298 {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:41:00.997902 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-abedcfd4-8efc-4bfa-b57b-df3d89bc136d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments/5283b273-3d7d-46a9-9981-b89da0e74298" status: 404 len: 154 microversion: 2.1 time: 0.091202 Jul 01 11:41:00.997902 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3579/7255] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:41:00 2022] DELETE /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef/os-volume_attachments/5283b273-3d7d-46a9-9981-b89da0e74298 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:41:04.387259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:04.387778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:04.394718 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:04.395193 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:04.395983 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:04.396435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:04.422141 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:41:04.706396 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bdaeca6c-89a2-492f-a1b5-0d6b64b02374 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 204 len: 0 microversion: 2.1 time: 0.322755 Jul 01 11:41:04.707025 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3677/7256] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:41:04 2022] DELETE /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:41:04.716004 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:04.716627 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:04.724484 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:04.724929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:04.725726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:04.726159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:04.864014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:04.871990 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a6fa5602-2f0c-4408-9e42-d4beeec04551 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1554 microversion: 2.1 time: 0.160517 Jul 01 11:41:04.872642 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3580/7257] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:04 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:05.889773 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:05.890494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:05.897399 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:05.897866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:05.898645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:05.899097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:06.025553 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:06.033039 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-27da7d91-a49a-43ee-bab4-3ea7cd8076cc tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1554 microversion: 2.1 time: 0.147624 Jul 01 11:41:06.033637 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3678/7258] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:05 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:07.051181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:07.051829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:07.061604 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:07.063700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:07.064548 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:07.065004 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:07.150715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:07.150961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-38b374fe-994b-400b-8876-31856dd12c32 req-64b8649c-3cce-40a1-a89b-c8a6479fb41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0a582c-f4e5-4b97-83a7-1f377117d1ef", "name": "network-vif-deleted", "tag": "7263fd6b-8c6f-4989-b0bf-c04171939c17"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:41:07.158499 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4f403fcc-4b26-4c2d-85a5-fe3d39d68f78 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 200 len: 1512 microversion: 2.1 time: 0.111241 Jul 01 11:41:07.159070 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3581/7259] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:07 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 1512 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:07.160073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-38b374fe-994b-400b-8876-31856dd12c32 req-64b8649c-3cce-40a1-a89b-c8a6479fb41f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:07.160535 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-38b374fe-994b-400b-8876-31856dd12c32 req-64b8649c-3cce-40a1-a89b-c8a6479fb41f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:07.171734 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-38b374fe-994b-400b-8876-31856dd12c32 req-64b8649c-3cce-40a1-a89b-c8a6479fb41f service nova] Creating event network-vif-deleted:7263fd6b-8c6f-4989-b0bf-c04171939c17 for instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef on n-h2-master-1 Jul 01 11:41:07.176743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-38b374fe-994b-400b-8876-31856dd12c32 req-64b8649c-3cce-40a1-a89b-c8a6479fb41f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030301 Jul 01 11:41:07.177383 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3679/7260] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:41:08.175878 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:08.176414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: 7f0a582c-f4e5-4b97-83a7-1f377117d1ef] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:08.183478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:08.183931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:08.184742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:08.187915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:08.198550 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] HTTP exception thrown: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef could not be found. Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Request method failure captured: Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef HTTP/1.1 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivtxXIwGb-JIgFSZ38mXh31VuXZ0oMqKN1lDLD5VIvnwAdsS6q9qHnMda8-A-Ndll0r81oqAThlwCe7QzXNAuCM9y-LvF5TFSHXegPlXGhwMl1f9J3eiOQNZj_1qVh5YAyN11gyIFHryyGg9IA9AzUZm3Bk3j_FZi0tdm6ksaKRJTGgI Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57c6e095b37444c69ee3aa71bd051270", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 12d77ce727d04d88b3593b123504535a Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef could not be found. Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '7f0a582c-f4e5-4b97-83a7-1f377117d1ef'} Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef could not be found. Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef could not be found. Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:41:08.200104 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef could not be found. Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Returning 404 to user: Instance 7f0a582c-f4e5-4b97-83a7-1f377117d1ef could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6748332a-8a7c-4d73-850b-e4a4212e7328 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef" status: 404 len: 111 microversion: 2.1 time: 0.029685 Jul 01 11:41:08.204927 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3582/7261] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:08 2022] GET /compute/v2.1/servers/7f0a582c-f4e5-4b97-83a7-1f377117d1ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:41:08.211517 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9a3b50cc-f357-4d3a-8c12-2e753348b4cf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '.version_select at 0x7f6f970ec940>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:08.283554 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9a3b50cc-f357-4d3a-8c12-2e753348b4cf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-118665239" status: 202 len: 0 microversion: 2.1 time: 0.077000 Jul 01 11:41:08.284132 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3680/7262] 10.222.0.23 () {58 vars in 1268 bytes} [Fri Jul 1 11:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-118665239 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:41:19.109191 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4f43fe0e-9ec3-415a-8402-0935c31d473e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'create', calling method: .version_select at 0x7f6f9065ad30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1217474719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZG90fkH4/XocIDuUzL7znSaOKnT9gn8x2AIcoKUwWD4BGr3b9UYhAcpSFsd2AfVSjyhV+qpUf3bQQIC0U7WZCnUSNpy9stNryn56vAM5e1Xw4IXQA2ahc602b6FCEWnA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:41:19.113637 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=18 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:19.114288 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:19.124877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4f43fe0e-9ec3-415a-8402-0935c31d473e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for project 57c6e095b37444c69ee3aa71bd051270. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:41:19.130789 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4f43fe0e-9ec3-415a-8402-0935c31d473e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for user 12d77ce727d04d88b3593b123504535a and project 57c6e095b37444c69ee3aa71bd051270. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:41:19.244436 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4f43fe0e-9ec3-415a-8402-0935c31d473e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.139095 Jul 01 11:41:19.245037 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3583/7263] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:41:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:41:19.290496 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:19.291380 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:19.295750 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-119767433", "imageRef": "3cc6c290-b49e-445a-ae77-65732cdb568e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1217474719", "networks": [{"uuid": "54aa9c5f-dcdc-4b8a-8f91-1c34958ba209"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:41:19.346039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] validate_networks() for [('54aa9c5f-dcdc-4b8a-8f91-1c34958ba209', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:41:19.762528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:41:19.762986 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:41:19.763469 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:41:19.763884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:41:19.764300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:41:19.773113 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:19.773541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:19.774339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:19.774781 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:19.792128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for project 57c6e095b37444c69ee3aa71bd051270. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:41:19.797389 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Getting quotas for user 12d77ce727d04d88b3593b123504535a and project 57c6e095b37444c69ee3aa71bd051270. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:41:19.810067 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:41:19.812353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc6c290-b49e-445a-ae77-65732cdb568e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:41:19.913485 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-33e292e0-67d9-4fed-a37f-f32c9e284412 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624741 Jul 01 11:41:19.914141 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3681/7264] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:41:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:41:19.924808 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e7a3725-bd89-4c85-86c5-a6cbe464791a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:19.925554 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4e7a3725-bd89-4c85-86c5-a6cbe464791a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:19.983156 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e7a3725-bd89-4c85-86c5-a6cbe464791a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:19.990044 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e7a3725-bd89-4c85-86c5-a6cbe464791a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1258 microversion: 2.1 time: 0.069125 Jul 01 11:41:19.990621 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3584/7265] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:19 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:21.008524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:21.009231 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:21.016161 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:21.016626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:21.017451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:21.017890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:21.077647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:21.085256 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-57c78c55-9544-4200-a433-298d0fd4f464 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1262 microversion: 2.1 time: 0.081442 Jul 01 11:41:21.085841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3682/7266] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:21 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:22.103849 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:22.104478 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:22.111520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:22.111975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:22.112750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:22.113213 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:22.185067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:22.193104 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8da412ca-a4af-4576-9a80-876f0cacfc48 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1318 microversion: 2.1 time: 0.093303 Jul 01 11:41:22.193721 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3585/7267] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:22 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:23.212970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:23.214261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:23.222141 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:23.222872 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:23.223839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:23.231439 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:23.433444 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:23.442755 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bc63ba21-d47a-426f-b754-2b46d60e1492 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.234360 Jul 01 11:41:23.443349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3683/7268] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:23 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:24.461274 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:24.462269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:24.470450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:24.470903 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:24.471721 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:24.472164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:24.606347 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:24.614042 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef0bdd6d-cc5c-4170-ab77-83d78575f143 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.157360 Jul 01 11:41:24.615192 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3586/7269] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:24 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:25.632440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:25.633063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:25.641793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:25.641793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:25.641793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:25.641793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:25.787253 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:25.795990 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4a63a821-39d1-4740-b441-cbc92da6d36b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.167431 Jul 01 11:41:25.797340 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3684/7270] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:25 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:26.813540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:26.814253 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:26.821605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:26.822066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:26.822963 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:26.823298 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:26.984251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:26.992216 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dae52851-09f3-43b6-bf07-e11a16610914 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.182576 Jul 01 11:41:26.992781 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3587/7271] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:26 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:28.009234 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:28.009995 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:28.017058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:28.017555 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:28.018353 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:28.018809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:28.170586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:28.178709 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a95ed7b-90b4-47b8-ae8a-a8ec9f4216cb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.173251 Jul 01 11:41:28.179594 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3685/7272] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:28 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:29.198563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:29.199540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:29.207317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:29.207876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:29.208740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:29.209281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:29.354240 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:29.362543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-35eb332f-c77b-4260-bfd0-90051e525b5c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.169038 Jul 01 11:41:29.370948 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3588/7273] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:29 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:30.379751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:30.381126 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:30.384519 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:30.385092 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:30.390597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:30.390831 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:30.391701 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:30.392334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:30.523513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:30.532132 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1213990c-ea89-42d2-bc74-8df14c0dab59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.156419 Jul 01 11:41:30.532705 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3686/7274] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:30 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:30.957225 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:31.025782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-06970885-bc56-42ea-875e-2b3ade84c786 req-8749b7da-913a-4a63-bd17-20b9a884f9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53922fb-4f64-4072-a521-901e8859d11d", "tag": "a08132a2-0721-4cbe-9c00-22ed2b7243e6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:41:31.034557 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-06970885-bc56-42ea-875e-2b3ade84c786 req-8749b7da-913a-4a63-bd17-20b9a884f9db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:31.035086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-06970885-bc56-42ea-875e-2b3ade84c786 req-8749b7da-913a-4a63-bd17-20b9a884f9db service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:31.046759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-06970885-bc56-42ea-875e-2b3ade84c786 req-8749b7da-913a-4a63-bd17-20b9a884f9db service nova] Creating event network-changed:a08132a2-0721-4cbe-9c00-22ed2b7243e6 for instance f53922fb-4f64-4072-a521-901e8859d11d on n-h1-master-1 Jul 01 11:41:31.051988 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-06970885-bc56-42ea-875e-2b3ade84c786 req-8749b7da-913a-4a63-bd17-20b9a884f9db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100739 Jul 01 11:41:31.052736 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3589/7275] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:41:31.549512 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:31.554428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:31.557982 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:31.558441 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:31.559220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:31.559674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:31.695581 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:31.703457 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-29c5fa73-90dc-42e8-a6d5-95ea9204661f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.157869 Jul 01 11:41:31.704046 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3687/7276] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:31 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:32.721684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:32.722385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:32.729166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:32.729629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:32.730393 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:32.730833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:32.860363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:32.868038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-667b49d7-6554-4ac4-b204-40bba8b020f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.151525 Jul 01 11:41:32.869176 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3590/7277] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:32 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:33.886528 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:33.887164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:33.894336 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:33.894741 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:33.895517 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:33.895969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:34.050128 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:34.050128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b00caf41-56b5-46a0-aff0-58817783deaa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.163475 Jul 01 11:41:34.050128 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3688/7278] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:33 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:35.064939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:35.065586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:35.072678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:35.073171 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:35.073947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:35.074380 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:35.205134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:35.212655 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1cb5e6ab-3da9-4922-8242-04c73e608fa4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.151578 Jul 01 11:41:35.213300 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3591/7279] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:35 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:41:36.231271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:36.232428 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:36.239044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:36.239511 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:36.240318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:36.240766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:36.376161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:36.383860 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e2340539-2b04-44dc-9e18-92b4b43be494 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.156619 Jul 01 11:41:36.384459 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3689/7280] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:36 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:37.400799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:37.401470 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:37.409200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:37.409660 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:37.410455 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:37.410875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:37.530345 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-a0f86c50-5b54-4001-a5dd-7ba6e06b6135 req-eb92421f-1820-459f-a565-cc230af2e02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53922fb-4f64-4072-a521-901e8859d11d", "name": "network-vif-plugged", "status": "completed", "tag": "a08132a2-0721-4cbe-9c00-22ed2b7243e6"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:41:37.538997 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a0f86c50-5b54-4001-a5dd-7ba6e06b6135 req-eb92421f-1820-459f-a565-cc230af2e02c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:37.539524 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-a0f86c50-5b54-4001-a5dd-7ba6e06b6135 req-eb92421f-1820-459f-a565-cc230af2e02c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:37.550410 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:37.554759 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-a0f86c50-5b54-4001-a5dd-7ba6e06b6135 req-eb92421f-1820-459f-a565-cc230af2e02c service nova] Creating event network-vif-plugged:a08132a2-0721-4cbe-9c00-22ed2b7243e6 for instance f53922fb-4f64-4072-a521-901e8859d11d on n-h1-master-1 Jul 01 11:41:37.559039 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-102cf8e4-3460-43d3-babd-552ab59d19c5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.161441 Jul 01 11:41:37.559631 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3592/7281] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:37 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:37.560627 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-a0f86c50-5b54-4001-a5dd-7ba6e06b6135 req-eb92421f-1820-459f-a565-cc230af2e02c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093093 Jul 01 11:41:37.561735 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3690/7282] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:41:38.576343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:38.576934 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:38.583181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:38.583627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:38.584382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:38.584815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:38.715399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:38.724055 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b958f35-08a4-445f-8b37-143d2b03f347 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1358 microversion: 2.1 time: 0.151723 Jul 01 11:41:38.724627 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3593/7283] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:38 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:39.742088 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:39.742809 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:39.750493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:39.750960 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:39.751743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:39.752195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:39.896476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:39.904097 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-eada1427-c47e-4eda-b03a-50f6b3720057 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1549 microversion: 2.1 time: 0.166384 Jul 01 11:41:39.904669 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3691/7284] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:39 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:39.920681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:39.921375 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:39.928700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:39.929167 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:39.929970 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:39.930400 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:40.061702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:40.069911 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aa095c75-f60b-4ab8-970f-b0d9c44f399a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1549 microversion: 2.1 time: 0.153439 Jul 01 11:41:40.070566 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3594/7285] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:39 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:40.086405 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:40.090101 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:40.090892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Searching by: {'deleted': False, 'project_id': '57c6e095b37444c69ee3aa71bd051270'} {{(pid=119764) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 11:41:40.097032 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:40.097533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:40.098347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:40.098802 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:40.122992 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.multi_cell_list [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 11:41:40.150141 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-411220f1-3a55-475d-9c0c-3b6caee7b4f1 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067538 Jul 01 11:41:40.150649 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3692/7286] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Jul 1 11:41:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:41:40.161918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:40.162548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:40.168934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:40.169926 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:40.170697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:40.171141 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:40.311523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:40.319367 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9a1309f2-cf0e-40d4-98b4-c674a38dc91e tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1549 microversion: 2.1 time: 0.161450 Jul 01 11:41:40.319945 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3595/7287] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:40 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:43.098702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-15df3c7f-a2d7-46d1-ad1c-030eb38989b8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "078cc07c-9b1c-4b90-801d-61afb43e97fb"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:41:43.099779 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-15df3c7f-a2d7-46d1-ad1c-030eb38989b8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:43.106710 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15df3c7f-a2d7-46d1-ad1c-030eb38989b8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:43.107169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15df3c7f-a2d7-46d1-ad1c-030eb38989b8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:43.107940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15df3c7f-a2d7-46d1-ad1c-030eb38989b8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:43.108383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-15df3c7f-a2d7-46d1-ad1c-030eb38989b8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:43.777773 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-15df3c7f-a2d7-46d1-ad1c-030eb38989b8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.682958 Jul 01 11:41:43.778535 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3693/7288] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Jul 1 11:41:43 2022] POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:41:55.534618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:41:55.535246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:41:55.538297 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:55.538960 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=62 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:55.543718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:55.544175 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:55.544949 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:55.545419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:55.675939 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:41:55.686715 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dd825d0d-3242-40a9-9bd6-25650aa0ebd5 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1595 microversion: 2.1 time: 0.156708 Jul 01 11:41:55.687296 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3596/7289] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:41:55 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:41:57.633096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9e909a81-bcd3-4815-a91e-ee89860c4226 req-67e63285-5589-462c-ae9f-b9263003af02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53922fb-4f64-4072-a521-901e8859d11d", "tag": "a08132a2-0721-4cbe-9c00-22ed2b7243e6"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:41:57.649888 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:57.650692 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:57.651362 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:41:57.654648 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e909a81-bcd3-4815-a91e-ee89860c4226 req-67e63285-5589-462c-ae9f-b9263003af02 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:41:57.655346 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9e909a81-bcd3-4815-a91e-ee89860c4226 req-67e63285-5589-462c-ae9f-b9263003af02 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:41:57.667629 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9e909a81-bcd3-4815-a91e-ee89860c4226 req-67e63285-5589-462c-ae9f-b9263003af02 service nova] Creating event network-changed:a08132a2-0721-4cbe-9c00-22ed2b7243e6 for instance f53922fb-4f64-4072-a521-901e8859d11d on n-h1-master-1 Jul 01 11:41:57.673070 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9e909a81-bcd3-4815-a91e-ee89860c4226 req-67e63285-5589-462c-ae9f-b9263003af02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045271 Jul 01 11:41:57.673835 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3694/7290] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:42:00.126338 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-85461318"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:42:00.129784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:00.134892 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:00.135344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:00.136106 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:00.136598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:00.262030 n-d-master-1 devstack@n-api.service[119765]: INFO nova.network.security_group_api [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Adding security group ef35d560-9292-4eb4-a1a7-f61942579ad9 to port a08132a2-0721-4cbe-9c00-22ed2b7243e6 Jul 01 11:42:00.670658 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cb500541-6466-4a9f-98c2-500b50df0946 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/action" status: 202 len: 0 microversion: 2.1 time: 0.548178 Jul 01 11:42:00.676622 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3597/7291] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:42:00 2022] POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:42:00.684343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:00.686980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3ebfd4e8-a753-495f-b124-4fcf6c9ceb03 req-eb396db8-b675-4b28-a97d-21d4ffaa81c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53922fb-4f64-4072-a521-901e8859d11d", "tag": "a08132a2-0721-4cbe-9c00-22ed2b7243e6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:42:00.687117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:00.694159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ebfd4e8-a753-495f-b124-4fcf6c9ceb03 req-eb396db8-b675-4b28-a97d-21d4ffaa81c0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:00.694608 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3ebfd4e8-a753-495f-b124-4fcf6c9ceb03 req-eb396db8-b675-4b28-a97d-21d4ffaa81c0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:00.703385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:00.703845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:00.704680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:00.705130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:00.708890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3ebfd4e8-a753-495f-b124-4fcf6c9ceb03 req-eb396db8-b675-4b28-a97d-21d4ffaa81c0 service nova] Creating event network-changed:a08132a2-0721-4cbe-9c00-22ed2b7243e6 for instance f53922fb-4f64-4072-a521-901e8859d11d on n-h1-master-1 Jul 01 11:42:00.716753 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3ebfd4e8-a753-495f-b124-4fcf6c9ceb03 req-eb396db8-b675-4b28-a97d-21d4ffaa81c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036208 Jul 01 11:42:00.717984 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3598/7292] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:42:00.904508 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:00.915028 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aae38bbc-75b4-496c-afd8-ad939fb4d89a tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1758 microversion: 2.1 time: 0.236647 Jul 01 11:42:00.933367 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3695/7293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:00 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1758 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:13.991197 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:42:13.992080 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:42:14.041899 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a8ca5aa6-fad3-445d-af4a-fbefcf161c3d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:42:14.042979 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a8ca5aa6-fad3-445d-af4a-fbefcf161c3d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:14.049509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ca5aa6-fad3-445d-af4a-fbefcf161c3d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:14.049964 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ca5aa6-fad3-445d-af4a-fbefcf161c3d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:14.050730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ca5aa6-fad3-445d-af4a-fbefcf161c3d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:14.051168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a8ca5aa6-fad3-445d-af4a-fbefcf161c3d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:14.271832 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a8ca5aa6-fad3-445d-af4a-fbefcf161c3d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/action" status: 202 len: 0 microversion: 2.1 time: 0.282159 Jul 01 11:42:14.272471 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3599/7294] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:42:13 2022] POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:42:14.280805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:14.281464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:14.284002 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:42:14.284676 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:42:14.289447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:14.289912 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:14.290704 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:14.291155 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:14.448018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:14.456008 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ba11f2d6-be6e-488a-9b65-1e6ee205ab0f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1750 microversion: 2.1 time: 0.179184 Jul 01 11:42:14.456588 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3696/7295] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:14 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:15.475135 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:15.475842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:15.482144 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:15.482594 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:15.483369 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:15.483806 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:15.627581 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:15.635676 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-86d7e76d-ce44-429c-a02d-6d5edbffcfbf tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.165652 Jul 01 11:42:15.636245 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3600/7296] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:15 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:16.653701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:16.654329 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:16.661248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:16.661711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:16.662484 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:16.662930 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:16.806304 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:16.814974 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-45d711b5-d522-4d30-90c6-4a55de1d2c94 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.164526 Jul 01 11:42:16.815539 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3697/7297] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:16 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:17.832322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:17.832892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:17.839788 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:17.840237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:17.841015 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:17.841473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:17.982959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:17.991038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68c2b2a1-bfde-425a-aa51-fff876a5308b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.162679 Jul 01 11:42:17.991610 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3601/7298] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:17 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:19.008500 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:19.009129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:19.016072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:19.016536 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:19.017375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:19.017835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:19.165200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:19.173295 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b2fe3b8-3542-4729-bac1-9b574ab1dae8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.168704 Jul 01 11:42:19.174478 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3698/7299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:19 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:20.190912 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:20.191530 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:20.198783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:20.199236 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:20.199996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:20.200432 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:20.340841 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:20.349716 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7156a606-ceff-4944-a987-77db79cf3c80 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.162650 Jul 01 11:42:20.350295 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3602/7300] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:20 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:21.366893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:21.367550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:21.374541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:21.375004 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:21.375777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:21.376224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:21.520689 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:21.528743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d2ea046-fcef-4fb6-80dd-454925cf07b4 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.165774 Jul 01 11:42:21.529332 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3699/7301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:21 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:42:22.545847 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:22.546472 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:22.553947 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:22.554401 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:22.555167 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:22.555606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:22.698870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:22.707300 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ff34afc1-2e19-491f-97bd-878e44fda06b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.165363 Jul 01 11:42:22.711121 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3603/7302] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:22 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:23.724332 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:23.725008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:23.732130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:23.732595 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:23.733404 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:23.733858 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:23.878334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:23.886362 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b59545f5-6a64-4c08-bb34-6095e0e97632 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.165983 Jul 01 11:42:23.886938 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3700/7303] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:23 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:24.903891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:24.904518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:24.912182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:24.912632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:24.913492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:24.913931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:25.059993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:25.068881 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58cb2bb3-0d72-4eb2-b294-4f8aa9000ce8 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.168912 Jul 01 11:42:25.069486 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3604/7304] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:24 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:26.085052 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:26.085701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:26.092681 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:26.093159 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:26.094012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:26.094457 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:26.234550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:26.242633 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7469e7f-5ae2-4b09-852c-259cd976c5c2 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.161442 Jul 01 11:42:26.243198 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3701/7305] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:26 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:26.811501 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:42:26.811969 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:42:27.260046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:27.260664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:27.267676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:27.268129 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:27.268899 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:27.269363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:27.415133 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:27.423181 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-57888a16-ce8a-4e83-a9e8-3cc8d9233ecb tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.167029 Jul 01 11:42:27.423752 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3605/7306] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:27 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:28.441555 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:28.442176 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:28.451568 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:28.452026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:28.452801 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:28.453283 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:28.595118 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:28.603109 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c5d731b4-88a2-4d3a-9824-2c42273db3fa tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.166192 Jul 01 11:42:28.603677 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3702/7307] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:28 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:29.619767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:29.620378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:29.627928 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:29.628372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:29.629135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:29.629591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:29.776582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:29.784644 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ce8f1d79-f3af-4f53-b8c5-c8c0ddf26d2b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.168809 Jul 01 11:42:29.785229 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3606/7308] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:29 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:30.800765 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:30.801413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:30.808724 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:30.809203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:30.809988 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:30.810438 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:30.961045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:30.970168 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e1085da0-fb41-4d5d-b841-724fdda35518 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1755 microversion: 2.1 time: 0.173288 Jul 01 11:42:30.970742 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3703/7309] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:30 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:42:31.988771 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:42:31.989451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:42:31.996470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:31.996919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:31.997728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:42:31.998164 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:42:32.137570 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:42:32.145759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b1275ae7-0321-4948-9683-bb1c8e1e6337 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1758 microversion: 2.1 time: 0.161693 Jul 01 11:42:32.146329 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3607/7310] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:42:31 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:04.343527 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-85461318"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:04.344154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:04.346401 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=16 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:04.347116 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=48 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:04.351951 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:04.352410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:04.353214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:04.353669 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:04.483659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.network.security_group_api [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Removing security group ef35d560-9292-4eb4-a1a7-f61942579ad9 from port a08132a2-0721-4cbe-9c00-22ed2b7243e6 Jul 01 11:43:04.862201 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ab1414fe-ebb5-43d3-b1ef-fc3909af0c7f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/action" status: 202 len: 0 microversion: 2.1 time: 0.522756 Jul 01 11:43:04.863214 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3704/7311] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:43:04 2022] POST /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:43:04.870966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-2d487e38-d827-48f3-b0b4-adadeddd6a02 req-d98b73f0-056a-450b-804f-c2d48fb96c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53922fb-4f64-4072-a521-901e8859d11d", "tag": "a08132a2-0721-4cbe-9c00-22ed2b7243e6"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:04.880432 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=18 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:04.881189 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:04.886444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2d487e38-d827-48f3-b0b4-adadeddd6a02 req-d98b73f0-056a-450b-804f-c2d48fb96c94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:04.890587 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-2d487e38-d827-48f3-b0b4-adadeddd6a02 req-d98b73f0-056a-450b-804f-c2d48fb96c94 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:04.916230 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-2d487e38-d827-48f3-b0b4-adadeddd6a02 req-d98b73f0-056a-450b-804f-c2d48fb96c94 service nova] Creating event network-changed:a08132a2-0721-4cbe-9c00-22ed2b7243e6 for instance f53922fb-4f64-4072-a521-901e8859d11d on n-h1-master-1 Jul 01 11:43:04.926452 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-2d487e38-d827-48f3-b0b4-adadeddd6a02 req-d98b73f0-056a-450b-804f-c2d48fb96c94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055693 Jul 01 11:43:04.926452 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3608/7312] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:06.464575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:06.465087 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:06.471454 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:06.471921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:06.472705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:06.473176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:06.553403 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lazy-loading 'services' on Instance uuid f53922fb-4f64-4072-a521-901e8859d11d {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:43:06.736693 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4ba209d9-92bd-4e05-b656-aa22071df14d tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments/078cc07c-9b1c-4b90-801d-61afb43e97fb" status: 202 len: 0 microversion: 2.1 time: 0.276875 Jul 01 11:43:06.737897 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3705/7313] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:43:06 2022] DELETE /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments/078cc07c-9b1c-4b90-801d-61afb43e97fb => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:43:06.748139 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e43d6a76-4d95-4ab3-ab30-a9a365154d59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:06.749872 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e43d6a76-4d95-4ab3-ab30-a9a365154d59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:06.758097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e43d6a76-4d95-4ab3-ab30-a9a365154d59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:06.758554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e43d6a76-4d95-4ab3-ab30-a9a365154d59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:06.759337 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e43d6a76-4d95-4ab3-ab30-a9a365154d59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:06.759779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e43d6a76-4d95-4ab3-ab30-a9a365154d59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:06.788890 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e43d6a76-4d95-4ab3-ab30-a9a365154d59 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046328 Jul 01 11:43:06.789707 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3609/7314] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:43:06 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:06.938812 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2361ffb3-64a7-427c-aaa1-6e75e5a84d4d req-79823b89-860a-4b24-88ce-0739f8c3a01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53922fb-4f64-4072-a521-901e8859d11d", "tag": "a08132a2-0721-4cbe-9c00-22ed2b7243e6"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:06.948110 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2361ffb3-64a7-427c-aaa1-6e75e5a84d4d req-79823b89-860a-4b24-88ce-0739f8c3a01e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:06.948573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2361ffb3-64a7-427c-aaa1-6e75e5a84d4d req-79823b89-860a-4b24-88ce-0739f8c3a01e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:06.959771 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2361ffb3-64a7-427c-aaa1-6e75e5a84d4d req-79823b89-860a-4b24-88ce-0739f8c3a01e service nova] Creating event network-changed:a08132a2-0721-4cbe-9c00-22ed2b7243e6 for instance f53922fb-4f64-4072-a521-901e8859d11d on n-h1-master-1 Jul 01 11:43:06.964621 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2361ffb3-64a7-427c-aaa1-6e75e5a84d4d req-79823b89-860a-4b24-88ce-0739f8c3a01e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030028 Jul 01 11:43:06.965247 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3706/7315] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:07.800203 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-699c990f-1e23-4eae-b813-fbbb5e2c070c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:07.801131 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-699c990f-1e23-4eae-b813-fbbb5e2c070c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:07.808824 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-699c990f-1e23-4eae-b813-fbbb5e2c070c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:07.811261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-699c990f-1e23-4eae-b813-fbbb5e2c070c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:07.811261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-699c990f-1e23-4eae-b813-fbbb5e2c070c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:07.811261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-699c990f-1e23-4eae-b813-fbbb5e2c070c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:07.841754 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-699c990f-1e23-4eae-b813-fbbb5e2c070c tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 Jul 01 11:43:07.842458 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3610/7316] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:43:07 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:08.854764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-198d1311-b952-4df2-a965-1669f357d792 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:08.855794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-198d1311-b952-4df2-a965-1669f357d792 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:08.863071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-198d1311-b952-4df2-a965-1669f357d792 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:08.863526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-198d1311-b952-4df2-a965-1669f357d792 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:08.864312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-198d1311-b952-4df2-a965-1669f357d792 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:08.864756 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-198d1311-b952-4df2-a965-1669f357d792 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:08.896192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-198d1311-b952-4df2-a965-1669f357d792 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Jul 01 11:43:08.896699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3707/7317] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:43:08 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:09.908654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9250d929-e79c-4915-95ff-a2f665b74e4b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:09.909633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9250d929-e79c-4915-95ff-a2f665b74e4b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:09.915849 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9250d929-e79c-4915-95ff-a2f665b74e4b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:09.916303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9250d929-e79c-4915-95ff-a2f665b74e4b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:09.917069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9250d929-e79c-4915-95ff-a2f665b74e4b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:09.917533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9250d929-e79c-4915-95ff-a2f665b74e4b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:09.947431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9250d929-e79c-4915-95ff-a2f665b74e4b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Jul 01 11:43:09.947923 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3611/7318] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:43:09 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:10.959383 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-112c2dda-d9d2-4808-ab8f-c7fbb3ff3b85 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:10.960368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-112c2dda-d9d2-4808-ab8f-c7fbb3ff3b85 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:10.967248 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112c2dda-d9d2-4808-ab8f-c7fbb3ff3b85 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:10.967709 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112c2dda-d9d2-4808-ab8f-c7fbb3ff3b85 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:10.968490 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112c2dda-d9d2-4808-ab8f-c7fbb3ff3b85 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:10.968940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-112c2dda-d9d2-4808-ab8f-c7fbb3ff3b85 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:10.998802 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-112c2dda-d9d2-4808-ab8f-c7fbb3ff3b85 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Jul 01 11:43:10.999361 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3708/7319] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:43:10 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:12.010257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fd4c932c-1760-4051-95b3-bf5feaa88724 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:12.011209 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fd4c932c-1760-4051-95b3-bf5feaa88724 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:12.018680 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd4c932c-1760-4051-95b3-bf5feaa88724 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:12.019126 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd4c932c-1760-4051-95b3-bf5feaa88724 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:12.020884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd4c932c-1760-4051-95b3-bf5feaa88724 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:12.020884 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fd4c932c-1760-4051-95b3-bf5feaa88724 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:12.048910 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fd4c932c-1760-4051-95b3-bf5feaa88724 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042692 Jul 01 11:43:12.049773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3612/7320] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Jul 1 11:43:12 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 11:43:12.059296 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:12.059862 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:12.066845 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:12.067314 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:12.068360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:12.068832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:12.145393 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] HTTP exception thrown: Instance f53922fb-4f64-4072-a521-901e8859d11d is not attached to volume 078cc07c-9b1c-4b90-801d-61afb43e97fb Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Request method failure captured: Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: request: DELETE /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments/078cc07c-9b1c-4b90-801d-61afb43e97fb HTTP/1.1 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtxXIwGb-JIgFSZ38mXh31VuXZ0oMqKN1lDLD5VIvnwAdsS6q9qHnMda8-A-Ndll0r81oqAThlwCe7QzXNAuCM9y-LvF5TFSHXegPlXGhwMl1f9J3eiOQNZj_1qVh5YAyN11gyIFHryyGg9IA9AzUZm3Bk3j_FZi0tdm6ksaKRJTGgI Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57c6e095b37444c69ee3aa71bd051270", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 12d77ce727d04d88b3593b123504535a Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f53922fb-4f64-4072-a521-901e8859d11d is not attached to volume 078cc07c-9b1c-4b90-801d-61afb43e97fb Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: action_args: {'server_id': 'f53922fb-4f64-4072-a521-901e8859d11d', 'id': '078cc07c-9b1c-4b90-801d-61afb43e97fb'} Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 078cc07c-9b1c-4b90-801d-61afb43e97fb. Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53922fb-4f64-4072-a521-901e8859d11d is not attached to volume 078cc07c-9b1c-4b90-801d-61afb43e97fb Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:43:12.147050 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:43:12.151583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:43:12.151583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:43:12.151583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53922fb-4f64-4072-a521-901e8859d11d is not attached to volume 078cc07c-9b1c-4b90-801d-61afb43e97fb Jul 01 11:43:12.151583 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:12.151583 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Returning 404 to user: Instance f53922fb-4f64-4072-a521-901e8859d11d is not attached to volume 078cc07c-9b1c-4b90-801d-61afb43e97fb {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:43:12.151583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6d20c60b-f711-4eca-a18c-80036da23d2f tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments/078cc07c-9b1c-4b90-801d-61afb43e97fb" status: 404 len: 154 microversion: 2.1 time: 0.093328 Jul 01 11:43:12.151583 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3709/7321] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Jul 1 11:43:12 2022] DELETE /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d/os-volume_attachments/078cc07c-9b1c-4b90-801d-61afb43e97fb => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:43:15.531221 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:15.531894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:15.539856 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:15.540379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:15.541286 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:15.541728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:15.567072 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:43:15.881447 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-57020861-2fa5-44bc-a64b-3020a85aa111 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 204 len: 0 microversion: 2.1 time: 0.353775 Jul 01 11:43:15.882040 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3613/7322] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:43:15 2022] DELETE /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:43:15.890522 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:15.891146 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:15.898730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:15.900029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:15.900029 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:15.900445 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:16.034605 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:16.042265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a2e78a24-c356-48f7-8b76-3cce556d318b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1555 microversion: 2.1 time: 0.155608 Jul 01 11:43:16.042822 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3710/7323] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:15 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:17.060003 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:17.060728 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:17.068583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:17.069040 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:17.069853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:17.070275 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:17.198679 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:17.206656 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dda3c8dd-87ad-43ac-8c24-783a0b9b6216 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1555 microversion: 2.1 time: 0.150967 Jul 01 11:43:17.207241 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3614/7324] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:17 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:18.132463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-cbe6fb80-cc1b-41f6-be04-cfb7eb8dc700 req-e4f9bfa7-348d-4f69-8eb6-95db085167fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53922fb-4f64-4072-a521-901e8859d11d", "name": "network-vif-deleted", "tag": "a08132a2-0721-4cbe-9c00-22ed2b7243e6"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:18.141739 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cbe6fb80-cc1b-41f6-be04-cfb7eb8dc700 req-e4f9bfa7-348d-4f69-8eb6-95db085167fd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:18.144133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cbe6fb80-cc1b-41f6-be04-cfb7eb8dc700 req-e4f9bfa7-348d-4f69-8eb6-95db085167fd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:18.153192 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-cbe6fb80-cc1b-41f6-be04-cfb7eb8dc700 req-e4f9bfa7-348d-4f69-8eb6-95db085167fd service nova] Creating event network-vif-deleted:a08132a2-0721-4cbe-9c00-22ed2b7243e6 for instance f53922fb-4f64-4072-a521-901e8859d11d on n-h1-master-1 Jul 01 11:43:18.158381 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-cbe6fb80-cc1b-41f6-be04-cfb7eb8dc700 req-e4f9bfa7-348d-4f69-8eb6-95db085167fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029589 Jul 01 11:43:18.159051 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3711/7325] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:18.222999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:18.223608 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:18.230789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:18.231232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:18.231988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:18.232420 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:18.297300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d77ce727d04d88b3593b123504535a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c6e095b37444c69ee3aa71bd051270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:18.305340 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6f02ba47-741a-4237-bb17-f2b9d44cb7c3 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 200 len: 1513 microversion: 2.1 time: 0.086235 Jul 01 11:43:18.305910 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3615/7326] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:18 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 1513 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:19.325394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:19.326114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] [instance: f53922fb-4f64-4072-a521-901e8859d11d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:19.332487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:19.332957 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:19.333759 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:19.334207 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:19.347863 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] HTTP exception thrown: Instance f53922fb-4f64-4072-a521-901e8859d11d could not be found. Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Request method failure captured: Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d HTTP/1.1 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivtxXIwGb-JIgFSZ38mXh31VuXZ0oMqKN1lDLD5VIvnwAdsS6q9qHnMda8-A-Ndll0r81oqAThlwCe7QzXNAuCM9y-LvF5TFSHXegPlXGhwMl1f9J3eiOQNZj_1qVh5YAyN11gyIFHryyGg9IA9AzUZm3Bk3j_FZi0tdm6ksaKRJTGgI Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57c6e095b37444c69ee3aa71bd051270", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57c6e095b37444c69ee3aa71bd051270"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 57c6e095b37444c69ee3aa71bd051270 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1106139756 Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 12d77ce727d04d88b3593b123504535a Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestMinimumBasicScenario-1106139756-project Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: exception: Instance f53922fb-4f64-4072-a521-901e8859d11d could not be found. Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'f53922fb-4f64-4072-a521-901e8859d11d'} Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f53922fb-4f64-4072-a521-901e8859d11d could not be found. Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53922fb-4f64-4072-a521-901e8859d11d could not be found. Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:43:19.349503 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53922fb-4f64-4072-a521-901e8859d11d could not be found. Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Returning 404 to user: Instance f53922fb-4f64-4072-a521-901e8859d11d could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-babfa138-5f93-4e0c-8060-d78dac414f35 tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d" status: 404 len: 111 microversion: 2.1 time: 0.030680 Jul 01 11:43:19.353969 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3712/7327] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:19 2022] GET /compute/v2.1/servers/f53922fb-4f64-4072-a521-901e8859d11d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:43:19.359575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61f85dfa-9971-4f3e-b392-0a2c30bd3c7b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] Calling method '.version_select at 0x7f6f90c243a0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:19.478755 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61f85dfa-9971-4f3e-b392-0a2c30bd3c7b tempest-TestMinimumBasicScenario-1106139756 tempest-TestMinimumBasicScenario-1106139756-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1217474719" status: 202 len: 0 microversion: 2.1 time: 0.122964 Jul 01 11:43:19.479331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3616/7328] 10.222.0.23 () {58 vars in 1271 bytes} [Fri Jul 1 11:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1217474719 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 11:43:30.940131 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=18 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:30.941116 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:31.097690 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-712cd342-a23f-4e4f-9411-6daae03fdbb2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: .version_select at 0x7f6f970ec1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-290698926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmqiwpkUumpmnEbAOHqi/JFmTG1Zj1Xx7flTXbsHIgeW/68JY0c0BfkGlH7Rmx83zK7gcx/ecoP3A3onmt6tXORGYH1usd+jPVEVGVCT+/rWza6J+yKEIYQS/iRGh1xWA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:31.112394 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-712cd342-a23f-4e4f-9411-6daae03fdbb2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:43:31.117574 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-712cd342-a23f-4e4f-9411-6daae03fdbb2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:43:31.132056 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [None req-712cd342-a23f-4e4f-9411-6daae03fdbb2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [5bc3f4db-c970-4b59-9ef4-f66428e8bb68] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:43:32.139669 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [None req-712cd342-a23f-4e4f-9411-6daae03fdbb2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [5bc3f4db-c970-4b59-9ef4-f66428e8bb68] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43730. Jul 01 11:43:32.224519 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-712cd342-a23f-4e4f-9411-6daae03fdbb2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.290308 Jul 01 11:43:32.225121 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3713/7329] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:43:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:40.607423 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:40.608397 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:40.612480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-422865897", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "3448947a-3340-443c-9a42-54dcd162522d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-290698926", "security_groups": [{"name": "tempest-secgroup-smoke-1519675983"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:40.742157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] validate_networks() for [('3448947a-3340-443c-9a42-54dcd162522d', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:43:41.258895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:43:41.259547 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:43:41.260025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:43:41.260434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:43:41.261014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:43:41.271173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:41.272173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:41.273552 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:41.273989 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:41.293836 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:43:41.300459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:43:41.313911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:43:41.316204 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:43:41.418126 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-db1cfe62-608f-48cf-95b3-9f23d94a7f41 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.812493 Jul 01 11:43:41.423871 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3617/7330] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:43:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:43:41.429283 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5e694e38-4f12-4b22-bbbf-ce6d00a6d4aa tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:41.430031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5e694e38-4f12-4b22-bbbf-ce6d00a6d4aa tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:41.435917 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:41.495236 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5e694e38-4f12-4b22-bbbf-ce6d00a6d4aa tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:41.503241 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5e694e38-4f12-4b22-bbbf-ce6d00a6d4aa tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1265 microversion: 2.1 time: 0.077773 Jul 01 11:43:41.504217 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3714/7331] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:41 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:42.521830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61aa3369-8b86-471b-8591-5942a3c74469 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:42.522544 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61aa3369-8b86-471b-8591-5942a3c74469 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:42.586417 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61aa3369-8b86-471b-8591-5942a3c74469 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:42.593946 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61aa3369-8b86-471b-8591-5942a3c74469 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1265 microversion: 2.1 time: 0.076971 Jul 01 11:43:42.594589 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3618/7332] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:42 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:43.614063 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:43.614704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:43.623021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:43.623763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:43.624766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:43.625245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:43.695737 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:43.703771 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8acc73d0-fe7b-4d8a-bc8f-388acf64270b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1317 microversion: 2.1 time: 0.095795 Jul 01 11:43:43.704436 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3715/7333] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:43 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1317 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:44.730890 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:44.731515 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:44.739072 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:44.742265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:44.742265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:44.742265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:44.949502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:44.956932 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-772e48a8-7aba-45b4-b09f-363b98a28a5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1391 microversion: 2.1 time: 0.229978 Jul 01 11:43:44.957534 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3619/7334] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:44 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:45.702951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e7069be9-ba61-4aa5-b11e-aa10f6415f8c req-213f59e7-49c1-4885-b9c9-6fce72bbd369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6316a7-8ff3-4681-8305-46676639ffbc", "tag": "051a77dd-decf-4cbc-8700-d7fe820d3eb4"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:45.716178 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e7069be9-ba61-4aa5-b11e-aa10f6415f8c req-213f59e7-49c1-4885-b9c9-6fce72bbd369 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:45.716650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e7069be9-ba61-4aa5-b11e-aa10f6415f8c req-213f59e7-49c1-4885-b9c9-6fce72bbd369 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:45.733075 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e7069be9-ba61-4aa5-b11e-aa10f6415f8c req-213f59e7-49c1-4885-b9c9-6fce72bbd369 service nova] Creating event network-changed:051a77dd-decf-4cbc-8700-d7fe820d3eb4 for instance 5f6316a7-8ff3-4681-8305-46676639ffbc on n-h2-master-1 Jul 01 11:43:45.738118 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e7069be9-ba61-4aa5-b11e-aa10f6415f8c req-213f59e7-49c1-4885-b9c9-6fce72bbd369 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043418 Jul 01 11:43:45.739059 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3716/7335] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:45.975942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:45.977739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:45.985278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:45.985732 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:45.986686 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:45.987287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:46.137078 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:46.145038 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1dc027e0-58ab-4faf-b5f9-767132cb70f7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1391 microversion: 2.1 time: 0.174190 Jul 01 11:43:46.145799 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3620/7336] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:45 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:47.164377 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:47.165091 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:47.171427 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:47.171906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:47.172668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:47.173548 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:47.307282 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:47.314743 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c2d9df70-a21d-4b20-b611-561f0bad7996 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1391 microversion: 2.1 time: 0.156044 Jul 01 11:43:47.315305 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3717/7337] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:47 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:48.331846 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:48.332454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:48.339447 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:48.339896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:48.340658 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:48.341092 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:48.484732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:48.492987 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-02fd3c55-bbb0-472d-89f1-95f8483a4844 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1391 microversion: 2.1 time: 0.164942 Jul 01 11:43:48.493605 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3621/7338] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:48 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:49.509900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:49.510524 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:49.517382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:49.517841 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:49.518610 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:49.519053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:49.654767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:49.662360 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65e68387-a384-4ba1-a86b-33e7373a3608 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1391 microversion: 2.1 time: 0.156844 Jul 01 11:43:49.662946 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3718/7339] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:49 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:49.985678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d76131f5-0bef-4bf8-96e5-e4cfe8c341ee req-101dcb40-90f4-4d17-b57e-c32a12c4b4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6316a7-8ff3-4681-8305-46676639ffbc", "name": "network-vif-plugged", "status": "completed", "tag": "051a77dd-decf-4cbc-8700-d7fe820d3eb4"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:49.995990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d76131f5-0bef-4bf8-96e5-e4cfe8c341ee req-101dcb40-90f4-4d17-b57e-c32a12c4b4cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:49.996451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d76131f5-0bef-4bf8-96e5-e4cfe8c341ee req-101dcb40-90f4-4d17-b57e-c32a12c4b4cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:50.008406 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d76131f5-0bef-4bf8-96e5-e4cfe8c341ee req-101dcb40-90f4-4d17-b57e-c32a12c4b4cf service nova] Creating event network-vif-plugged:051a77dd-decf-4cbc-8700-d7fe820d3eb4 for instance 5f6316a7-8ff3-4681-8305-46676639ffbc on n-h2-master-1 Jul 01 11:43:50.014035 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d76131f5-0bef-4bf8-96e5-e4cfe8c341ee req-101dcb40-90f4-4d17-b57e-c32a12c4b4cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Jul 01 11:43:50.014818 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3622/7340] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:43:50.679850 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:50.680514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:50.687626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:50.688931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:50.688931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:50.689341 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:50.852955 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:50.860443 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bf45b12f-b887-4780-8730-e95d22a7a56a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1391 microversion: 2.1 time: 0.184957 Jul 01 11:43:50.861013 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3719/7341] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:50 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:51.876028 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:51.880143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:51.880838 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:51.887607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:51.888055 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:51.888812 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:51.889283 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:52.023355 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:52.031165 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-53586be1-07d9-4935-9d64-8b477c2b207c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1563 microversion: 2.1 time: 0.157048 Jul 01 11:43:52.031818 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3623/7342] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:51 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:52.047330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:52.047926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:52.049966 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:52.056200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:52.063769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:52.063769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:52.063769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:52.186904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:52.195253 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-aebed559-309e-4206-a247-5cbd184017e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1563 microversion: 2.1 time: 0.151313 Jul 01 11:43:52.195816 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3720/7343] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:52 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:43:54.034629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:43:54.035247 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:43:54.036563 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-caf2f348-c480-4ec0-a3e0-fcd0debc2c4f req-ccffd624-0210-46b2-921f-a69123283d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6316a7-8ff3-4681-8305-46676639ffbc", "tag": "051a77dd-decf-4cbc-8700-d7fe820d3eb4"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:43:54.037438 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=8 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:43:54.043969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:54.044424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:54.050678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:54.050678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:54.050932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-caf2f348-c480-4ec0-a3e0-fcd0debc2c4f req-ccffd624-0210-46b2-921f-a69123283d41 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:43:54.050932 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-caf2f348-c480-4ec0-a3e0-fcd0debc2c4f req-ccffd624-0210-46b2-921f-a69123283d41 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:43:54.060872 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-caf2f348-c480-4ec0-a3e0-fcd0debc2c4f req-ccffd624-0210-46b2-921f-a69123283d41 service nova] Creating event network-changed:051a77dd-decf-4cbc-8700-d7fe820d3eb4 for instance 5f6316a7-8ff3-4681-8305-46676639ffbc on n-h2-master-1 Jul 01 11:43:54.066403 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-caf2f348-c480-4ec0-a3e0-fcd0debc2c4f req-ccffd624-0210-46b2-921f-a69123283d41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033555 Jul 01 11:43:54.067962 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3721/7344] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:43:54.267996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:43:54.276489 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-720b7e0f-65e7-4adf-87c6-0f96063f8737 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1563 microversion: 2.1 time: 0.245772 Jul 01 11:43:54.277371 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3624/7345] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:43:54 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:06.490716 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:44:06.491239 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:44:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:44:17.571970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-91546444-3a91-418b-aa51-8c8fc2bff11e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:17.573162 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-91546444-3a91-418b-aa51-8c8fc2bff11e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:17.575256 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:44:17.575932 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:44:17.580940 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91546444-3a91-418b-aa51-8c8fc2bff11e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:17.581434 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91546444-3a91-418b-aa51-8c8fc2bff11e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:17.582214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91546444-3a91-418b-aa51-8c8fc2bff11e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:17.582667 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-91546444-3a91-418b-aa51-8c8fc2bff11e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:17.641594 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-91546444-3a91-418b-aa51-8c8fc2bff11e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action" status: 200 len: 24558 microversion: 2.1 time: 0.074358 Jul 01 11:44:17.643461 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3722/7346] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:44:17 2022] POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action => generated 24558 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:44:28.538044 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9b903ff-54e3-4453-8d87-d54ebd3fb958 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:28.538623 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9b903ff-54e3-4453-8d87-d54ebd3fb958 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:28.541282 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:44:28.542011 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=34 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:44:28.546869 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b903ff-54e3-4453-8d87-d54ebd3fb958 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:28.547324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b903ff-54e3-4453-8d87-d54ebd3fb958 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:28.548103 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b903ff-54e3-4453-8d87-d54ebd3fb958 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:28.548550 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9b903ff-54e3-4453-8d87-d54ebd3fb958 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:28.782406 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9b903ff-54e3-4453-8d87-d54ebd3fb958 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action" status: 202 len: 0 microversion: 2.1 time: 0.248296 Jul 01 11:44:28.783073 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3625/7347] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:44:28 2022] POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:44:28.794354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:28.794354 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:28.801897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:28.802357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:28.803132 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:28.803573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:28.940540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:28.948550 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62297600-63d1-41f8-bb10-e7b3473f8d92 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1685 microversion: 2.1 time: 0.160974 Jul 01 11:44:28.949114 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3723/7348] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:28 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:29.967768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:29.968481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:29.975640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:29.975640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:29.976057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:29.976499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:30.109070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:30.116610 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5b617bed-8b18-4434-b742-184ef50d4471 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1665 microversion: 2.1 time: 0.154198 Jul 01 11:44:30.117198 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3626/7349] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:29 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:31.206360 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4b34da6e-665b-44b2-a160-4afe208324c7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:31.207306 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4b34da6e-665b-44b2-a160-4afe208324c7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:31.216045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b34da6e-665b-44b2-a160-4afe208324c7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:31.216698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b34da6e-665b-44b2-a160-4afe208324c7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:31.217839 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b34da6e-665b-44b2-a160-4afe208324c7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:31.218293 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4b34da6e-665b-44b2-a160-4afe208324c7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:31.283420 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4b34da6e-665b-44b2-a160-4afe208324c7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action" status: 200 len: 32638 microversion: 2.1 time: 0.080749 Jul 01 11:44:31.284052 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3724/7350] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:44:31 2022] POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action => generated 32638 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:44:31.295590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c34480fc-c6cd-4907-8663-5a8f5a6c7aa9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:31.296134 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c34480fc-c6cd-4907-8663-5a8f5a6c7aa9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:31.303048 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34480fc-c6cd-4907-8663-5a8f5a6c7aa9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:31.303499 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34480fc-c6cd-4907-8663-5a8f5a6c7aa9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:31.304267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34480fc-c6cd-4907-8663-5a8f5a6c7aa9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:31.304703 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c34480fc-c6cd-4907-8663-5a8f5a6c7aa9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:31.511916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c34480fc-c6cd-4907-8663-5a8f5a6c7aa9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action" status: 202 len: 0 microversion: 2.1 time: 0.220008 Jul 01 11:44:31.512476 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3627/7351] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:44:31 2022] POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:44:31.521374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:31.522098 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:31.529278 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:31.529743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:31.530538 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:31.530995 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:31.667794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:31.675351 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-12bbdca6-aeec-4867-b31c-8f358f3e5d6d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1672 microversion: 2.1 time: 0.158274 Jul 01 11:44:31.675919 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3725/7352] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:31 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:32.693990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:32.694727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:32.702497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:32.702943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:32.703708 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:32.704143 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:32.833756 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:32.842363 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9de8addc-1edf-4ad4-bb41-7018a84071dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1680 microversion: 2.1 time: 0.152950 Jul 01 11:44:32.845935 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3628/7353] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:32 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:32.933904 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48bf6f10-cefb-4884-881e-fb4daeea2efd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:32.934857 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-48bf6f10-cefb-4884-881e-fb4daeea2efd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:32.942834 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48bf6f10-cefb-4884-881e-fb4daeea2efd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:32.943312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48bf6f10-cefb-4884-881e-fb4daeea2efd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:32.944092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48bf6f10-cefb-4884-881e-fb4daeea2efd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:32.944543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48bf6f10-cefb-4884-881e-fb4daeea2efd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:32.997553 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-48bf6f10-cefb-4884-881e-fb4daeea2efd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action" status: 200 len: 37961 microversion: 2.1 time: 0.067384 Jul 01 11:44:32.998213 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3726/7354] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:44:32 2022] POST /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc/action => generated 37961 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:44:34.056389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:34.057303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:34.058452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-cf4f1612-16ee-4f89-ab8e-2140e49cab2a req-39a7233f-55a1-4c66-98d2-919a2a03b87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6316a7-8ff3-4681-8305-46676639ffbc", "tag": "051a77dd-decf-4cbc-8700-d7fe820d3eb4"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:34.064324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:34.064775 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:34.065733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:34.066168 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:34.067972 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cf4f1612-16ee-4f89-ab8e-2140e49cab2a req-39a7233f-55a1-4c66-98d2-919a2a03b87b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:34.068433 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-cf4f1612-16ee-4f89-ab8e-2140e49cab2a req-39a7233f-55a1-4c66-98d2-919a2a03b87b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:34.080411 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-cf4f1612-16ee-4f89-ab8e-2140e49cab2a req-39a7233f-55a1-4c66-98d2-919a2a03b87b service nova] Creating event network-changed:051a77dd-decf-4cbc-8700-d7fe820d3eb4 for instance 5f6316a7-8ff3-4681-8305-46676639ffbc on n-h2-master-1 Jul 01 11:44:34.085344 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-cf4f1612-16ee-4f89-ab8e-2140e49cab2a req-39a7233f-55a1-4c66-98d2-919a2a03b87b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030899 Jul 01 11:44:34.089440 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3727/7355] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:44:34.099145 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:44:34.402007 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-af598a7a-c93e-4eda-aca9-5886cea2b3fd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 204 len: 0 microversion: 2.1 time: 0.349846 Jul 01 11:44:34.403154 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3629/7356] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:44:34 2022] DELETE /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:44:34.414285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:34.418057 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:34.422821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:34.423355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:34.424184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:34.424740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:34.560452 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:34.568246 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-48527a15-c20b-46c8-801c-d6d34b9d2d91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1686 microversion: 2.1 time: 0.160183 Jul 01 11:44:34.568812 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3728/7357] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:34 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:35.586518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:35.595497 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:35.595497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:35.595497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:35.595497 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:35.595908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:35.732116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:35.739772 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4404362e-450f-41ab-881c-fa7718d6cc2a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1686 microversion: 2.1 time: 0.157532 Jul 01 11:44:35.740331 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3630/7358] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:35 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:36.758894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:36.759520 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:36.766361 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:36.766821 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:36.767598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:36.768045 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:36.919576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:36.924525 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-70aa389b-7328-4c3d-945f-55addc194c3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 200 len: 1569 microversion: 2.1 time: 0.170096 Jul 01 11:44:36.925172 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3729/7359] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:36 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:36.932141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-e01f222f-c6f4-4e24-90c0-74aa9a555d2b req-0a6047e2-778d-4bd5-9106-268b29e6928d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6316a7-8ff3-4681-8305-46676639ffbc", "name": "network-vif-deleted", "tag": "051a77dd-decf-4cbc-8700-d7fe820d3eb4"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:36.940868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e01f222f-c6f4-4e24-90c0-74aa9a555d2b req-0a6047e2-778d-4bd5-9106-268b29e6928d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:36.941364 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-e01f222f-c6f4-4e24-90c0-74aa9a555d2b req-0a6047e2-778d-4bd5-9106-268b29e6928d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:36.953741 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-e01f222f-c6f4-4e24-90c0-74aa9a555d2b req-0a6047e2-778d-4bd5-9106-268b29e6928d service nova] Creating event network-vif-deleted:051a77dd-decf-4cbc-8700-d7fe820d3eb4 for instance 5f6316a7-8ff3-4681-8305-46676639ffbc on n-h2-master-1 Jul 01 11:44:36.958541 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-e01f222f-c6f4-4e24-90c0-74aa9a555d2b req-0a6047e2-778d-4bd5-9106-268b29e6928d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030959 Jul 01 11:44:36.959132 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3631/7360] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:44:37.943346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:37.943967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: 5f6316a7-8ff3-4681-8305-46676639ffbc] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:37.951763 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:37.952226 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:37.953021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:37.953498 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:37.968546 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] HTTP exception thrown: Instance 5f6316a7-8ff3-4681-8305-46676639ffbc could not be found. Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Request method failure captured: Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc HTTP/1.1 Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivt3iKYRNMDATa7XvEuJgW7rQGilItNuRV6_d_8xSB37VP39Yb8N8f7CSubsdCwEw0QHmULNxVzm-Zev0bmzhi1zkjNRLsRYCbPJ92dUzgL7L1E9UY97cSO668ttCSvEY5uZdx3Tzni985zS3TuIn213lSLOJftpFHyUu3_z32I3UE4k Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_15b96072e1d94e0cb6b8cd96cd5be12e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 75be289075e445379af6da1f99bab64e Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 5f6316a7-8ff3-4681-8305-46676639ffbc could not be found. Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '5f6316a7-8ff3-4681-8305-46676639ffbc'} Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6316a7-8ff3-4681-8305-46676639ffbc could not be found. Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6316a7-8ff3-4681-8305-46676639ffbc could not be found. Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:44:37.970256 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6316a7-8ff3-4681-8305-46676639ffbc could not be found. Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Returning 404 to user: Instance 5f6316a7-8ff3-4681-8305-46676639ffbc could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:44:37.975294 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3214ff9e-07b1-4c56-abbc-b4074348e55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc" status: 404 len: 111 microversion: 2.1 time: 0.032602 Jul 01 11:44:37.976627 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3730/7361] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:37 2022] GET /compute/v2.1/servers/5f6316a7-8ff3-4681-8305-46676639ffbc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:44:41.822615 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-167cecba-80d3-467e-8b35-fdca97d7898f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '.version_select at 0x7f6f912e5700>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:41.898117 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-167cecba-80d3-467e-8b35-fdca97d7898f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-290698926" status: 202 len: 0 microversion: 2.1 time: 0.080512 Jul 01 11:44:41.898653 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3632/7362] 10.222.0.23 () {58 vars in 1280 bytes} [Fri Jul 1 11:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-290698926 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:44:41.926534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d9505521-c317-4d22-87f7-b8468192ac74 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: .version_select at 0x7f6f91396e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1521105015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsoo6kFax/q19JDdn9fNoorDRE85TMtZwIUCpX8F6z6qOfGJXZMta86lqwr6HjDvPh3a9XFA7+ath8Yi1kvXWOelXbaBGXNXT4GRJ6ChyYiEVNZrNHctrRUM+sT024WWA=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:41.941265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d9505521-c317-4d22-87f7-b8468192ac74 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:44:41.947879 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-d9505521-c317-4d22-87f7-b8468192ac74 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:44:42.048412 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d9505521-c317-4d22-87f7-b8468192ac74 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.125785 Jul 01 11:44:42.049033 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3731/7363] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:44:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:44:50.184722 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:44:50.188929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1370377122", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "64ee024b-817f-41d1-b76d-1d8c86b64689"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1521105015", "security_groups": [{"name": "tempest-secgroup-smoke-20977660"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:50.459659 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] validate_networks() for [('64ee024b-817f-41d1-b76d-1d8c86b64689', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:44:50.880066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:44:50.880502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:44:50.880983 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:44:50.881598 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:44:50.882019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:44:50.904515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:50.905105 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:50.905977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:50.906417 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:50.925201 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:44:50.931507 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:44:50.945583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:44:50.950609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:44:51.106053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ca2cc90e-e67b-430d-b54b-90652f7cfa5c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.922881 Jul 01 11:44:51.122104 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3633/7364] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:44:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 11:44:51.128456 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=40 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:44:51.132944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8972133-e340-4b12-ba1b-670db44ad568 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:51.133755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8972133-e340-4b12-ba1b-670db44ad568 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:51.294865 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8972133-e340-4b12-ba1b-670db44ad568 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:51.306207 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8972133-e340-4b12-ba1b-670db44ad568 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1267 microversion: 2.1 time: 0.179365 Jul 01 11:44:51.307338 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3732/7365] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:51 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:52.325114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:52.327272 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:52.334406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:52.334961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:52.335833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:52.336449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:52.405882 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:52.414294 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-059b9a3d-3ade-408a-b8c7-8a8b9f2cc6e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1271 microversion: 2.1 time: 0.094694 Jul 01 11:44:52.415461 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3634/7366] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:52 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:53.432265 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:53.432895 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:53.443368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:53.443838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:53.444630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:53.445094 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:53.509612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:53.518566 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2cdde708-7c1e-4016-9d30-c38833eb616b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1327 microversion: 2.1 time: 0.090559 Jul 01 11:44:53.528025 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3733/7367] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:53 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:44:54.535518 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:54.536251 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:54.544214 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:54.544663 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:54.545496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:54.545929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:54.679844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:54.688664 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-355f8bc6-b528-47c8-ace3-d7130699a159 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.156939 Jul 01 11:44:54.689845 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3635/7368] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:54 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:54.985769 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-6f0214a9-431a-4f29-b55d-42d2e8a6a98e req-f0eb0d40-7490-4943-bcaa-66df42482429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db4bdf27-e674-4cfd-af1a-ade8363bab8b", "tag": "9af1f348-cd7d-4f60-b9cf-890f8fe245b0"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:44:54.998412 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6f0214a9-431a-4f29-b55d-42d2e8a6a98e req-f0eb0d40-7490-4943-bcaa-66df42482429 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:54.998916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-6f0214a9-431a-4f29-b55d-42d2e8a6a98e req-f0eb0d40-7490-4943-bcaa-66df42482429 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:55.011086 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-6f0214a9-431a-4f29-b55d-42d2e8a6a98e req-f0eb0d40-7490-4943-bcaa-66df42482429 service nova] Creating event network-changed:9af1f348-cd7d-4f60-b9cf-890f8fe245b0 for instance db4bdf27-e674-4cfd-af1a-ade8363bab8b on n-h2-master-1 Jul 01 11:44:55.016345 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-6f0214a9-431a-4f29-b55d-42d2e8a6a98e req-f0eb0d40-7490-4943-bcaa-66df42482429 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035254 Jul 01 11:44:55.016980 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3734/7369] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:44:55.706625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:55.707277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:55.714225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:55.714685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:55.715461 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:55.716237 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:55.856918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:55.864499 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8f6f6e75-3324-4c69-a7fe-192cf46ef4c0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.161879 Jul 01 11:44:55.865082 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3636/7370] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:55 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:56.883154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:56.883874 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:56.890601 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:56.891063 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:56.891849 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:56.892301 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:57.025305 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:57.032896 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f6164de-7270-4c3f-8eba-90857900d706 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.154887 Jul 01 11:44:57.033498 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3735/7371] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:56 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:58.049589 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:58.050098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:58.056993 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:58.057464 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:58.058248 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:58.058678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:58.187845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:58.195511 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2acfbdb0-c30e-454a-8340-17d1e346dab9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.149856 Jul 01 11:44:58.196687 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3637/7372] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:58 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:44:59.213831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:44:59.214466 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:44:59.217325 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:44:59.222161 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:59.222625 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:59.223405 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:44:59.223859 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:44:59.357307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:44:59.364761 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ca061b8d-8492-4f6d-9bf7-147bed71f1b8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.155573 Jul 01 11:44:59.365366 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3736/7373] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:44:59 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:00.381364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:00.381974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:00.385339 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:00.390165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:00.390613 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:00.391419 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:00.391850 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:00.526970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:00.534570 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1e3dacdf-2e22-4718-8b74-743fa1fcf6c9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.157149 Jul 01 11:45:00.535139 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3638/7374] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:00 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:01.552144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:01.561933 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:01.561933 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:01.561933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:01.561933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:01.562298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:01.562714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:01.698594 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:01.706059 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7aae74b9-65e8-4bf5-917a-519b3df516b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.158026 Jul 01 11:45:01.706632 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3737/7375] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:01 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:02.372655 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-34049027-2c64-4db3-9db5-8ac170d64619 req-a0252601-1dba-4ce6-a86e-8428f120e345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db4bdf27-e674-4cfd-af1a-ade8363bab8b", "name": "network-vif-plugged", "status": "completed", "tag": "9af1f348-cd7d-4f60-b9cf-890f8fe245b0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:45:02.376641 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:02.380406 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:02.383818 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-34049027-2c64-4db3-9db5-8ac170d64619 req-a0252601-1dba-4ce6-a86e-8428f120e345 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:02.384266 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-34049027-2c64-4db3-9db5-8ac170d64619 req-a0252601-1dba-4ce6-a86e-8428f120e345 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:02.395228 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-34049027-2c64-4db3-9db5-8ac170d64619 req-a0252601-1dba-4ce6-a86e-8428f120e345 service nova] Creating event network-vif-plugged:9af1f348-cd7d-4f60-b9cf-890f8fe245b0 for instance db4bdf27-e674-4cfd-af1a-ade8363bab8b on n-h2-master-1 Jul 01 11:45:02.400865 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-34049027-2c64-4db3-9db5-8ac170d64619 req-a0252601-1dba-4ce6-a86e-8428f120e345 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032005 Jul 01 11:45:02.401497 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3639/7376] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:45:02.723018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:02.723641 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:02.730543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:02.731005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:02.731785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:02.732231 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:02.870908 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:02.878429 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c3ea2802-a7fd-4974-ba49-b66e1b15287f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.159317 Jul 01 11:45:02.878989 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3738/7377] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:02 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:03.898300 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:03.899429 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:03.906566 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:03.907025 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:03.907794 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:03.908229 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:04.044343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:04.051870 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eba25488-625a-46b7-a296-88aaa7f0d2b3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1391 microversion: 2.1 time: 0.159716 Jul 01 11:45:04.052445 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3640/7378] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:03 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:05.075545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:05.076161 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:05.082991 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:05.083450 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:05.084715 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:05.085396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:05.227493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:05.235147 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0a525b51-4ee7-4d93-a93b-ac65c152dc83 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1562 microversion: 2.1 time: 0.169621 Jul 01 11:45:05.235660 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3739/7379] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:05 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:05.251523 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:05.252142 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:05.259730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:05.260182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:05.260944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:05.261412 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:05.390504 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:05.398075 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f8e67c8c-fc21-44d2-bf39-f756443853cb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1562 microversion: 2.1 time: 0.150759 Jul 01 11:45:05.398653 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3641/7380] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:05 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:07.697805 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:07.698496 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:07.699224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-07df758c-7bfa-426f-a7d4-718f6c03fa00 req-61689b54-4fda-42b5-b133-6fe1ad6a30a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db4bdf27-e674-4cfd-af1a-ade8363bab8b", "tag": "9af1f348-cd7d-4f60-b9cf-890f8fe245b0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:45:07.706244 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:07.706853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:07.707698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:07.708212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:07.708925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-07df758c-7bfa-426f-a7d4-718f6c03fa00 req-61689b54-4fda-42b5-b133-6fe1ad6a30a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:07.709395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-07df758c-7bfa-426f-a7d4-718f6c03fa00 req-61689b54-4fda-42b5-b133-6fe1ad6a30a4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:07.721800 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-07df758c-7bfa-426f-a7d4-718f6c03fa00 req-61689b54-4fda-42b5-b133-6fe1ad6a30a4 service nova] Creating event network-changed:9af1f348-cd7d-4f60-b9cf-890f8fe245b0 for instance db4bdf27-e674-4cfd-af1a-ade8363bab8b on n-h2-master-1 Jul 01 11:45:07.727600 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-07df758c-7bfa-426f-a7d4-718f6c03fa00 req-61689b54-4fda-42b5-b133-6fe1ad6a30a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031408 Jul 01 11:45:07.728222 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3642/7381] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:45:07.862076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:07.869958 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f8d16465-8505-4a11-9e57-bf9095880393 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1562 microversion: 2.1 time: 0.176907 Jul 01 11:45:07.881841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3740/7382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:07 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:31.111318 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=9 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:31.112066 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=48 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:31.116225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-fac3ae89-825a-4f57-8e75-3bdf297b3cbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:45:31.117266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-fac3ae89-825a-4f57-8e75-3bdf297b3cbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:31.123891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fac3ae89-825a-4f57-8e75-3bdf297b3cbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:31.124351 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fac3ae89-825a-4f57-8e75-3bdf297b3cbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:31.125117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fac3ae89-825a-4f57-8e75-3bdf297b3cbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:31.125647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-fac3ae89-825a-4f57-8e75-3bdf297b3cbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:31.178742 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-fac3ae89-825a-4f57-8e75-3bdf297b3cbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b/action" status: 200 len: 24565 microversion: 2.1 time: 0.069248 Jul 01 11:45:31.179384 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3643/7383] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:45:31 2022] POST /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b/action => generated 24565 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:45:42.151312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-07c6996f-5d40-45cc-98ee-80c44d10271e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:45:42.152275 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-07c6996f-5d40-45cc-98ee-80c44d10271e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:42.154534 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=9 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:42.155212 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=44 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:42.160105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c6996f-5d40-45cc-98ee-80c44d10271e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:42.160570 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c6996f-5d40-45cc-98ee-80c44d10271e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:42.161383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c6996f-5d40-45cc-98ee-80c44d10271e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:42.161832 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-07c6996f-5d40-45cc-98ee-80c44d10271e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:42.362344 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-07c6996f-5d40-45cc-98ee-80c44d10271e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b/action" status: 202 len: 0 microversion: 2.1 time: 0.215469 Jul 01 11:45:42.362981 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3741/7384] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:45:42 2022] POST /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:45:42.371949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:42.372830 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:42.375597 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:42.376465 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:45:42.381726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:42.382911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:42.382911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:42.383437 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:42.523432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:42.531838 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f5271f72-1a02-4f38-9cd0-d66d449c8b60 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1672 microversion: 2.1 time: 0.164375 Jul 01 11:45:42.532416 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3644/7385] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:42 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:43.550026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:43.550741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:43.556996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:43.557488 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:43.558266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:43.558714 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:43.696540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:43.704111 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3a24faa4-e21f-4b70-8a93-4db44ad3b468 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.159409 Jul 01 11:45:43.704675 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3742/7386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:43 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:44.722242 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:44.722855 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:44.730459 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:44.730910 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:44.731676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:44.732134 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:44.864210 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:44.872543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a9d814dd-312f-4c4c-a9b0-d43c0c884947 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.154203 Jul 01 11:45:44.873120 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3645/7387] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:44 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:45.888901 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:45.889595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:45.896426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:45.896885 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:45.897688 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:45.898136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:46.031082 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:46.038762 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-94422208-ad1a-46ec-a930-9aad481f7db9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.153813 Jul 01 11:45:46.039326 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3743/7388] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:45 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:47.056664 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:47.057314 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:47.064808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:47.065293 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:47.066070 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:47.066507 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:47.202174 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:47.209952 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cbc41180-889f-442e-9e1e-9a45234e6895 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.157280 Jul 01 11:45:47.210531 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3646/7389] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:47 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:48.227652 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:48.228340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:48.235423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:48.235890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:48.236674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:48.237134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:48.415558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:48.423590 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b0a0e3e8-9cb5-469f-8d01-dd1fcb204ca4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.199913 Jul 01 11:45:48.424159 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3744/7390] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:48 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:49.441580 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:49.442200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:49.449948 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:49.450404 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:49.451173 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:49.451618 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:49.584107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:49.591684 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-521a86d2-a77b-4615-ab41-2492c6faceae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.154124 Jul 01 11:45:49.592263 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3647/7391] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:49 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:50.609651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:50.610246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:50.617192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:50.617652 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:50.618422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:50.618867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:50.753385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:50.761456 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-182f1ae1-d79b-4151-bc4f-64c324f8ecfd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.155079 Jul 01 11:45:50.762107 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3745/7392] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:50 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:51.779427 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:51.780040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:51.786930 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:51.787375 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:51.788133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:51.788570 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:51.919020 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:51.926674 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-76f1cbe7-7367-47db-b0e0-6b718988e7ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.151561 Jul 01 11:45:51.927152 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3648/7393] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:51 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:52.944261 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:52.944880 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:52.952117 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:52.952593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:52.953376 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:52.953822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:53.092620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:53.100210 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8eef7d9f-2b54-4cf7-b0c6-70a5c15c361f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.160275 Jul 01 11:45:53.100768 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3746/7394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:52 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:54.118064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:54.118713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:54.126406 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:54.126951 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:54.127741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:54.128182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:54.266583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:54.274149 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8637db30-fed2-46d4-95a5-4d65b47e22ef tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1677 microversion: 2.1 time: 0.160018 Jul 01 11:45:54.274743 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3649/7395] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:54 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:45:55.291453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:45:55.291993 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:45:55.298928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:55.299389 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:55.300165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:45:55.300614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:45:55.436172 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:45:55.444187 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-01f23e63-77b2-410d-9cad-9869395f2044 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1680 microversion: 2.1 time: 0.156802 Jul 01 11:45:55.444753 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3747/7396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:45:55 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:21.634408 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eab1fbe0-543f-4bc2-a208-11455d70c96d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:21.635343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eab1fbe0-543f-4bc2-a208-11455d70c96d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:21.637630 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:21.638463 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=36 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:21.643284 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab1fbe0-543f-4bc2-a208-11455d70c96d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:21.643944 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab1fbe0-543f-4bc2-a208-11455d70c96d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:21.644492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab1fbe0-543f-4bc2-a208-11455d70c96d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:21.644961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eab1fbe0-543f-4bc2-a208-11455d70c96d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:21.704060 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eab1fbe0-543f-4bc2-a208-11455d70c96d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b/action" status: 200 len: 69096 microversion: 2.1 time: 0.073638 Jul 01 11:46:21.704734 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3650/7397] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:46:21 2022] POST /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b/action => generated 69096 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:46:29.067717 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:29.068556 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:29.070308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-b72c2106-2488-4c6c-b15d-87fb0d6451e8 req-6b52819f-6f5b-41b5-9511-e28935d75813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db4bdf27-e674-4cfd-af1a-ade8363bab8b", "tag": "9af1f348-cd7d-4f60-b9cf-890f8fe245b0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:29.071205 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=14 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:29.072441 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:29.077769 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:29.078233 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:29.079021 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:29.079467 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:29.081606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b72c2106-2488-4c6c-b15d-87fb0d6451e8 req-6b52819f-6f5b-41b5-9511-e28935d75813 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:29.082135 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-b72c2106-2488-4c6c-b15d-87fb0d6451e8 req-6b52819f-6f5b-41b5-9511-e28935d75813 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:29.095115 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-b72c2106-2488-4c6c-b15d-87fb0d6451e8 req-6b52819f-6f5b-41b5-9511-e28935d75813 service nova] Creating event network-changed:9af1f348-cd7d-4f60-b9cf-890f8fe245b0 for instance db4bdf27-e674-4cfd-af1a-ade8363bab8b on n-h2-master-1 Jul 01 11:46:29.100521 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-b72c2106-2488-4c6c-b15d-87fb0d6451e8 req-6b52819f-6f5b-41b5-9511-e28935d75813 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034436 Jul 01 11:46:29.101813 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3651/7398] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:46:29.106478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:46:29.455480 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-06d83bb2-70ea-415b-8415-e12941606e25 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 204 len: 0 microversion: 2.1 time: 0.391785 Jul 01 11:46:29.456419 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3748/7399] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:46:29 2022] DELETE /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:46:29.465574 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:29.466411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:29.473728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:29.474479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:29.475513 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:29.476222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:29.615493 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:29.627745 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b3d28ea6-95a7-4ed3-9567-d4492968be9a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1686 microversion: 2.1 time: 0.166961 Jul 01 11:46:29.628501 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3652/7400] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:29 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:30.647799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:30.647799 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:30.653543 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:30.654011 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:30.654863 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:30.655321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:30.786949 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:30.795128 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc515f4a-717e-4a78-a0c4-9f705ab8d2a4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1686 microversion: 2.1 time: 0.153379 Jul 01 11:46:30.795702 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3749/7401] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:30 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:31.812938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:31.813659 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:31.821108 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:31.821703 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:31.823237 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:31.823850 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:31.839081 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-6c1b53fb-82cd-425c-a868-bbaf22706ede req-2a105117-5bf6-45c8-aed7-3be8858a915b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db4bdf27-e674-4cfd-af1a-ade8363bab8b", "name": "network-vif-deleted", "tag": "9af1f348-cd7d-4f60-b9cf-890f8fe245b0"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:31.850030 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6c1b53fb-82cd-425c-a868-bbaf22706ede req-2a105117-5bf6-45c8-aed7-3be8858a915b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:31.850487 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-6c1b53fb-82cd-425c-a868-bbaf22706ede req-2a105117-5bf6-45c8-aed7-3be8858a915b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:31.863671 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-6c1b53fb-82cd-425c-a868-bbaf22706ede req-2a105117-5bf6-45c8-aed7-3be8858a915b service nova] Creating event network-vif-deleted:9af1f348-cd7d-4f60-b9cf-890f8fe245b0 for instance db4bdf27-e674-4cfd-af1a-ade8363bab8b on n-h2-master-1 Jul 01 11:46:31.868731 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-6c1b53fb-82cd-425c-a868-bbaf22706ede req-2a105117-5bf6-45c8-aed7-3be8858a915b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094641 Jul 01 11:46:31.869894 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3653/7402] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:46:31.895896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:31.903657 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-076860a9-3fe8-4057-ba53-36589c3737da tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 200 len: 1502 microversion: 2.1 time: 0.094689 Jul 01 11:46:31.904222 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3750/7403] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:31 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 1502 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:32.922211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:32.922852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: db4bdf27-e674-4cfd-af1a-ade8363bab8b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:32.929098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:32.929580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:32.930370 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:32.930811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:32.944424 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] HTTP exception thrown: Instance db4bdf27-e674-4cfd-af1a-ade8363bab8b could not be found. Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Request method failure captured: Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b HTTP/1.1 Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivt3iKYRNMDATa7XvEuJgW7rQGilItNuRV6_d_8xSB37VP39Yb8N8f7CSubsdCwEw0QHmULNxVzm-Zev0bmzhi1zkjNRLsRYCbPJ92dUzgL7L1E9UY97cSO668ttCSvEY5uZdx3Tzni985zS3TuIn213lSLOJftpFHyUu3_z32I3UE4k Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_15b96072e1d94e0cb6b8cd96cd5be12e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 75be289075e445379af6da1f99bab64e Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: exception: Instance db4bdf27-e674-4cfd-af1a-ade8363bab8b could not be found. Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'db4bdf27-e674-4cfd-af1a-ade8363bab8b'} Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db4bdf27-e674-4cfd-af1a-ade8363bab8b could not be found. Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db4bdf27-e674-4cfd-af1a-ade8363bab8b could not be found. Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:46:32.946105 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db4bdf27-e674-4cfd-af1a-ade8363bab8b could not be found. Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Returning 404 to user: Instance db4bdf27-e674-4cfd-af1a-ade8363bab8b could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4f23a056-7c9e-4e6c-a12b-1449b6caf2cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b" status: 404 len: 111 microversion: 2.1 time: 0.031077 Jul 01 11:46:32.951123 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3654/7404] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:32 2022] GET /compute/v2.1/servers/db4bdf27-e674-4cfd-af1a-ade8363bab8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 11:46:36.650824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9d1c2634-b042-4d23-a7ec-b4d79cc6ebe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '.version_select at 0x7f6f970eca60>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:36.715983 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9d1c2634-b042-4d23-a7ec-b4d79cc6ebe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1521105015" status: 202 len: 0 microversion: 2.1 time: 0.069688 Jul 01 11:46:36.716579 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3751/7405] 10.222.0.23 () {58 vars in 1283 bytes} [Fri Jul 1 11:46:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1521105015 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:46:36.746075 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-149fafe7-a610-42d6-a76c-6298014a1035 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: .version_select at 0x7f6f907eb160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1431554478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw4srNfg05IzUBFaodJCRtFqJIXMuB1jKiri38KpOzb9uV8K1gOpa2R11yZLyO+sZFDCxust0Vl5Ez4PdYS9YEdBJVyUmxXv0ll42Ww8Dg0PqVGGCXjEBo2k7xaQ74XbA=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:36.762222 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-149fafe7-a610-42d6-a76c-6298014a1035 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:46:36.767399 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-149fafe7-a610-42d6-a76c-6298014a1035 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:46:36.858370 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-149fafe7-a610-42d6-a76c-6298014a1035 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.116831 Jul 01 11:46:36.858971 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3655/7406] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:46:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:46:44.525715 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:44.529884 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-146961525", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "79a64b32-aa8f-40ed-85e1-360aedd366e2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1431554478", "security_groups": [{"name": "tempest-secgroup-smoke-2133102498"}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:44.652213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] validate_networks() for [('79a64b32-aa8f-40ed-85e1-360aedd366e2', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:46:45.114587 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:46:45.115357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:46:45.116024 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:46:45.116441 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:46:45.117037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:46:45.128307 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:45.128765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:45.129620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:45.130071 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:45.147531 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:46:45.152970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:46:45.165549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:46:45.167868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:46:45.283471 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ffe0d5ef-8149-4a36-9b19-2fe580ab6196 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760064 Jul 01 11:46:45.284299 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3752/7407] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:46:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:46:45.294147 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c75c70fd-9031-4a03-9360-0b2f19b176c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:45.295372 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c75c70fd-9031-4a03-9360-0b2f19b176c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:45.299279 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=16 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:45.356411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c75c70fd-9031-4a03-9360-0b2f19b176c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:45.364664 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c75c70fd-9031-4a03-9360-0b2f19b176c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1266 microversion: 2.1 time: 0.074178 Jul 01 11:46:45.365705 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3656/7408] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:45 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:46.383900 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:46.385702 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:46.392482 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:46.393761 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:46.394749 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:46.395362 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:46.477728 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:46.486624 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1b6c2cce-67b4-41bd-a8ae-63b0898138d1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1270 microversion: 2.1 time: 0.107781 Jul 01 11:46:46.496701 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3753/7409] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:46 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:47.504767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:47.505593 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:47.513743 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:47.514853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:47.516264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:47.517306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:47.587505 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:47.597552 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0daebb0e-47a1-413a-9557-c90d4cd0fd52 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1326 microversion: 2.1 time: 0.097281 Jul 01 11:46:47.598788 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3657/7410] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:47 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:48.615214 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:48.615896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:48.628921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:48.629415 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:48.634646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:48.634646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:48.769934 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:48.778286 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-65859b82-fc78-4108-af6e-bdd8c831bd57 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1392 microversion: 2.1 time: 0.167099 Jul 01 11:46:48.778862 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3754/7411] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:48 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:49.265239 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-82644958-2b3a-4871-b6e7-f3af7308274e req-44fd1183-82c4-48a4-ae0c-3db3483e9ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:49.276282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-82644958-2b3a-4871-b6e7-f3af7308274e req-44fd1183-82c4-48a4-ae0c-3db3483e9ae5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:49.278059 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-82644958-2b3a-4871-b6e7-f3af7308274e req-44fd1183-82c4-48a4-ae0c-3db3483e9ae5 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:49.288989 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-82644958-2b3a-4871-b6e7-f3af7308274e req-44fd1183-82c4-48a4-ae0c-3db3483e9ae5 service nova] Creating event network-changed:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h2-master-1 Jul 01 11:46:49.294265 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-82644958-2b3a-4871-b6e7-f3af7308274e req-44fd1183-82c4-48a4-ae0c-3db3483e9ae5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037758 Jul 01 11:46:49.294884 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3658/7412] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:46:49.795447 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:49.796175 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:49.803436 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:49.803902 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:49.804680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:49.805127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:49.964944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:49.972499 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-475349bd-c812-44a7-b362-9271f40c4322 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1392 microversion: 2.1 time: 0.181031 Jul 01 11:46:49.973075 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3755/7413] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:49 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:50.992816 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:50.993539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:51.000612 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:51.001076 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:51.001914 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:51.002357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:51.137220 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:51.144824 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-51fbbc11-ac09-42ea-aeb1-f1314e991102 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1392 microversion: 2.1 time: 0.157017 Jul 01 11:46:51.145420 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3659/7414] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:50 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:52.161802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:52.162453 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:52.169920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:52.170383 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:52.171169 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:52.171646 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:52.302343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:52.310384 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6375fb8d-81c8-4382-95ec-64dd8c7c48e6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1392 microversion: 2.1 time: 0.152568 Jul 01 11:46:52.310962 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3756/7415] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:52 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:53.328128 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:53.328743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:53.331578 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:53.336454 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:53.336906 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:53.337707 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:53.338139 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:53.482980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:53.490973 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f15cbc3a-8149-4a7b-99e0-4948f4cbab54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1392 microversion: 2.1 time: 0.166750 Jul 01 11:46:53.491584 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3660/7416] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:53 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:54.508331 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:54.508963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:54.516446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:54.519480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:54.519480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:54.519480 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:54.651596 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:54.659051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-345d2971-eef4-474a-9585-6c2eb960c0e0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1392 microversion: 2.1 time: 0.154643 Jul 01 11:46:54.659606 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3757/7417] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:54 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:55.098436 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-d95cbe3d-4c74-4b95-becd-472f50f50514 req-683e9ae6-2d1f-4a46-91a4-34c9e45cad59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "name": "network-vif-plugged", "status": "completed", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:55.107132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d95cbe3d-4c74-4b95-becd-472f50f50514 req-683e9ae6-2d1f-4a46-91a4-34c9e45cad59 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:55.107585 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-d95cbe3d-4c74-4b95-becd-472f50f50514 req-683e9ae6-2d1f-4a46-91a4-34c9e45cad59 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:55.119527 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-d95cbe3d-4c74-4b95-becd-472f50f50514 req-683e9ae6-2d1f-4a46-91a4-34c9e45cad59 service nova] Creating event network-vif-plugged:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h2-master-1 Jul 01 11:46:55.124578 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-d95cbe3d-4c74-4b95-becd-472f50f50514 req-683e9ae6-2d1f-4a46-91a4-34c9e45cad59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085831 Jul 01 11:46:55.125203 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3661/7418] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:46:55.675514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:55.676105 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:55.678109 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:55.678802 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:55.684493 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:55.684955 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:55.685766 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:55.686242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:55.824768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:55.832240 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6389b701-e12e-4e7c-b3a3-c629f33ff04b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1392 microversion: 2.1 time: 0.160677 Jul 01 11:46:55.832824 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3758/7419] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:55 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:56.846520 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:56.851509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:56.852207 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:56.859394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:56.868322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:56.868322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:56.868322 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:56.993562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:57.001175 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f373757c-4aaf-455b-90e8-11c2c9be65c4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1564 microversion: 2.1 time: 0.155683 Jul 01 11:46:57.001735 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3662/7420] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:56 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:57.018608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:57.019237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:57.026630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:57.027086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:57.027866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:57.028318 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:57.161561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:57.169781 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0968cb41-d08f-4d30-a257-5ca60f7f89be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1564 microversion: 2.1 time: 0.155189 Jul 01 11:46:57.170349 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3759/7421] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:57 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:46:59.336697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:46:59.336697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:46:59.338755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:59.339200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:59.340017 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:59.340446 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:59.399490 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-167dc4d4-bc1b-4533-a9d5-e76f578086ec req-aeffa0af-b8eb-4455-a6c6-ddb64d0efa4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:46:59.404409 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:46:59.408594 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-167dc4d4-bc1b-4533-a9d5-e76f578086ec req-aeffa0af-b8eb-4455-a6c6-ddb64d0efa4b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:46:59.409126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-167dc4d4-bc1b-4533-a9d5-e76f578086ec req-aeffa0af-b8eb-4455-a6c6-ddb64d0efa4b service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:46:59.421530 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-167dc4d4-bc1b-4533-a9d5-e76f578086ec req-aeffa0af-b8eb-4455-a6c6-ddb64d0efa4b service nova] Creating event network-changed:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h2-master-1 Jul 01 11:46:59.426992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-167dc4d4-bc1b-4533-a9d5-e76f578086ec req-aeffa0af-b8eb-4455-a6c6-ddb64d0efa4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099123 Jul 01 11:46:59.428115 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3760/7422] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:46:59.487684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:46:59.500049 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1f83d460-8adb-4569-9adc-41ba2e0eb069 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1564 microversion: 2.1 time: 0.174697 Jul 01 11:46:59.500831 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3663/7423] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:46:59 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:22.861352 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=46 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:47:22.865597 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6f44b1ab-1732-4714-aa0b-5c76b9b361f4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:47:22.866676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6f44b1ab-1732-4714-aa0b-5c76b9b361f4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:22.873364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f44b1ab-1732-4714-aa0b-5c76b9b361f4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:22.881312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f44b1ab-1732-4714-aa0b-5c76b9b361f4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:22.881312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f44b1ab-1732-4714-aa0b-5c76b9b361f4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:22.881312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6f44b1ab-1732-4714-aa0b-5c76b9b361f4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:22.925804 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6f44b1ab-1732-4714-aa0b-5c76b9b361f4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action" status: 200 len: 24573 microversion: 2.1 time: 0.066155 Jul 01 11:47:22.926357 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3761/7424] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:47:22 2022] POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:47:26.823450 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:47:26.823990 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:47:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:47:33.857304 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:47:33.858908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:33.861302 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=7 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:47:33.861954 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=34 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:47:33.866688 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:33.867130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:33.867886 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:33.868315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:33.906769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:33.912966 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119765) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 01 11:47:33.919116 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:47:33.919536 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:47:33.920050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:47:33.921105 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:47:33.921548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:47:34.104865 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-38b857f0-a679-443d-bec5-1f6431f72d29 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action" status: 202 len: 0 microversion: 2.1 time: 0.251491 Jul 01 11:47:34.105517 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3664/7425] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:47:33 2022] POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:47:34.114532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:34.115326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:34.118787 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:47:34.125381 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:34.128379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:34.128379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:34.128379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:34.261987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:34.270224 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7eb2007-d838-4c6a-90ae-04f2accb928e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1692 microversion: 2.1 time: 0.160113 Jul 01 11:47:34.270778 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3762/7426] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:34 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:35.288618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:35.289250 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:35.296811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:35.297320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:35.298088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:35.298527 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:35.443296 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:35.452436 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f54fb072-b329-4847-871b-ae22e189f223 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1692 microversion: 2.1 time: 0.167719 Jul 01 11:47:35.453015 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3665/7427] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:35 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:36.469835 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:36.470463 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:36.478813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:36.485539 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:36.485539 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:36.485539 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:36.620164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:36.627988 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5ebd3de9-d212-4d17-a5d0-cc68861c4951 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1692 microversion: 2.1 time: 0.162066 Jul 01 11:47:36.628566 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3763/7428] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:36 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:47:37.646219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:37.646834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:37.654045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:37.654519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:37.655288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:37.655726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:37.797432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:37.805137 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5d169caa-99eb-45b8-9c19-94ec1c04b8c5 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1692 microversion: 2.1 time: 0.162989 Jul 01 11:47:37.805755 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3666/7429] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:37 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:38.823357 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:38.823976 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:38.831634 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:38.832086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:38.832848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:38.833322 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:38.966494 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:38.974055 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-af887023-2589-43bf-8d00-eff17c00d454 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.154607 Jul 01 11:47:38.974618 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3764/7430] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:38 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:39.991413 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:39.992027 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:39.998706 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:39.999149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:39.999895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:40.000324 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:40.127702 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:40.135284 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-efd10bad-dfe0-414c-b643-0d0693bdb0ae tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.147834 Jul 01 11:47:40.135843 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3667/7431] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:39 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:41.153237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:41.153864 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:41.161019 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:41.161514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:41.162291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:41.162738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:41.293743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:41.301992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbfd7a8a-07cb-41c3-853d-0e4796d01718 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.152729 Jul 01 11:47:41.302569 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3765/7432] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:41 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:42.319416 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:42.320056 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:42.327583 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:42.328024 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:42.328782 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:42.329243 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:42.462184 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:42.470378 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c035551f-af74-4685-b72a-e6ec00a589dd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.155231 Jul 01 11:47:42.470949 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3668/7433] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:42 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:43.487916 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:43.488532 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:43.495372 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:43.495830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:43.496599 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:43.497044 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:43.629760 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:43.637522 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-10816fe7-58cc-4b96-93fd-98e2dea5643c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.153447 Jul 01 11:47:43.638095 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3766/7434] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:43 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:44.654224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:44.655562 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:44.662627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:44.663078 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:44.663838 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:44.664272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:44.798870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:44.806629 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9c98ea5b-b9f9-47d7-b01a-b024fa56b47e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.156404 Jul 01 11:47:44.807208 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3669/7435] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:44 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:45.825558 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:45.826929 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:45.832964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:45.834279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:45.834279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:45.834655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:45.966513 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:45.974199 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc06d9ce-beca-4723-ae0f-90c507b75dd1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.153665 Jul 01 11:47:45.974989 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3767/7436] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:45 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:47:46.991774 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:46.992391 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:46.999397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:46.999841 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:47.000627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:47.001060 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:47.138257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:47.146467 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bd11904e-5a3c-4c9c-9f12-40e21e39253c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.158680 Jul 01 11:47:47.155558 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3670/7437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:46 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:48.163510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:48.164132 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:48.171711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:48.172166 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:48.172950 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:48.173411 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:48.316631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:48.324572 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e0aa0512-48c1-4e49-a1b8-03fd6d20b741 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.165033 Jul 01 11:47:48.325137 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3768/7438] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:48 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:49.343480 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:49.344026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:49.351165 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:49.351610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:49.352365 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:49.352793 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:49.484271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:49.491828 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a374102e-6eab-457a-8b1b-28cb0bd75e33 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.152341 Jul 01 11:47:49.492397 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3671/7439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:49 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:50.509537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:50.510163 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:50.517820 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:50.518282 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:50.519062 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:50.519507 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:50.652475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:50.661765 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bb70100c-c311-4d54-a40c-41aa2d5b795f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.156311 Jul 01 11:47:50.662351 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3769/7440] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:50 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:51.678698 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:51.679421 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:51.686875 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:51.687331 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:51.688162 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:51.688624 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:51.823842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:51.832035 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-83af8da7-1244-42c1-ae5d-5ae0a7b9dbf4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.157242 Jul 01 11:47:51.832614 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3672/7441] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:51 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:52.849740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:52.850396 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:52.857333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:52.857792 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:52.858561 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:52.859005 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:52.992164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:53.000259 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e5f459c3-e720-4b5c-babb-55ebc4278599 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.154462 Jul 01 11:47:53.000833 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3770/7442] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:52 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:54.017226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:54.017844 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:54.024759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:54.025240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:54.026013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:54.026451 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:54.161848 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:54.169422 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-96f15512-524f-450d-a551-e9dfdf5e037e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.156086 Jul 01 11:47:54.169992 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3673/7443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:54 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:55.186457 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:55.187715 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:55.195010 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:55.195470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:55.196246 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:55.196692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:55.329514 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:55.336966 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-69c8f228-65d8-4d88-a6a6-a2744b839e15 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1697 microversion: 2.1 time: 0.154412 Jul 01 11:47:55.337561 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3771/7444] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:55 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:56.355688 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:56.357022 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:56.364991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:56.366032 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:56.366270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:56.366698 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:56.519067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:56.527141 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3334403c-2d1f-4d2c-9534-89d3d2cc9c84 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1696 microversion: 2.1 time: 0.176215 Jul 01 11:47:56.527752 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3674/7445] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:56 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:56.673048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-787ec672-c660-4d9e-85c5-b39a594cfb7b req-1aa2cf22-35a9-4e01-87ef-61d8de890281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "name": "network-vif-unplugged", "status": "completed", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:47:56.682291 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-787ec672-c660-4d9e-85c5-b39a594cfb7b req-1aa2cf22-35a9-4e01-87ef-61d8de890281 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:56.682756 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-787ec672-c660-4d9e-85c5-b39a594cfb7b req-1aa2cf22-35a9-4e01-87ef-61d8de890281 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:56.694749 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-787ec672-c660-4d9e-85c5-b39a594cfb7b req-1aa2cf22-35a9-4e01-87ef-61d8de890281 service nova] Creating event network-vif-unplugged:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h1-master-1 Jul 01 11:47:56.700142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [req-787ec672-c660-4d9e-85c5-b39a594cfb7b req-1aa2cf22-35a9-4e01-87ef-61d8de890281 service nova] Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119764) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:47:56.712636 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-787ec672-c660-4d9e-85c5-b39a594cfb7b req-1aa2cf22-35a9-4e01-87ef-61d8de890281 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043515 Jul 01 11:47:56.713628 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3772/7446] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:47:57.545112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:57.545693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:57.553170 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:57.553640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:57.554414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:57.554857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:57.697038 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:57.705181 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dca7526e-ed84-4bbf-9a35-24b20e8aa57f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1696 microversion: 2.1 time: 0.164065 Jul 01 11:47:57.705788 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3675/7447] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:57 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:58.723687 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:58.724406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:58.727354 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-bd895b98-282c-457b-ad9e-60bd4e256fa8 req-b31827ae-6f6a-4cd9-acae-19e554844822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:47:58.731735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:58.732199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:58.732971 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:58.733512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:58.736227 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bd895b98-282c-457b-ad9e-60bd4e256fa8 req-b31827ae-6f6a-4cd9-acae-19e554844822 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:58.736685 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-bd895b98-282c-457b-ad9e-60bd4e256fa8 req-b31827ae-6f6a-4cd9-acae-19e554844822 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:58.748162 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-bd895b98-282c-457b-ad9e-60bd4e256fa8 req-b31827ae-6f6a-4cd9-acae-19e554844822 service nova] Creating event network-changed:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h1-master-1 Jul 01 11:47:58.753477 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [req-bd895b98-282c-457b-ad9e-60bd4e256fa8 req-b31827ae-6f6a-4cd9-acae-19e554844822 service nova] Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119765) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 01 11:47:58.764376 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-bd895b98-282c-457b-ad9e-60bd4e256fa8 req-b31827ae-6f6a-4cd9-acae-19e554844822 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040668 Jul 01 11:47:58.765528 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3676/7448] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:47:58.871561 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:47:58.879127 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-99b55422-23e9-49f7-ad42-38cc177763d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1694 microversion: 2.1 time: 0.160266 Jul 01 11:47:58.879710 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3773/7449] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:58 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:47:59.898120 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:47:59.899102 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:47:59.905990 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:59.906441 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:47:59.907209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:47:59.907689 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:00.044359 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:00.053018 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f53bdf5b-07ac-4239-b687-cf9e5c276d23 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1691 microversion: 2.1 time: 0.160034 Jul 01 11:48:00.053702 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3677/7450] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:47:59 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:00.069906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bed1eb8f-0197-44a8-8225-67f19afe16c3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:00.070451 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bed1eb8f-0197-44a8-8225-67f19afe16c3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:00.077165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bed1eb8f-0197-44a8-8225-67f19afe16c3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:00.077632 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bed1eb8f-0197-44a8-8225-67f19afe16c3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:00.078409 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bed1eb8f-0197-44a8-8225-67f19afe16c3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:00.078854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bed1eb8f-0197-44a8-8225-67f19afe16c3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:00.293175 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bed1eb8f-0197-44a8-8225-67f19afe16c3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action" status: 204 len: 0 microversion: 2.1 time: 0.227362 Jul 01 11:48:00.293841 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3774/7451] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:48:00 2022] POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:48:00.301937 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:00.302624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:00.308908 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:00.309347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:00.310130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:00.310572 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:00.451440 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:00.459833 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d3b49a36-a326-4f34-a995-a157be5410db tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1691 microversion: 2.1 time: 0.161838 Jul 01 11:48:00.460408 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3678/7452] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:00 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:00.477239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:00.477964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:00.484324 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:00.484785 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:00.485633 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:00.486083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:00.620763 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:00.629423 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-749e5d7c-1386-48b2-bc58-adcb9eb62bfc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1691 microversion: 2.1 time: 0.156300 Jul 01 11:48:00.630016 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3775/7453] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:00 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:01.646988 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:01.647605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:01.654545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:01.655007 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:01.656434 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:01.656873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:01.675818 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:01.790841 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:01.798916 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-74888670-fc78-46ef-89a8-363cd3111d79 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1691 microversion: 2.1 time: 0.155805 Jul 01 11:48:01.799741 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3679/7454] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:01 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:02.815867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:02.816499 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:02.823672 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:02.824134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:02.824910 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:02.825396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:02.958114 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:02.965612 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-135c1336-cc7a-4be8-8c44-94a86ff33cc9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1683 microversion: 2.1 time: 0.153617 Jul 01 11:48:02.966190 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3776/7455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:02 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:03.427388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-020bc0f1-3338-4561-b7e0-3e88d88cb7ac req-c9e45d9a-5bd7-49c1-a330-166bd4470c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "name": "network-vif-plugged", "status": "completed", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:03.437763 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-020bc0f1-3338-4561-b7e0-3e88d88cb7ac req-c9e45d9a-5bd7-49c1-a330-166bd4470c3f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:03.440731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-020bc0f1-3338-4561-b7e0-3e88d88cb7ac req-c9e45d9a-5bd7-49c1-a330-166bd4470c3f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:03.449621 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-020bc0f1-3338-4561-b7e0-3e88d88cb7ac req-c9e45d9a-5bd7-49c1-a330-166bd4470c3f service nova] Creating event network-vif-plugged:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h1-master-1 Jul 01 11:48:03.454669 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-020bc0f1-3338-4561-b7e0-3e88d88cb7ac req-c9e45d9a-5bd7-49c1-a330-166bd4470c3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031059 Jul 01 11:48:03.455265 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3680/7456] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:48:25.140475 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bddee06f-4c9f-49bf-a934-02f534681731 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:25.141470 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bddee06f-4c9f-49bf-a934-02f534681731 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:25.143940 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=33 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:25.144608 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:25.149423 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bddee06f-4c9f-49bf-a934-02f534681731 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:25.149883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bddee06f-4c9f-49bf-a934-02f534681731 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:25.150658 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bddee06f-4c9f-49bf-a934-02f534681731 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:25.151101 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bddee06f-4c9f-49bf-a934-02f534681731 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:25.215306 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bddee06f-4c9f-49bf-a934-02f534681731 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action" status: 200 len: 24580 microversion: 2.1 time: 0.078506 Jul 01 11:48:25.216200 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3777/7457] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:48:25 2022] POST /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d/action => generated 24580 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:48:32.366763 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=38 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:32.371076 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-4fc63e55-5612-491e-9d87-20fe30fbe2e7 req-01a013b1-4865-4130-9b8f-a190feca0bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:32.371520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:32.372263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:32.379953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:32.380405 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:32.381193 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:32.381627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:32.382066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4fc63e55-5612-491e-9d87-20fe30fbe2e7 req-01a013b1-4865-4130-9b8f-a190feca0bfc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:32.382642 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-4fc63e55-5612-491e-9d87-20fe30fbe2e7 req-01a013b1-4865-4130-9b8f-a190feca0bfc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:32.397753 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-4fc63e55-5612-491e-9d87-20fe30fbe2e7 req-01a013b1-4865-4130-9b8f-a190feca0bfc service nova] Creating event network-changed:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h1-master-1 Jul 01 11:48:32.403572 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-4fc63e55-5612-491e-9d87-20fe30fbe2e7 req-01a013b1-4865-4130-9b8f-a190feca0bfc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036925 Jul 01 11:48:32.404982 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3778/7458] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:48:32.410633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:48:32.694704 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-69c483dd-b908-4e9f-a5b1-7a7ac0811c56 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 204 len: 0 microversion: 2.1 time: 0.329801 Jul 01 11:48:32.696435 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3681/7459] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:48:32 2022] DELETE /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:48:32.705557 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:32.706293 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:32.715181 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:32.715944 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:32.716814 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:32.717377 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:32.858294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:32.866063 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-efbef3c8-5bd7-4e2b-a440-cbb28c5b9d89 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1689 microversion: 2.1 time: 0.166003 Jul 01 11:48:32.866629 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3779/7460] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:32 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:33.884337 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:33.885046 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:33.893802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:33.893802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:33.894265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:33.894565 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:34.030585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:34.038183 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-850b5af2-0d2e-4a3e-883e-bb12497d983e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1689 microversion: 2.1 time: 0.158183 Jul 01 11:48:34.038962 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3682/7461] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:33 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:34.805127 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-638a2510-f614-431c-b6b6-f92b6018eedb req-e25fadfa-deac-4adf-84b3-3fd0f0ab1b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa6a7bd-6cd4-40ab-88b2-7c4ec162509d", "name": "network-vif-deleted", "tag": "1b14ca5e-68f7-4549-b170-548e5688810a"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:34.813931 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-638a2510-f614-431c-b6b6-f92b6018eedb req-e25fadfa-deac-4adf-84b3-3fd0f0ab1b44 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:34.817980 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-638a2510-f614-431c-b6b6-f92b6018eedb req-e25fadfa-deac-4adf-84b3-3fd0f0ab1b44 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:34.825725 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-638a2510-f614-431c-b6b6-f92b6018eedb req-e25fadfa-deac-4adf-84b3-3fd0f0ab1b44 service nova] Creating event network-vif-deleted:1b14ca5e-68f7-4549-b170-548e5688810a for instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d on n-h1-master-1 Jul 01 11:48:34.831046 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-638a2510-f614-431c-b6b6-f92b6018eedb req-e25fadfa-deac-4adf-84b3-3fd0f0ab1b44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029572 Jul 01 11:48:34.831621 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3780/7462] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:48:35.056070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:35.056611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:35.064124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:35.064577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:35.065579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:35.066022 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:35.133301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:35.142139 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-89c4cfd3-4c91-4d17-9ad7-8d1c2eb5325d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 200 len: 1351 microversion: 2.1 time: 0.090028 Jul 01 11:48:35.145189 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3683/7463] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:35 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:36.161526 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:36.162207 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: faa6a7bd-6cd4-40ab-88b2-7c4ec162509d] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:36.168487 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:36.168949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:36.169788 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:36.170242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:36.183439 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] HTTP exception thrown: Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d could not be found. Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Request method failure captured: Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d HTTP/1.1 Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivt3iKYRNMDATa7XvEuJgW7rQGilItNuRV6_d_8xSB37VP39Yb8N8f7CSubsdCwEw0QHmULNxVzm-Zev0bmzhi1zkjNRLsRYCbPJ92dUzgL7L1E9UY97cSO668ttCSvEY5uZdx3Tzni985zS3TuIn213lSLOJftpFHyUu3_z32I3UE4k Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_15b96072e1d94e0cb6b8cd96cd5be12e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 75be289075e445379af6da1f99bab64e Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: exception: Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d could not be found. Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'faa6a7bd-6cd4-40ab-88b2-7c4ec162509d'} Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d could not be found. Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d could not be found. Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:48:36.185043 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d could not be found. Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Returning 404 to user: Instance faa6a7bd-6cd4-40ab-88b2-7c4ec162509d could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9fdc6802-802e-4112-8873-7d5d2d90399c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d" status: 404 len: 111 microversion: 2.1 time: 0.030331 Jul 01 11:48:36.189894 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3781/7464] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:36 2022] GET /compute/v2.1/servers/faa6a7bd-6cd4-40ab-88b2-7c4ec162509d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:48:39.665867 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3010a37f-ff20-4502-a8c1-90b5b665eb40 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '.version_select at 0x7f6f90c2f0d0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:39.804032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3010a37f-ff20-4502-a8c1-90b5b665eb40 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1431554478" status: 202 len: 0 microversion: 2.1 time: 0.142803 Jul 01 11:48:39.804529 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3684/7465] 10.222.0.23 () {58 vars in 1283 bytes} [Fri Jul 1 11:48:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1431554478 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:48:39.833134 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-857733a1-dce2-4a07-bf77-0f09751e0439 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: .version_select at 0x7f6f90246160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1028018235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/nBMye8aHmVyoumxcABSS5vBbBeQed4sGe1iSfEGC9DGVTysOuJgx0DXHOTniIc8O/qaPWle5QWaSIvGBzjXfH9j8g7OeyWFvwxhDR7roKtXRNNVSKShehrJD3aGxaqw=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:39.848106 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-857733a1-dce2-4a07-bf77-0f09751e0439 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:48:39.853397 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-857733a1-dce2-4a07-bf77-0f09751e0439 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:48:39.917647 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-857733a1-dce2-4a07-bf77-0f09751e0439 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.088320 Jul 01 11:48:39.918227 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3782/7466] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:48:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:48:48.141779 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:48.146083 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-871951263", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "1fd67ead-e1f3-4353-a1a7-762ca0930782"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1028018235", "security_groups": [{"name": "tempest-secgroup-smoke-1836886420"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:48.276796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] validate_networks() for [('1fd67ead-e1f3-4353-a1a7-762ca0930782', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:48:48.788630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:48:48.789392 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:48:48.790036 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:48:48.790662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:48:48.791082 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:48:48.800916 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:48.801431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:48.802239 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:48.802890 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:48.822200 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:48:48.828858 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:48:48.843520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:48:48.846219 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:48:48.949088 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4615e170-82ee-42e3-834b-f03f3778e9b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809705 Jul 01 11:48:48.949778 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3685/7467] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:48:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:48:48.957566 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=16 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:48.961564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f909d4a-f958-4c55-87e7-c0694d20d28e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:48.962190 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f909d4a-f958-4c55-87e7-c0694d20d28e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:49.018836 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0f909d4a-f958-4c55-87e7-c0694d20d28e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:49.027906 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f909d4a-f958-4c55-87e7-c0694d20d28e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1266 microversion: 2.1 time: 0.072042 Jul 01 11:48:49.028648 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3783/7468] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:48 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:50.045459 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:50.046117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:50.057986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:50.057986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:50.057986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:50.057986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:50.160974 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:50.169614 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c439e308-0a8d-4952-9606-d676e1048a9d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1270 microversion: 2.1 time: 0.128878 Jul 01 11:48:50.170211 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3686/7469] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:50 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:51.186972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:51.188245 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:51.196838 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:51.197351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:51.198321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:51.198798 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:51.268482 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:51.278038 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da025e8c-8344-49f3-89f1-91de9321578d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1326 microversion: 2.1 time: 0.095246 Jul 01 11:48:51.289743 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3784/7470] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:51 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:52.295785 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:52.296385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:52.303530 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:52.303977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:52.304745 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:52.305200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:52.439586 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:52.447500 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7e640582-9cb1-4e2f-9649-f6e5d84c5241 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.155633 Jul 01 11:48:52.448076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3687/7471] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:52 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:52.855915 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-79fe4448-26d4-4cd0-b5b1-874163f3f105 req-c536b1cc-e90f-4e81-90be-61c12fc620bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6fb70f-e17c-4096-9e80-d1aac2fe32c1", "tag": "e5202e1e-b7b9-4bc4-8317-f87c6d222c4b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:52.865600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-79fe4448-26d4-4cd0-b5b1-874163f3f105 req-c536b1cc-e90f-4e81-90be-61c12fc620bb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:52.866068 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-79fe4448-26d4-4cd0-b5b1-874163f3f105 req-c536b1cc-e90f-4e81-90be-61c12fc620bb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:52.878628 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-79fe4448-26d4-4cd0-b5b1-874163f3f105 req-c536b1cc-e90f-4e81-90be-61c12fc620bb service nova] Creating event network-changed:e5202e1e-b7b9-4bc4-8317-f87c6d222c4b for instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 on n-h2-master-1 Jul 01 11:48:52.883514 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-79fe4448-26d4-4cd0-b5b1-874163f3f105 req-c536b1cc-e90f-4e81-90be-61c12fc620bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032032 Jul 01 11:48:52.884292 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3785/7472] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:48:53.465172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:53.465865 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:53.473531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:53.473988 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:53.474767 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:53.475206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:53.614098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:53.621663 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-12550767-66e4-457a-9c60-216c83e8c712 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.160423 Jul 01 11:48:53.622204 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3688/7473] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:53 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:54.639821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:54.640536 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:54.646990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:54.647452 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:54.648230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:54.648679 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:54.781551 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:54.788999 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-579d9c1a-39f4-4ed8-91c5-48db3a5a8037 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.154377 Jul 01 11:48:54.789596 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3786/7474] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:54 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:55.805942 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:55.806469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:55.813650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:55.814100 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:55.814876 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:55.815315 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:55.952303 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:55.959814 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-49bd9062-ded8-4031-bd35-9140ed201ff8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.157866 Jul 01 11:48:55.960386 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3689/7475] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:55 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:56.977294 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:56.977922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:56.980746 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:56.986378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:56.987027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:56.987819 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:56.988271 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:57.124386 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:57.131831 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dbd3b8b8-2ac9-436d-8eb3-072e3a8b87f2 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.158438 Jul 01 11:48:57.132410 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3787/7476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:56 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:58.149176 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:58.149796 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:58.156679 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:58.157121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:58.157907 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:58.158358 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:58.290263 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:58.298408 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2ae69f37-f42e-4df2-b3ea-1a8a5ebcb8b1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.153157 Jul 01 11:48:58.299003 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3690/7477] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:58 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:59.314961 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:48:59.315621 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:48:59.318647 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:59.325722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:59.325722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:59.325722 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:59.326041 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:59.460633 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:48:59.468142 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-04fbfc9c-e81b-4848-873c-abd10c1d1123 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.157147 Jul 01 11:48:59.468737 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3788/7478] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:48:59 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:48:59.649654 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a7ea17ed-233a-4afe-b570-472b29abd1a0 req-2eaf698e-8135-4015-97e8-26c8f58aead2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6fb70f-e17c-4096-9e80-d1aac2fe32c1", "name": "network-vif-plugged", "status": "completed", "tag": "e5202e1e-b7b9-4bc4-8317-f87c6d222c4b"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:48:59.653862 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:59.654540 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:48:59.661130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a7ea17ed-233a-4afe-b570-472b29abd1a0 req-2eaf698e-8135-4015-97e8-26c8f58aead2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:48:59.661605 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a7ea17ed-233a-4afe-b570-472b29abd1a0 req-2eaf698e-8135-4015-97e8-26c8f58aead2 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:48:59.672446 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a7ea17ed-233a-4afe-b570-472b29abd1a0 req-2eaf698e-8135-4015-97e8-26c8f58aead2 service nova] Creating event network-vif-plugged:e5202e1e-b7b9-4bc4-8317-f87c6d222c4b for instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 on n-h2-master-1 Jul 01 11:48:59.677726 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a7ea17ed-233a-4afe-b570-472b29abd1a0 req-2eaf698e-8135-4015-97e8-26c8f58aead2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032042 Jul 01 11:48:59.678417 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3691/7479] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:49:00.484969 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:00.485622 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:00.492578 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:00.493042 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:00.493854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:00.494305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:00.624313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:00.631945 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9dbf79b0-a8e4-49d4-90f4-c613aa261a97 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1392 microversion: 2.1 time: 0.150837 Jul 01 11:49:00.632538 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3789/7480] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:00 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:01.650266 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:01.650970 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:01.659726 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:01.660172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:01.660931 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:01.661397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:01.800681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:01.808295 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2e62fdfa-0e27-40b4-9445-c4f5f3ab98a7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1563 microversion: 2.1 time: 0.162440 Jul 01 11:49:01.808878 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3692/7481] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:01 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:01.824537 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:01.825701 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:01.832557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:01.833022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:01.833847 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:01.834326 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:01.964777 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:01.973046 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b520d3dc-5dc5-47a5-83da-bd5fdf9bdf48 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1563 microversion: 2.1 time: 0.152407 Jul 01 11:49:01.973650 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3790/7482] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:01 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:03.820435 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:03.821689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:03.822433 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-ac468f10-7260-4e9f-b1ea-49a0a52266a2 req-6a22d257-974f-43c6-afd3-37784266f39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6fb70f-e17c-4096-9e80-d1aac2fe32c1", "tag": "e5202e1e-b7b9-4bc4-8317-f87c6d222c4b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:49:03.826653 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:49:03.830330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:03.831033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:03.831912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:03.832058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ac468f10-7260-4e9f-b1ea-49a0a52266a2 req-6a22d257-974f-43c6-afd3-37784266f39f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:03.832472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:03.832711 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-ac468f10-7260-4e9f-b1ea-49a0a52266a2 req-6a22d257-974f-43c6-afd3-37784266f39f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:03.844940 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-ac468f10-7260-4e9f-b1ea-49a0a52266a2 req-6a22d257-974f-43c6-afd3-37784266f39f service nova] Creating event network-changed:e5202e1e-b7b9-4bc4-8317-f87c6d222c4b for instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 on n-h2-master-1 Jul 01 11:49:03.850455 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-ac468f10-7260-4e9f-b1ea-49a0a52266a2 req-6a22d257-974f-43c6-afd3-37784266f39f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031960 Jul 01 11:49:03.851318 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3791/7483] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:49:03.977976 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:03.986535 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-aeed7e9c-e23b-48e9-aa93-90efafe192cd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1563 microversion: 2.1 time: 0.170931 Jul 01 11:49:03.987392 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3693/7484] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:03 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:06.501343 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:49:06.501929 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:49:27.228534 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=9 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:49:27.229410 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=40 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:49:27.233549 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-063cb9b6-b3c9-4aa4-8f5e-4bc5a0dbfd91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:49:27.234570 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-063cb9b6-b3c9-4aa4-8f5e-4bc5a0dbfd91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:27.241212 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-063cb9b6-b3c9-4aa4-8f5e-4bc5a0dbfd91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:27.247357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-063cb9b6-b3c9-4aa4-8f5e-4bc5a0dbfd91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:27.247357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-063cb9b6-b3c9-4aa4-8f5e-4bc5a0dbfd91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:27.247357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-063cb9b6-b3c9-4aa4-8f5e-4bc5a0dbfd91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:27.293290 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-063cb9b6-b3c9-4aa4-8f5e-4bc5a0dbfd91 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action" status: 200 len: 24561 microversion: 2.1 time: 0.066543 Jul 01 11:49:27.293914 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3792/7485] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:49:27 2022] POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action => generated 24561 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:49:38.288465 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ffd34467-4057-4131-8c29-9ceb068ed93e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:49:38.290571 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=46 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:49:38.295416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ffd34467-4057-4131-8c29-9ceb068ed93e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:38.295865 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ffd34467-4057-4131-8c29-9ceb068ed93e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:38.317892 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ffd34467-4057-4131-8c29-9ceb068ed93e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Going to try to stop instance {{(pid=119765) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 11:49:38.495177 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ffd34467-4057-4131-8c29-9ceb068ed93e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action" status: 202 len: 0 microversion: 2.1 time: 0.211126 Jul 01 11:49:38.495779 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3694/7486] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:49:38 2022] POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:49:38.504977 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:38.505733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:38.508654 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:49:38.509343 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:49:38.515606 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:38.516063 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:38.516848 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:38.517325 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:38.651440 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:38.659459 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-60485106-df01-42fd-888e-2e385ad0efbd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.158842 Jul 01 11:49:38.660021 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3793/7487] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:38 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:39.678405 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:39.679137 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:39.685394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:39.685895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:39.686632 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:39.687069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:39.817439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:39.825402 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6d1530fa-baac-45fc-b044-ec73dbf17f9c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.152028 Jul 01 11:49:39.825974 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3695/7488] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:39 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:40.844039 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:40.844661 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:40.851160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:40.851620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:40.852392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:40.853130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:40.986734 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:40.994352 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6c3ca4a-572a-4979-b5c9-83dec2064fe8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.155073 Jul 01 11:49:40.994924 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3794/7489] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:40 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:42.011842 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:42.012486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:42.020034 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:42.020481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:42.021265 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:42.021702 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:42.152308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:42.159882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-100ee693-8400-4afe-b6a8-2ff21752d91c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.151947 Jul 01 11:49:42.160449 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3696/7490] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:42 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:43.176823 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:43.177459 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:43.184288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:43.184742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:43.185533 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:43.185976 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:43.319276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:43.327778 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f710a60d-e0e3-43fa-a7e8-ee3922a7fbe9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.154129 Jul 01 11:49:43.328350 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3795/7491] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:43 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:44.345277 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:44.346264 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:44.353480 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:44.353923 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:44.354678 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:44.355109 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:44.485764 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:44.494378 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8565e962-b247-4bf6-9a29-f8eab56a73b4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.153922 Jul 01 11:49:44.494952 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3697/7492] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:44 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:45.512284 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:45.513049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:45.519864 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:45.520320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:45.521091 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:45.521557 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:45.650963 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:45.659257 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f1a1c4cc-9d93-4069-a0a7-d4448bc70452 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.150825 Jul 01 11:49:45.659826 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3796/7493] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:45 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:46.676323 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:46.677019 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:46.683895 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:46.684348 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:46.685117 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:46.685577 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:46.823956 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:46.832025 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dcc855b8-10e8-43a7-ae20-3d647547d8be tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.159464 Jul 01 11:49:46.832622 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3698/7494] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:46 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:47.849421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:47.850464 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:47.857250 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:47.857743 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:47.858544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:47.858998 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:47.987476 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:47.995197 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-851d7e28-bdd6-475f-8eb0-2f9fc5192007 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.149825 Jul 01 11:49:47.995805 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3797/7495] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:47 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:49.011949 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:49.012946 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:49.020528 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:49.020985 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:49.021828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:49.022257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:49.161085 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:49.168709 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-89e6991a-42b4-418f-a007-d736224c5bff tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1692 microversion: 2.1 time: 0.160729 Jul 01 11:49:49.169637 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3699/7496] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:49 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:50.186237 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:50.186871 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:50.194184 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:50.194654 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:50.195434 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:50.195884 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:50.324319 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:50.332445 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8b978ca3-9ab1-41f3-afe6-d65415c24cdd tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1669 microversion: 2.1 time: 0.150084 Jul 01 11:49:50.333019 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3798/7497] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:50 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:51.422821 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a42ffa60-bd98-41db-9b8a-97c13425e97e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:49:51.423690 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a42ffa60-bd98-41db-9b8a-97c13425e97e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:51.430779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a42ffa60-bd98-41db-9b8a-97c13425e97e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:51.431230 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a42ffa60-bd98-41db-9b8a-97c13425e97e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:51.431996 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a42ffa60-bd98-41db-9b8a-97c13425e97e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:51.432431 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a42ffa60-bd98-41db-9b8a-97c13425e97e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:51.490804 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a42ffa60-bd98-41db-9b8a-97c13425e97e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action" status: 200 len: 37933 microversion: 2.1 time: 0.071841 Jul 01 11:49:51.491448 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3700/7498] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:49:51 2022] POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action => generated 37933 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:49:51.503120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-538c5cbb-9518-448f-9da1-7c06199d08a0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:49:51.510119 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-538c5cbb-9518-448f-9da1-7c06199d08a0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:51.510580 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-538c5cbb-9518-448f-9da1-7c06199d08a0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:51.532256 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-538c5cbb-9518-448f-9da1-7c06199d08a0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Going to try to start instance {{(pid=119764) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 11:49:51.707992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-538c5cbb-9518-448f-9da1-7c06199d08a0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action" status: 202 len: 0 microversion: 2.1 time: 0.209136 Jul 01 11:49:51.708589 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3799/7499] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:49:51 2022] POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:49:51.717412 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:51.718117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:51.725196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:51.725657 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:51.726429 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:51.726866 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:51.922032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:51.929864 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-30a25edb-1758-4802-b53f-6829ca901d37 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1678 microversion: 2.1 time: 0.216785 Jul 01 11:49:51.930454 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3701/7500] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:51 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:52.949647 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:52.950276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:52.957210 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:52.957676 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:52.958451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:52.958906 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:53.140338 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:53.147992 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c02d292e-9d4d-4db6-9d87-1ad838a350e7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1678 microversion: 2.1 time: 0.203567 Jul 01 11:49:53.148560 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3800/7501] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:52 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:49:54.165640 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:49:54.166257 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:49:54.174063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:54.174515 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:54.175281 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:49:54.175717 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:49:54.321374 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:49:54.329479 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-54465308-55da-4314-a22f-46e0dd8c3a06 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1682 microversion: 2.1 time: 0.167732 Jul 01 11:49:54.330057 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3702/7502] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:49:54 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:20.518300 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6534a11e-a65f-4ab8-8917-5de775796828 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:50:20.519239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6534a11e-a65f-4ab8-8917-5de775796828 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:20.521830 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=16 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:20.522517 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:20.527285 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6534a11e-a65f-4ab8-8917-5de775796828 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:20.527753 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6534a11e-a65f-4ab8-8917-5de775796828 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:20.528527 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6534a11e-a65f-4ab8-8917-5de775796828 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:20.528975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6534a11e-a65f-4ab8-8917-5de775796828 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:20.585195 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6534a11e-a65f-4ab8-8917-5de775796828 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action" status: 200 len: 62488 microversion: 2.1 time: 0.071157 Jul 01 11:50:20.585836 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3801/7503] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:50:20 2022] POST /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1/action => generated 62488 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:50:28.030509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:28.031079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c3bb3ab2-3b18-47bb-990f-17d4b5352305 req-8b6e87b1-e445-41e5-a08f-1044cc416fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6fb70f-e17c-4096-9e80-d1aac2fe32c1", "tag": "e5202e1e-b7b9-4bc4-8317-f87c6d222c4b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:50:28.031456 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:28.034357 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=19 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:28.035016 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:28.039780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:28.040241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:28.041012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:28.041470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:28.041751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c3bb3ab2-3b18-47bb-990f-17d4b5352305 req-8b6e87b1-e445-41e5-a08f-1044cc416fd3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:28.042214 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c3bb3ab2-3b18-47bb-990f-17d4b5352305 req-8b6e87b1-e445-41e5-a08f-1044cc416fd3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:28.054760 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c3bb3ab2-3b18-47bb-990f-17d4b5352305 req-8b6e87b1-e445-41e5-a08f-1044cc416fd3 service nova] Creating event network-changed:e5202e1e-b7b9-4bc4-8317-f87c6d222c4b for instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 on n-h2-master-1 Jul 01 11:50:28.060151 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c3bb3ab2-3b18-47bb-990f-17d4b5352305 req-8b6e87b1-e445-41e5-a08f-1044cc416fd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033360 Jul 01 11:50:28.061487 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3802/7504] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:50:28.069301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:50:28.309826 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc72ffe6-5813-414d-bc79-0dcca7a72445 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 204 len: 0 microversion: 2.1 time: 0.285516 Jul 01 11:50:28.310624 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3703/7505] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:50:28 2022] DELETE /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:50:28.320714 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:28.321460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:28.328650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:28.329129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:28.329952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:28.330443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:28.475999 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:28.485701 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-848b17b2-49c5-4459-b66a-1828708cbdad tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1688 microversion: 2.1 time: 0.170335 Jul 01 11:50:28.486849 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3803/7506] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:28 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:29.504532 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:29.505279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:29.512740 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:29.513232 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:29.513999 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:29.514439 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:29.648656 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:29.656351 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-42aa9c41-4889-4552-9b28-10ab218cbb36 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1688 microversion: 2.1 time: 0.156673 Jul 01 11:50:29.656919 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3704/7507] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:29 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:30.615930 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-605c0d00-e53d-4855-be59-ff4f5d71f3a2 req-7bcc40f4-76dc-4780-8aa6-0d775a0052ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6fb70f-e17c-4096-9e80-d1aac2fe32c1", "name": "network-vif-deleted", "tag": "e5202e1e-b7b9-4bc4-8317-f87c6d222c4b"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:50:30.625127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-605c0d00-e53d-4855-be59-ff4f5d71f3a2 req-7bcc40f4-76dc-4780-8aa6-0d775a0052ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:30.625618 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-605c0d00-e53d-4855-be59-ff4f5d71f3a2 req-7bcc40f4-76dc-4780-8aa6-0d775a0052ca service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:30.636949 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-605c0d00-e53d-4855-be59-ff4f5d71f3a2 req-7bcc40f4-76dc-4780-8aa6-0d775a0052ca service nova] Creating event network-vif-deleted:e5202e1e-b7b9-4bc4-8317-f87c6d222c4b for instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 on n-h2-master-1 Jul 01 11:50:30.644265 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-605c0d00-e53d-4855-be59-ff4f5d71f3a2 req-7bcc40f4-76dc-4780-8aa6-0d775a0052ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032571 Jul 01 11:50:30.644724 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3804/7508] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:50:30.674802 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:30.675411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:30.683272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:30.683754 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:30.684537 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:30.684975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:30.747678 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:30.755224 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d87c0d7b-a6e5-4aa4-94fd-7625746d3329 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 200 len: 1501 microversion: 2.1 time: 0.084994 Jul 01 11:50:30.755793 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3705/7509] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:30 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 1501 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:31.773888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:31.774615 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: ec6fb70f-e17c-4096-9e80-d1aac2fe32c1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:31.780862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:31.781373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:31.782157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:31.782609 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:31.796275 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] HTTP exception thrown: Instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 could not be found. Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Request method failure captured: Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 HTTP/1.1 Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivt3iKYRNMDATa7XvEuJgW7rQGilItNuRV6_d_8xSB37VP39Yb8N8f7CSubsdCwEw0QHmULNxVzm-Zev0bmzhi1zkjNRLsRYCbPJ92dUzgL7L1E9UY97cSO668ttCSvEY5uZdx3Tzni985zS3TuIn213lSLOJftpFHyUu3_z32I3UE4k Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_15b96072e1d94e0cb6b8cd96cd5be12e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 75be289075e445379af6da1f99bab64e Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: exception: Instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 could not be found. Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'ec6fb70f-e17c-4096-9e80-d1aac2fe32c1'} Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 could not be found. Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 could not be found. Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:50:31.797912 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 could not be found. Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Returning 404 to user: Instance ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d7e4bd2d-e606-4c2c-ae9e-b508becbc6e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1" status: 404 len: 111 microversion: 2.1 time: 0.030667 Jul 01 11:50:31.802806 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3805/7510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:31 2022] GET /compute/v2.1/servers/ec6fb70f-e17c-4096-9e80-d1aac2fe32c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:50:35.389432 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e99ea3e-c927-4258-ae0f-7005d6cff1de tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '.version_select at 0x7f6f91261af0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:35.498889 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e99ea3e-c927-4258-ae0f-7005d6cff1de tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1028018235" status: 202 len: 0 microversion: 2.1 time: 0.113915 Jul 01 11:50:35.499483 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3706/7511] 10.222.0.23 () {58 vars in 1283 bytes} [Fri Jul 1 11:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1028018235 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:50:35.531896 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e291ccb7-3e0d-477f-88d3-65f67d671e19 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: .version_select at 0x7f6f90b2e310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-585216776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCwOX0FSOrPvo9TQgjk7yjkne8CDkBhESyABYQVVBQjoVUcvdK5qXBnn8c3LAgLNw3WPfCOXG9WamJrgyGV0SfmgtY8AcUPh2hJPSoK+QEbvZW86enTequXctVgl0clfg=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:50:35.547197 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e291ccb7-3e0d-477f-88d3-65f67d671e19 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:50:35.553181 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-e291ccb7-3e0d-477f-88d3-65f67d671e19 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:50:35.628447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e291ccb7-3e0d-477f-88d3-65f67d671e19 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.100315 Jul 01 11:50:35.629013 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3806/7512] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:50:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:50:43.500815 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:43.505891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2071099399", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "networks": [{"uuid": "741b7477-2ff2-499c-8831-f82f15534835"}], "key_name": "tempest-TestNetworkAdvancedServerOps-585216776", "security_groups": [{"name": "tempest-secgroup-smoke-957518552"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:50:43.631625 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] validate_networks() for [('741b7477-2ff2-499c-8831-f82f15534835', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:50:44.022357 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:50:44.022919 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:50:44.023402 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:50:44.023815 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:50:44.024228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:50:44.033757 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:44.034209 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:44.035012 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:44.035443 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:44.053026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:50:44.058336 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Getting quotas for user 75be289075e445379af6da1f99bab64e and project 15b96072e1d94e0cb6b8cd96cd5be12e. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:50:44.071434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:50:44.073752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:50:44.164821 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5bee654c-3163-4e83-926d-355d58e750f0 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.665803 Jul 01 11:50:44.170732 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3707/7513] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:50:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:50:44.174431 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=16 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:44.178429 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-38914149-9f0d-4c5d-a6a7-652ba7f49e8d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:44.179054 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-38914149-9f0d-4c5d-a6a7-652ba7f49e8d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:44.243485 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-38914149-9f0d-4c5d-a6a7-652ba7f49e8d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:44.250659 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-38914149-9f0d-4c5d-a6a7-652ba7f49e8d tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1266 microversion: 2.1 time: 0.078727 Jul 01 11:50:44.252001 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3807/7514] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:44 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:45.268898 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c99c67e1-4979-433e-ae59-c51ff3c772d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:45.269542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c99c67e1-4979-433e-ae59-c51ff3c772d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:45.324098 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c99c67e1-4979-433e-ae59-c51ff3c772d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:45.331321 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c99c67e1-4979-433e-ae59-c51ff3c772d3 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1266 microversion: 2.1 time: 0.067197 Jul 01 11:50:45.332051 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3708/7515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:45 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:46.350725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da963f1e-ebdf-423b-a2e4-4256d3189d5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:46.351785 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da963f1e-ebdf-423b-a2e4-4256d3189d5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:46.443142 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da963f1e-ebdf-423b-a2e4-4256d3189d5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:46.453315 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da963f1e-ebdf-423b-a2e4-4256d3189d5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1266 microversion: 2.1 time: 0.109116 Jul 01 11:50:46.457213 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3808/7516] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:46 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:47.470837 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1693523b-1dbe-4d71-acbb-bd7a16dea9e8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:47.471446 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1693523b-1dbe-4d71-acbb-bd7a16dea9e8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:47.527271 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1693523b-1dbe-4d71-acbb-bd7a16dea9e8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:47.536148 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1693523b-1dbe-4d71-acbb-bd7a16dea9e8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1266 microversion: 2.1 time: 0.069802 Jul 01 11:50:47.536728 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3709/7517] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:47 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:48.553723 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:48.554346 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:48.561303 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:48.561765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:48.562537 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:48.562984 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:48.624008 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:48.631843 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-86f54dcd-a3e9-49f5-bcd0-06f1514bc3e4 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1270 microversion: 2.1 time: 0.082582 Jul 01 11:50:48.632410 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3809/7518] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:48 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:49.647981 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:49.648595 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:49.655733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:49.656186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:49.656958 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:49.657426 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:49.719738 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:49.727218 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-033237d1-4b39-48f4-82aa-4ce530cad55f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1262 microversion: 2.1 time: 0.083200 Jul 01 11:50:49.727779 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3710/7519] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:49 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:50:50.745189 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:50.745821 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:50.748556 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:50.754306 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:50.755613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:50.755613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:50.756031 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:50.820987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:50.828656 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-124da66e-c238-443d-8935-227263f29f3c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1324 microversion: 2.1 time: 0.087396 Jul 01 11:50:50.829474 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3810/7520] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:50 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1324 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:51.846832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:51.847563 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:51.854925 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:51.855379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:51.856150 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:51.856588 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:51.994918 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:52.001188 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-9f4f8cdb-2ac0-4929-92f6-3fdff300e570 req-0734703d-85db-45f6-a498-c42ac97f520a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c44236-66a4-4dbe-b057-a6d011436a7b", "tag": "f26ef6ef-8aab-4181-914f-e93a3491495c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:50:52.004363 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-31156cb8-d01d-4863-b8f2-14df17149a03 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1391 microversion: 2.1 time: 0.162069 Jul 01 11:50:52.005062 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3711/7521] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:51 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:52.011351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9f4f8cdb-2ac0-4929-92f6-3fdff300e570 req-0734703d-85db-45f6-a498-c42ac97f520a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:52.012499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-9f4f8cdb-2ac0-4929-92f6-3fdff300e570 req-0734703d-85db-45f6-a498-c42ac97f520a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:52.032994 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-9f4f8cdb-2ac0-4929-92f6-3fdff300e570 req-0734703d-85db-45f6-a498-c42ac97f520a service nova] Creating event network-changed:f26ef6ef-8aab-4181-914f-e93a3491495c for instance b0c44236-66a4-4dbe-b057-a6d011436a7b on n-h2-master-1 Jul 01 11:50:52.039264 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-9f4f8cdb-2ac0-4929-92f6-3fdff300e570 req-0734703d-85db-45f6-a498-c42ac97f520a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047513 Jul 01 11:50:52.040038 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3811/7522] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:50:53.020709 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:53.021385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:53.028244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:53.028697 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:53.029481 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:53.029919 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:53.158798 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:53.166444 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2258a839-6683-4e76-9551-c2e0a1dcdc32 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1391 microversion: 2.1 time: 0.149673 Jul 01 11:50:53.167023 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3712/7523] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:53 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:54.184591 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:54.185334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:54.193876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:54.194350 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:54.195157 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:54.195611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:54.331852 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:54.339352 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-43103bf1-4661-4e80-97d9-b67eae7246b9 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1391 microversion: 2.1 time: 0.159145 Jul 01 11:50:54.339906 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3812/7524] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:54 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:55.355752 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:55.356362 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:55.359133 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:55.364687 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:55.365133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:55.365915 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:55.366344 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:55.499669 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:55.506214 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a29345bb-d3a6-44dc-9daa-0322a74babc7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1391 microversion: 2.1 time: 0.154350 Jul 01 11:50:55.506804 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3713/7525] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:55 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:56.523493 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:56.524053 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:56.526847 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=8 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:56.531767 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:56.532224 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:56.533048 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:56.534057 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:56.668643 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:56.676319 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-df6cfa8e-457f-4e41-ae35-aec32398ff54 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1391 microversion: 2.1 time: 0.156867 Jul 01 11:50:56.677257 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3813/7526] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:56 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:57.693757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:57.694361 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:57.697287 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:57.702101 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:57.702542 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:57.703295 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:57.703719 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:57.837064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:57.844601 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2a896dc8-f807-4c1c-9a55-b6d0dea5ce93 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1391 microversion: 2.1 time: 0.155031 Jul 01 11:50:57.845476 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3714/7527] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:57 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:50:58.206182 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-1b23142c-9ec3-478c-b8cd-6a7c94a6a154 req-5c0b028e-519a-49e3-8d0b-f6ec3bfce67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c44236-66a4-4dbe-b057-a6d011436a7b", "name": "network-vif-plugged", "status": "completed", "tag": "f26ef6ef-8aab-4181-914f-e93a3491495c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:50:58.214813 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1b23142c-9ec3-478c-b8cd-6a7c94a6a154 req-5c0b028e-519a-49e3-8d0b-f6ec3bfce67c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:58.215267 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-1b23142c-9ec3-478c-b8cd-6a7c94a6a154 req-5c0b028e-519a-49e3-8d0b-f6ec3bfce67c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:58.226051 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-1b23142c-9ec3-478c-b8cd-6a7c94a6a154 req-5c0b028e-519a-49e3-8d0b-f6ec3bfce67c service nova] Creating event network-vif-plugged:f26ef6ef-8aab-4181-914f-e93a3491495c for instance b0c44236-66a4-4dbe-b057-a6d011436a7b on n-h2-master-1 Jul 01 11:50:58.230968 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-1b23142c-9ec3-478c-b8cd-6a7c94a6a154 req-5c0b028e-519a-49e3-8d0b-f6ec3bfce67c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029166 Jul 01 11:50:58.231549 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3814/7528] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:50:58.862950 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:50:58.863551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:50:58.866218 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:50:58.870956 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:58.871398 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:58.872149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:50:58.872579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:50:59.003780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:50:59.011494 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6aa0ec8d-33cd-41cb-bd4a-e92933b04b7c tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1391 microversion: 2.1 time: 0.153377 Jul 01 11:50:59.012056 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3715/7529] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:50:58 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:00.029254 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:00.029970 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:00.036276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:00.036737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:00.037544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:00.037990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:00.176987 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:00.184540 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fc6c04b1-2419-4946-ba13-da01f2d999e1 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1564 microversion: 2.1 time: 0.160400 Jul 01 11:51:00.185102 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3815/7530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:00 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:00.201925 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:00.202599 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:00.209646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:00.210096 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:00.210857 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:00.211291 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:00.341117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:00.349104 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5a889e95-99b6-4a6e-b9e1-922c63fc9a27 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1564 microversion: 2.1 time: 0.151010 Jul 01 11:51:00.349691 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3716/7531] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:00 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:02.547309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-512327a1-8843-4294-aad9-285310273811 req-1e43ceac-d102-4f05-82cc-c2b6896d0f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c44236-66a4-4dbe-b057-a6d011436a7b", "tag": "f26ef6ef-8aab-4181-914f-e93a3491495c"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:02.550040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:02.552747 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:02.562786 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:02.563340 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:02.563709 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-512327a1-8843-4294-aad9-285310273811 req-1e43ceac-d102-4f05-82cc-c2b6896d0f0d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:02.564206 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-512327a1-8843-4294-aad9-285310273811 req-1e43ceac-d102-4f05-82cc-c2b6896d0f0d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:02.564333 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:02.564765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:02.576682 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-512327a1-8843-4294-aad9-285310273811 req-1e43ceac-d102-4f05-82cc-c2b6896d0f0d service nova] Creating event network-changed:f26ef6ef-8aab-4181-914f-e93a3491495c for instance b0c44236-66a4-4dbe-b057-a6d011436a7b on n-h2-master-1 Jul 01 11:51:02.582331 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-512327a1-8843-4294-aad9-285310273811 req-1e43ceac-d102-4f05-82cc-c2b6896d0f0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038530 Jul 01 11:51:02.583501 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3717/7532] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:51:02.703374 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:02.711021 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4262c899-590d-42e5-af2b-912260d2b7a6 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1564 microversion: 2.1 time: 0.171247 Jul 01 11:51:02.711592 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3816/7533] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:02 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:51:25.951397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-41b082f8-3197-4436-96e0-5fa37fdcb805 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:25.952411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-41b082f8-3197-4436-96e0-5fa37fdcb805 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:25.954913 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=5 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:51:25.955552 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=46 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:51:25.961093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41b082f8-3197-4436-96e0-5fa37fdcb805 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:25.961561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41b082f8-3197-4436-96e0-5fa37fdcb805 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:25.962318 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41b082f8-3197-4436-96e0-5fa37fdcb805 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:25.962773 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-41b082f8-3197-4436-96e0-5fa37fdcb805 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:26.021166 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-41b082f8-3197-4436-96e0-5fa37fdcb805 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action" status: 200 len: 24564 microversion: 2.1 time: 0.074059 Jul 01 11:51:26.021799 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3718/7534] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:51:25 2022] POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action => generated 24564 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:51:36.964754 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:36.965356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:36.967533 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=13 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:51:36.968208 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=40 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:51:36.973600 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:36.974055 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:36.974905 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:36.975351 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:37.001027 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lazy-loading 'flavor' on Instance uuid b0c44236-66a4-4dbe-b057-a6d011436a7b {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:51:37.260690 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c4b56c5d-86b1-4215-b010-107f690e6e39 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action" status: 202 len: 0 microversion: 2.1 time: 0.300291 Jul 01 11:51:37.261463 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3817/7535] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:51:36 2022] POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:51:37.270575 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:37.271384 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:37.274392 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:51:37.275066 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:51:37.280148 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:37.284052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:37.284052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:37.284052 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:37.414632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:37.422601 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6fc5a8c2-15ca-44ba-871a-4f8c6d0c3cf8 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1691 microversion: 2.1 time: 0.156957 Jul 01 11:51:37.423166 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3719/7536] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:37 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:38.442564 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:38.443268 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:38.449876 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:38.450329 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:38.451097 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:38.451541 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:38.582778 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:38.590238 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5d15d001-b708-4ead-8bba-33556cc6c7bb tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1674 microversion: 2.1 time: 0.153610 Jul 01 11:51:38.590797 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3818/7537] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:38 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:39.690658 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f28acb03-2b0d-4719-af3e-5cc1f190b4ca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:39.692224 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f28acb03-2b0d-4719-af3e-5cc1f190b4ca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:39.699245 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f28acb03-2b0d-4719-af3e-5cc1f190b4ca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:39.699735 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f28acb03-2b0d-4719-af3e-5cc1f190b4ca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:39.700522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f28acb03-2b0d-4719-af3e-5cc1f190b4ca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:39.700959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f28acb03-2b0d-4719-af3e-5cc1f190b4ca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:39.763395 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f28acb03-2b0d-4719-af3e-5cc1f190b4ca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action" status: 200 len: 37449 microversion: 2.1 time: 0.076797 Jul 01 11:51:39.764045 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3720/7538] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:51:39 2022] POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action => generated 37449 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:51:39.776023 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-de132563-674e-4a84-9b84-83c25565687f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:39.776572 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-de132563-674e-4a84-9b84-83c25565687f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:39.783180 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de132563-674e-4a84-9b84-83c25565687f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:39.783645 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de132563-674e-4a84-9b84-83c25565687f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:39.784451 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de132563-674e-4a84-9b84-83c25565687f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:39.784904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-de132563-674e-4a84-9b84-83c25565687f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:39.951259 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-de132563-674e-4a84-9b84-83c25565687f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action" status: 202 len: 0 microversion: 2.1 time: 0.179110 Jul 01 11:51:39.951900 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3819/7539] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:51:39 2022] POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:51:39.961712 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:39.962423 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:39.969885 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:39.970372 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:39.971158 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:39.971597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:40.112032 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:40.120377 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f197cfef-684e-4046-a604-b7aabb37dbd7 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1680 microversion: 2.1 time: 0.163608 Jul 01 11:51:40.121072 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3721/7540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:39 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:41.139040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:41.139764 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:41.147396 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:41.147800 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:41.148586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:41.149038 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:41.282671 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:41.290320 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-da261c87-ab18-4975-be63-ce9059a50b5e tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1680 microversion: 2.1 time: 0.155615 Jul 01 11:51:41.290886 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3820/7541] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:41 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:42.308016 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:42.308559 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:42.315511 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:42.315960 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:42.316891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:42.317363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:42.446442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:42.453984 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-751ba189-c68a-4454-91ab-3c5c2265cf8a tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1683 microversion: 2.1 time: 0.149951 Jul 01 11:51:42.454554 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3722/7542] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:42 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:42.549309 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c80339f3-e384-4de4-8fe2-20f3d3064676 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:42.550340 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c80339f3-e384-4de4-8fe2-20f3d3064676 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:42.558680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80339f3-e384-4de4-8fe2-20f3d3064676 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:42.559082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80339f3-e384-4de4-8fe2-20f3d3064676 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:42.559862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80339f3-e384-4de4-8fe2-20f3d3064676 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:42.560312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c80339f3-e384-4de4-8fe2-20f3d3064676 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:42.602892 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c80339f3-e384-4de4-8fe2-20f3d3064676 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action" status: 200 len: 37449 microversion: 2.1 time: 0.057505 Jul 01 11:51:42.603754 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3821/7543] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:51:42 2022] POST /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b/action => generated 37449 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 11:51:43.671799 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:43.672445 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:43.675271 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-3bf1ef2b-b02a-4366-8591-74ff1fda46c1 req-04d81640-d406-467e-a99c-8b6dca3d2ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c44236-66a4-4dbe-b057-a6d011436a7b", "tag": "f26ef6ef-8aab-4181-914f-e93a3491495c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:43.679470 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:43.679946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:43.681093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:43.681556 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:43.686573 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3bf1ef2b-b02a-4366-8591-74ff1fda46c1 req-04d81640-d406-467e-a99c-8b6dca3d2ee9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:43.687039 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-3bf1ef2b-b02a-4366-8591-74ff1fda46c1 req-04d81640-d406-467e-a99c-8b6dca3d2ee9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:43.700583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-3bf1ef2b-b02a-4366-8591-74ff1fda46c1 req-04d81640-d406-467e-a99c-8b6dca3d2ee9 service nova] Creating event network-changed:f26ef6ef-8aab-4181-914f-e93a3491495c for instance b0c44236-66a4-4dbe-b057-a6d011436a7b on n-h2-master-1 Jul 01 11:51:43.708287 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-3bf1ef2b-b02a-4366-8591-74ff1fda46c1 req-04d81640-d406-467e-a99c-8b6dca3d2ee9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035549 Jul 01 11:51:43.708287 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3822/7544] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:51:43.713582 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:51:44.097030 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03167fa7-c0fa-4997-989b-8089ebde5a4b tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 204 len: 0 microversion: 2.1 time: 0.429096 Jul 01 11:51:44.099938 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3723/7545] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:51:43 2022] DELETE /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:51:44.107758 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:44.108474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:44.115051 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:44.115508 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:44.116290 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:44.116736 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:44.256892 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:44.264520 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e25aa0ab-4d88-4bba-9769-48018361d66f tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1689 microversion: 2.1 time: 0.160883 Jul 01 11:51:44.265107 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3823/7546] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:44 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:45.282713 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:45.283451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:45.290973 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:45.291424 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:45.292185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:45.292620 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:45.421725 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:45.430044 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1c9464b7-4301-4362-9185-672a76e01fca tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1689 microversion: 2.1 time: 0.151607 Jul 01 11:51:45.430613 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3724/7547] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:45 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:46.387154 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f09db52f-5968-46be-88a4-16281ddc0ed5 req-3f3683cd-f35d-4a63-93f7-f9e59634d84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c44236-66a4-4dbe-b057-a6d011436a7b", "name": "network-vif-deleted", "tag": "f26ef6ef-8aab-4181-914f-e93a3491495c"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:51:46.396476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f09db52f-5968-46be-88a4-16281ddc0ed5 req-3f3683cd-f35d-4a63-93f7-f9e59634d84f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:46.396963 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f09db52f-5968-46be-88a4-16281ddc0ed5 req-3f3683cd-f35d-4a63-93f7-f9e59634d84f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:46.408120 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f09db52f-5968-46be-88a4-16281ddc0ed5 req-3f3683cd-f35d-4a63-93f7-f9e59634d84f service nova] Creating event network-vif-deleted:f26ef6ef-8aab-4181-914f-e93a3491495c for instance b0c44236-66a4-4dbe-b057-a6d011436a7b on n-h2-master-1 Jul 01 11:51:46.414009 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f09db52f-5968-46be-88a4-16281ddc0ed5 req-3f3683cd-f35d-4a63-93f7-f9e59634d84f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080935 Jul 01 11:51:46.414600 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3824/7548] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:51:46.447170 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:46.447911 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:46.462367 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:46.462749 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:46.463746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:46.464189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:46.532498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75be289075e445379af6da1f99bab64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b96072e1d94e0cb6b8cd96cd5be12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:51:46.540981 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81815aa9-3794-4535-ad21-0af13c1f8723 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 200 len: 1503 microversion: 2.1 time: 0.098172 Jul 01 11:51:46.541666 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3725/7549] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:46 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 1503 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:51:47.559676 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:47.560419 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] [instance: b0c44236-66a4-4dbe-b057-a6d011436a7b] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:51:47.567321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:47.567854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:47.568915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:51:47.569393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:51:47.583131 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] HTTP exception thrown: Instance b0c44236-66a4-4dbe-b057-a6d011436a7b could not be found. Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Request method failure captured: Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b HTTP/1.1 Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivt3iKYRNMDATa7XvEuJgW7rQGilItNuRV6_d_8xSB37VP39Yb8N8f7CSubsdCwEw0QHmULNxVzm-Zev0bmzhi1zkjNRLsRYCbPJ92dUzgL7L1E9UY97cSO668ttCSvEY5uZdx3Tzni985zS3TuIn213lSLOJftpFHyUu3_z32I3UE4k Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_15b96072e1d94e0cb6b8cd96cd5be12e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/15b96072e1d94e0cb6b8cd96cd5be12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 15b96072e1d94e0cb6b8cd96cd5be12e Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-17535833 Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 75be289075e445379af6da1f99bab64e Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestNetworkAdvancedServerOps-17535833-project Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: exception: Instance b0c44236-66a4-4dbe-b057-a6d011436a7b could not be found. Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': 'b0c44236-66a4-4dbe-b057-a6d011436a7b'} Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c44236-66a4-4dbe-b057-a6d011436a7b could not be found. Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c44236-66a4-4dbe-b057-a6d011436a7b could not be found. Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:51:47.584694 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c44236-66a4-4dbe-b057-a6d011436a7b could not be found. Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Returning 404 to user: Instance b0c44236-66a4-4dbe-b057-a6d011436a7b could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0f8ba0de-766f-438a-bdf4-a927be450456 tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b" status: 404 len: 111 microversion: 2.1 time: 0.031644 Jul 01 11:51:47.589726 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3825/7550] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:51:47 2022] GET /compute/v2.1/servers/b0c44236-66a4-4dbe-b057-a6d011436a7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:51:51.039141 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5cce2332-1e66-4eec-85a5-a5878538b0fc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] Calling method '.version_select at 0x7f6f91b09ee0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:51:51.114419 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5cce2332-1e66-4eec-85a5-a5878538b0fc tempest-TestNetworkAdvancedServerOps-17535833 tempest-TestNetworkAdvancedServerOps-17535833-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-585216776" status: 202 len: 0 microversion: 2.1 time: 0.079771 Jul 01 11:51:51.114953 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3726/7551] 10.222.0.23 () {58 vars in 1280 bytes} [Fri Jul 1 11:51:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-585216776 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:52:05.445044 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=18 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:52:05.445991 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:52:05.659768 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b59aa58-4925-4792-bf9f-b6610ad42ac5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'create', calling method: .version_select at 0x7f6f901eff70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1145011161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymL2Nphoixt33GVQDwovUwQeZvoiGbj00x6/p3MjIYx0WvWGCPDwAo+hAVKSxBpnN2k11kixl8UueZbaKyOQTW12GwMzwaT9EXPXbwBW3rEj43aWW/x/eofTnPjzRAxQ=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:52:05.677868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-6b59aa58-4925-4792-bf9f-b6610ad42ac5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for project 38f5f7f94d464276a2993b970be5287f. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:52:05.683606 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-6b59aa58-4925-4792-bf9f-b6610ad42ac5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for user 45fedf332aaf4ce8900ce797a0fd06e4 and project 38f5f7f94d464276a2993b970be5287f. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:52:05.766447 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b59aa58-4925-4792-bf9f-b6610ad42ac5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.328126 Jul 01 11:52:05.767061 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3826/7552] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:52:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:52:08.173469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1954383196", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1145011161", "security_groups": [{"name": "tempest-secgroup-smoke-122735716"}], "networks": [{"uuid": "c983e5eb-f61c-4fb1-b5f9-e2f71cf062dc"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:52:08.191120 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:52:08.191914 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:52:08.302715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] validate_networks() for [('c983e5eb-f61c-4fb1-b5f9-e2f71cf062dc', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:52:09.079819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:52:09.080301 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:52:09.080779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:52:09.081211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:52:09.081630 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:52:09.091465 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:09.092182 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:09.093267 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:09.093734 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:09.112418 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for project 38f5f7f94d464276a2993b970be5287f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:52:09.118040 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for user 45fedf332aaf4ce8900ce797a0fd06e4 and project 38f5f7f94d464276a2993b970be5287f. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:52:09.131364 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:52:09.133749 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:52:09.236314 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-29ed2dbb-ac66-40f7-ae3c-7a94e2f797ab tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.068786 Jul 01 11:52:09.238655 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3727/7553] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:52:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:52:09.248247 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3d7c2979-ce21-4ac7-a2eb-3953a8c209ae tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:09.248967 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3d7c2979-ce21-4ac7-a2eb-3953a8c209ae tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:09.309698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3d7c2979-ce21-4ac7-a2eb-3953a8c209ae tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:09.317715 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3d7c2979-ce21-4ac7-a2eb-3953a8c209ae tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1247 microversion: 2.1 time: 0.074519 Jul 01 11:52:09.318948 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3827/7554] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:09 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:52:10.335805 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:10.336396 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:10.343770 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:10.349334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:10.349334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:10.349334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:10.405926 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:10.413412 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3de7f460-eb84-4545-9e8f-cf1893923082 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1251 microversion: 2.1 time: 0.082476 Jul 01 11:52:10.414007 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3728/7555] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:10 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1251 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:11.431477 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:11.432612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:11.440151 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:11.440605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:11.441643 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:11.442081 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:11.510334 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:11.518414 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6087b985-5cd3-493f-98d5-749483a42fa5 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1307 microversion: 2.1 time: 0.092160 Jul 01 11:52:11.518712 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3828/7556] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:11 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:12.536677 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:12.537398 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:12.544980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:12.545495 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:12.546247 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:12.546681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:12.680743 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:12.688499 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-1fdec5b6-fd2b-4d00-bab8-b00bd3ba1f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1372 microversion: 2.1 time: 0.156550 Jul 01 11:52:12.689076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3729/7557] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:12 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:13.071620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c0960b70-f1aa-4b82-b538-ae3cd0817f83 req-c94fe77a-eabe-43cb-b8ce-f9d430f20deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:52:13.075775 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c0960b70-f1aa-4b82-b538-ae3cd0817f83 req-c94fe77a-eabe-43cb-b8ce-f9d430f20deb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:13.076240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c0960b70-f1aa-4b82-b538-ae3cd0817f83 req-c94fe77a-eabe-43cb-b8ce-f9d430f20deb service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:13.088978 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c0960b70-f1aa-4b82-b538-ae3cd0817f83 req-c94fe77a-eabe-43cb-b8ce-f9d430f20deb service nova] Creating event network-changed:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h1-master-1 Jul 01 11:52:13.094774 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c0960b70-f1aa-4b82-b538-ae3cd0817f83 req-c94fe77a-eabe-43cb-b8ce-f9d430f20deb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032063 Jul 01 11:52:13.095548 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3829/7558] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:52:13.707302 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:13.708542 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:13.716121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:13.716574 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:13.717379 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:13.717828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:13.853024 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:13.860754 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-307cea4b-6a75-4225-b1af-2c1293ea2b79 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1372 microversion: 2.1 time: 0.157357 Jul 01 11:52:13.861283 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3730/7559] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:13 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:14.880550 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:14.881359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:14.887674 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:14.888130 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:14.888897 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:14.889375 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:15.017674 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:15.025919 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-9922aa44-986b-460e-91de-174f7d53e3ec tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1372 microversion: 2.1 time: 0.150554 Jul 01 11:52:15.026523 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3830/7560] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:14 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:16.043088 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:16.043697 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:16.050615 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:16.051057 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:16.052383 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:16.052811 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:16.182054 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:16.189518 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d2eea409-cfb1-479f-ba56-1a6406dfc9ea tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1372 microversion: 2.1 time: 0.150316 Jul 01 11:52:16.190083 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3731/7561] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:16 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:17.206725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:17.207381 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:17.214829 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:17.215288 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:17.216083 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:17.216526 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:17.375620 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:17.383867 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-88c9b434-80db-4763-a762-6eed7f78759c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1372 microversion: 2.1 time: 0.181132 Jul 01 11:52:17.385391 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3831/7562] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:17 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:18.402041 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:18.402565 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:18.409449 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:18.409893 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:18.410828 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:18.411278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:18.540632 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:18.548287 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-bc6c5778-cebe-4d48-be6d-76c3c7f70305 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1372 microversion: 2.1 time: 0.150216 Jul 01 11:52:18.548864 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3732/7563] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:18 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:18.887790 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-2afebd49-4ba8-4214-8740-4492378599cd req-6190af91-593b-4bd4-846e-deda7525cd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "name": "network-vif-plugged", "status": "completed", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:52:18.895750 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2afebd49-4ba8-4214-8740-4492378599cd req-6190af91-593b-4bd4-846e-deda7525cd9c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:18.900185 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-2afebd49-4ba8-4214-8740-4492378599cd req-6190af91-593b-4bd4-846e-deda7525cd9c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:18.906859 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-2afebd49-4ba8-4214-8740-4492378599cd req-6190af91-593b-4bd4-846e-deda7525cd9c service nova] Creating event network-vif-plugged:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h1-master-1 Jul 01 11:52:18.912205 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-2afebd49-4ba8-4214-8740-4492378599cd req-6190af91-593b-4bd4-846e-deda7525cd9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081343 Jul 01 11:52:18.912772 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3832/7564] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:52:19.565537 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:19.566157 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:19.568920 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:52:19.569684 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:52:19.575264 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:19.575700 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:19.576460 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:19.576901 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:19.714913 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:19.722464 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b39354ed-d139-43cf-86cc-9683e9fd90e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1372 microversion: 2.1 time: 0.160855 Jul 01 11:52:19.723596 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3733/7565] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:19 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:20.737048 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:52:20.742129 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:20.742870 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:20.749136 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:20.749628 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:20.750410 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:20.750860 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:20.885183 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:20.892553 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-873fbac1-0da5-4f39-b97d-40d26878a60c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1557 microversion: 2.1 time: 0.156421 Jul 01 11:52:20.893061 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3833/7566] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:20 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:20.908775 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:52:20.909407 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:52:20.916302 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:20.916741 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:20.917525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:20.917957 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:21.050662 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:52:21.058641 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6c9aac51-9054-474c-a9ae-25cfaa3f7e35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1557 microversion: 2.1 time: 0.153870 Jul 01 11:52:21.059208 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3734/7567] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:52:20 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:52:23.016220 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-c173a85e-63d7-410f-92a5-b5bde0fd9819 req-c80f94c9-a13b-40c0-9b8f-b69e744de88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:52:23.024996 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c173a85e-63d7-410f-92a5-b5bde0fd9819 req-c80f94c9-a13b-40c0-9b8f-b69e744de88f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:52:23.027298 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-c173a85e-63d7-410f-92a5-b5bde0fd9819 req-c80f94c9-a13b-40c0-9b8f-b69e744de88f service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:52:23.036808 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-c173a85e-63d7-410f-92a5-b5bde0fd9819 req-c80f94c9-a13b-40c0-9b8f-b69e744de88f service nova] Creating event network-changed:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h1-master-1 Jul 01 11:52:23.041957 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-c173a85e-63d7-410f-92a5-b5bde0fd9819 req-c80f94c9-a13b-40c0-9b8f-b69e744de88f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084350 Jul 01 11:52:23.042605 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3834/7568] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:52:26.509558 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:52:26.510254 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:54:07.143454 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:54:07.144055 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:54:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:54:18.266198 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:54:18.271238 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:18.271238 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=44 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:18.272026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:54:18.272556 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:18.278467 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:18.278912 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:18.279692 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:18.280124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:18.303629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lazy-loading 'flavor' on Instance uuid 37242916-5e34-4061-aee2-afa69545df89 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:54:18.802928 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-25bc4f31-cb3b-494f-81eb-3650755a5ebe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89/action" status: 202 len: 0 microversion: 2.1 time: 0.538221 Jul 01 11:54:18.803668 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3735/7569] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:54:18 2022] POST /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:54:18.810640 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:54:18.814491 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:18.815221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:18.817338 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:18.818002 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=30 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:18.824074 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:18.824542 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:18.825368 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:18.825822 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:18.964073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:18.971732 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ac1eb632-95a3-40ff-90a1-02df21267358 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.163613 Jul 01 11:54:18.972281 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3835/7570] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:18 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:19.991650 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:19.992379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:20.002054 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 44956. Jul 01 11:54:20.004257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:20.004733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:20.005532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:20.005975 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:20.134826 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:20.142849 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c2130ab7-7b16-4865-915a-5bfb4f5177f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.157051 Jul 01 11:54:20.143413 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3736/7571] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:19 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:21.160312 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:21.160940 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:21.170209 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:21.170668 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:21.171447 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:21.171899 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:21.177308 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 44960. Jul 01 11:54:21.312046 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:21.319928 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc9a0ac1-fe7b-4d62-b013-3f4a32dedc9d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.163544 Jul 01 11:54:21.320483 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3836/7572] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:21 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:22.337025 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:22.337583 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:22.345169 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:22.345629 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:22.346394 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:22.346831 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:22.479473 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:22.487002 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0605e097-fe04-4999-861f-b57362c22712 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.154009 Jul 01 11:54:22.487570 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3737/7573] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:22 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:23.504413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:23.505073 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:23.512129 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:23.512586 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:23.513393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:23.513844 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:23.643966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:23.652191 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c8c01ab7-6de6-4b19-b411-028d62076132 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.151709 Jul 01 11:54:23.652752 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3837/7574] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:23 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:24.669340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:24.669958 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:24.676833 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:24.677321 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:24.678084 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:24.678519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:24.810602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:24.818093 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-30ab0bf0-7dfb-46ec-a75b-2690d22c4f2e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.152661 Jul 01 11:54:24.818665 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3738/7575] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:24 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:25.835771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:25.836421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:25.843867 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:25.844327 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:25.845106 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:25.845579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:25.973761 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:25.981813 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d97d767f-8d1c-4165-ab41-6e518ca32b4f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.149922 Jul 01 11:54:25.982375 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3838/7576] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:25 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:26.998820 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:26.999442 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:27.006313 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:27.006759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:27.007519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:27.007953 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:27.139715 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:27.147299 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5ae24d4d-cd30-407b-b6ca-644850e98905 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.152431 Jul 01 11:54:27.147878 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3739/7577] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:26 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:28.164964 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:28.166251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:28.174105 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:28.174579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:28.175364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:28.175815 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:28.309573 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:28.317037 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ea4c44f-f618-4639-a41e-a966af5d22b4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.155970 Jul 01 11:54:28.317638 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3839/7578] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:28 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:29.334585 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:29.335227 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:29.342822 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:29.343272 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:29.344035 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:29.344473 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:29.473318 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:29.481368 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-c1cd186d-1ccd-4d7d-88dd-74aee3e3a328 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.150236 Jul 01 11:54:29.481939 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3740/7579] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:29 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:30.498454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:30.499083 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:30.506124 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:30.506584 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:30.507389 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:30.507835 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:30.639984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:30.647687 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fac146c1-623f-4c39-b162-6d3380b65ab2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1702 microversion: 2.1 time: 0.153152 Jul 01 11:54:30.648251 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3840/7580] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:30 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:31.667100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:31.667714 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:31.675147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:31.678796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:31.678796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:31.678796 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:31.841431 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:31.850431 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d4930eb-5116-41c8-97bf-263374f257b9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.187624 Jul 01 11:54:31.851358 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3741/7581] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:31 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:32.868120 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:32.868740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:32.877092 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:32.877591 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:32.878435 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:32.878933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:33.035740 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:33.044438 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0eb62b0f-d0b2-48fd-a7a2-d0719c3ea168 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.180416 Jul 01 11:54:33.054278 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3841/7582] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:32 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:33.409552 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9dd54d4b-33b0-442c-ad34-bc27abb07a59 req-8c9793c5-7a62-4ca1-a82e-4e8721c0471a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "name": "network-vif-plugged", "status": "completed", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:54:33.425037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9dd54d4b-33b0-442c-ad34-bc27abb07a59 req-8c9793c5-7a62-4ca1-a82e-4e8721c0471a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:33.425509 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9dd54d4b-33b0-442c-ad34-bc27abb07a59 req-8c9793c5-7a62-4ca1-a82e-4e8721c0471a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:33.439098 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9dd54d4b-33b0-442c-ad34-bc27abb07a59 req-8c9793c5-7a62-4ca1-a82e-4e8721c0471a service nova] Creating event network-vif-plugged:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h1-master-1 Jul 01 11:54:33.445706 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9dd54d4b-33b0-442c-ad34-bc27abb07a59 req-8c9793c5-7a62-4ca1-a82e-4e8721c0471a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038758 Jul 01 11:54:33.450668 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3742/7583] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:54:34.062343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:34.063125 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:34.070613 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:34.071078 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:34.071901 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:34.072355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:34.217693 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:34.226280 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e33d9e28-b1d6-4bb0-a11b-eaeea7d7bd3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.168416 Jul 01 11:54:34.227151 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3842/7584] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:34 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:35.244403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:35.245908 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:35.252452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:35.253045 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:35.253966 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:35.254639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:35.402852 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:35.411358 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d389f100-f0fd-48ee-bc75-6b4c34ac7d40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.171920 Jul 01 11:54:35.412205 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3743/7585] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:35 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:36.431045 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:36.432359 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:36.439965 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:36.440430 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:36.441334 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:36.441789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:36.590719 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:36.599317 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-26702590-821e-4ec4-9337-3eea09b758fa tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.172112 Jul 01 11:54:36.600117 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3843/7586] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:36 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:37.618797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:37.619437 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:37.646294 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:37.646759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:37.647545 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:37.647982 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:37.797980 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:37.806257 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9093f23c-9464-4c9e-945b-716a6222db00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.191276 Jul 01 11:54:37.807093 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3744/7587] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:37 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:38.823706 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:38.825352 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:38.834887 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:38.835347 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:38.836182 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:38.836757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:38.995219 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:39.010820 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a5b57544-1362-47d1-9247-ba1bfddcf265 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.190942 Jul 01 11:54:39.011692 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3844/7588] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:38 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:40.029014 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:40.029739 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:40.036977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:40.037520 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:40.038305 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:40.038739 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:40.188967 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:40.197629 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3cb86e01-1b25-4157-b724-2b849e89e09b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.173481 Jul 01 11:54:40.198409 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3745/7589] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:40 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:41.214695 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:41.215330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:41.222692 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:41.224047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:41.224047 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:41.224393 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:41.369048 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:41.377618 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5d754c4-71c7-4942-8a57-7cd7adc5e02b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.166716 Jul 01 11:54:41.378638 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3845/7590] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:41 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:42.394153 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:42.394757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:42.401704 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:42.402140 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:42.402883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:42.403388 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:42.539675 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:42.543929 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-17fad46d-9577-4c50-bbaa-f2cb9cbd6871 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1697 microversion: 2.1 time: 0.153674 Jul 01 11:54:42.544495 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3746/7591] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:42 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:43.561612 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:43.562243 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:43.569478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:43.569947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:43.570738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:43.571191 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:43.957382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:43.967421 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3eca21dc-1dfb-4a35-bb69-d4c814921db2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1679 microversion: 2.1 time: 0.409833 Jul 01 11:54:43.968179 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3846/7592] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:43 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1679 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:44.985730 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:44.986378 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:44.993301 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:44.993759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:44.994519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:44.994961 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:45.132033 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:45.139759 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0cfe5da0-3725-40d0-9c73-ed992d669a16 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1679 microversion: 2.1 time: 0.157953 Jul 01 11:54:45.140337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3747/7593] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:44 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:45.591455 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-453b5834-f82e-4517-a8cf-fc12f51c894d req-e6779662-47f2-4788-a761-0b352a93813a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "name": "network-vif-unplugged", "status": "completed", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:54:45.600364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-453b5834-f82e-4517-a8cf-fc12f51c894d req-e6779662-47f2-4788-a761-0b352a93813a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:45.604472 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-453b5834-f82e-4517-a8cf-fc12f51c894d req-e6779662-47f2-4788-a761-0b352a93813a service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:45.615109 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.compute.server_external_events [req-453b5834-f82e-4517-a8cf-fc12f51c894d req-e6779662-47f2-4788-a761-0b352a93813a service nova] Unable to find a host for instance 37242916-5e34-4061-aee2-afa69545df89. Dropping event network-vif-unplugged {{(pid=119764) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 11:54:45.616032 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-453b5834-f82e-4517-a8cf-fc12f51c894d req-e6779662-47f2-4788-a761-0b352a93813a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029156 Jul 01 11:54:45.616911 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3847/7594] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 11:54:46.161498 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:46.162115 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:46.169496 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:46.169946 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:46.170701 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:46.171132 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:46.309211 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:46.317567 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9857fe49-78ef-4de5-9aec-f0a580eee987 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1622 microversion: 2.1 time: 0.159796 Jul 01 11:54:46.330882 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3748/7595] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:46 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:46.336040 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1f7e33c9-2d72-415c-a1c5-134fac2b65f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:54:46.336767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1f7e33c9-2d72-415c-a1c5-134fac2b65f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:46.343693 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f7e33c9-2d72-415c-a1c5-134fac2b65f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:46.344355 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f7e33c9-2d72-415c-a1c5-134fac2b65f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:46.345022 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f7e33c9-2d72-415c-a1c5-134fac2b65f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:46.345597 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1f7e33c9-2d72-415c-a1c5-134fac2b65f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:46.658639 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1f7e33c9-2d72-415c-a1c5-134fac2b65f4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89/action" status: 202 len: 0 microversion: 2.1 time: 0.327300 Jul 01 11:54:46.659915 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3848/7596] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:54:46 2022] POST /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:54:46.673512 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:46.674229 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:46.682671 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:46.683159 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:46.684010 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:46.684452 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:46.827817 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:46.835823 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a28eafd6-883f-4cd8-be2b-543235574753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1630 microversion: 2.1 time: 0.171446 Jul 01 11:54:46.836407 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3749/7597] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:46 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1630 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:54:47.854645 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:47.855804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:47.862664 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:47.863127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:47.863933 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:47.864382 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:47.993117 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:48.001661 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7dd93544-b40e-4050-9e17-e6eb84da30e1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1630 microversion: 2.1 time: 0.151770 Jul 01 11:54:48.002225 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3849/7598] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:47 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1630 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:49.018927 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:49.019527 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:49.022367 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=31 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:49.027554 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:49.027991 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:49.028742 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:49.029188 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:49.033036 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:49.162693 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:49.170859 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7368bb7a-a3c8-44b6-8a58-a7fdeaa0829b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1630 microversion: 2.1 time: 0.155784 Jul 01 11:54:49.171430 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3750/7599] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:49 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1630 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:50.188413 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:50.189034 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:50.196445 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:50.196934 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:50.197807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:50.198320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:50.201626 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:50.353027 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:50.360996 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-62357a84-db15-47ec-a03e-ffde0846360b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1630 microversion: 2.1 time: 0.176719 Jul 01 11:54:50.361784 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3850/7600] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:50 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1630 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:51.378238 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:51.378856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:51.385575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:51.386598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:51.387371 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:51.387813 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:51.518127 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:51.525645 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cdd4f653-ea11-499f-8090-bdfbbd7251c7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1630 microversion: 2.1 time: 0.151503 Jul 01 11:54:51.526231 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3751/7601] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:51 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1630 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:52.547810 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:52.548675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:52.551226 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=35 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:54:52.556367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:52.556655 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:52.557477 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:52.558514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:52.783699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:52.791275 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7ac64aca-4f34-43f2-8fb6-7ca49b77d26a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.247639 Jul 01 11:54:52.791848 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3851/7602] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:52 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:53.537181 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-47c652af-6eae-4cbd-85f5-f6d5162a04e1 req-25ac0247-8a77-438e-975a-cbf6f072ba39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:54:53.549395 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-47c652af-6eae-4cbd-85f5-f6d5162a04e1 req-25ac0247-8a77-438e-975a-cbf6f072ba39 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:53.549929 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-47c652af-6eae-4cbd-85f5-f6d5162a04e1 req-25ac0247-8a77-438e-975a-cbf6f072ba39 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:53.564762 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-47c652af-6eae-4cbd-85f5-f6d5162a04e1 req-25ac0247-8a77-438e-975a-cbf6f072ba39 service nova] Creating event network-changed:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h2-master-1 Jul 01 11:54:53.570795 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-47c652af-6eae-4cbd-85f5-f6d5162a04e1 req-25ac0247-8a77-438e-975a-cbf6f072ba39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038712 Jul 01 11:54:53.572089 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3752/7603] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:54:53.809938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:53.810567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:53.817474 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:53.817935 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:53.818757 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:53.819475 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:53.952699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:53.960419 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-56eb8cb0-121a-4bb7-85ef-1353d235c941 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.154434 Jul 01 11:54:53.960992 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3852/7604] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:53 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:54.978681 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:54.979422 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:54.987531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:54.988225 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:54.989278 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:54.989943 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:55.195502 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:55.203815 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5ec896cd-c55d-4640-9b66-fc1556c3cfc7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.229300 Jul 01 11:54:55.204404 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3753/7605] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:54 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:56.221330 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:56.222092 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:56.229006 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:56.229500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:56.230295 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:56.230752 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:56.377802 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:56.387016 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cd0284a7-57e9-48bc-bfe9-35586437dbeb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.169507 Jul 01 11:54:56.387699 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3853/7606] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:56 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:57.404350 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:57.405760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:57.414368 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:57.414954 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:57.416018 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:57.416652 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:57.562428 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:57.570836 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cefbf208-a503-4bd6-8890-7d439f61f59b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.170885 Jul 01 11:54:57.581028 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3754/7607] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:57 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:58.588200 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:58.588893 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:58.596728 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:58.597220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:58.598027 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:58.598481 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:58.756756 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:58.765404 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1466a148-a926-411e-b256-c1ca688caf5e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.181150 Jul 01 11:54:58.765987 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3854/7608] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:58 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:54:59.782784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:54:59.783434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:54:59.790653 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:59.791456 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:59.793042 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:54:59.793650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:54:59.934388 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:54:59.942275 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-52bac5b5-b1e1-4670-a219-18d833fa0034 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.163433 Jul 01 11:54:59.942857 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3755/7609] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:54:59 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:00.960069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:00.961571 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:00.970514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:00.971332 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:00.972358 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:00.973199 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:01.165321 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:01.176556 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4199f994-e781-4168-8bc0-f193b2faefd8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.219723 Jul 01 11:55:01.176556 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3855/7610] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:00 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:02.193322 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:02.193885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:02.201718 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:02.205376 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:02.205376 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:02.205376 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:02.331986 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:02.340190 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4e2b807d-8c3c-4869-a26c-719d8039d709 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.150855 Jul 01 11:55:02.340759 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3756/7611] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:02 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:03.358056 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:03.358698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:03.365699 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:03.366164 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:03.366949 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:03.367402 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:03.498025 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:03.505907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-32a23c6f-66a9-4ba8-83cc-ef551493042c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.152529 Jul 01 11:55:03.506473 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3856/7612] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:03 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:04.522994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:04.526168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:04.530533 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:04.530962 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:04.531720 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:04.532154 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:04.665528 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:04.673542 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8e7722ec-1467-4191-869f-fa1ba4561e7e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.154398 Jul 01 11:55:04.674117 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3757/7613] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:04 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:05.691259 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:05.691918 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:05.699635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:05.700093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:05.701615 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:05.702115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:05.837049 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:05.844751 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2ef0524e-2a57-4e01-95a4-b2b1f23ac737 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.157559 Jul 01 11:55:05.845490 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3857/7614] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:05 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:06.862539 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:06.863150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:06.870014 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:06.870458 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:06.871212 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:06.871643 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:07.008760 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:07.016509 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-03a8ff24-dbe0-4222-986c-12af7ad5233e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.157943 Jul 01 11:55:07.017116 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3758/7615] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:06 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:07.420586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5ec51208-8dd8-4446-b94d-c3d090845e89 req-329d0c5e-8d3b-405c-9263-0ce2434007e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "name": "network-vif-plugged", "status": "completed", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:55:07.429740 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5ec51208-8dd8-4446-b94d-c3d090845e89 req-329d0c5e-8d3b-405c-9263-0ce2434007e7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:07.430751 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5ec51208-8dd8-4446-b94d-c3d090845e89 req-329d0c5e-8d3b-405c-9263-0ce2434007e7 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:07.441738 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5ec51208-8dd8-4446-b94d-c3d090845e89 req-329d0c5e-8d3b-405c-9263-0ce2434007e7 service nova] Creating event network-vif-plugged:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h2-master-1 Jul 01 11:55:07.447130 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5ec51208-8dd8-4446-b94d-c3d090845e89 req-329d0c5e-8d3b-405c-9263-0ce2434007e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030747 Jul 01 11:55:07.447709 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3858/7616] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:55:08.034050 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:08.034667 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:08.042299 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:08.042760 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:08.043532 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:08.043969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:08.173621 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:08.181104 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0447c0cf-ff4b-46dd-805f-44fad7be2e04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.151023 Jul 01 11:55:08.181702 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3759/7617] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:08 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:09.200151 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:09.200660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:09.207082 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:09.207612 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:09.208431 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:09.208892 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:09.346291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:09.353886 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cc0d4c3d-6ae7-4cdb-84dc-b50ff40e45a2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1688 microversion: 2.1 time: 0.159020 Jul 01 11:55:09.355072 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3859/7618] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:09 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:55:10.371877 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:55:10.372486 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:55:10.379149 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:10.379602 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:10.380374 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:55:10.380817 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:55:10.510607 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:55:10.518350 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f172def2-c6f5-49db-9d3b-d2d871aef414 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1675 microversion: 2.1 time: 0.150636 Jul 01 11:55:10.518937 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3760/7619] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:55:10 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:25.076771 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=17 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:25.076771 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=55 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:25.076771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:25.076771 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:25.077662 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=21 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:25.078026 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:25.078275 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:25.078426 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=61 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:25.079478 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:25.080000 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:25.082160 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-ba6d45d7-0df0-4c50-87dc-039aee86e167 req-6c108aef-89da-44b3-b698-65fd7ecb2130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:56:25.090142 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ba6d45d7-0df0-4c50-87dc-039aee86e167 req-6c108aef-89da-44b3-b698-65fd7ecb2130 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:25.090591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-ba6d45d7-0df0-4c50-87dc-039aee86e167 req-6c108aef-89da-44b3-b698-65fd7ecb2130 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:25.102329 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-ba6d45d7-0df0-4c50-87dc-039aee86e167 req-6c108aef-89da-44b3-b698-65fd7ecb2130 service nova] Creating event network-changed:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h2-master-1 Jul 01 11:56:25.107713 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-ba6d45d7-0df0-4c50-87dc-039aee86e167 req-6c108aef-89da-44b3-b698-65fd7ecb2130 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033352 Jul 01 11:56:25.111631 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 11:56:25.112226 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3761/7620] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:56:25.378567 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b0061a5f-f307-4661-a526-8c1ac7a87fa7 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "DELETE /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 204 len: 0 microversion: 2.1 time: 0.315440 Jul 01 11:56:25.379367 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3860/7621] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 11:56:25 2022] DELETE /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 11:56:25.388244 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:25.389895 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:25.397186 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:25.404001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:25.404001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:25.404001 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:25.546073 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:25.553800 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-4a3486c0-7526-437a-8db5-d60f37434ba3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.169855 Jul 01 11:56:25.554389 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3762/7622] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:25 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:26.572150 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:26.572867 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:26.580990 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:26.581476 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:26.582259 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:26.582705 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:26.718826 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:26.726349 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d5ae8c9c-6388-4665-81e2-269b403b537e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1681 microversion: 2.1 time: 0.158907 Jul 01 11:56:26.726911 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3861/7623] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:26 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:27.417340 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-53aed7a9-1fd1-46b8-bf95-afebcaf324a7 req-b84663c6-3987-44b0-b15b-23444f36a2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37242916-5e34-4061-aee2-afa69545df89", "name": "network-vif-deleted", "tag": "3e942fde-7123-48e6-811c-7af20a9758f8"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:56:27.427646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-53aed7a9-1fd1-46b8-bf95-afebcaf324a7 req-b84663c6-3987-44b0-b15b-23444f36a2b3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:27.428098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-53aed7a9-1fd1-46b8-bf95-afebcaf324a7 req-b84663c6-3987-44b0-b15b-23444f36a2b3 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:27.439577 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-53aed7a9-1fd1-46b8-bf95-afebcaf324a7 req-b84663c6-3987-44b0-b15b-23444f36a2b3 service nova] Creating event network-vif-deleted:3e942fde-7123-48e6-811c-7af20a9758f8 for instance 37242916-5e34-4061-aee2-afa69545df89 on n-h2-master-1 Jul 01 11:56:27.445177 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-53aed7a9-1fd1-46b8-bf95-afebcaf324a7 req-b84663c6-3987-44b0-b15b-23444f36a2b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Jul 01 11:56:27.445944 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3763/7624] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:56:27.743873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:27.744510 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:27.752392 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:27.752854 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:27.753687 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:27.754140 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:27.787360 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:27.787830 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:27.788307 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.objects.instance [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lazy-loading 'fault' on Instance uuid 37242916-5e34-4061-aee2-afa69545df89 {{(pid=119764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:56:27.833326 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:27.841046 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b21b9372-303b-4c67-9289-96f403287dfe tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 200 len: 1337 microversion: 2.1 time: 0.101048 Jul 01 11:56:27.841656 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3862/7625] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:27 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:28.860449 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:28.861173 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 37242916-5e34-4061-aee2-afa69545df89] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:28.868303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:28.868748 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:28.869539 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:28.869977 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:28.883683 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] HTTP exception thrown: Instance 37242916-5e34-4061-aee2-afa69545df89 could not be found. Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Request method failure captured: Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 HTTP/1.1 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivt_feZJZXEUtJaa-WvAacTbqYqc5ItZ7O8KOq_3Oo98wAFCf8-OQb8MZQJojHrm1iNQJ703aouzZm38ojHFa6tfMOMLgD6i-NnNjsCsToMzlzAS5bgwr4kUQkrlMMLNMyB5u75mUVGgw0pmZJrTffvI2g4dBVRv0jHITFa4CpYrgKhs Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 38f5f7f94d464276a2993b970be5287f Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestShelveInstance-1029792326 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38f5f7f94d464276a2993b970be5287f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38f5f7f94d464276a2993b970be5287f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38f5f7f94d464276a2993b970be5287f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38f5f7f94d464276a2993b970be5287f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestShelveInstance-1029792326 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 38f5f7f94d464276a2993b970be5287f Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestShelveInstance-1029792326 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestShelveInstance-1029792326-project Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 45fedf332aaf4ce8900ce797a0fd06e4 Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestShelveInstance-1029792326-project Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 37242916-5e34-4061-aee2-afa69545df89 could not be found. Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '37242916-5e34-4061-aee2-afa69545df89'} Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37242916-5e34-4061-aee2-afa69545df89 could not be found. Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37242916-5e34-4061-aee2-afa69545df89 could not be found. Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 11:56:28.885328 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37242916-5e34-4061-aee2-afa69545df89 could not be found. Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Returning 404 to user: Instance 37242916-5e34-4061-aee2-afa69545df89 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b0f61961-8028-46ef-a462-e43ce653012c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89" status: 404 len: 111 microversion: 2.1 time: 0.030611 Jul 01 11:56:28.890891 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3764/7626] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:28 2022] GET /compute/v2.1/servers/37242916-5e34-4061-aee2-afa69545df89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 11:56:29.113362 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-00e663f8-79d4-445f-87c6-59bd5fb1d292 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '.version_select at 0x7f6f91bce700>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:29.235921 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-00e663f8-79d4-445f-87c6-59bd5fb1d292 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1145011161" status: 202 len: 0 microversion: 2.1 time: 0.126402 Jul 01 11:56:29.236774 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3863/7627] 10.222.0.23 () {58 vars in 1253 bytes} [Fri Jul 1 11:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1145011161 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:56:29.261850 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-289064ad-45dd-4539-8bf3-4e3e0037b23e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'create', calling method: .version_select at 0x7f6f90699af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-330640124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2mJL4HnEp4ayYth+qkX68rOHrJBpUpB9zifBzIY90anyYsmH5lOXY6sZQOBznGWt31YfDxy6AOHxBqW8n6ultacvHFR9BVYcxRBCVVCbylVqto8RaG1F+R+WsNLbowrg=="}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:56:29.275647 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-289064ad-45dd-4539-8bf3-4e3e0037b23e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for project 38f5f7f94d464276a2993b970be5287f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:56:29.280824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-289064ad-45dd-4539-8bf3-4e3e0037b23e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for user 45fedf332aaf4ce8900ce797a0fd06e4 and project 38f5f7f94d464276a2993b970be5287f. Resources: {'key_pairs'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:56:29.378380 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-289064ad-45dd-4539-8bf3-4e3e0037b23e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.120554 Jul 01 11:56:29.378972 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3765/7628] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 11:56:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:56:52.380217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1073496417", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-330640124", "security_groups": [{"name": "tempest-secgroup-smoke-1528539545"}], "networks": [{"uuid": "c983e5eb-f61c-4fb1-b5f9-e2f71cf062dc"}], "block_device_mapping_v2": [{"uuid": "e1bc561b-b250-412d-ab07-8337720a79ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:56:52.389292 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:52.389951 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:52.491276 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.network.neutron [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] validate_networks() for [('c983e5eb-f61c-4fb1-b5f9-e2f71cf062dc', None, None, None, None, None)] {{(pid=119764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 11:56:52.866579 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Flavor limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 11:56:52.867020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Image limits 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 11:56:52.867501 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Flavor pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 11:56:52.867943 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Image pref 0:0:0 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 11:56:52.868387 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.virt.hardware [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 11:56:52.877579 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:52.878115 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:52.878929 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:52.879378 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:52.895666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for project 38f5f7f94d464276a2993b970be5287f. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 11:56:52.901233 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Getting quotas for user 45fedf332aaf4ce8900ce797a0fd06e4 and project 38f5f7f94d464276a2993b970be5287f. Resources: {'instances', 'ram', 'cores'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 11:56:52.959213 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Going to run 1 instances... {{(pid=119764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 11:56:52.961460 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1bc561b-b250-412d-ab07-8337720a79ba',volume_size=None,volume_type=None)] {{(pid=119764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 11:56:53.316350 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-497660ef-027c-437b-a5ad-aa960f8276e8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.939924 Jul 01 11:56:53.317020 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3864/7629] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 11:56:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 11:56:53.325462 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=12 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:53.326880 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:53.327534 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:56:53.332185 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d91a5def-7ea8-4354-b6fa-22a8a7b335d0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:53.332819 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d91a5def-7ea8-4354-b6fa-22a8a7b335d0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:53.384794 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d91a5def-7ea8-4354-b6fa-22a8a7b335d0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:53.392357 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d91a5def-7ea8-4354-b6fa-22a8a7b335d0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1088 microversion: 2.1 time: 0.068812 Jul 01 11:56:53.392930 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3766/7630] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:53 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:54.409660 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0bb4cb93-1cb0-4459-aa90-362d794fc5a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:54.410285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0bb4cb93-1cb0-4459-aa90-362d794fc5a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:54.468576 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0bb4cb93-1cb0-4459-aa90-362d794fc5a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:54.475305 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0bb4cb93-1cb0-4459-aa90-362d794fc5a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1088 microversion: 2.1 time: 0.069500 Jul 01 11:56:54.475862 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3865/7631] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:54 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:55.492699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a5b2598b-1c94-46a2-bb9f-7ecc7535df3a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:55.493397 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a5b2598b-1c94-46a2-bb9f-7ecc7535df3a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:55.555143 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a5b2598b-1c94-46a2-bb9f-7ecc7535df3a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:55.563228 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a5b2598b-1c94-46a2-bb9f-7ecc7535df3a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1088 microversion: 2.1 time: 0.075049 Jul 01 11:56:55.563796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3767/7632] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:55 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:56.580323 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7a05530e-ad72-40bc-8ddc-d3fec4d16cbb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:56.580951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7a05530e-ad72-40bc-8ddc-d3fec4d16cbb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:56.633725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7a05530e-ad72-40bc-8ddc-d3fec4d16cbb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:56.641097 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7a05530e-ad72-40bc-8ddc-d3fec4d16cbb tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1088 microversion: 2.1 time: 0.065236 Jul 01 11:56:56.641689 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3866/7633] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:56 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:57.658591 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:57.659228 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:57.666854 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:57.667306 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:57.668061 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:57.668492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:57.731067 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:57.738572 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c96da8c-5f8a-42d1-bd56-45a9a34dfb86 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1138 microversion: 2.1 time: 0.084522 Jul 01 11:56:57.739149 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3768/7634] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:57 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:58.754685 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:58.755313 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:58.762299 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:58.762789 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:58.763630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:58.764086 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:58.828041 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:56:58.835647 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3f590ef5-f82d-48e1-9541-85031e4baff0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1186 microversion: 2.1 time: 0.084860 Jul 01 11:56:58.836214 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3867/7635] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:58 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:56:59.856411 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:56:59.857104 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:56:59.868066 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:59.869013 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:56:59.870037 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:56:59.870589 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:00.030439 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:00.038652 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-61e32ab4-d031-4646-a7fd-6dd30bf36786 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1272 microversion: 2.1 time: 0.189279 Jul 01 11:57:00.049321 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3769/7636] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:56:59 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:01.056902 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:01.058164 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:01.074735 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:01.075379 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:01.077320 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:01.077964 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:01.169721 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-7c093b54-0f99-4830-8b01-2f95eff1b80b req-37bd2df0-616c-4399-86ad-6c44b57b7ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c608b4-dc3a-4df3-b64b-bcec7e34d3d4", "tag": "6fbfc58b-2608-4b60-9e62-071e8ec69b48"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:57:01.196252 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7c093b54-0f99-4830-8b01-2f95eff1b80b req-37bd2df0-616c-4399-86ad-6c44b57b7ca9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:01.197044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-7c093b54-0f99-4830-8b01-2f95eff1b80b req-37bd2df0-616c-4399-86ad-6c44b57b7ca9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:01.209818 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-7c093b54-0f99-4830-8b01-2f95eff1b80b req-37bd2df0-616c-4399-86ad-6c44b57b7ca9 service nova] Creating event network-changed:6fbfc58b-2608-4b60-9e62-071e8ec69b48 for instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 on n-h1-master-1 Jul 01 11:57:01.224192 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-7c093b54-0f99-4830-8b01-2f95eff1b80b req-37bd2df0-616c-4399-86ad-6c44b57b7ca9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169811 Jul 01 11:57:01.225608 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3770/7637] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:57:01.262232 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:01.270911 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-6b4ce9cd-3aaf-4ea9-b068-a57bd8f10aa4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1272 microversion: 2.1 time: 0.218662 Jul 01 11:57:01.272040 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3868/7638] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:01 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:02.289168 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:02.289894 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:02.296244 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:02.296691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:02.297488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:02.297927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:02.434923 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:02.443688 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-07ba0d61-8fdd-4ed7-a86a-dfb10d53a637 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1272 microversion: 2.1 time: 0.159446 Jul 01 11:57:02.444337 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3771/7639] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:02 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:03.461844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:03.462617 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:03.465354 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=2 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:57:03.470959 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:03.471446 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:03.472422 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:03.473018 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:03.605743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:03.613645 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-d2c67579-e88b-443f-8f4f-d35294b9934f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1272 microversion: 2.1 time: 0.155653 Jul 01 11:57:03.614338 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3869/7640] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:03 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:04.629661 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:04.630941 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:04.638172 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:04.638617 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:04.639382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:04.639814 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:04.776343 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:04.784468 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d69ec68c-7a9a-46d0-86e5-e98496da3f9b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1272 microversion: 2.1 time: 0.158723 Jul 01 11:57:04.785039 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3772/7641] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:04 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:05.846972 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:05.847601 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:05.853666 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:05.854127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:05.854895 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:05.855339 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:05.987586 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:05.995535 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-714d19ae-9bc5-4b15-a6e2-d3b6d4102e00 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.197932 Jul 01 11:57:05.996128 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3870/7642] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:05 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:07.014218 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:07.014824 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:07.016789 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=4 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:57:07.022579 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:07.027093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:07.027093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:07.027093 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:07.159767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:07.167249 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3d33bda4-9239-41b4-aa3c-856d2ed88881 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.157753 Jul 01 11:57:07.167881 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3773/7643] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:07 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:08.184480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:08.185251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:08.187173 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=10 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:57:08.192853 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:08.193352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:08.194134 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:08.194883 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:08.323651 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:08.331729 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4e49b3d6-dcd6-4043-93e9-e71ed8c9cab0 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.151158 Jul 01 11:57:08.332297 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3871/7644] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:08 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:09.348385 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:09.348993 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:09.355747 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:09.356196 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:09.357610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:09.358064 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:09.487309 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:09.494882 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9d7cbbb2-f22b-4045-a31b-5aa5d402b5ef tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.150421 Jul 01 11:57:09.495451 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3774/7645] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:09 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:10.511227 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:10.511858 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:10.519370 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:10.519837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:10.520622 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:10.521073 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:10.660590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:10.668272 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5da6a0a3-e0f3-4aef-92e8-a26bf5293704 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.161065 Jul 01 11:57:10.668917 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3872/7646] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:10 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:11.685138 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:11.685767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:11.692755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:11.693288 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:11.694053 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:11.694755 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:11.826205 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:11.834278 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ef5ef6e6-bdd9-4c64-9c5f-35d4f21862c4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.152982 Jul 01 11:57:11.834859 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3775/7647] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:11 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:12.851759 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:12.852421 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:12.860521 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:12.860979 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:12.861799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:12.862245 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:12.997953 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:13.005583 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-246aa617-d494-40e5-a4ed-86ac41915ac1 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.157637 Jul 01 11:57:13.006159 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3873/7648] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:12 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:14.022492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:14.023117 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:14.030200 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:14.030650 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:14.031414 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:14.031851 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:14.161900 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:14.169444 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dc04bf20-17c0-4537-85fb-463c4a2aef81 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.150831 Jul 01 11:57:14.170019 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3776/7649] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:14 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:14.406741 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-83cea9b4-d8e8-4996-87a9-dfe2315e7fde req-cd3fe0db-ff19-44ba-a892-465f6db38714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c608b4-dc3a-4df3-b64b-bcec7e34d3d4", "name": "network-vif-plugged", "status": "completed", "tag": "6fbfc58b-2608-4b60-9e62-071e8ec69b48"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:57:14.416165 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83cea9b4-d8e8-4996-87a9-dfe2315e7fde req-cd3fe0db-ff19-44ba-a892-465f6db38714 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:14.416629 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-83cea9b4-d8e8-4996-87a9-dfe2315e7fde req-cd3fe0db-ff19-44ba-a892-465f6db38714 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:14.428198 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-83cea9b4-d8e8-4996-87a9-dfe2315e7fde req-cd3fe0db-ff19-44ba-a892-465f6db38714 service nova] Creating event network-vif-plugged:6fbfc58b-2608-4b60-9e62-071e8ec69b48 for instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 on n-h1-master-1 Jul 01 11:57:14.433324 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-83cea9b4-d8e8-4996-87a9-dfe2315e7fde req-cd3fe0db-ff19-44ba-a892-465f6db38714 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031119 Jul 01 11:57:14.433917 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3874/7650] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:57:15.186829 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:15.188002 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:15.195303 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:15.195759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:15.196522 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:15.196968 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:15.330887 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:15.338405 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-58f00363-e317-491a-98cf-c5543757fc59 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1260 microversion: 2.1 time: 0.155547 Jul 01 11:57:15.342796 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3777/7651] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:15 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:16.361666 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:16.362414 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:16.368630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:16.369093 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:16.369890 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:16.370337 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:16.504727 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:16.512532 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b6450b24-cb11-4a8f-9df4-0fe38fbced9c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1444 microversion: 2.1 time: 0.156437 Jul 01 11:57:16.513109 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3875/7652] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:16 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:16.528959 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:57:16.529602 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:57:16.536531 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:16.536980 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:16.543580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:16.543580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:16.669066 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:57:16.677178 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d6814955-f710-4b5e-bc0c-cf73ae06d137 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1444 microversion: 2.1 time: 0.152031 Jul 01 11:57:16.677755 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3778/7653] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:57:16 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:57:18.533944 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-5035f60c-d376-4651-b422-4ad5ef62615f req-b5050290-4e25-4e27-9e3f-b64c8c5e3a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c608b4-dc3a-4df3-b64b-bcec7e34d3d4", "tag": "6fbfc58b-2608-4b60-9e62-071e8ec69b48"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:57:18.542919 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5035f60c-d376-4651-b422-4ad5ef62615f req-b5050290-4e25-4e27-9e3f-b64c8c5e3a0c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:57:18.543486 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-5035f60c-d376-4651-b422-4ad5ef62615f req-b5050290-4e25-4e27-9e3f-b64c8c5e3a0c service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:57:18.555159 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-5035f60c-d376-4651-b422-4ad5ef62615f req-b5050290-4e25-4e27-9e3f-b64c8c5e3a0c service nova] Creating event network-changed:6fbfc58b-2608-4b60-9e62-071e8ec69b48 for instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 on n-h1-master-1 Jul 01 11:57:18.560340 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-5035f60c-d376-4651-b422-4ad5ef62615f req-b5050290-4e25-4e27-9e3f-b64c8c5e3a0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030651 Jul 01 11:57:18.561232 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3876/7654] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 11:57:26.838895 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:57:26.839383 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:57:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:59:06.366124 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:59:06.366686 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 11:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:59:07.153156 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 11:59:07.153726 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 11:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 11:59:36.929774 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:59:36.930876 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 11:59:36.932111 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=30 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:59:36.932844 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=62 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:59:36.936929 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:59:36.937494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:36.944746 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:36.945479 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:36.946261 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:36.946711 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:36.970325 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lazy-loading 'flavor' on Instance uuid 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 11:59:37.211130 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [ce66b27d-0f68-4a0d-a9e4-599c964ae14c] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:59:37.941679 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45526. Jul 01 11:59:37.945295 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45528. Jul 01 11:59:38.218607 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [ce66b27d-0f68-4a0d-a9e4-599c964ae14c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45530. Jul 01 11:59:38.221924 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-b40f00f0-8bf9-47bb-841f-55ac7a78f660 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4/action" status: 202 len: 0 microversion: 2.1 time: 1.294129 Jul 01 11:59:38.222523 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3779/7655] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:59:36 2022] POST /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4/action => generated 0 bytes in 1295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:59:38.228818 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:59:38.229667 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 11:59:38.230857 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:59:38.231629 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=54 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 11:59:38.236069 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:38.236807 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:38.243509 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:38.247502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:38.247502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:38.247502 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:38.378511 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:38.386926 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b8f9ccfa-2e2f-4e6c-aa05-9bc2673f5ac8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.159913 Jul 01 11:59:38.387487 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3877/7656] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:38 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:39.405112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:39.406685 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:39.412959 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:39.413425 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:39.414178 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:39.414610 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:39.549524 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:39.557005 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d1bd9e27-5568-426c-9eb5-21a7d4bd045c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.156961 Jul 01 11:59:39.557585 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3780/7657] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:39 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:40.574951 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:40.575589 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:40.587053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:40.588170 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:40.588952 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:40.589420 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:40.596235 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45544. Jul 01 11:59:40.606128 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45542. Jul 01 11:59:40.720379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:40.728087 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b5906fb0-fde7-4325-9969-dce2b0e40ce9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.157857 Jul 01 11:59:40.728657 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3878/7658] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:40 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:41.745443 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:41.746062 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:41.752909 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:41.753397 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:41.754157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:41.754591 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:41.886590 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:41.900509 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7fa408cb-942d-4bf8-8529-6fd5629a4b2d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.152815 Jul 01 11:59:41.900509 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3781/7659] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:41 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:42.912186 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:42.912794 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:42.919777 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:42.920240 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:42.921054 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:42.921529 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:43.058627 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:43.066401 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-247ce7de-8ec5-4c76-8719-29de10500e7d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.158339 Jul 01 11:59:43.066976 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3879/7660] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:42 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:44.084339 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:44.084994 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:44.091981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:44.092430 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:44.093216 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:44.093654 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:44.225634 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:44.239428 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6a6a63b7-1e5d-461f-9300-8aa9aa39475d tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.158920 Jul 01 11:59:44.240011 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3782/7661] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:44 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:45.257099 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:45.257743 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:45.265168 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:45.265635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:45.266408 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:45.266851 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:45.396406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:45.404549 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-494c8339-3876-43eb-843f-48ed349ace6a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.151345 Jul 01 11:59:45.405113 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3880/7662] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:45 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:46.422093 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:46.422683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:46.429609 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:46.430086 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:46.430848 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:46.431309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:46.565232 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:46.573662 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-eaeb47e3-2a74-40a1-a5f5-6f9109238d35 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.155474 Jul 01 11:59:46.574226 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3783/7663] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:46 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:47.590837 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:47.591454 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:47.599277 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:47.599738 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:47.600616 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:47.601088 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:47.735285 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:47.743094 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8c476e8f-6c83-495e-ab3a-220bca9c2025 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.156198 Jul 01 11:59:47.744240 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3881/7664] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:47 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:48.760935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:48.761577 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:48.768580 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:48.769021 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:48.769815 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:48.770241 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:48.904363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:48.912113 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-68079c85-c239-4cfa-80c9-e86e57f4b831 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.155123 Jul 01 11:59:48.912783 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3784/7665] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:48 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:49.930699 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:49.931988 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:49.939133 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:49.939592 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:49.940364 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:49.940807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:50.078022 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:50.085756 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-e134e5be-de38-40da-8a3b-f422e037c561 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.159111 Jul 01 11:59:50.086341 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3882/7666] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:49 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:51.103514 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:51.104045 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:51.110898 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:51.111340 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:51.112095 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:51.112519 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:51.253845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:51.261961 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a5041c77-21c5-4af9-b4b6-9adce4b4c0e6 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.162411 Jul 01 11:59:51.262523 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3785/7667] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:51 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:52.279786 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:52.280418 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:52.287611 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:52.288080 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:52.288877 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:52.289365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:52.484938 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:52.492760 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2633017e-d548-454a-a624-c9279db854a9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.216959 Jul 01 11:59:52.499425 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3883/7668] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:52 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:53.099618 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-61c1707c-0969-450c-b8cc-fc304efc24da req-f4c822fd-9fc4-4d9c-b3b3-de878edef41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c608b4-dc3a-4df3-b64b-bcec7e34d3d4", "name": "network-vif-unplugged", "status": "completed", "tag": "6fbfc58b-2608-4b60-9e62-071e8ec69b48"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:59:53.107883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-61c1707c-0969-450c-b8cc-fc304efc24da req-f4c822fd-9fc4-4d9c-b3b3-de878edef41e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:53.108330 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-61c1707c-0969-450c-b8cc-fc304efc24da req-f4c822fd-9fc4-4d9c-b3b3-de878edef41e service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:53.119706 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-61c1707c-0969-450c-b8cc-fc304efc24da req-f4c822fd-9fc4-4d9c-b3b3-de878edef41e service nova] Creating event network-vif-unplugged:6fbfc58b-2608-4b60-9e62-071e8ec69b48 for instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 on n-h1-master-1 Jul 01 11:59:53.124837 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-61c1707c-0969-450c-b8cc-fc304efc24da req-f4c822fd-9fc4-4d9c-b3b3-de878edef41e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080700 Jul 01 11:59:53.125430 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3786/7669] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 11:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 11:59:53.510590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:53.511217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:53.517798 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:53.522284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:53.522284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:53.522284 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:53.655216 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:53.662845 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-ea334f77-0aaa-4970-895a-728d2bf90514 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1510 microversion: 2.1 time: 0.156182 Jul 01 11:59:53.663411 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3884/7670] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:53 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:53.680189 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ab006852-f66a-41d4-9da1-cb46aafe4dbf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 11:59:53.681509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ab006852-f66a-41d4-9da1-cb46aafe4dbf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:53.687792 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab006852-f66a-41d4-9da1-cb46aafe4dbf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:53.688240 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab006852-f66a-41d4-9da1-cb46aafe4dbf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:53.689003 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab006852-f66a-41d4-9da1-cb46aafe4dbf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:53.689462 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-ab006852-f66a-41d4-9da1-cb46aafe4dbf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:53.976227 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ab006852-f66a-41d4-9da1-cb46aafe4dbf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "POST /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4/action" status: 202 len: 0 microversion: 2.1 time: 0.300291 Jul 01 11:59:53.976844 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3787/7671] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 11:59:53 2022] POST /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 11:59:53.985725 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:53.986353 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:53.992426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:53.992888 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:53.993726 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:53.994160 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:54.178139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:54.186009 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a958080c-f4eb-4da3-9aca-91f3ce3a8baf tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1518 microversion: 2.1 time: 0.204193 Jul 01 11:59:54.186590 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3885/7672] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:53 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1518 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 11:59:55.204611 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:55.204995 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:55.211122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:55.211561 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:55.212829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:55.213296 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:55.389494 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:55.397215 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9404fe8b-0323-4114-8fd9-fb2205423239 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1518 microversion: 2.1 time: 0.197782 Jul 01 11:59:55.397785 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3788/7673] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:55 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:56.415011 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:56.419624 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:56.423974 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:56.424663 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:56.425514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:56.425968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:56.560922 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:56.568821 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-3c42e887-9537-44cd-9b61-48b77f44a71e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1518 microversion: 2.1 time: 0.157834 Jul 01 11:59:56.569413 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3886/7674] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:56 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:57.585990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:57.586605 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:57.598282 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:57.598730 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:57.599494 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:57.599927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:57.742315 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:57.749998 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f4f71d1b-7c8b-4bfc-8dff-51cdd334bd46 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1518 microversion: 2.1 time: 0.167930 Jul 01 11:59:57.750575 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3789/7675] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:57 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:58.767608 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:58.768291 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:58.776058 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:58.776514 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:58.777354 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:58.785186 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:58.909994 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 11:59:58.917585 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7d771b22-eda6-4409-bbd1-1392cef41753 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1518 microversion: 2.1 time: 0.154464 Jul 01 11:59:58.918145 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3887/7676] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:58 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 11:59:59.935215 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 11:59:59.936469 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 11:59:59.943728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:59.944474 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 11:59:59.945346 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 11:59:59.945783 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:00.088548 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:00.096440 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-d14bd144-2642-49cd-89fb-f8a7ef398801 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1520 microversion: 2.1 time: 0.165279 Jul 01 12:00:00.097409 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3790/7677] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 11:59:59 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:01.114255 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:01.114888 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:01.122122 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:01.122593 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:01.123385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:01.123837 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:01.253590 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:01.261898 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4918189d-9d63-4b5d-8405-8fd211f7a7ff tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1520 microversion: 2.1 time: 0.151539 Jul 01 12:00:01.262470 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3888/7678] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:01 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:02.278906 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:02.279509 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:02.286647 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:02.287098 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:02.287896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:02.288334 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:02.425930 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:02.433895 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-20bb9b02-7b5f-4942-b533-5dc52e09f7ee tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1520 microversion: 2.1 time: 0.159418 Jul 01 12:00:02.434473 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3791/7679] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:02 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:03.451208 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:03.451844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:03.458847 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:03.459312 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:03.460107 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:03.460567 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:03.591223 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:03.598956 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-f6c2e4ab-8e47-435b-be8a-f7993f4a032b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1520 microversion: 2.1 time: 0.151780 Jul 01 12:00:03.599525 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3889/7680] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:03 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:04.615612 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:04.616225 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:04.623319 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:04.623779 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:04.624555 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:04.624992 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:04.756704 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:04.764623 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-467d2bd6-4335-4168-b69a-25f930eb73c9 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1520 microversion: 2.1 time: 0.152760 Jul 01 12:00:04.765225 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3792/7681] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:04 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 12:00:05.782177 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:05.782815 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:05.789866 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:05.792506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:05.792506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:05.792506 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:05.925348 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:05.932999 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0ab922e2-38fa-47a8-83bd-f48a15e115d8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.154842 Jul 01 12:00:05.933593 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3890/7682] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:05 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:06.950492 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:06.951110 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:06.958044 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:06.958488 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:06.959246 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:06.959684 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:06.963956 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:00:07.102540 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:07.111215 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0927e0a0-b224-464d-93a9-68be0c2d5d4a tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.164759 Jul 01 12:00:07.112036 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3793/7683] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:06 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 12:00:08.129100 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:08.129704 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:08.136631 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:08.137098 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:08.137915 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:08.138367 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:08.273742 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:08.281802 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b32d8bd9-c755-4ca1-84e2-d7408269a680 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.156730 Jul 01 12:00:08.282387 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3891/7684] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:08 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:09.300767 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:09.301400 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:09.303430 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=33 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:00:09.308157 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:09.308607 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:09.309398 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:09.309834 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:09.440943 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:09.449469 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9b09a305-f381-4b19-a8e9-d7801863ae40 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.152785 Jul 01 12:00:09.450044 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3794/7685] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:09 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:10.466337 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:10.466956 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:10.469647 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=31 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:00:10.474400 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:10.474862 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:10.475635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:10.476077 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:10.480738 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=91 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:00:10.605598 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:10.612998 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-87c8b137-c85c-4d50-ac08-c363ee68d68e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.151162 Jul 01 12:00:10.613613 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3892/7686] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:10 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:11.629999 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:11.630609 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:11.637651 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:11.638097 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:11.638853 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:11.639285 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:12.086931 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:12.095264 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7925637c-895e-452e-abaf-aba914618409 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.469190 Jul 01 12:00:12.095836 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3795/7687] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:11 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:13.112290 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:13.112913 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:13.120904 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:13.121397 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:13.122230 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:13.122680 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:13.250844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:13.258424 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2abee861-8509-4d45-9288-6c4bf158cb04 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.150034 Jul 01 12:00:13.258996 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3893/7688] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:13 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:14.275629 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:14.276246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:14.283147 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:14.283598 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:14.284360 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:14.284801 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:14.420151 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:14.427733 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-701e4239-c69d-4bec-9e50-058e0482e7fc tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.156111 Jul 01 12:00:14.428304 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3796/7689] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:14 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:15.445721 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:15.447139 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:15.454187 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:15.454650 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:15.455426 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:15.455873 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:15.586844 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:15.594828 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-0348bdd8-3b71-44d9-8c08-1279fdcda899 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.153366 Jul 01 12:00:15.595401 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3894/7690] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:15 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:16.612090 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:16.612637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:16.619575 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:16.620018 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:16.620780 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:16.621646 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:16.753779 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:16.761815 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7e4752ab-f554-4c17-a2bb-a6150e04a2a3 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.153740 Jul 01 12:00:16.762399 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3797/7691] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:16 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:17.179755 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-534daa38-f018-496e-b975-074ad38de14f req-4d957af0-b1fb-4778-b1de-7cf01b6db712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c608b4-dc3a-4df3-b64b-bcec7e34d3d4", "name": "network-vif-plugged", "status": "completed", "tag": "6fbfc58b-2608-4b60-9e62-071e8ec69b48"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:00:17.188720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-534daa38-f018-496e-b975-074ad38de14f req-4d957af0-b1fb-4778-b1de-7cf01b6db712 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:17.189203 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-534daa38-f018-496e-b975-074ad38de14f req-4d957af0-b1fb-4778-b1de-7cf01b6db712 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:17.200392 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-534daa38-f018-496e-b975-074ad38de14f req-4d957af0-b1fb-4778-b1de-7cf01b6db712 service nova] Creating event network-vif-plugged:6fbfc58b-2608-4b60-9e62-071e8ec69b48 for instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 on n-h1-master-1 Jul 01 12:00:17.209750 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-534daa38-f018-496e-b975-074ad38de14f req-4d957af0-b1fb-4778-b1de-7cf01b6db712 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029883 Jul 01 12:00:17.209750 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3895/7692] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:00:17.778183 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:17.778797 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:17.786138 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:17.786592 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:17.787363 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:17.787798 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:17.917624 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:17.925131 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f81b305b-f025-4975-ad80-6e64f2d32ed4 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1576 microversion: 2.1 time: 0.150953 Jul 01 12:00:17.925727 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3798/7693] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:17 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:00:18.943239 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:00:18.943873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:00:18.951742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:18.952200 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:18.952969 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:00:18.953590 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:00:19.082018 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:00:19.090193 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-696a863c-b5ac-4c04-9cec-95bc2c532927 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1563 microversion: 2.1 time: 0.151247 Jul 01 12:00:19.090762 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3896/7694] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:00:18 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:01:55.910503 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=9 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:01:55.918140 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=34 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:01:55.918281 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=9 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:01:55.918281 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=25 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:01:55.918776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:01:55.918776 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:01:55.918966 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-f3cac4f5-0f93-46e5-9cd8-f129a2f79c01 req-b7b360c2-29c6-4842-ba59-8c2ebddcfea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c608b4-dc3a-4df3-b64b-bcec7e34d3d4", "tag": "6fbfc58b-2608-4b60-9e62-071e8ec69b48"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:01:55.923829 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:55.924311 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:55.925332 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:55.925786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:55.927698 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f3cac4f5-0f93-46e5-9cd8-f129a2f79c01 req-b7b360c2-29c6-4842-ba59-8c2ebddcfea4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:55.928156 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-f3cac4f5-0f93-46e5-9cd8-f129a2f79c01 req-b7b360c2-29c6-4842-ba59-8c2ebddcfea4 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:55.941266 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-f3cac4f5-0f93-46e5-9cd8-f129a2f79c01 req-b7b360c2-29c6-4842-ba59-8c2ebddcfea4 service nova] Creating event network-changed:6fbfc58b-2608-4b60-9e62-071e8ec69b48 for instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 on n-h1-master-1 Jul 01 12:01:55.947580 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-f3cac4f5-0f93-46e5-9cd8-f129a2f79c01 req-b7b360c2-29c6-4842-ba59-8c2ebddcfea4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036980 Jul 01 12:01:55.948451 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3897/7695] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:01:55.956856 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 12:01:56.232495 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-81755069-d937-4740-8b2c-6819c2a0fee8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "DELETE /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 204 len: 0 microversion: 2.1 time: 0.323871 Jul 01 12:01:56.233628 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3799/7696] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 12:01:55 2022] DELETE /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 12:01:56.243912 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:01:56.244708 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:01:56.253577 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:56.254443 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:56.255253 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:56.255742 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:56.399646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:01:56.407730 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c1b90738-ef24-4392-a99e-ba133b327a3b tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.168855 Jul 01 12:01:56.408439 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3898/7697] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:01:56 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:01:57.426731 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:01:57.427434 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:01:57.434492 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:57.434940 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:57.435694 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:57.436127 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:57.568732 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:01:57.576774 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-7307415f-5cc4-4980-adb2-b94459a6727e tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1569 microversion: 2.1 time: 0.154422 Jul 01 12:01:57.577376 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3800/7698] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:01:57 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:01:58.357593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-e6eb2ad2-2307-46e4-bdef-2149b705a8e7 req-7eb4be0c-38f8-46a5-8ba3-0051898399e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c608b4-dc3a-4df3-b64b-bcec7e34d3d4", "name": "network-vif-deleted", "tag": "6fbfc58b-2608-4b60-9e62-071e8ec69b48"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:01:58.366793 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e6eb2ad2-2307-46e4-bdef-2149b705a8e7 req-7eb4be0c-38f8-46a5-8ba3-0051898399e0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:58.367286 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-e6eb2ad2-2307-46e4-bdef-2149b705a8e7 req-7eb4be0c-38f8-46a5-8ba3-0051898399e0 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:58.378402 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-e6eb2ad2-2307-46e4-bdef-2149b705a8e7 req-7eb4be0c-38f8-46a5-8ba3-0051898399e0 service nova] Creating event network-vif-deleted:6fbfc58b-2608-4b60-9e62-071e8ec69b48 for instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 on n-h1-master-1 Jul 01 12:01:58.383579 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-e6eb2ad2-2307-46e4-bdef-2149b705a8e7 req-7eb4be0c-38f8-46a5-8ba3-0051898399e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029883 Jul 01 12:01:58.384159 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3899/7699] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:01:58.594175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:01:58.594784 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:01:58.602307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:58.602753 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:58.603638 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:58.604074 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:58.678363 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:01:58.686455 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-de4015f1-e9db-48fc-9c0a-7a0413fa102f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1219 microversion: 2.1 time: 0.096202 Jul 01 12:01:58.687039 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3801/7700] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:01:58 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:01:59.704443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:01:59.705221 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:01:59.712352 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:59.712816 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:59.713635 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:01:59.714089 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:01:59.780804 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:01:59.789062 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bb902212-0feb-4956-b6db-a23b66e13726 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1219 microversion: 2.1 time: 0.088904 Jul 01 12:01:59.789683 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3900/7701] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:01:59 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:00.806438 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:00.807100 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:00.814518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:00.815640 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:00.816415 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:00.816846 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:00.882683 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:00.890591 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-cbfc4a3d-87e8-47ea-bafb-16ef474a59a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1219 microversion: 2.1 time: 0.088081 Jul 01 12:02:00.891197 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3802/7702] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:00 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:01.907634 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:01.908251 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:01.915239 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:01.915696 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:01.916470 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:01.916916 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:01.980776 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:01.989131 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a638e3e7-4c48-4cba-95c5-20e5270abd7f tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1219 microversion: 2.1 time: 0.085336 Jul 01 12:02:01.989664 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3901/7703] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:01 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:03.005905 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:03.006513 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:03.013525 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:03.013967 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:03.014731 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:03.015222 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:03.048345 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:03.048789 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:03.049269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.objects.instance [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lazy-loading 'fault' on Instance uuid 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 {{(pid=119765) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 12:02:03.091538 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fedf332aaf4ce8900ce797a0fd06e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f5f7f94d464276a2993b970be5287f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:03.100460 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-9b152edb-1ab0-4863-b3dd-d3cd499b14b2 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 200 len: 1224 microversion: 2.1 time: 0.098452 Jul 01 12:02:03.101380 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3803/7704] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:03 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:04.118923 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:04.119545 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] [instance: 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:04.126500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:04.126968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:04.127746 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:04.128256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:04.141406 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.wsgi [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] HTTP exception thrown: Instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 could not be found. Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Request method failure captured: Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: request: GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 HTTP/1.1 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: Accept: application/json Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: Accept-Encoding: identity Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: Connection: close Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: Content-Length: 0 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: Content-Type: application/json Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: Host: 10.222.0.23 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: Openstack-System-Scope: None Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: User-Agent: python-urllib3/1.26.9 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Auth-Token: gAAAAABivt_feZJZXEUtJaa-WvAacTbqYqc5ItZ7O8KOq_3Oo98wAFCf8-OQb8MZQJojHrm1iNQJ703aouzZm38ojHFa6tfMOMLgD6i-NnNjsCsToMzlzAS5bgwr4kUQkrlMMLNMyB5u75mUVGgw0pmZJrTffvI2g4dBVRv0jHITFa4CpYrgKhs Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Id: None Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Domain-Name: None Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Identity-Status: Confirmed Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Is-Admin-Project: True Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Id: default Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Project-Domain-Name: Default Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Project-Id: 38f5f7f94d464276a2993b970be5287f Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Project-Name: tempest-TestShelveInstance-1029792326 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Role: reader,member Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Roles: reader,member Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38f5f7f94d464276a2993b970be5287f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38f5f7f94d464276a2993b970be5287f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38f5f7f94d464276a2993b970be5287f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38f5f7f94d464276a2993b970be5287f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Tenant: tempest-TestShelveInstance-1029792326 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Id: 38f5f7f94d464276a2993b970be5287f Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-Tenant-Name: tempest-TestShelveInstance-1029792326 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-User: tempest-TestShelveInstance-1029792326-project Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Id: default Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-User-Domain-Name: Default Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-User-Id: 45fedf332aaf4ce8900ce797a0fd06e4 Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: X-User-Name: tempest-TestShelveInstance-1029792326-project Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: method: > Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: exception: Instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 could not be found. Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: action_args: {'id': '30c608b4-dc3a-4df3-b64b-bcec7e34d3d4'} Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 could not be found. Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 could not be found. Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 12:02:04.143246 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 could not be found. Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: ERROR nova.api.openstack.wsgi Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Returning 404 to user: Instance 30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 could not be found. {{(pid=119764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-7998f8d1-4d5d-4473-a997-9d35349ad7a8 tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4" status: 404 len: 111 microversion: 2.1 time: 0.029873 Jul 01 12:02:04.147534 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3902/7705] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:04 2022] GET /compute/v2.1/servers/30c608b4-dc3a-4df3-b64b-bcec7e34d3d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 12:02:04.360114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-10438999-6c40-485d-a2a6-797e0abfd89c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] Calling method '.version_select at 0x7f6f90e3b8b0>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:04.435032 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-10438999-6c40-485d-a2a6-797e0abfd89c tempest-TestShelveInstance-1029792326 tempest-TestShelveInstance-1029792326-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-330640124" status: 202 len: 0 microversion: 2.1 time: 0.079045 Jul 01 12:02:04.435628 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3804/7706] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Jul 1 12:02:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-330640124 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 12:02:25.790351 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=12 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:02:25.791115 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=24 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:02:25.974443 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-1fac28c8-08af-4a4c-8280-f04d14d25b41 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Action: 'create', calling method: .version_select at 0x7f6f91c22ca0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1630055980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8OYUdzuhkM6OTGGsbGod5FY1NYuCDsJJ9WECo85VvpllYXW7stCbHrpQyrMvx5sT4zzd3bowNpRNSvrfPDaMkc7R8TLhYqKOqI7rwj+4fzmCEzOhlH66w2Ws4atw/xsg=="}} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:02:25.989983 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1fac28c8-08af-4a4c-8280-f04d14d25b41 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Getting quotas for project 21244a54ba2a4205bb15a8246e5ce0ac. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 12:02:25.995654 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.quota [None req-1fac28c8-08af-4a4c-8280-f04d14d25b41 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Getting quotas for user 51fd564b234b4b27ad82927b8cde8c92 and project 21244a54ba2a4205bb15a8246e5ce0ac. Resources: {'key_pairs'} {{(pid=119764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 12:02:26.011104 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1fac28c8-08af-4a4c-8280-f04d14d25b41 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [5bc3f4db-c970-4b59-9ef4-f66428e8bb68] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 12:02:26.525853 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:02:26.526070 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Jul 01 12:02:26.849920 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:02:26.850442 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:02:27.020352 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [None req-1fac28c8-08af-4a4c-8280-f04d14d25b41 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [5bc3f4db-c970-4b59-9ef4-f66428e8bb68] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45818. Jul 01 12:02:27.115075 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-1fac28c8-08af-4a4c-8280-f04d14d25b41 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.337115 Jul 01 12:02:27.115597 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3903/7707] 10.222.0.23 () {60 vars in 1158 bytes} [Fri Jul 1 12:02:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:02:29.515389 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1653830532", "imageRef": "f784d1ed-9670-424c-abfe-e98e973ecb0e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1630055980", "security_groups": [{"name": "tempest-secgroup-smoke-1447703417"}], "networks": [{"uuid": "70a3f2b1-49d2-4061-b369-38785d4627f6"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:02:29.523676 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:02:29.524327 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:02:29.636790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] validate_networks() for [('70a3f2b1-49d2-4061-b369-38785d4627f6', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 12:02:30.445948 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 12:02:30.446381 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 12:02:30.446863 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 12:02:30.447279 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 12:02:30.447705 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 12:02:30.458416 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:30.458868 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:30.459744 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:30.460325 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:30.481845 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Getting quotas for project 21244a54ba2a4205bb15a8246e5ce0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 12:02:30.487790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Getting quotas for user 51fd564b234b4b27ad82927b8cde8c92 and project 21244a54ba2a4205bb15a8246e5ce0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 12:02:30.504854 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 12:02:30.505595 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f784d1ed-9670-424c-abfe-e98e973ecb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 12:02:30.641769 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-3ee5aef7-90c0-4cf3-a954-deec324a26c9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.126811 Jul 01 12:02:30.641769 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3805/7708] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 12:02:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 12:02:30.654385 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-49936b4b-1a34-4509-bd40-a23d096aa6a6 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:30.659217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-49936b4b-1a34-4509-bd40-a23d096aa6a6 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:30.724097 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-49936b4b-1a34-4509-bd40-a23d096aa6a6 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:30.731663 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-49936b4b-1a34-4509-bd40-a23d096aa6a6 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1249 microversion: 2.1 time: 0.082898 Jul 01 12:02:30.732718 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3904/7709] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:30 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:31.749699 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:31.750310 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:31.756485 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:31.756934 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:31.757728 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:31.758189 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:31.831148 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:31.838756 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-dda0b731-f8e0-4591-a58d-0e674855907e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1253 microversion: 2.1 time: 0.093904 Jul 01 12:02:31.839342 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3806/7710] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:31 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1253 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:32.856002 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:32.856691 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:32.864855 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:32.865369 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:32.866158 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:32.866661 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:32.929926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:32.938031 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-be1b782c-9592-4322-9e31-5935571905d9 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1309 microversion: 2.1 time: 0.086025 Jul 01 12:02:32.957487 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3905/7711] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:32 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:33.965600 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:33.966007 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:33.972852 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:33.973347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:33.974121 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:33.974559 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:34.111768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:34.119433 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-229123c4-b65f-4214-8da7-ee7994234a6a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1375 microversion: 2.1 time: 0.158064 Jul 01 12:02:34.120009 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3807/7712] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:33 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:34.754906 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-983f3556-0fc2-4fe7-845d-43b2aab8ece0 req-3428577b-0ff1-44d6-ba2a-4a04423fc6cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab42c25b-4539-438c-bfb2-2eafd5c820b1", "tag": "94d62634-6d50-47a6-ab10-6757bd1e8ccc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:02:34.778365 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-983f3556-0fc2-4fe7-845d-43b2aab8ece0 req-3428577b-0ff1-44d6-ba2a-4a04423fc6cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:34.779256 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-983f3556-0fc2-4fe7-845d-43b2aab8ece0 req-3428577b-0ff1-44d6-ba2a-4a04423fc6cf service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:34.791821 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-983f3556-0fc2-4fe7-845d-43b2aab8ece0 req-3428577b-0ff1-44d6-ba2a-4a04423fc6cf service nova] Creating event network-changed:94d62634-6d50-47a6-ab10-6757bd1e8ccc for instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 on n-h2-master-1 Jul 01 12:02:34.796907 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-983f3556-0fc2-4fe7-845d-43b2aab8ece0 req-3428577b-0ff1-44d6-ba2a-4a04423fc6cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107793 Jul 01 12:02:34.797747 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3906/7713] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:02:35.137935 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:35.139208 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:35.146644 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:35.147122 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:35.147887 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:35.148320 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:35.281521 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:35.289731 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-e074b74d-cf05-4387-b1ef-5c241ad660d8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1375 microversion: 2.1 time: 0.155755 Jul 01 12:02:35.290305 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3808/7714] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:35 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:36.308035 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:36.308787 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:36.315265 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:36.315720 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:36.316500 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:36.316947 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:36.454595 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:36.462861 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-fea5830c-06c6-4a97-8c34-92441483019e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1375 microversion: 2.1 time: 0.160008 Jul 01 12:02:36.463669 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3907/7715] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:36 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:37.479996 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:37.480684 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:37.488181 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:37.488627 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:37.489411 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:37.489844 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:37.623944 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:37.631523 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-82f36c56-ebfa-4911-8fe5-b651496f5903 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1375 microversion: 2.1 time: 0.155611 Jul 01 12:02:37.632351 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3809/7716] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:37 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:38.648343 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:38.649079 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:38.655926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:38.656388 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:38.657167 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:38.657620 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:38.791824 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:38.799794 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-2d30ed57-6b96-4c48-a7ea-f1b27d11e405 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1375 microversion: 2.1 time: 0.155311 Jul 01 12:02:38.800352 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3908/7717] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:38 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:39.557175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-cc1fadf2-89c1-4988-8619-5ad74db01bf9 req-6c61c36a-6e09-482d-978d-9733fdf716b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab42c25b-4539-438c-bfb2-2eafd5c820b1", "name": "network-vif-plugged", "status": "completed", "tag": "94d62634-6d50-47a6-ab10-6757bd1e8ccc"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:02:39.566353 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cc1fadf2-89c1-4988-8619-5ad74db01bf9 req-6c61c36a-6e09-482d-978d-9733fdf716b9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:39.566802 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-cc1fadf2-89c1-4988-8619-5ad74db01bf9 req-6c61c36a-6e09-482d-978d-9733fdf716b9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:39.577734 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-cc1fadf2-89c1-4988-8619-5ad74db01bf9 req-6c61c36a-6e09-482d-978d-9733fdf716b9 service nova] Creating event network-vif-plugged:94d62634-6d50-47a6-ab10-6757bd1e8ccc for instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 on n-h2-master-1 Jul 01 12:02:39.582952 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-cc1fadf2-89c1-4988-8619-5ad74db01bf9 req-6c61c36a-6e09-482d-978d-9733fdf716b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029413 Jul 01 12:02:39.583518 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3810/7718] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:02:39.817096 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:39.817751 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:39.824799 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:39.825289 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:39.826066 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:39.826512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:39.955121 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:39.962632 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-658a89bd-958f-4eda-b4be-cf05485132a2 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1375 microversion: 2.1 time: 0.150166 Jul 01 12:02:39.963209 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3909/7719] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:39 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:40.977094 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:02:40.977989 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=6 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:02:40.983070 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:40.983782 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:40.990450 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:40.990896 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:40.991656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:40.992146 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:41.131409 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:41.139134 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0622cb0b-f17b-46bc-b488-67c33a28a3b1 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1375 microversion: 2.1 time: 0.162787 Jul 01 12:02:41.145765 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3811/7720] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:40 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:42.156250 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:42.156803 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:42.158934 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=6 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:02:42.163928 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:42.164385 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:42.165176 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:42.165624 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:42.295796 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:42.303356 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a6377853-669c-4de2-9982-189db6898a97 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1560 microversion: 2.1 time: 0.151399 Jul 01 12:02:42.303922 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3910/7721] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:42 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:02:42.319637 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:02:42.320241 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:02:42.327691 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:42.328133 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:42.328883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:42.329347 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:42.464916 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:02:42.472677 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-0469a230-ef88-49ba-8e1f-85081e6f1021 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1560 microversion: 2.1 time: 0.156833 Jul 01 12:02:42.473269 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3812/7722] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:02:42 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 12:02:44.436732 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-7c2a5357-8adc-467a-82e6-48b32ca7e319 req-6e827d60-6fdd-4b95-b513-f9b2ae833a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab42c25b-4539-438c-bfb2-2eafd5c820b1", "tag": "94d62634-6d50-47a6-ab10-6757bd1e8ccc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:02:44.446060 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c2a5357-8adc-467a-82e6-48b32ca7e319 req-6e827d60-6fdd-4b95-b513-f9b2ae833a75 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:02:44.446522 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-7c2a5357-8adc-467a-82e6-48b32ca7e319 req-6e827d60-6fdd-4b95-b513-f9b2ae833a75 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:02:44.459307 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-7c2a5357-8adc-467a-82e6-48b32ca7e319 req-6e827d60-6fdd-4b95-b513-f9b2ae833a75 service nova] Creating event network-changed:94d62634-6d50-47a6-ab10-6757bd1e8ccc for instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 on n-h2-master-1 Jul 01 12:02:44.464605 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-7c2a5357-8adc-467a-82e6-48b32ca7e319 req-6e827d60-6fdd-4b95-b513-f9b2ae833a75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089068 Jul 01 12:02:44.465248 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3911/7723] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:04:07.162969 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:04:07.163554 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:04:41.711844 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 12:04:41.712750 n-d-master-1 devstack@n-api.service[119765]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 12:04:41.713532 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:04:41.714447 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=40 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:04:41.718249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a1b044b4-c0b9-41d7-af84-ee441a49c399 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2049783712"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:04:41.719298 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a1b044b4-c0b9-41d7-af84-ee441a49c399 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:04:41.725136 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1b044b4-c0b9-41d7-af84-ee441a49c399 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:04:41.729713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1b044b4-c0b9-41d7-af84-ee441a49c399 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:04:41.729713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1b044b4-c0b9-41d7-af84-ee441a49c399 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:04:41.729713 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a1b044b4-c0b9-41d7-af84-ee441a49c399 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:04:42.257252 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a1b044b4-c0b9-41d7-af84-ee441a49c399 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "POST /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1/action" status: 202 len: 0 microversion: 2.1 time: 0.546911 Jul 01 12:04:42.257889 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3813/7724] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 12:04:41 2022] POST /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 12:04:48.133612 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 12:04:48.137183 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 12:04:48.138079 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:04:48.139485 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:04:48.144217 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-17214ddd-8a7f-46e4-bb88-4e2fe4e61cf3 req-61b14063-d122-4e15-b493-980e2f057494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab42c25b-4539-438c-bfb2-2eafd5c820b1", "name": "network-vif-plugged", "status": "completed", "tag": "94d62634-6d50-47a6-ab10-6757bd1e8ccc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:04:48.153305 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-17214ddd-8a7f-46e4-bb88-4e2fe4e61cf3 req-61b14063-d122-4e15-b493-980e2f057494 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:04:48.154072 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-17214ddd-8a7f-46e4-bb88-4e2fe4e61cf3 req-61b14063-d122-4e15-b493-980e2f057494 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:04:48.166577 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-17214ddd-8a7f-46e4-bb88-4e2fe4e61cf3 req-61b14063-d122-4e15-b493-980e2f057494 service nova] Creating event network-vif-plugged:94d62634-6d50-47a6-ab10-6757bd1e8ccc for instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 on n-h2-master-1 Jul 01 12:04:48.172082 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-17214ddd-8a7f-46e4-bb88-4e2fe4e61cf3 req-61b14063-d122-4e15-b493-980e2f057494 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042048 Jul 01 12:04:48.173217 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3912/7725] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:04:58.014778 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:04:58.015530 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:04:58.020489 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1865591285", "imageRef": "7a2c570e-a2e8-4131-9fb3-370f64ce33c8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1630055980", "security_groups": [{"name": "tempest-secgroup-smoke-1447703417"}], "networks": [{"uuid": "70a3f2b1-49d2-4061-b369-38785d4627f6"}]}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:04:58.041262 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e243ce0-c8f7-4727-9aef-36d74bdfb9c1] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 46088. Jul 01 12:04:58.041980 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d920935-43ab-41f1-bae1-4b292318efa6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 46086. Jul 01 12:04:58.273746 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.network.neutron [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] validate_networks() for [('70a3f2b1-49d2-4061-b369-38785d4627f6', None, None, None, None, None)] {{(pid=119765) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 12:04:58.690813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Flavor limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 12:04:58.691269 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Image limits 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 12:04:58.691766 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Flavor pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 12:04:58.692171 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Image pref 0:0:0 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 12:04:58.692576 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.virt.hardware [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119765) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 12:04:58.701786 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:04:58.702228 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:04:58.703069 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:04:58.703444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:04:58.720260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Getting quotas for project 21244a54ba2a4205bb15a8246e5ce0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 12:04:58.725990 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.quota [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Getting quotas for user 51fd564b234b4b27ad82927b8cde8c92 and project 21244a54ba2a4205bb15a8246e5ce0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=119765) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 12:04:58.738596 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Going to run 1 instances... {{(pid=119765) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 12:04:58.740987 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a2c570e-a2e8-4131-9fb3-370f64ce33c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119765) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 12:04:58.888105 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-84fe8a75-0f29-4c41-8411-34f61ccdc04e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.875177 Jul 01 12:04:58.894108 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3814/7726] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Jul 1 12:04:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 12:04:58.904301 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5f79f7cf-706c-4a7a-8e76-570c8c8c16c0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:04:58.905122 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5f79f7cf-706c-4a7a-8e76-570c8c8c16c0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:04:58.918323 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 46106. Jul 01 12:04:58.921298 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 46108. Jul 01 12:04:59.019593 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5f79f7cf-706c-4a7a-8e76-570c8c8c16c0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:04:59.026437 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5f79f7cf-706c-4a7a-8e76-570c8c8c16c0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1249 microversion: 2.1 time: 0.130695 Jul 01 12:04:59.027006 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3913/7727] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:04:58 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:00.045114 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-544c9747-c20e-414c-b7a0-57965bb471bc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:00.045780 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-544c9747-c20e-414c-b7a0-57965bb471bc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:00.099727 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-544c9747-c20e-414c-b7a0-57965bb471bc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:00.106536 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-544c9747-c20e-414c-b7a0-57965bb471bc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1249 microversion: 2.1 time: 0.066345 Jul 01 12:05:00.107110 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3815/7728] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:00 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:00.179877 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-932a479c-4802-4a9e-8918-149e16a7291b req-5cdf343c-1f52-4a3e-ad7e-1f9d16278b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab42c25b-4539-438c-bfb2-2eafd5c820b1", "name": "network-vif-unplugged", "status": "completed", "tag": "94d62634-6d50-47a6-ab10-6757bd1e8ccc"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:05:00.188920 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-932a479c-4802-4a9e-8918-149e16a7291b req-5cdf343c-1f52-4a3e-ad7e-1f9d16278b14 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:00.190046 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-932a479c-4802-4a9e-8918-149e16a7291b req-5cdf343c-1f52-4a3e-ad7e-1f9d16278b14 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:00.200638 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-932a479c-4802-4a9e-8918-149e16a7291b req-5cdf343c-1f52-4a3e-ad7e-1f9d16278b14 service nova] Creating event network-vif-unplugged:94d62634-6d50-47a6-ab10-6757bd1e8ccc for instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 on n-h2-master-1 Jul 01 12:05:00.206076 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-932a479c-4802-4a9e-8918-149e16a7291b req-5cdf343c-1f52-4a3e-ad7e-1f9d16278b14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083962 Jul 01 12:05:00.206683 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3914/7729] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:05:01.123481 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-ed975e7d-ceec-437b-9df5-254e2be4bed3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:01.123901 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-ed975e7d-ceec-437b-9df5-254e2be4bed3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:01.176633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-ed975e7d-ceec-437b-9df5-254e2be4bed3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:01.183457 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-ed975e7d-ceec-437b-9df5-254e2be4bed3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1249 microversion: 2.1 time: 0.064393 Jul 01 12:05:01.184027 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3816/7730] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:01 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1249 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:02.201833 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-dac8e0f0-353e-4712-8cfb-8c601e42f064 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:02.202474 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-dac8e0f0-353e-4712-8cfb-8c601e42f064 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:02.258258 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-dac8e0f0-353e-4712-8cfb-8c601e42f064 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:02.264967 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-dac8e0f0-353e-4712-8cfb-8c601e42f064 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1249 microversion: 2.1 time: 0.068403 Jul 01 12:05:02.265570 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3915/7731] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:02 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:03.282924 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:03.283462 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:03.291382 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:03.291832 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:03.292597 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:03.293033 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:03.353246 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:03.360605 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-99b8eaf9-45db-459e-a97e-039642787044 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1253 microversion: 2.1 time: 0.082057 Jul 01 12:05:03.361755 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3817/7732] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:03 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:04.379110 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:04.380364 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:04.388300 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:04.388790 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:04.389656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:04.390126 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:04.457868 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:04.465915 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4389dd3b-c458-4eef-87ff-d939f188325c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1301 microversion: 2.1 time: 0.091730 Jul 01 12:05:04.471677 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3916/7733] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:04 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:05.483833 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:05.484451 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:05.493116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:05.493478 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:05.494257 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:05.494690 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:05.608633 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:05.618972 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72a76f83-d60a-415d-a365-227f06a0f93a tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1307 microversion: 2.1 time: 0.139010 Jul 01 12:05:05.619558 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3818/7734] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:05 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1307 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:06.635917 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:06.643020 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:06.651464 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:06.651926 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:06.652975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:06.653461 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:06.802131 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:06.812784 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-005cba18-287c-4de9-970a-1cba2e768018 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.180594 Jul 01 12:05:06.814682 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3917/7735] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:06 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:07.831260 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:07.832832 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:07.840681 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:07.841269 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:07.842124 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:07.842639 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:08.008551 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:08.016545 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-05801839-8a00-4cce-be4e-fa5ff5f35975 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.189752 Jul 01 12:05:08.017670 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3819/7736] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:07 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 12:05:09.034698 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:09.035379 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:09.042598 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:09.043127 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:09.043921 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:09.044373 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:09.195395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:09.205827 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4372da2c-50b4-4b8f-b53c-61bdb1f83b4b tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.175364 Jul 01 12:05:09.206616 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3918/7737] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:09 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:10.222458 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:10.223026 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:10.224863 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:05:10.230661 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:10.231116 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:10.231883 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:10.232317 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:10.382108 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:10.391248 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-09522a6f-58a4-4c24-80e2-cebe5ac0aa14 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.172698 Jul 01 12:05:10.391856 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3820/7738] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:10 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:11.411984 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:11.412540 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:11.419700 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:11.420163 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:11.420946 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:11.421608 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:11.570575 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:11.580461 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-a77bf61f-656f-4c7c-83db-a05c76b0f826 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.174824 Jul 01 12:05:11.581077 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3919/7739] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:11 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:12.598172 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:12.598885 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:12.604655 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell0:SELECT=10 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:05:12.607521 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:12.607986 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:12.608759 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:12.609270 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:12.771064 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:12.779011 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-a6e27120-e11f-4cf9-b53e-624da77b50fc tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.184669 Jul 01 12:05:12.779599 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3821/7740] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:12 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:13.798567 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:13.804085 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:13.804762 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell0:SELECT=4 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:05:13.810927 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:13.811391 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:13.812177 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:13.812626 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:13.951031 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:13.959680 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-69d1cb33-4710-4080-81c9-42de3549b9bd tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.165229 Jul 01 12:05:13.965523 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3920/7741] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:13 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:14.840012 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-9a8dfa7c-9991-400f-8000-fafd5edeb70d req-18d7ad0e-dbb0-407c-b5f7-83e49fd754a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662956ac-7410-4f1d-9801-be62e76e5df8", "tag": "297b7f53-16d5-4e04-8e40-71a63b4239ea"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:05:14.850855 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9a8dfa7c-9991-400f-8000-fafd5edeb70d req-18d7ad0e-dbb0-407c-b5f7-83e49fd754a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:14.852185 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-9a8dfa7c-9991-400f-8000-fafd5edeb70d req-18d7ad0e-dbb0-407c-b5f7-83e49fd754a6 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:14.865750 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-9a8dfa7c-9991-400f-8000-fafd5edeb70d req-18d7ad0e-dbb0-407c-b5f7-83e49fd754a6 service nova] Creating event network-changed:297b7f53-16d5-4e04-8e40-71a63b4239ea for instance 662956ac-7410-4f1d-9801-be62e76e5df8 on n-h1-master-1 Jul 01 12:05:14.871003 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-9a8dfa7c-9991-400f-8000-fafd5edeb70d req-18d7ad0e-dbb0-407c-b5f7-83e49fd754a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038243 Jul 01 12:05:14.871902 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3822/7742] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:05:14.976926 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:14.978308 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:14.987266 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:14.987729 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:14.988523 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:14.988968 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:15.130395 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:15.139146 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-b3c2fc11-8189-4394-a408-ba69caa43032 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.166593 Jul 01 12:05:15.139726 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3921/7743] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:14 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:16.157403 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:16.158112 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:16.164444 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:16.164891 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:16.165676 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:16.166113 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:16.295175 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:16.303152 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5c4a4cb8-fb41-47f1-b09e-b900a0c5be88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.150872 Jul 01 12:05:16.303717 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3823/7744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:16 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:17.321368 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:17.322026 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:17.329247 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:17.329710 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:17.331150 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:17.331630 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:17.473382 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:17.480963 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-35cca6f3-30f2-4780-b955-d1e090256816 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.164067 Jul 01 12:05:17.481575 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3922/7745] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:17 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:18.497226 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:18.497834 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:18.505287 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:18.505733 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:18.506483 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:18.506911 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:18.641249 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:18.649162 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f4255c9d-edf8-4377-8158-33c0349e252c tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.155786 Jul 01 12:05:18.649773 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3824/7746] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:18 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:19.665478 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:19.666133 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:19.673053 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:19.673552 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:19.674321 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:19.674762 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:19.803672 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:19.811404 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-c7eea32d-4b55-4c54-ad5e-8f3d22ebcdc0 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.149911 Jul 01 12:05:19.811986 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3923/7747] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:19 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:20.812689 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-16a5a22b-eea8-4f60-82d9-3020f75fa543 req-30a2ec09-66c2-433e-a76f-d40298b6d9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662956ac-7410-4f1d-9801-be62e76e5df8", "name": "network-vif-plugged", "status": "completed", "tag": "297b7f53-16d5-4e04-8e40-71a63b4239ea"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:05:20.822705 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-16a5a22b-eea8-4f60-82d9-3020f75fa543 req-30a2ec09-66c2-433e-a76f-d40298b6d9c9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:20.823155 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-16a5a22b-eea8-4f60-82d9-3020f75fa543 req-30a2ec09-66c2-433e-a76f-d40298b6d9c9 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:20.829753 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:20.830569 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:20.834853 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-16a5a22b-eea8-4f60-82d9-3020f75fa543 req-30a2ec09-66c2-433e-a76f-d40298b6d9c9 service nova] Creating event network-vif-plugged:297b7f53-16d5-4e04-8e40-71a63b4239ea for instance 662956ac-7410-4f1d-9801-be62e76e5df8 on n-h1-master-1 Jul 01 12:05:20.838034 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:20.839809 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:20.840174 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-16a5a22b-eea8-4f60-82d9-3020f75fa543 req-30a2ec09-66c2-433e-a76f-d40298b6d9c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031245 Jul 01 12:05:20.840605 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:20.840858 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3825/7748] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:05:20.841499 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:20.988767 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:20.996463 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-8580f0ba-066d-4ebc-87e2-e1ecbe73ec88 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.170838 Jul 01 12:05:20.997049 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3924/7749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:20 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 12:05:22.015395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:22.016379 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:22.023518 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:22.025063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:22.025063 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:22.025290 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:22.164316 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:22.172019 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-5787d2bb-f5ff-40a7-bf08-9c4e68d96d52 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1375 microversion: 2.1 time: 0.161738 Jul 01 12:05:22.172678 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3826/7750] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:22 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:23.188707 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:23.189367 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:23.196504 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:23.196961 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:23.197765 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:23.198279 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:23.335094 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:23.342658 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-20613f94-8a5f-4ca4-9dbb-9c3898e2d72d tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1559 microversion: 2.1 time: 0.157925 Jul 01 12:05:23.343218 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3925/7751] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:23 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:23.359107 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:05:23.359718 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:05:23.367329 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:23.367777 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:23.368538 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:23.368969 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:23.505870 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:05:23.513488 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-f85c860f-efab-427d-85a5-65f672e8d112 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1559 microversion: 2.1 time: 0.158155 Jul 01 12:05:23.514076 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3827/7752] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:05:23 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:05:25.770043 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-b821bb6b-0509-42c7-8a98-a5970cd3cd28 req-66202dcb-c7d5-43af-adb3-326b85ebc4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662956ac-7410-4f1d-9801-be62e76e5df8", "tag": "297b7f53-16d5-4e04-8e40-71a63b4239ea"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:05:25.779730 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b821bb6b-0509-42c7-8a98-a5970cd3cd28 req-66202dcb-c7d5-43af-adb3-326b85ebc4cc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:05:25.780195 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-b821bb6b-0509-42c7-8a98-a5970cd3cd28 req-66202dcb-c7d5-43af-adb3-326b85ebc4cc service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:05:25.791739 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-b821bb6b-0509-42c7-8a98-a5970cd3cd28 req-66202dcb-c7d5-43af-adb3-326b85ebc4cc service nova] Creating event network-changed:297b7f53-16d5-4e04-8e40-71a63b4239ea for instance 662956ac-7410-4f1d-9801-be62e76e5df8 on n-h1-master-1 Jul 01 12:05:25.797122 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-b821bb6b-0509-42c7-8a98-a5970cd3cd28 req-66202dcb-c7d5-43af-adb3-326b85ebc4cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Jul 01 12:05:25.797565 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3926/7753] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:05:46.533828 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:05:46.534480 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:05:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:05:47.030592 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:05:47.030781 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:06:52.896407 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:06:52.897298 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=60 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:06:52.901196 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-8c3d8ba7-53f7-4c69-9a6f-8101e8a5307e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1842628736"}} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:06:52.902237 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-8c3d8ba7-53f7-4c69-9a6f-8101e8a5307e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:06:52.908166 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c3d8ba7-53f7-4c69-9a6f-8101e8a5307e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:06:52.917310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c3d8ba7-53f7-4c69-9a6f-8101e8a5307e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:06:52.917310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c3d8ba7-53f7-4c69-9a6f-8101e8a5307e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:06:52.917310 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-8c3d8ba7-53f7-4c69-9a6f-8101e8a5307e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:06:53.415190 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-8c3d8ba7-53f7-4c69-9a6f-8101e8a5307e tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "POST /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8/action" status: 202 len: 0 microversion: 2.1 time: 0.520797 Jul 01 12:06:53.422138 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3828/7754] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Jul 1 12:06:52 2022] POST /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 01 12:06:59.094796 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 01 12:06:59.096721 n-d-master-1 devstack@n-api.service[119764]: ERROR oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 01 12:06:59.098135 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_api:SELECT=34 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:06:59.109675 n-d-master-1 devstack@n-api.service[119764]: DEBUG dbcounter [-] [119764] Writing DB stats nova_cell1:SELECT=66 {{(pid=119764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:06:59.109675 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-48213090-4ecf-4021-a063-bc3cfa87e5c2 req-bbf9ef51-3356-4725-9a48-fcb2c62cd63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662956ac-7410-4f1d-9801-be62e76e5df8", "name": "network-vif-plugged", "status": "completed", "tag": "297b7f53-16d5-4e04-8e40-71a63b4239ea"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:06:59.126656 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-48213090-4ecf-4021-a063-bc3cfa87e5c2 req-bbf9ef51-3356-4725-9a48-fcb2c62cd63d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:06:59.127220 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-48213090-4ecf-4021-a063-bc3cfa87e5c2 req-bbf9ef51-3356-4725-9a48-fcb2c62cd63d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:06:59.139674 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-48213090-4ecf-4021-a063-bc3cfa87e5c2 req-bbf9ef51-3356-4725-9a48-fcb2c62cd63d service nova] Creating event network-vif-plugged:297b7f53-16d5-4e04-8e40-71a63b4239ea for instance 662956ac-7410-4f1d-9801-be62e76e5df8 on n-h1-master-1 Jul 01 12:06:59.145671 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-48213090-4ecf-4021-a063-bc3cfa87e5c2 req-bbf9ef51-3356-4725-9a48-fcb2c62cd63d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053104 Jul 01 12:06:59.146387 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3927/7755] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:07:09.715405 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_api:SELECT=2 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:07:09.716261 n-d-master-1 devstack@n-api.service[119765]: DEBUG dbcounter [-] [119765] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 12:07:09.720144 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [req-876dd953-d845-48cc-911d-8e3e5810a6ef req-35cf94f3-532a-4e03-a1ce-3216e1f0c31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662956ac-7410-4f1d-9801-be62e76e5df8", "tag": "297b7f53-16d5-4e04-8e40-71a63b4239ea"}]} {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:07:09.720610 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:09.721414 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:09.728606 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:09.733130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:09.733130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:09.733130 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:09.743192 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-876dd953-d845-48cc-911d-8e3e5810a6ef req-35cf94f3-532a-4e03-a1ce-3216e1f0c31d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:09.743803 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [req-876dd953-d845-48cc-911d-8e3e5810a6ef req-35cf94f3-532a-4e03-a1ce-3216e1f0c31d service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:09.748827 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [72723bcd-fe8c-4e27-bc42-987ff4bac6bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 46426. Jul 01 12:07:09.750238 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] [545517cb-025c-404f-9124-9ff2c35be440] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 46428. Jul 01 12:07:09.758287 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.compute.server_external_events [req-876dd953-d845-48cc-911d-8e3e5810a6ef req-35cf94f3-532a-4e03-a1ce-3216e1f0c31d service nova] Creating event network-changed:297b7f53-16d5-4e04-8e40-71a63b4239ea for instance 662956ac-7410-4f1d-9801-be62e76e5df8 on n-h1-master-1 Jul 01 12:07:09.761769 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Going to try to terminate instance {{(pid=119765) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 12:07:09.765291 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [req-876dd953-d845-48cc-911d-8e3e5810a6ef req-35cf94f3-532a-4e03-a1ce-3216e1f0c31d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049389 Jul 01 12:07:09.766100 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3928/7756] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:07:10.053543 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2d6be717-7f08-4dfd-8d1b-30893602a663 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "DELETE /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 204 len: 0 microversion: 2.1 time: 0.339990 Jul 01 12:07:10.055885 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3829/7757] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 12:07:09 2022] DELETE /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 12:07:10.072037 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:10.075480 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:10.082544 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:10.083335 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:10.084263 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:10.084807 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:10.234502 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:07:10.248634 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-342b0de6-ebd3-4ca0-8c04-35cdba3a64e3 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1684 microversion: 2.1 time: 0.182422 Jul 01 12:07:10.249373 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3929/7758] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:10 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:07:11.095813 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-a1a04be3-4c57-4201-b076-fed3173f6941 req-8616f2ac-a448-4070-af80-c8d887a620cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662956ac-7410-4f1d-9801-be62e76e5df8", "name": "network-vif-unplugged", "status": "completed", "tag": "297b7f53-16d5-4e04-8e40-71a63b4239ea"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:07:11.105307 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a1a04be3-4c57-4201-b076-fed3173f6941 req-8616f2ac-a448-4070-af80-c8d887a620cd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:11.105750 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-a1a04be3-4c57-4201-b076-fed3173f6941 req-8616f2ac-a448-4070-af80-c8d887a620cd service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:11.116618 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-a1a04be3-4c57-4201-b076-fed3173f6941 req-8616f2ac-a448-4070-af80-c8d887a620cd service nova] Creating event network-vif-unplugged:297b7f53-16d5-4e04-8e40-71a63b4239ea for instance 662956ac-7410-4f1d-9801-be62e76e5df8 on n-h1-master-1 Jul 01 12:07:11.121523 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-a1a04be3-4c57-4201-b076-fed3173f6941 req-8616f2ac-a448-4070-af80-c8d887a620cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030051 Jul 01 12:07:11.122439 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3830/7759] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 12:07:11.267646 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:11.268272 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:11.275748 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:11.276204 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:11.276975 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:11.277512 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:11.409442 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:07:11.416934 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-96db5212-02a6-439c-b9fc-e93695744994 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1684 microversion: 2.1 time: 0.153217 Jul 01 12:07:11.417555 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3930/7760] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:11 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:07:12.331308 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-981ddac6-62e7-42cb-b41c-f7d53fa8a982 req-ff3353cd-7b9f-4c96-82b2-e219bfee61e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662956ac-7410-4f1d-9801-be62e76e5df8", "name": "network-vif-deleted", "tag": "297b7f53-16d5-4e04-8e40-71a63b4239ea"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:07:12.339614 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-981ddac6-62e7-42cb-b41c-f7d53fa8a982 req-ff3353cd-7b9f-4c96-82b2-e219bfee61e8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:12.340058 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-981ddac6-62e7-42cb-b41c-f7d53fa8a982 req-ff3353cd-7b9f-4c96-82b2-e219bfee61e8 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:12.350776 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-981ddac6-62e7-42cb-b41c-f7d53fa8a982 req-ff3353cd-7b9f-4c96-82b2-e219bfee61e8 service nova] Creating event network-vif-deleted:297b7f53-16d5-4e04-8e40-71a63b4239ea for instance 662956ac-7410-4f1d-9801-be62e76e5df8 on n-h1-master-1 Jul 01 12:07:12.356162 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-981ddac6-62e7-42cb-b41c-f7d53fa8a982 req-ff3353cd-7b9f-4c96-82b2-e219bfee61e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029714 Jul 01 12:07:12.356863 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3831/7761] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:07:12.434784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:12.435406 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:12.442357 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:12.444614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:12.444614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:12.444614 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:12.506733 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:07:12.514510 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-5fe73ad4-5d77-43a5-aa9b-899dd9d6ee47 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 200 len: 1497 microversion: 2.1 time: 0.084290 Jul 01 12:07:12.515076 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3931/7762] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:12 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 1497 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:07:13.533454 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:13.534150 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: 662956ac-7410-4f1d-9801-be62e76e5df8] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:13.540436 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:13.540873 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:13.541656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:13.542088 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:13.559086 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] HTTP exception thrown: Instance 662956ac-7410-4f1d-9801-be62e76e5df8 could not be found. Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Request method failure captured: Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 HTTP/1.1 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivuJLraSShBKDdAcQ0tnW8SoN8TVzTZQhV4fSqU40k6LMbsCyHXBB8IIhH0gxXoTqEdVSW85iSRUryaa8aUzIce2GUjumLqWcOAph7OYVwdg_CgNafG_mAtPkrplLR9le-ECKf6fcS1ExUT_O7gHer-aA3nmxCtxyBhttMrfBGdiVe34 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 21244a54ba2a4205bb15a8246e5ce0ac Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestSnapshotPattern-105169747 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/21244a54ba2a4205bb15a8246e5ce0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/21244a54ba2a4205bb15a8246e5ce0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_21244a54ba2a4205bb15a8246e5ce0ac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/21244a54ba2a4205bb15a8246e5ce0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestSnapshotPattern-105169747 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 21244a54ba2a4205bb15a8246e5ce0ac Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestSnapshotPattern-105169747 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestSnapshotPattern-105169747-project Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 51fd564b234b4b27ad82927b8cde8c92 Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestSnapshotPattern-105169747-project Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: exception: Instance 662956ac-7410-4f1d-9801-be62e76e5df8 could not be found. Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': '662956ac-7410-4f1d-9801-be62e76e5df8'} Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662956ac-7410-4f1d-9801-be62e76e5df8 could not be found. Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662956ac-7410-4f1d-9801-be62e76e5df8 could not be found. Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 12:07:13.560790 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662956ac-7410-4f1d-9801-be62e76e5df8 could not be found. Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Returning 404 to user: Instance 662956ac-7410-4f1d-9801-be62e76e5df8 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-72a44133-e82c-4ea3-b90f-28c5f9e6c93f tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8" status: 404 len: 111 microversion: 2.1 time: 0.033907 Jul 01 12:07:13.565390 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3832/7763] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:13 2022] GET /compute/v2.1/servers/662956ac-7410-4f1d-9801-be62e76e5df8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 12:07:15.995356 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:15.995873 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:15.997768 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-3e99ea98-11f9-4712-8436-fdbb2674d9d6 req-eb927156-1b4f-48c5-9cf9-1171c49bea08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab42c25b-4539-438c-bfb2-2eafd5c820b1", "tag": "94d62634-6d50-47a6-ab10-6757bd1e8ccc"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:07:16.003215 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:16.003694 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:16.004496 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:16.004954 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:16.007826 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3e99ea98-11f9-4712-8436-fdbb2674d9d6 req-eb927156-1b4f-48c5-9cf9-1171c49bea08 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:16.008385 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-3e99ea98-11f9-4712-8436-fdbb2674d9d6 req-eb927156-1b4f-48c5-9cf9-1171c49bea08 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:16.020867 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-3e99ea98-11f9-4712-8436-fdbb2674d9d6 req-eb927156-1b4f-48c5-9cf9-1171c49bea08 service nova] Creating event network-changed:94d62634-6d50-47a6-ab10-6757bd1e8ccc for instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 on n-h2-master-1 Jul 01 12:07:16.033895 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-3e99ea98-11f9-4712-8436-fdbb2674d9d6 req-eb927156-1b4f-48c5-9cf9-1171c49bea08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039999 Jul 01 12:07:16.034738 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3833/7764] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:07:16.037855 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Going to try to terminate instance {{(pid=119764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 12:07:16.376333 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-bd62c629-948c-44c4-9272-4a50e32d6428 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 204 len: 0 microversion: 2.1 time: 0.385203 Jul 01 12:07:16.380875 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3932/7765] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Jul 1 12:07:15 2022] DELETE /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 12:07:16.386757 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:16.387395 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:16.394472 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:16.394927 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:16.395981 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:16.396656 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:16.539909 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.policy [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119765) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:07:16.548327 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-2b399fc5-a52c-4b78-990c-7653ce33bca8 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1685 microversion: 2.1 time: 0.165898 Jul 01 12:07:16.548897 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3834/7766] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:16 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:07:17.566831 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:17.567548 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:17.574771 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:17.575242 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:17.576007 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:17.576456 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:17.706825 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:07:17.714582 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-cda604bf-914c-48c3-b471-b737b8a28f39 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1685 microversion: 2.1 time: 0.152001 Jul 01 12:07:17.715156 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3933/7767] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:17 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 12:07:18.705520 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [req-5ff51f8d-fd79-4013-9943-11eefeadf323 req-12f7dcde-1833-4321-8818-cec36c9d88e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab42c25b-4539-438c-bfb2-2eafd5c820b1", "name": "network-vif-deleted", "tag": "94d62634-6d50-47a6-ab10-6757bd1e8ccc"}]} {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 12:07:18.714870 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5ff51f8d-fd79-4013-9943-11eefeadf323 req-12f7dcde-1833-4321-8818-cec36c9d88e1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:18.715309 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [req-5ff51f8d-fd79-4013-9943-11eefeadf323 req-12f7dcde-1833-4321-8818-cec36c9d88e1 service nova] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:18.726237 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.compute.server_external_events [req-5ff51f8d-fd79-4013-9943-11eefeadf323 req-12f7dcde-1833-4321-8818-cec36c9d88e1 service nova] Creating event network-vif-deleted:94d62634-6d50-47a6-ab10-6757bd1e8ccc for instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 on n-h2-master-1 Jul 01 12:07:18.732053 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [req-5ff51f8d-fd79-4013-9943-11eefeadf323 req-12f7dcde-1833-4321-8818-cec36c9d88e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030156 Jul 01 12:07:18.732281 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:18.733022 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3835/7768] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Jul 1 12:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 12:07:18.733174 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.compute.api [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:18.740276 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:18.740737 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:18.741560 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:18.742012 n-d-master-1 devstack@n-api.service[119764]: DEBUG oslo_concurrency.lockutils [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:18.808735 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.policy [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51fd564b234b4b27ad82927b8cde8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21244a54ba2a4205bb15a8246e5ce0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 12:07:18.816621 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-4cbb8d8f-386c-4fba-abef-29d793c0d861 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 200 len: 1498 microversion: 2.1 time: 0.088205 Jul 01 12:07:18.817214 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3934/7769] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:18 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 1498 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 12:07:19.836313 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '>' {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:19.837074 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.compute.api [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] [instance: ab42c25b-4539-438c-bfb2-2eafd5c820b1] Fetching instance by UUID {{(pid=119765) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 12:07:19.843357 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:19.843808 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:19.844569 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 12:07:19.845038 n-d-master-1 devstack@n-api.service[119765]: DEBUG oslo_concurrency.lockutils [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Lock "dfe0d2a4-39ae-4976-badb-e47e9e297f2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 12:07:19.858676 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.wsgi [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] HTTP exception thrown: Instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 could not be found. Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Request method failure captured: Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: request: GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 HTTP/1.1 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: Accept: application/json Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: Accept-Encoding: identity Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: Connection: close Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: Content-Length: 0 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: Content-Type: application/json Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: Host: 10.222.0.23 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: Openstack-System-Scope: None Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: User-Agent: python-urllib3/1.26.9 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Auth-Token: gAAAAABivuJLraSShBKDdAcQ0tnW8SoN8TVzTZQhV4fSqU40k6LMbsCyHXBB8IIhH0gxXoTqEdVSW85iSRUryaa8aUzIce2GUjumLqWcOAph7OYVwdg_CgNafG_mAtPkrplLR9le-ECKf6fcS1ExUT_O7gHer-aA3nmxCtxyBhttMrfBGdiVe34 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Id: None Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Domain-Name: None Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Identity-Status: Confirmed Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Is-Admin-Project: True Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Id: default Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Project-Domain-Name: Default Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Project-Id: 21244a54ba2a4205bb15a8246e5ce0ac Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Project-Name: tempest-TestSnapshotPattern-105169747 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Role: reader,member Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Roles: reader,member Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/21244a54ba2a4205bb15a8246e5ce0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/21244a54ba2a4205bb15a8246e5ce0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_21244a54ba2a4205bb15a8246e5ce0ac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/21244a54ba2a4205bb15a8246e5ce0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Tenant: tempest-TestSnapshotPattern-105169747 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Id: 21244a54ba2a4205bb15a8246e5ce0ac Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-Tenant-Name: tempest-TestSnapshotPattern-105169747 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-User: tempest-TestSnapshotPattern-105169747-project Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Id: default Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-User-Domain-Name: Default Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-User-Id: 51fd564b234b4b27ad82927b8cde8c92 Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: X-User-Name: tempest-TestSnapshotPattern-105169747-project Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: method: > Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: exception: Instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 could not be found. Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: action_args: {'id': 'ab42c25b-4539-438c-bfb2-2eafd5c820b1'} Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: {{(pid=119765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 could not be found. Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 could not be found. Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 12:07:19.860282 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 could not be found. Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: ERROR nova.api.openstack.wsgi Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: DEBUG nova.api.openstack.wsgi [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Returning 404 to user: Instance ab42c25b-4539-438c-bfb2-2eafd5c820b1 could not be found. {{(pid=119765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: INFO nova.api.openstack.requestlog [None req-6e7a2a75-839c-40be-a679-982bff7b5824 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1" status: 404 len: 111 microversion: 2.1 time: 0.030748 Jul 01 12:07:19.864613 n-d-master-1 devstack@n-api.service[119765]: [pid: 119765|app: 0|req: 3836/7770] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Jul 1 12:07:19 2022] GET /compute/v2.1/servers/ab42c25b-4539-438c-bfb2-2eafd5c820b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 12:07:20.089784 n-d-master-1 devstack@n-api.service[119764]: DEBUG nova.api.openstack.wsgi [None req-339428a3-fb62-4c21-9fc3-5f86d831ac00 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] Calling method '.version_select at 0x7f6f971254c0>' {{(pid=119764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 12:07:20.171420 n-d-master-1 devstack@n-api.service[119764]: INFO nova.api.openstack.requestlog [None req-339428a3-fb62-4c21-9fc3-5f86d831ac00 tempest-TestSnapshotPattern-105169747 tempest-TestSnapshotPattern-105169747-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1630055980" status: 202 len: 0 microversion: 2.1 time: 0.086036 Jul 01 12:07:20.172001 n-d-master-1 devstack@n-api.service[119764]: [pid: 119764|app: 0|req: 3935/7771] 10.222.0.23 () {58 vars in 1256 bytes} [Fri Jul 1 12:07:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1630055980 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 12:07:26.860404 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:07:26.860871 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:07:27.171921 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:07:27.172288 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:07:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:09:06.543489 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:09:06.544058 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:09:41.205848 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:09:41.206350 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:10:46.871900 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:10:46.872638 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:10:47.180869 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:10:47.181094 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:10:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:12:26.553034 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:12:26.553640 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:12:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:12:27.041628 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:12:27.041864 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:12:40.714103 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:12:40.714689 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:12:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:13:01.213753 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:13:01.214346 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:14:06.881547 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:14:06.882258 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:14:07.188974 n-d-master-1 devstack@n-api.service[119765]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:14:07.189208 n-d-master-1 devstack@n-api.service[119765]: Fri Jul 1 12:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:15:46.562317 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:15:46.567462 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:15:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 12:15:47.050861 n-d-master-1 devstack@n-api.service[119764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 12:15:47.051069 n-d-master-1 devstack@n-api.service[119764]: Fri Jul 1 12:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!